2024-04-25T15:31:46.218 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T15:31:46.218 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/fsstress validater/valgrind} --verbose --owner scheduled_pdonnell@teuthology --name pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673226 -- /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673226/orig.config.yaml 2024-04-25T15:31:46.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T15:31:46.359 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673226 branch: wip-pdonnell-testing-20240425.015853-debug description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/fsstress validater/valgrind} email: pdonnell@redhat.com first_in_suite: false job_id: '7673226' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240425.015853-debug ceph: cephfs: max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow request - SLOW_OPS - MON_DOWN sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240425.015853-debug sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 owner: scheduled_pdonnell@teuthology priority: 85 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 1880 sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 sleep_before_teardown: 0 subset: 178/512 suite: fs suite_branch: wip-pdonnell-testing-20240425.015853-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGdemGxTK68nqF3V6Lmt9r8tcb216MI1zS4QEgjsP1aRZvGLT6LWUifVNcR6SteFO1LcYelejf8Ym2jkv/FDopE= smithi064.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKFArLSnqQ2fJgOOsnL3/wiLX/siemldj7xq0Cy0DgHMJCkM55ry4RBTTgQP6sGYbMSmS4OIRwDvD0dIRh+E/V4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_10:00:23 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T15:31:46.359 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa; will attempt to use it 2024-04-25T15:31:46.360 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks 2024-04-25T15:31:46.360 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T15:31:46.362 INFO:teuthology.task.internal:Checking packages... 2024-04-25T15:31:46.385 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '994e2f20102a20fa9a27966c14b625cc01884df8' 2024-04-25T15:31:46.385 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T15:31:46.385 INFO:teuthology.packaging:ref: None 2024-04-25T15:31:46.385 INFO:teuthology.packaging:tag: None 2024-04-25T15:31:46.385 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240425.015853-debug 2024-04-25T15:31:46.385 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:31:46.386 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240425.015853-debug 2024-04-25T15:31:46.535 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3291.g994e2f20 2024-04-25T15:31:46.537 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T15:31:46.546 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T15:31:46.546 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T15:31:46.565 INFO:teuthology.task.internal:Saving configuration 2024-04-25T15:31:46.583 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T15:31:46.589 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T15:31:46.613 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673226', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 15:26:53.491578', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGdemGxTK68nqF3V6Lmt9r8tcb216MI1zS4QEgjsP1aRZvGLT6LWUifVNcR6SteFO1LcYelejf8Ym2jkv/FDopE='} 2024-04-25T15:31:46.634 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673226', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 15:26:53.493385', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKFArLSnqQ2fJgOOsnL3/wiLX/siemldj7xq0Cy0DgHMJCkM55ry4RBTTgQP6sGYbMSmS4OIRwDvD0dIRh+E/V4='} 2024-04-25T15:31:46.634 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T15:31:46.640 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-25T15:31:46.640 INFO:teuthology.task.internal:roles: ubuntu@smithi064.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-25T15:31:46.640 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T15:31:46.713 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1eef903f70>, signals=[15]) 2024-04-25T15:31:46.714 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T15:31:46.720 INFO:teuthology.task.internal:Opening connections... 2024-04-25T15:31:46.720 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T15:31:46.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:31:46.796 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi064.front.sepia.ceph.com 2024-04-25T15:31:46.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:31:46.870 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T15:31:46.877 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-04-25T15:31:46.896 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-04-25T15:31:46.896 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-04-25T15:31:46.955 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-04-25T15:31:46.955 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-04-25T15:31:46.955 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-04-25T15:31:46.955 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-04-25T15:31:46.955 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-04-25T15:31:46.956 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-04-25T15:31:46.956 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T15:31:46.956 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-04-25T15:31:46.956 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-04-25T15:31:46.956 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T15:31:46.956 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-04-25T15:31:46.956 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T15:31:46.956 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T15:31:46.956 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T15:31:46.957 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-04-25T15:31:46.979 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2024-04-25T15:31:46.998 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2024-04-25T15:31:46.999 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2024-04-25T15:31:47.056 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2024-04-25T15:31:47.056 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2024-04-25T15:31:47.057 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2024-04-25T15:31:47.057 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2024-04-25T15:31:47.057 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2024-04-25T15:31:47.057 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2024-04-25T15:31:47.057 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T15:31:47.057 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2024-04-25T15:31:47.057 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2024-04-25T15:31:47.057 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T15:31:47.057 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2024-04-25T15:31:47.057 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T15:31:47.057 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T15:31:47.057 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T15:31:47.058 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2024-04-25T15:31:47.082 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T15:31:47.092 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T15:31:47.097 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T15:31:47.097 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2024-04-25T15:31:47.100 DEBUG:teuthology.orchestra.run.smithi064:> test '!' -e /home/ubuntu/cephtest 2024-04-25T15:31:47.117 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T15:31:47.123 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T15:31:47.123 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2024-04-25T15:31:47.158 DEBUG:teuthology.orchestra.run.smithi064:> test -z $(ls -A /var/lib/ceph) 2024-04-25T15:31:47.193 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T15:31:47.249 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T15:31:47.263 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-25T15:31:47.263 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-25T15:31:47.263 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T15:31:47.263 DEBUG:teuthology.orchestra.run.smithi064:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T15:31:47.280 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:31:47.280 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-04-25T15:31:47.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:31:47.281 DEBUG:teuthology.orchestra.run.smithi064:> uname -r 2024-04-25T15:31:47.338 INFO:teuthology.orchestra.run.smithi059.stdout:5.14.0-437.el9.x86_64 2024-04-25T15:31:47.339 INFO:teuthology.task.kernel:Running kernel on smithi059: 5.14.0-437.el9.x86_64 2024-04-25T15:31:47.339 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum install -y kernel 2024-04-25T15:31:47.340 INFO:teuthology.orchestra.run.smithi064.stdout:5.14.0-437.el9.x86_64 2024-04-25T15:31:47.340 INFO:teuthology.task.kernel:Running kernel on smithi064: 5.14.0-437.el9.x86_64 2024-04-25T15:31:47.340 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum install -y kernel 2024-04-25T15:31:49.681 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-25T15:31:51.068 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.0 MB 00:02 2024-04-25T15:31:51.583 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-04-25T15:31:52.970 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-04-25T15:31:57.345 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.2 MB 00:00 2024-04-25T15:31:59.325 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - CRB 1.5 MB/s | 6.2 MB 00:04 2024-04-25T15:31:59.443 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 16 kB 00:00 2024-04-25T15:32:00.856 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 16 kB 00:00 2024-04-25T15:32:03.313 INFO:teuthology.orchestra.run.smithi064.stdout:Extra Packages for Enterprise Linux 9.0 MB/s | 21 MB 00:02 2024-04-25T15:32:05.186 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 3.7 MB/s | 21 MB 00:05 2024-04-25T15:32:08.566 INFO:teuthology.orchestra.run.smithi064.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-04-25T15:32:10.527 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-25T15:32:10.530 INFO:teuthology.orchestra.run.smithi064.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T15:32:10.530 INFO:teuthology.orchestra.run.smithi064.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T15:32:10.628 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-25T15:32:10.629 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-04-25T15:32:10.629 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-25T15:32:10.739 DEBUG:teuthology.orchestra.run.smithi064:> echo no | sudo yum reinstall kernel || true 2024-04-25T15:32:11.262 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 03:32:08 PM UTC. 2024-04-25T15:32:11.398 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-25T15:32:11.411 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-25T15:32:11.411 INFO:teuthology.orchestra.run.smithi064.stdout: Package Architecture Version Repository Size 2024-04-25T15:32:11.411 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-25T15:32:11.411 INFO:teuthology.orchestra.run.smithi064.stdout:Reinstalling: 2024-04-25T15:32:11.412 INFO:teuthology.orchestra.run.smithi064.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T15:32:11.412 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:32:11.412 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-04-25T15:32:11.412 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-25T15:32:11.412 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:32:11.412 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 255 k 2024-04-25T15:32:11.412 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 0 2024-04-25T15:32:11.412 INFO:teuthology.orchestra.run.smithi064.stderr:Operation aborted. 2024-04-25T15:32:11.470 INFO:teuthology.orchestra.run.smithi064.stdout:Is this ok [y/N]: 2024-04-25T15:32:11.471 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum reinstall -y kernel || true 2024-04-25T15:32:11.999 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 03:32:08 PM UTC. 2024-04-25T15:32:12.119 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-25T15:32:12.120 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-25T15:32:12.120 INFO:teuthology.orchestra.run.smithi064.stdout: Package Architecture Version Repository Size 2024-04-25T15:32:12.120 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-25T15:32:12.120 INFO:teuthology.orchestra.run.smithi064.stdout:Reinstalling: 2024-04-25T15:32:12.120 INFO:teuthology.orchestra.run.smithi064.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T15:32:12.120 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:32:12.120 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-04-25T15:32:12.121 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-04-25T15:32:12.121 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:32:12.121 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 255 k 2024-04-25T15:32:12.121 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 0 2024-04-25T15:32:12.121 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-04-25T15:32:12.459 INFO:teuthology.orchestra.run.smithi064.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.4 MB/s | 255 kB 00:00 2024-04-25T15:32:12.460 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-04-25T15:32:12.460 INFO:teuthology.orchestra.run.smithi064.stdout:Total 751 kB/s | 255 kB 00:00 2024-04-25T15:32:12.476 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-04-25T15:32:12.517 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T15:32:12.518 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T15:32:12.600 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-04-25T15:32:12.600 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2024-04-25T15:32:12.601 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-04-25T15:32:12.655 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-04-25T15:32:12.655 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-04-25T15:32:12.660 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-04-25T15:32:12.661 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-04-25T15:32:12.720 DEBUG:teuthology.orchestra.run.smithi059:> echo no | sudo yum reinstall kernel || true 2024-04-25T15:32:12.798 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-04-25T15:32:12.869 INFO:teuthology.orchestra.run.smithi064.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T15:32:12.869 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T15:32:13.240 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 03:32:10 PM UTC. 2024-04-25T15:32:13.363 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-04-25T15:32:13.377 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-04-25T15:32:13.377 INFO:teuthology.orchestra.run.smithi059.stdout: Package Architecture Version Repository Size 2024-04-25T15:32:13.377 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-04-25T15:32:13.377 INFO:teuthology.orchestra.run.smithi059.stdout:Reinstalling: 2024-04-25T15:32:13.377 INFO:teuthology.orchestra.run.smithi059.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T15:32:13.377 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:32:13.377 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-04-25T15:32:13.377 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-04-25T15:32:13.377 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:32:13.378 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 255 k 2024-04-25T15:32:13.378 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 0 2024-04-25T15:32:13.378 INFO:teuthology.orchestra.run.smithi059.stderr:Operation aborted. 2024-04-25T15:32:13.436 INFO:teuthology.orchestra.run.smithi059.stdout:Is this ok [y/N]: 2024-04-25T15:32:13.436 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum reinstall -y kernel || true 2024-04-25T15:32:13.516 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T15:32:13.516 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T15:32:13.954 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 03:32:10 PM UTC. 2024-04-25T15:32:14.074 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-04-25T15:32:14.075 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-04-25T15:32:14.075 INFO:teuthology.orchestra.run.smithi059.stdout: Package Architecture Version Repository Size 2024-04-25T15:32:14.075 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-04-25T15:32:14.076 INFO:teuthology.orchestra.run.smithi059.stdout:Reinstalling: 2024-04-25T15:32:14.076 INFO:teuthology.orchestra.run.smithi059.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T15:32:14.076 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:32:14.076 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-04-25T15:32:14.076 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-04-25T15:32:14.076 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:32:14.076 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 255 k 2024-04-25T15:32:14.076 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 0 2024-04-25T15:32:14.076 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-04-25T15:32:14.174 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T15:32:14.175 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:32:14.175 INFO:teuthology.orchestra.run.smithi064.stdout:Reinstalled: 2024-04-25T15:32:14.175 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T15:32:14.175 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:32:14.175 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-25T15:32:14.325 DEBUG:teuthology.orchestra.run.smithi064:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T15:32:14.373 INFO:teuthology.orchestra.run.smithi064.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T15:32:14.373 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T15:32:14.373 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T15:32:14.373 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-25T15:32:14.374 DEBUG:teuthology.orchestra.run.smithi064:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T15:32:14.410 INFO:teuthology.orchestra.run.smithi064.stdout:ttyS1 2024-04-25T15:32:14.436 DEBUG:teuthology.parallel:result is None 2024-04-25T15:32:17.521 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.6 MB/s | 255 kB 00:00 2024-04-25T15:32:17.521 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-04-25T15:32:17.522 INFO:teuthology.orchestra.run.smithi059.stdout:Total 74 kB/s | 255 kB 00:03 2024-04-25T15:32:17.540 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-04-25T15:32:17.724 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-04-25T15:32:17.724 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-04-25T15:32:17.729 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-04-25T15:32:17.730 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-04-25T15:32:17.875 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-04-25T15:32:17.939 INFO:teuthology.orchestra.run.smithi059.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T15:32:17.939 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T15:32:18.605 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T15:32:18.605 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T15:32:19.282 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T15:32:19.283 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:32:19.283 INFO:teuthology.orchestra.run.smithi059.stdout:Reinstalled: 2024-04-25T15:32:19.283 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T15:32:19.283 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:32:19.283 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-04-25T15:32:19.478 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T15:32:19.526 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T15:32:19.527 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T15:32:19.527 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T15:32:19.527 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T15:32:19.527 DEBUG:teuthology.orchestra.run.smithi059:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T15:32:19.559 INFO:teuthology.orchestra.run.smithi059.stdout:ttyS1 2024-04-25T15:32:19.582 DEBUG:teuthology.parallel:result is None 2024-04-25T15:32:19.582 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T15:32:19.589 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T15:32:19.590 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T15:32:19.625 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T15:32:19.643 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T15:32:19.652 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T15:32:19.659 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T15:32:19.659 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T15:32:19.680 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T15:32:19.717 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T15:32:19.724 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T15:32:19.724 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T15:32:19.746 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T15:32:19.785 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:32:19.796 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:32:19.799 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:32:19.810 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:32:19.811 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T15:32:19.819 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T15:32:19.819 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T15:32:19.822 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T15:32:19.866 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T15:32:19.876 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T15:32:19.876 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T15:32:19.887 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T15:32:19.924 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T15:32:19.977 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T15:32:20.032 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T15:32:20.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T15:32:20.154 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:32:20.154 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T15:32:20.218 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T15:32:20.259 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T15:32:20.311 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T15:32:20.389 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T15:32:20.438 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:32:20.438 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T15:32:20.504 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2024-04-25T15:32:20.506 DEBUG:teuthology.orchestra.run.smithi064:> sudo service rsyslog restart 2024-04-25T15:32:20.536 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T15:32:20.588 INFO:teuthology.orchestra.run.smithi064.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T15:32:21.051 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T15:32:21.059 INFO:teuthology.task.internal:Starting timer... 2024-04-25T15:32:21.059 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T15:32:21.070 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T15:32:21.080 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-25T15:32:21.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo service auditd rotate 2024-04-25T15:32:21.138 INFO:teuthology.orchestra.run.smithi059.stdout:Rotating logs: 2024-04-25T15:32:21.140 DEBUG:teuthology.orchestra.run.smithi064:> sudo service auditd rotate 2024-04-25T15:32:21.190 INFO:teuthology.orchestra.run.smithi064.stdout:Rotating logs: 2024-04-25T15:32:21.192 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T15:32:21.192 DEBUG:teuthology.orchestra.run.smithi059:> /usr/sbin/getenforce 2024-04-25T15:32:21.215 INFO:teuthology.orchestra.run.smithi059.stdout:Permissive 2024-04-25T15:32:21.215 DEBUG:teuthology.orchestra.run.smithi064:> /usr/sbin/getenforce 2024-04-25T15:32:21.235 INFO:teuthology.orchestra.run.smithi064.stdout:Permissive 2024-04-25T15:32:21.236 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi059.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi064.front.sepia.ceph.com': 'permissive'} 2024-04-25T15:32:21.236 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T15:32:21.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:32:21.282 DEBUG:teuthology.orchestra.run.smithi064:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T15:32:21.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:32:21.309 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T15:32:21.309 DEBUG:teuthology.orchestra.run.smithi059:> sudo /usr/sbin/setenforce permissive 2024-04-25T15:32:21.347 DEBUG:teuthology.orchestra.run.smithi064:> sudo /usr/sbin/setenforce permissive 2024-04-25T15:32:21.374 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T15:32:21.384 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T15:32:21.400 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T15:32:21.402 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi059.front.sepia.ceph.com,smithi064.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T15:36:04.317 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi059.front.sepia.ceph.com'), Remote(name='ubuntu@smithi064.front.sepia.ceph.com')] 2024-04-25T15:36:04.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-25T15:36:04.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:36:04.397 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-04-25T15:36:04.490 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-25T15:36:04.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-04-25T15:36:04.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:36:04.565 DEBUG:teuthology.orchestra.run.smithi064:> true 2024-04-25T15:36:04.641 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-04-25T15:36:04.641 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T15:36:04.656 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T15:36:04.656 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T15:36:04.656 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T15:36:04.659 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T15:36:04.659 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T15:36:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T15:36:04.702 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T15:36:04.710 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T15:36:04.724 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T15:36:04.727 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: ntpd: command not found 2024-04-25T15:36:04.738 INFO:teuthology.orchestra.run.smithi059.stdout:506 Cannot talk to daemon 2024-04-25T15:36:04.748 INFO:teuthology.orchestra.run.smithi064.stderr:sudo: ntpd: command not found 2024-04-25T15:36:04.752 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T15:36:04.759 INFO:teuthology.orchestra.run.smithi064.stdout:506 Cannot talk to daemon 2024-04-25T15:36:04.766 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T15:36:04.773 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T15:36:04.786 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T15:36:04.824 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2024-04-25T15:36:04.827 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T15:36:04.827 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2024-04-25T15:36:04.827 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:36:04.827 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:36:04.827 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:36:04.827 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:36:04.851 INFO:teuthology.orchestra.run.smithi064.stderr:bash: line 1: ntpq: command not found 2024-04-25T15:36:04.854 INFO:teuthology.orchestra.run.smithi064.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T15:36:04.854 INFO:teuthology.orchestra.run.smithi064.stdout:=============================================================================== 2024-04-25T15:36:04.854 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:36:04.855 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:36:04.855 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:36:04.855 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:36:04.856 INFO:teuthology.run_tasks:Running task install... 2024-04-25T15:36:04.866 DEBUG:teuthology.task.install:project ceph 2024-04-25T15:36:04.867 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}} 2024-04-25T15:36:04.867 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'} 2024-04-25T15:36:04.867 INFO:teuthology.task.install:Using flavor: default 2024-04-25T15:36:04.877 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-04-25T15:36:04.878 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T15:36:04.878 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T15:36:04.879 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:36:04.881 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T15:36:04.881 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:36:05.025 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T15:36:05.026 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T15:36:05.106 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T15:36:05.106 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T15:36:05.136 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T15:36:05.137 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:36:05.137 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T15:36:05.162 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T15:36:05.163 DEBUG:teuthology.orchestra.run.smithi064:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T15:36:05.228 DEBUG:teuthology.orchestra.run.smithi064:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T15:36:05.273 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T15:36:05.274 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:36:05.274 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T15:36:05.301 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T15:36:05.301 DEBUG:teuthology.orchestra.run.smithi059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T15:36:05.302 DEBUG:teuthology.orchestra.run.smithi064:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T15:36:05.365 INFO:teuthology.orchestra.run.smithi064.stdout:check_obsoletes = 1 2024-04-25T15:36:05.367 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum clean all 2024-04-25T15:36:05.368 DEBUG:teuthology.orchestra.run.smithi059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T15:36:05.444 DEBUG:teuthology.orchestra.run.smithi059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T15:36:05.508 INFO:teuthology.orchestra.run.smithi059.stdout:check_obsoletes = 1 2024-04-25T15:36:05.510 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum clean all 2024-04-25T15:36:05.599 INFO:teuthology.orchestra.run.smithi064.stdout:48 files removed 2024-04-25T15:36:05.627 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T15:36:05.743 INFO:teuthology.orchestra.run.smithi059.stdout:48 files removed 2024-04-25T15:36:05.770 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T15:36:06.301 INFO:teuthology.orchestra.run.smithi064.stdout:ceph packages for x86_64 209 kB/s | 84 kB 00:00 2024-04-25T15:36:06.376 INFO:teuthology.orchestra.run.smithi059.stdout:ceph packages for x86_64 254 kB/s | 84 kB 00:00 2024-04-25T15:36:06.668 INFO:teuthology.orchestra.run.smithi064.stdout:ceph noarch packages 36 kB/s | 12 kB 00:00 2024-04-25T15:36:06.751 INFO:teuthology.orchestra.run.smithi059.stdout:ceph noarch packages 35 kB/s | 12 kB 00:00 2024-04-25T15:36:07.069 INFO:teuthology.orchestra.run.smithi064.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2024-04-25T15:36:07.094 INFO:teuthology.orchestra.run.smithi059.stdout:ceph source packages 6.2 kB/s | 1.9 kB 00:00 2024-04-25T15:36:07.704 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-25T15:36:07.821 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-25T15:36:09.706 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-25T15:36:10.064 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-25T15:36:13.990 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-25T15:36:14.298 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-25T15:36:15.480 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 16 kB 00:00 2024-04-25T15:36:15.930 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-04-25T15:36:19.498 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 5.4 MB/s | 21 MB 00:03 2024-04-25T15:36:20.073 INFO:teuthology.orchestra.run.smithi064.stdout:Extra Packages for Enterprise Linux 5.2 MB/s | 21 MB 00:04 2024-04-25T15:36:24.731 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-04-25T15:36:25.323 INFO:teuthology.orchestra.run.smithi064.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-04-25T15:36:26.949 INFO:teuthology.orchestra.run.smithi059.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T15:36:26.950 INFO:teuthology.orchestra.run.smithi059.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T15:36:26.977 INFO:teuthology.orchestra.run.smithi059.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T15:36:26.977 INFO:teuthology.orchestra.run.smithi059.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T15:36:26.978 INFO:teuthology.orchestra.run.smithi059.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T15:36:26.979 INFO:teuthology.orchestra.run.smithi059.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T15:36:26.981 INFO:teuthology.orchestra.run.smithi059.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T15:36:26.983 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T15:36:26.984 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T15:36:27.051 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-04-25T15:36:27.062 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================================== 2024-04-25T15:36:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-04-25T15:36:27.063 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================================== 2024-04-25T15:36:27.063 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-04-25T15:36:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T15:36:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T15:36:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T15:36:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 69 M 2024-04-25T15:36:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 420 M 2024-04-25T15:36:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T15:36:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.2 M 2024-04-25T15:36:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T15:36:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T15:36:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 49 M 2024-04-25T15:36:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T15:36:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T15:36:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T15:36:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 21 M 2024-04-25T15:36:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T15:36:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T15:36:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 99 M 2024-04-25T15:36:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 283 M 2024-04-25T15:36:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T15:36:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 192 M 2024-04-25T15:36:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T15:36:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 623 M 2024-04-25T15:36:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T15:36:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T15:36:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T15:36:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T15:36:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T15:36:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T15:36:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T15:36:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T15:36:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T15:36:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T15:36:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T15:36:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T15:36:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 105 k 2024-04-25T15:36:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 47 M 2024-04-25T15:36:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 54 M 2024-04-25T15:36:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T15:36:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T15:36:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T15:36:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T15:36:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T15:36:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T15:36:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T15:36:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 615 k 2024-04-25T15:36:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T15:36:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 769 k 2024-04-25T15:36:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T15:36:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.1 M 2024-04-25T15:36:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T15:36:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 337 k 2024-04-25T15:36:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T15:36:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 524 k 2024-04-25T15:36:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T15:36:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 53 M 2024-04-25T15:36:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T15:36:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.3 M 2024-04-25T15:36:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T15:36:27.073 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2024-04-25T15:36:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T15:36:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T15:36:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T15:36:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T15:36:27.073 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-04-25T15:36:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T15:36:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T15:36:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T15:36:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T15:36:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 22 M 2024-04-25T15:36:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T15:36:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T15:36:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T15:36:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T15:36:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T15:36:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T15:36:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T15:36:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T15:36:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T15:36:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T15:36:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T15:36:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T15:36:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T15:36:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T15:36:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T15:36:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T15:36:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T15:36:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T15:36:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T15:36:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T15:36:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T15:36:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T15:36:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T15:36:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T15:36:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T15:36:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T15:36:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T15:36:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T15:36:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T15:36:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T15:36:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T15:36:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T15:36:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T15:36:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T15:36:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T15:36:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T15:36:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T15:36:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T15:36:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T15:36:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T15:36:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T15:36:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T15:36:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T15:36:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T15:36:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T15:36:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T15:36:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T15:36:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T15:36:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T15:36:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T15:36:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T15:36:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T15:36:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T15:36:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T15:36:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T15:36:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T15:36:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T15:36:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T15:36:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T15:36:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T15:36:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T15:36:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T15:36:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T15:36:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T15:36:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T15:36:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T15:36:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T15:36:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T15:36:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T15:36:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T15:36:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T15:36:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T15:36:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T15:36:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T15:36:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T15:36:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T15:36:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T15:36:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T15:36:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T15:36:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T15:36:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T15:36:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T15:36:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T15:36:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T15:36:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T15:36:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T15:36:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T15:36:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T15:36:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T15:36:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T15:36:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T15:36:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T15:36:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T15:36:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T15:36:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T15:36:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T15:36:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T15:36:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T15:36:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T15:36:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T15:36:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T15:36:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T15:36:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T15:36:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T15:36:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T15:36:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T15:36:27.086 INFO:teuthology.orchestra.run.smithi059.stdout:Installing weak dependencies: 2024-04-25T15:36:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T15:36:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:36:27.087 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-04-25T15:36:27.087 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================================== 2024-04-25T15:36:27.087 INFO:teuthology.orchestra.run.smithi059.stdout:Install 170 Packages 2024-04-25T15:36:27.087 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 4 Packages 2024-04-25T15:36:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:36:27.088 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 2.1 G 2024-04-25T15:36:27.088 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-04-25T15:36:27.542 INFO:teuthology.orchestra.run.smithi064.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T15:36:27.543 INFO:teuthology.orchestra.run.smithi064.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T15:36:27.571 INFO:teuthology.orchestra.run.smithi064.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T15:36:27.571 INFO:teuthology.orchestra.run.smithi064.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T15:36:27.572 INFO:teuthology.orchestra.run.smithi064.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T15:36:27.573 INFO:teuthology.orchestra.run.smithi064.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T15:36:27.575 INFO:teuthology.orchestra.run.smithi064.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T15:36:27.577 INFO:teuthology.orchestra.run.smithi064.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T15:36:27.578 INFO:teuthology.orchestra.run.smithi064.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T15:36:27.646 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-04-25T15:36:27.657 INFO:teuthology.orchestra.run.smithi064.stdout:=============================================================================================== 2024-04-25T15:36:27.657 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-04-25T15:36:27.658 INFO:teuthology.orchestra.run.smithi064.stdout:=============================================================================================== 2024-04-25T15:36:27.658 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-04-25T15:36:27.658 INFO:teuthology.orchestra.run.smithi064.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T15:36:27.658 INFO:teuthology.orchestra.run.smithi064.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T15:36:27.658 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T15:36:27.658 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 69 M 2024-04-25T15:36:27.658 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-common-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 420 M 2024-04-25T15:36:27.658 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T15:36:27.658 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.2 M 2024-04-25T15:36:27.658 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T15:36:27.658 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T15:36:27.658 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 49 M 2024-04-25T15:36:27.659 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T15:36:27.659 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T15:36:27.659 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T15:36:27.659 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 21 M 2024-04-25T15:36:27.659 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T15:36:27.659 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T15:36:27.659 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 99 M 2024-04-25T15:36:27.659 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 283 M 2024-04-25T15:36:27.659 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T15:36:27.659 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 192 M 2024-04-25T15:36:27.659 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T15:36:27.659 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-test-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 623 M 2024-04-25T15:36:27.659 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T15:36:27.659 INFO:teuthology.orchestra.run.smithi064.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T15:36:27.659 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T15:36:27.660 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T15:36:27.660 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T15:36:27.660 INFO:teuthology.orchestra.run.smithi064.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T15:36:27.660 INFO:teuthology.orchestra.run.smithi064.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T15:36:27.660 INFO:teuthology.orchestra.run.smithi064.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T15:36:27.660 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T15:36:27.660 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T15:36:27.660 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T15:36:27.660 INFO:teuthology.orchestra.run.smithi064.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T15:36:27.660 INFO:teuthology.orchestra.run.smithi064.stdout: librados-devel-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 105 k 2024-04-25T15:36:27.660 INFO:teuthology.orchestra.run.smithi064.stdout: librados2-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 47 M 2024-04-25T15:36:27.661 INFO:teuthology.orchestra.run.smithi064.stdout: librbd1-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 54 M 2024-04-25T15:36:27.661 INFO:teuthology.orchestra.run.smithi064.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T15:36:27.661 INFO:teuthology.orchestra.run.smithi064.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T15:36:27.661 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T15:36:27.661 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T15:36:27.661 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T15:36:27.661 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T15:36:27.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T15:36:27.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 615 k 2024-04-25T15:36:27.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T15:36:27.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 769 k 2024-04-25T15:36:27.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T15:36:27.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.1 M 2024-04-25T15:36:27.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T15:36:27.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 337 k 2024-04-25T15:36:27.662 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T15:36:27.662 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 524 k 2024-04-25T15:36:27.662 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T15:36:27.662 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 53 M 2024-04-25T15:36:27.662 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T15:36:27.662 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.3 M 2024-04-25T15:36:27.662 INFO:teuthology.orchestra.run.smithi064.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T15:36:27.662 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrading: 2024-04-25T15:36:27.662 INFO:teuthology.orchestra.run.smithi064.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T15:36:27.662 INFO:teuthology.orchestra.run.smithi064.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T15:36:27.662 INFO:teuthology.orchestra.run.smithi064.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T15:36:27.662 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T15:36:27.662 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-04-25T15:36:27.662 INFO:teuthology.orchestra.run.smithi064.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T15:36:27.663 INFO:teuthology.orchestra.run.smithi064.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T15:36:27.663 INFO:teuthology.orchestra.run.smithi064.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T15:36:27.663 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T15:36:27.663 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-debuginfo x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 22 M 2024-04-25T15:36:27.663 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T15:36:27.663 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T15:36:27.663 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T15:36:27.663 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T15:36:27.663 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T15:36:27.663 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T15:36:27.663 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T15:36:27.663 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T15:36:27.663 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T15:36:27.663 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T15:36:27.664 INFO:teuthology.orchestra.run.smithi064.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T15:36:27.664 INFO:teuthology.orchestra.run.smithi064.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T15:36:27.664 INFO:teuthology.orchestra.run.smithi064.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T15:36:27.664 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T15:36:27.664 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T15:36:27.664 INFO:teuthology.orchestra.run.smithi064.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T15:36:27.664 INFO:teuthology.orchestra.run.smithi064.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T15:36:27.664 INFO:teuthology.orchestra.run.smithi064.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T15:36:27.664 INFO:teuthology.orchestra.run.smithi064.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T15:36:27.664 INFO:teuthology.orchestra.run.smithi064.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T15:36:27.664 INFO:teuthology.orchestra.run.smithi064.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T15:36:27.664 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T15:36:27.664 INFO:teuthology.orchestra.run.smithi064.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T15:36:27.664 INFO:teuthology.orchestra.run.smithi064.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T15:36:27.665 INFO:teuthology.orchestra.run.smithi064.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T15:36:27.665 INFO:teuthology.orchestra.run.smithi064.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T15:36:27.665 INFO:teuthology.orchestra.run.smithi064.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T15:36:27.665 INFO:teuthology.orchestra.run.smithi064.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T15:36:27.665 INFO:teuthology.orchestra.run.smithi064.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T15:36:27.665 INFO:teuthology.orchestra.run.smithi064.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T15:36:27.665 INFO:teuthology.orchestra.run.smithi064.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T15:36:27.665 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T15:36:27.665 INFO:teuthology.orchestra.run.smithi064.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T15:36:27.665 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T15:36:27.665 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T15:36:27.665 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T15:36:27.665 INFO:teuthology.orchestra.run.smithi064.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T15:36:27.665 INFO:teuthology.orchestra.run.smithi064.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T15:36:27.666 INFO:teuthology.orchestra.run.smithi064.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T15:36:27.666 INFO:teuthology.orchestra.run.smithi064.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T15:36:27.666 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T15:36:27.666 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T15:36:27.666 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T15:36:27.666 INFO:teuthology.orchestra.run.smithi064.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T15:36:27.666 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T15:36:27.666 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T15:36:27.666 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T15:36:27.666 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T15:36:27.666 INFO:teuthology.orchestra.run.smithi064.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T15:36:27.666 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T15:36:27.666 INFO:teuthology.orchestra.run.smithi064.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T15:36:27.666 INFO:teuthology.orchestra.run.smithi064.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T15:36:27.667 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T15:36:27.667 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T15:36:27.667 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T15:36:27.667 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T15:36:27.667 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T15:36:27.667 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T15:36:27.667 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T15:36:27.667 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T15:36:27.667 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T15:36:27.667 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T15:36:27.667 INFO:teuthology.orchestra.run.smithi064.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T15:36:27.667 INFO:teuthology.orchestra.run.smithi064.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T15:36:27.667 INFO:teuthology.orchestra.run.smithi064.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T15:36:27.667 INFO:teuthology.orchestra.run.smithi064.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T15:36:27.668 INFO:teuthology.orchestra.run.smithi064.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T15:36:27.668 INFO:teuthology.orchestra.run.smithi064.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T15:36:27.668 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T15:36:27.668 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T15:36:27.668 INFO:teuthology.orchestra.run.smithi064.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T15:36:27.668 INFO:teuthology.orchestra.run.smithi064.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T15:36:27.668 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T15:36:27.668 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T15:36:27.668 INFO:teuthology.orchestra.run.smithi064.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T15:36:27.668 INFO:teuthology.orchestra.run.smithi064.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T15:36:27.668 INFO:teuthology.orchestra.run.smithi064.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T15:36:27.668 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T15:36:27.668 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T15:36:27.668 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T15:36:27.669 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T15:36:27.669 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T15:36:27.669 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T15:36:27.669 INFO:teuthology.orchestra.run.smithi064.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T15:36:27.669 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T15:36:27.669 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T15:36:27.669 INFO:teuthology.orchestra.run.smithi064.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T15:36:27.669 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T15:36:27.670 INFO:teuthology.orchestra.run.smithi064.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T15:36:27.670 INFO:teuthology.orchestra.run.smithi064.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T15:36:27.670 INFO:teuthology.orchestra.run.smithi064.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T15:36:27.670 INFO:teuthology.orchestra.run.smithi064.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T15:36:27.670 INFO:teuthology.orchestra.run.smithi064.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T15:36:27.670 INFO:teuthology.orchestra.run.smithi064.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T15:36:27.670 INFO:teuthology.orchestra.run.smithi064.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T15:36:27.670 INFO:teuthology.orchestra.run.smithi064.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T15:36:27.670 INFO:teuthology.orchestra.run.smithi064.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T15:36:27.670 INFO:teuthology.orchestra.run.smithi064.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T15:36:27.670 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T15:36:27.670 INFO:teuthology.orchestra.run.smithi064.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T15:36:27.671 INFO:teuthology.orchestra.run.smithi064.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T15:36:27.671 INFO:teuthology.orchestra.run.smithi064.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T15:36:27.671 INFO:teuthology.orchestra.run.smithi064.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T15:36:27.671 INFO:teuthology.orchestra.run.smithi064.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T15:36:27.671 INFO:teuthology.orchestra.run.smithi064.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T15:36:27.671 INFO:teuthology.orchestra.run.smithi064.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T15:36:27.671 INFO:teuthology.orchestra.run.smithi064.stdout:Installing weak dependencies: 2024-04-25T15:36:27.671 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T15:36:27.671 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:36:27.671 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-04-25T15:36:27.671 INFO:teuthology.orchestra.run.smithi064.stdout:=============================================================================================== 2024-04-25T15:36:27.671 INFO:teuthology.orchestra.run.smithi064.stdout:Install 170 Packages 2024-04-25T15:36:27.671 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrade 4 Packages 2024-04-25T15:36:27.671 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:36:27.672 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 2.1 G 2024-04-25T15:36:27.672 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-04-25T15:36:27.982 INFO:teuthology.orchestra.run.smithi059.stdout:(1/174): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 26 kB/s | 6.6 kB 00:00 2024-04-25T15:36:28.558 INFO:teuthology.orchestra.run.smithi059.stdout:(2/174): ceph-base-19.0.0-3291.g994e2f20.el9.x8 6.5 MB/s | 5.4 MB 00:00 2024-04-25T15:36:28.833 INFO:teuthology.orchestra.run.smithi064.stdout:(1/174): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-04-25T15:36:33.141 INFO:teuthology.orchestra.run.smithi064.stdout:(2/174): ceph-common-19.0.0-3291.g994e2f20.el9. 4.5 MB/s | 20 MB 00:04 2024-04-25T15:36:34.316 INFO:teuthology.orchestra.run.smithi064.stdout:(3/174): ceph-base-19.0.0-3291.g994e2f20.el9.x8 955 kB/s | 5.4 MB 00:05 2024-04-25T15:36:38.740 INFO:teuthology.orchestra.run.smithi059.stdout:(3/174): ceph-common-19.0.0-3291.g994e2f20.el9. 1.8 MB/s | 20 MB 00:10 2024-04-25T15:36:43.382 INFO:teuthology.orchestra.run.smithi059.stdout:(4/174): ceph-base-debuginfo-19.0.0-3291.g994e2 4.4 MB/s | 69 MB 00:15 2024-04-25T15:36:43.874 INFO:teuthology.orchestra.run.smithi059.stdout:(5/174): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 1.7 MB/s | 863 kB 00:00 2024-04-25T15:36:46.532 INFO:teuthology.orchestra.run.smithi059.stdout:(6/174): ceph-fuse-debuginfo-19.0.0-3291.g994e2 2.3 MB/s | 6.2 MB 00:02 2024-04-25T15:36:46.690 INFO:teuthology.orchestra.run.smithi059.stdout:(7/174): ceph-immutable-object-cache-19.0.0-329 930 kB/s | 147 kB 00:00 2024-04-25T15:36:47.474 INFO:teuthology.orchestra.run.smithi059.stdout:(8/174): ceph-immutable-object-cache-debuginfo- 1.9 MB/s | 1.5 MB 00:00 2024-04-25T15:36:48.516 INFO:teuthology.orchestra.run.smithi059.stdout:(9/174): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 2.2 MB/s | 2.3 MB 00:01 2024-04-25T15:36:49.965 INFO:teuthology.orchestra.run.smithi064.stdout:(4/174): ceph-debuginfo-19.0.0-3291.g994e2f20.e 1.4 MB/s | 22 MB 00:15 2024-04-25T15:36:50.474 INFO:teuthology.orchestra.run.smithi064.stdout:(5/174): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 1.7 MB/s | 863 kB 00:00 2024-04-25T15:36:53.482 INFO:teuthology.orchestra.run.smithi064.stdout:(6/174): ceph-fuse-debuginfo-19.0.0-3291.g994e2 2.1 MB/s | 6.2 MB 00:03 2024-04-25T15:36:53.565 INFO:teuthology.orchestra.run.smithi064.stdout:(7/174): ceph-immutable-object-cache-19.0.0-329 1.7 MB/s | 147 kB 00:00 2024-04-25T15:36:54.165 INFO:teuthology.orchestra.run.smithi064.stdout:(8/174): ceph-immutable-object-cache-debuginfo- 2.4 MB/s | 1.5 MB 00:00 2024-04-25T15:36:55.016 INFO:teuthology.orchestra.run.smithi064.stdout:(9/174): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 2.7 MB/s | 2.3 MB 00:00 2024-04-25T15:36:56.666 INFO:teuthology.orchestra.run.smithi059.stdout:(10/174): ceph-debuginfo-19.0.0-3291.g994e2f20. 1.2 MB/s | 22 MB 00:17 2024-04-25T15:36:57.366 INFO:teuthology.orchestra.run.smithi059.stdout:(11/174): ceph-mgr-19.0.0-3291.g994e2f20.el9.x8 2.1 MB/s | 1.5 MB 00:00 2024-04-25T15:37:04.141 INFO:teuthology.orchestra.run.smithi059.stdout:(12/174): ceph-mds-debuginfo-19.0.0-3291.g994e2 3.1 MB/s | 49 MB 00:15 2024-04-25T15:37:05.341 INFO:teuthology.orchestra.run.smithi059.stdout:(13/174): ceph-mon-19.0.0-3291.g994e2f20.el9.x8 4.1 MB/s | 4.9 MB 00:01 2024-04-25T15:37:07.007 INFO:teuthology.orchestra.run.smithi064.stdout:(10/174): ceph-mds-debuginfo-19.0.0-3291.g994e2 4.1 MB/s | 49 MB 00:11 2024-04-25T15:37:07.174 INFO:teuthology.orchestra.run.smithi059.stdout:(14/174): ceph-mgr-debuginfo-19.0.0-3291.g994e2 2.2 MB/s | 21 MB 00:09 2024-04-25T15:37:07.349 INFO:teuthology.orchestra.run.smithi064.stdout:(11/174): ceph-mgr-19.0.0-3291.g994e2f20.el9.x8 4.4 MB/s | 1.5 MB 00:00 2024-04-25T15:37:07.940 INFO:teuthology.orchestra.run.smithi064.stdout:(12/174): ceph-base-debuginfo-19.0.0-3291.g994e 1.8 MB/s | 69 MB 00:39 2024-04-25T15:37:10.574 INFO:teuthology.orchestra.run.smithi064.stdout:(13/174): ceph-mon-19.0.0-3291.g994e2f20.el9.x8 1.9 MB/s | 4.9 MB 00:02 2024-04-25T15:37:11.599 INFO:teuthology.orchestra.run.smithi064.stdout:(14/174): ceph-mgr-debuginfo-19.0.0-3291.g994e2 5.0 MB/s | 21 MB 00:04 2024-04-25T15:37:13.207 INFO:teuthology.orchestra.run.smithi059.stdout:(15/174): ceph-osd-19.0.0-3291.g994e2f20.el9.x8 2.9 MB/s | 18 MB 00:06 2024-04-25T15:37:14.816 INFO:teuthology.orchestra.run.smithi064.stdout:(15/174): ceph-osd-19.0.0-3291.g994e2f20.el9.x8 5.5 MB/s | 18 MB 00:03 2024-04-25T15:37:23.798 INFO:teuthology.orchestra.run.smithi059.stdout:(16/174): ceph-mon-debuginfo-19.0.0-3291.g994e2 5.4 MB/s | 99 MB 00:18 2024-04-25T15:37:32.290 INFO:teuthology.orchestra.run.smithi059.stdout:(17/174): ceph-radosgw-19.0.0-3291.g994e2f20.el 1.2 MB/s | 10 MB 00:08 2024-04-25T15:38:07.861 INFO:teuthology.orchestra.run.smithi064.stdout:(16/174): ceph-mon-debuginfo-19.0.0-3291.g994e2 1.7 MB/s | 99 MB 00:57 2024-04-25T15:38:08.987 INFO:teuthology.orchestra.run.smithi059.stdout:(18/174): ceph-common-debuginfo-19.0.0-3291.g99 4.2 MB/s | 420 MB 01:40 2024-04-25T15:38:09.095 INFO:teuthology.orchestra.run.smithi059.stdout:(19/174): ceph-selinux-19.0.0-3291.g994e2f20.el 232 kB/s | 25 kB 00:00 2024-04-25T15:38:13.719 INFO:teuthology.orchestra.run.smithi064.stdout:(17/174): ceph-radosgw-19.0.0-3291.g994e2f20.el 1.7 MB/s | 10 MB 00:05 2024-04-25T15:38:20.461 INFO:teuthology.orchestra.run.smithi059.stdout:(20/174): ceph-test-19.0.0-3291.g994e2f20.el9.x 3.8 MB/s | 43 MB 00:11 2024-04-25T15:38:23.835 INFO:teuthology.orchestra.run.smithi064.stdout:(18/174): ceph-osd-debuginfo-19.0.0-3291.g994e2 4.1 MB/s | 283 MB 01:09 2024-04-25T15:38:23.935 INFO:teuthology.orchestra.run.smithi064.stdout:(19/174): ceph-selinux-19.0.0-3291.g994e2f20.el 252 kB/s | 25 kB 00:00 2024-04-25T15:38:25.785 INFO:teuthology.orchestra.run.smithi059.stdout:(21/174): ceph-radosgw-debuginfo-19.0.0-3291.g9 3.6 MB/s | 192 MB 00:53 2024-04-25T15:38:26.127 INFO:teuthology.orchestra.run.smithi059.stdout:(22/174): cephfs-mirror-19.0.0-3291.g994e2f20.e 657 kB/s | 224 kB 00:00 2024-04-25T15:38:26.219 INFO:teuthology.orchestra.run.smithi059.stdout:(23/174): cephfs-shell-19.0.0-3291.g994e2f20.el 295 kB/s | 27 kB 00:00 2024-04-25T15:38:26.311 INFO:teuthology.orchestra.run.smithi059.stdout:(24/174): libcephfs-devel-19.0.0-3291.g994e2f20 347 kB/s | 32 kB 00:00 2024-04-25T15:38:26.720 INFO:teuthology.orchestra.run.smithi059.stdout:(25/174): libcephfs2-19.0.0-3291.g994e2f20.el9. 1.8 MB/s | 756 kB 00:00 2024-04-25T15:38:28.737 INFO:teuthology.orchestra.run.smithi059.stdout:(26/174): libcephfs2-debuginfo-19.0.0-3291.g994 2.7 MB/s | 5.4 MB 00:02 2024-04-25T15:38:28.812 INFO:teuthology.orchestra.run.smithi059.stdout:(27/174): libcephsqlite-19.0.0-3291.g994e2f20.e 2.1 MB/s | 158 kB 00:00 2024-04-25T15:38:29.495 INFO:teuthology.orchestra.run.smithi059.stdout:(28/174): librados-devel-19.0.0-3291.g994e2f20. 186 kB/s | 127 kB 00:00 2024-04-25T15:38:29.579 INFO:teuthology.orchestra.run.smithi059.stdout:(29/174): librados-devel-debuginfo-19.0.0-3291. 1.2 MB/s | 105 kB 00:00 2024-04-25T15:38:33.609 INFO:teuthology.orchestra.run.smithi064.stdout:(20/174): ceph-test-19.0.0-3291.g994e2f20.el9.x 4.5 MB/s | 43 MB 00:09 2024-04-25T15:38:39.828 INFO:teuthology.orchestra.run.smithi059.stdout:(30/174): librados2-debuginfo-19.0.0-3291.g994e 4.6 MB/s | 47 MB 00:10 2024-04-25T15:38:39.962 INFO:teuthology.orchestra.run.smithi059.stdout:(31/174): libradosstriper1-19.0.0-3291.g994e2f2 3.7 MB/s | 497 kB 00:00 2024-04-25T15:38:50.847 INFO:teuthology.orchestra.run.smithi059.stdout:(32/174): librbd1-debuginfo-19.0.0-3291.g994e2f 5.0 MB/s | 54 MB 00:10 2024-04-25T15:38:52.328 INFO:teuthology.orchestra.run.smithi059.stdout:(33/174): librgw2-19.0.0-3291.g994e2f20.el9.x86 3.5 MB/s | 5.2 MB 00:01 2024-04-25T15:38:52.428 INFO:teuthology.orchestra.run.smithi059.stdout:(34/174): python3-ceph-argparse-19.0.0-3291.g99 453 kB/s | 45 kB 00:00 2024-04-25T15:38:52.545 INFO:teuthology.orchestra.run.smithi059.stdout:(35/174): python3-ceph-common-19.0.0-3291.g994e 1.1 MB/s | 135 kB 00:00 2024-04-25T15:38:52.654 INFO:teuthology.orchestra.run.smithi059.stdout:(36/174): python3-cephfs-19.0.0-3291.g994e2f20. 1.5 MB/s | 161 kB 00:00 2024-04-25T15:38:52.904 INFO:teuthology.orchestra.run.smithi059.stdout:(37/174): python3-cephfs-debuginfo-19.0.0-3291. 2.4 MB/s | 615 kB 00:00 2024-04-25T15:38:53.079 INFO:teuthology.orchestra.run.smithi059.stdout:(38/174): python3-rados-19.0.0-3291.g994e2f20.e 1.8 MB/s | 321 kB 00:00 2024-04-25T15:38:53.330 INFO:teuthology.orchestra.run.smithi059.stdout:(39/174): python3-rados-debuginfo-19.0.0-3291.g 3.0 MB/s | 769 kB 00:00 2024-04-25T15:38:53.430 INFO:teuthology.orchestra.run.smithi059.stdout:(40/174): python3-rbd-19.0.0-3291.g994e2f20.el9 2.9 MB/s | 298 kB 00:00 2024-04-25T15:38:53.722 INFO:teuthology.orchestra.run.smithi059.stdout:(41/174): python3-rbd-debuginfo-19.0.0-3291.g99 3.9 MB/s | 1.1 MB 00:00 2024-04-25T15:38:53.922 INFO:teuthology.orchestra.run.smithi059.stdout:(42/174): python3-rgw-19.0.0-3291.g994e2f20.el9 499 kB/s | 100 kB 00:00 2024-04-25T15:38:54.348 INFO:teuthology.orchestra.run.smithi059.stdout:(43/174): python3-rgw-debuginfo-19.0.0-3291.g99 794 kB/s | 337 kB 00:00 2024-04-25T15:38:54.523 INFO:teuthology.orchestra.run.smithi059.stdout:(44/174): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 493 kB/s | 86 kB 00:00 2024-04-25T15:38:54.915 INFO:teuthology.orchestra.run.smithi059.stdout:(45/174): rbd-fuse-debuginfo-19.0.0-3291.g994e2 1.3 MB/s | 524 kB 00:00 2024-04-25T15:38:55.940 INFO:teuthology.orchestra.run.smithi059.stdout:(46/174): rbd-mirror-19.0.0-3291.g994e2f20.el9. 3.0 MB/s | 3.0 MB 00:01 2024-04-25T15:39:09.981 INFO:teuthology.orchestra.run.smithi059.stdout:(47/174): rbd-mirror-debuginfo-19.0.0-3291.g994 3.8 MB/s | 53 MB 00:14 2024-04-25T15:39:10.122 INFO:teuthology.orchestra.run.smithi059.stdout:(48/174): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 1.2 MB/s | 169 kB 00:00 2024-04-25T15:39:10.508 INFO:teuthology.orchestra.run.smithi059.stdout:(49/174): rbd-nbd-debuginfo-19.0.0-3291.g994e2f 3.3 MB/s | 1.3 MB 00:00 2024-04-25T15:39:10.583 INFO:teuthology.orchestra.run.smithi059.stdout:(50/174): ceph-grafana-dashboards-19.0.0-3291.g 457 kB/s | 34 kB 00:00 2024-04-25T15:39:10.675 INFO:teuthology.orchestra.run.smithi059.stdout:(51/174): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 1.5 MB/s | 142 kB 00:00 2024-04-25T15:39:11.476 INFO:teuthology.orchestra.run.smithi059.stdout:(52/174): ceph-mgr-dashboard-19.0.0-3291.g994e2 4.4 MB/s | 3.5 MB 00:00 2024-04-25T15:39:13.109 INFO:teuthology.orchestra.run.smithi059.stdout:(53/174): ceph-mgr-diskprediction-local-19.0.0- 4.5 MB/s | 7.4 MB 00:01 2024-04-25T15:39:13.193 INFO:teuthology.orchestra.run.smithi059.stdout:(54/174): ceph-mgr-modules-core-19.0.0-3291.g99 2.9 MB/s | 249 kB 00:00 2024-04-25T15:39:13.268 INFO:teuthology.orchestra.run.smithi059.stdout:(55/174): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 659 kB/s | 49 kB 00:00 2024-04-25T15:39:13.343 INFO:teuthology.orchestra.run.smithi059.stdout:(56/174): ceph-prometheus-alerts-19.0.0-3291.g9 220 kB/s | 16 kB 00:00 2024-04-25T15:39:13.435 INFO:teuthology.orchestra.run.smithi059.stdout:(57/174): ceph-volume-19.0.0-3291.g994e2f20.el9 2.9 MB/s | 273 kB 00:00 2024-04-25T15:39:13.652 INFO:teuthology.orchestra.run.smithi059.stdout:(58/174): cephadm-19.0.0-3291.g994e2f20.el9.noa 3.4 MB/s | 762 kB 00:00 2024-04-25T15:39:13.727 INFO:teuthology.orchestra.run.smithi059.stdout:(59/174): cephfs-top-19.0.0-3291.g994e2f20.el9. 244 kB/s | 18 kB 00:00 2024-04-25T15:39:13.844 INFO:teuthology.orchestra.run.smithi059.stdout:(60/174): fuse-2.9.9-15.el9.x86_64.rpm 690 kB/s | 80 kB 00:00 2024-04-25T15:39:13.911 INFO:teuthology.orchestra.run.smithi059.stdout:(61/174): libgfortran-11.4.1-3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2024-04-25T15:39:13.953 INFO:teuthology.orchestra.run.smithi059.stdout:(62/174): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2024-04-25T15:39:13.995 INFO:teuthology.orchestra.run.smithi059.stdout:(63/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 253 kB 00:00 2024-04-25T15:39:14.054 INFO:teuthology.orchestra.run.smithi059.stdout:(64/174): python3-cryptography-36.0.1-4.el9.x86 21 MB/s | 1.2 MB 00:00 2024-04-25T15:39:14.104 INFO:teuthology.orchestra.run.smithi059.stdout:(65/174): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-25T15:39:14.145 INFO:teuthology.orchestra.run.smithi059.stdout:(66/174): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-04-25T15:39:14.196 INFO:teuthology.orchestra.run.smithi059.stdout:(67/174): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-25T15:39:14.238 INFO:teuthology.orchestra.run.smithi059.stdout:(68/174): python3-urllib3-1.26.5-5.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-04-25T15:39:14.288 INFO:teuthology.orchestra.run.smithi059.stdout:(69/174): automake-1.16.2-8.el9.noarch.rpm 14 MB/s | 689 kB 00:00 2024-04-25T15:39:14.355 INFO:teuthology.orchestra.run.smithi059.stdout:(70/174): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-04-25T15:39:14.389 INFO:teuthology.orchestra.run.smithi059.stdout:(71/174): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 107 kB 00:00 2024-04-25T15:39:14.422 INFO:teuthology.orchestra.run.smithi059.stdout:(72/174): elfutils-libelf-devel-0.190-2.el9.x86 647 kB/s | 21 kB 00:00 2024-04-25T15:39:14.464 INFO:teuthology.orchestra.run.smithi059.stdout:(73/174): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 313 kB 00:00 2024-04-25T15:39:14.498 INFO:teuthology.orchestra.run.smithi059.stdout:(74/174): flexiblas-3.0.4-8.el9.x86_64.rpm 985 kB/s | 33 kB 00:00 2024-04-25T15:39:14.615 INFO:teuthology.orchestra.run.smithi059.stdout:(75/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-04-25T15:39:14.648 INFO:teuthology.orchestra.run.smithi059.stdout:(76/174): flexiblas-openblas-openmp-3.0.4-8.el9 552 kB/s | 18 kB 00:00 2024-04-25T15:39:14.691 INFO:teuthology.orchestra.run.smithi059.stdout:(77/174): libaio-devel-0.3.111-13.el9.x86_64.rp 265 kB/s | 11 kB 00:00 2024-04-25T15:39:14.733 INFO:teuthology.orchestra.run.smithi059.stdout:(78/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-04-25T15:39:14.767 INFO:teuthology.orchestra.run.smithi059.stdout:(79/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-04-25T15:39:14.825 INFO:teuthology.orchestra.run.smithi059.stdout:(80/174): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-04-25T15:39:14.875 INFO:teuthology.orchestra.run.smithi059.stdout:(81/174): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 582 kB 00:00 2024-04-25T15:39:14.909 INFO:teuthology.orchestra.run.smithi059.stdout:(82/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 768 kB/s | 25 kB 00:00 2024-04-25T15:39:14.942 INFO:teuthology.orchestra.run.smithi059.stdout:(83/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-04-25T15:39:14.993 INFO:teuthology.orchestra.run.smithi059.stdout:(84/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-25T15:39:15.043 INFO:teuthology.orchestra.run.smithi059.stdout:(85/174): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T15:39:15.077 INFO:teuthology.orchestra.run.smithi059.stdout:(86/174): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 35 kB 00:00 2024-04-25T15:39:15.236 INFO:teuthology.orchestra.run.smithi059.stdout:(87/174): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-04-25T15:39:15.402 INFO:teuthology.orchestra.run.smithi059.stdout:(88/174): openssl-devel-3.2.1-1.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-04-25T15:39:15.478 INFO:teuthology.orchestra.run.smithi059.stdout:(89/174): postgresql-13.14-1.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-04-25T15:39:15.545 INFO:teuthology.orchestra.run.smithi059.stdout:(90/174): postgresql-contrib-13.14-1.el9.x86_64 13 MB/s | 911 kB 00:00 2024-04-25T15:39:15.578 INFO:teuthology.orchestra.run.smithi059.stdout:(91/174): postgresql-private-libs-13.14-1.el9.x 3.9 MB/s | 133 kB 00:00 2024-04-25T15:39:15.762 INFO:teuthology.orchestra.run.smithi059.stdout:(92/174): postgresql-server-13.14-1.el9.x86_64. 32 MB/s | 5.8 MB 00:00 2024-04-25T15:39:15.829 INFO:teuthology.orchestra.run.smithi059.stdout:(93/174): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-04-25T15:39:15.862 INFO:teuthology.orchestra.run.smithi059.stdout:(94/174): python3-attrs-20.3.0-7.el9.noarch.rpm 2.6 MB/s | 87 kB 00:00 2024-04-25T15:39:16.054 INFO:teuthology.orchestra.run.smithi059.stdout:(95/174): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 6.0 MB 00:00 2024-04-25T15:39:16.104 INFO:teuthology.orchestra.run.smithi059.stdout:(96/174): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-04-25T15:39:16.155 INFO:teuthology.orchestra.run.smithi059.stdout:(97/174): python3-jinja2-2.11.3-5.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-04-25T15:39:16.189 INFO:teuthology.orchestra.run.smithi059.stdout:(98/174): python3-jsonpatch-1.21-16.el9.noarch. 767 kB/s | 26 kB 00:00 2024-04-25T15:39:16.222 INFO:teuthology.orchestra.run.smithi059.stdout:(99/174): python3-jsonpointer-2.0-4.el9.noarch. 578 kB/s | 19 kB 00:00 2024-04-25T15:39:16.272 INFO:teuthology.orchestra.run.smithi059.stdout:(100/174): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-25T15:39:16.297 INFO:teuthology.orchestra.run.smithi059.stdout:(101/174): python3-markupsafe-1.1.1-12.el9.x86_ 1.4 MB/s | 35 kB 00:00 2024-04-25T15:39:16.473 INFO:teuthology.orchestra.run.smithi059.stdout:(102/174): python3-numpy-1.20.1-5.el9.x86_64.rp 29 MB/s | 5.1 MB 00:00 2024-04-25T15:39:16.515 INFO:teuthology.orchestra.run.smithi059.stdout:(103/174): python3-numpy-f2py-1.20.1-5.el9.x86_ 5.9 MB/s | 250 kB 00:00 2024-04-25T15:39:16.565 INFO:teuthology.orchestra.run.smithi059.stdout:(104/174): python3-oauthlib-3.1.1-5.el9.noarch. 4.3 MB/s | 222 kB 00:00 2024-04-25T15:39:16.599 INFO:teuthology.orchestra.run.smithi059.stdout:(105/174): python3-packaging-20.9-5.el9.noarch. 2.2 MB/s | 77 kB 00:00 2024-04-25T15:39:16.632 INFO:teuthology.orchestra.run.smithi059.stdout:(106/174): python3-prettytable-0.7.2-27.el9.noa 1.2 MB/s | 42 kB 00:00 2024-04-25T15:39:16.675 INFO:teuthology.orchestra.run.smithi059.stdout:(107/174): python3-protobuf-3.14.0-13.el9.noarc 6.3 MB/s | 269 kB 00:00 2024-04-25T15:39:16.716 INFO:teuthology.orchestra.run.smithi059.stdout:(108/174): python3-pyasn1-0.4.8-6.el9.noarch.rp 3.7 MB/s | 159 kB 00:00 2024-04-25T15:39:16.759 INFO:teuthology.orchestra.run.smithi059.stdout:(109/174): python3-pyasn1-modules-0.4.8-6.el9.n 6.5 MB/s | 279 kB 00:00 2024-04-25T15:39:16.792 INFO:teuthology.orchestra.run.smithi059.stdout:(110/174): python3-pytz-2021.1-5.el9.noarch.rpm 1.5 MB/s | 51 kB 00:00 2024-04-25T15:39:16.826 INFO:teuthology.orchestra.run.smithi059.stdout:(111/174): python3-requests-oauthlib-1.3.0-12.e 1.6 MB/s | 54 kB 00:00 2024-04-25T15:39:17.218 INFO:teuthology.orchestra.run.smithi059.stdout:(112/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-04-25T15:39:17.251 INFO:teuthology.orchestra.run.smithi059.stdout:(113/174): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-04-25T15:39:17.285 INFO:teuthology.orchestra.run.smithi059.stdout:(114/174): python3-wcwidth-0.2.5-8.el9.noarch.r 1.3 MB/s | 44 kB 00:00 2024-04-25T15:39:17.327 INFO:teuthology.orchestra.run.smithi059.stdout:(115/174): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-04-25T15:39:17.369 INFO:teuthology.orchestra.run.smithi059.stdout:(116/174): qatlib-service-24.02.0-1.el9.x86_64. 863 kB/s | 36 kB 00:00 2024-04-25T15:39:17.403 INFO:teuthology.orchestra.run.smithi059.stdout:(117/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-04-25T15:39:17.444 INFO:teuthology.orchestra.run.smithi059.stdout:(118/174): socat-1.7.4.1-5.el9.x86_64.rpm 7.2 MB/s | 305 kB 00:00 2024-04-25T15:39:17.478 INFO:teuthology.orchestra.run.smithi059.stdout:(119/174): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2024-04-25T15:39:17.512 INFO:teuthology.orchestra.run.smithi059.stdout:(120/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 2.7 MB/s | 94 kB 00:00 2024-04-25T15:39:17.545 INFO:teuthology.orchestra.run.smithi059.stdout:(121/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2024-04-25T15:39:17.579 INFO:teuthology.orchestra.run.smithi059.stdout:(122/174): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-04-25T15:39:17.621 INFO:teuthology.orchestra.run.smithi059.stdout:(123/174): lua-devel-5.4.4-4.el9.x86_64.rpm 534 kB/s | 22 kB 00:00 2024-04-25T15:39:17.671 INFO:teuthology.orchestra.run.smithi059.stdout:(124/174): protobuf-compiler-3.14.0-13.el9.x86_ 17 MB/s | 863 kB 00:00 2024-04-25T15:39:18.105 INFO:teuthology.orchestra.run.smithi059.stdout:(125/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.2 MB/s | 548 kB 00:00 2024-04-25T15:39:18.205 INFO:teuthology.orchestra.run.smithi059.stdout:(126/174): gperftools-libs-2.9.1-2.el9.x86_64.r 3.0 MB/s | 309 kB 00:00 2024-04-25T15:39:18.272 INFO:teuthology.orchestra.run.smithi059.stdout:(127/174): grpc-data-1.46.7-10.el9.noarch.rpm 292 kB/s | 19 kB 00:00 2024-04-25T15:39:19.656 INFO:teuthology.orchestra.run.smithi059.stdout:(128/174): ceph-osd-debuginfo-19.0.0-3291.g994e 2.2 MB/s | 283 MB 02:06 2024-04-25T15:39:19.739 INFO:teuthology.orchestra.run.smithi059.stdout:(129/174): libarrow-9.0.0-10.el9.x86_64.rpm 3.0 MB/s | 4.4 MB 00:01 2024-04-25T15:39:19.848 INFO:teuthology.orchestra.run.smithi059.stdout:(130/174): liboath-2.6.7-2.el9.x86_64.rpm 612 kB/s | 49 kB 00:00 2024-04-25T15:39:19.915 INFO:teuthology.orchestra.run.smithi059.stdout:(131/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-04-25T15:39:19.949 INFO:teuthology.orchestra.run.smithi059.stdout:(132/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 89 kB/s | 26 kB 00:00 2024-04-25T15:39:19.982 INFO:teuthology.orchestra.run.smithi059.stdout:(133/174): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-04-25T15:39:20.066 INFO:teuthology.orchestra.run.smithi059.stdout:(134/174): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-04-25T15:39:20.133 INFO:teuthology.orchestra.run.smithi059.stdout:(135/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 651 kB/s | 43 kB 00:00 2024-04-25T15:39:20.200 INFO:teuthology.orchestra.run.smithi059.stdout:(136/174): python3-cachetools-4.2.4-1.el9.noarc 484 kB/s | 32 kB 00:00 2024-04-25T15:39:20.267 INFO:teuthology.orchestra.run.smithi059.stdout:(137/174): python3-certifi-2021.10.8-2.el9.noar 225 kB/s | 15 kB 00:00 2024-04-25T15:39:20.309 INFO:teuthology.orchestra.run.smithi059.stdout:(138/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.3 MB/s | 838 kB 00:00 2024-04-25T15:39:20.334 INFO:teuthology.orchestra.run.smithi059.stdout:(139/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-04-25T15:39:20.409 INFO:teuthology.orchestra.run.smithi059.stdout:(140/174): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-04-25T15:39:20.443 INFO:teuthology.orchestra.run.smithi059.stdout:(141/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-04-25T15:39:20.526 INFO:teuthology.orchestra.run.smithi059.stdout:(142/174): python3-colorama-0.4.4-12.el9.noarch 302 kB/s | 35 kB 00:00 2024-04-25T15:39:20.552 INFO:teuthology.orchestra.run.smithi059.stdout:(143/174): python3-google-auth-2.29.0-1.el9.noa 1.9 MB/s | 206 kB 00:00 2024-04-25T15:39:20.619 INFO:teuthology.orchestra.run.smithi059.stdout:(144/174): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-04-25T15:39:20.686 INFO:teuthology.orchestra.run.smithi059.stdout:(145/174): python3-jaraco-8.2.1-3.el9.noarch.rp 161 kB/s | 11 kB 00:00 2024-04-25T15:39:20.736 INFO:teuthology.orchestra.run.smithi059.stdout:(146/174): python3-grpcio-1.46.7-10.el9.x86_64. 9.7 MB/s | 2.0 MB 00:00 2024-04-25T15:39:20.761 INFO:teuthology.orchestra.run.smithi059.stdout:(147/174): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-04-25T15:39:20.803 INFO:teuthology.orchestra.run.smithi059.stdout:(148/174): python3-jaraco-collections-3.0.0-8.e 347 kB/s | 23 kB 00:00 2024-04-25T15:39:20.828 INFO:teuthology.orchestra.run.smithi059.stdout:(149/174): python3-jaraco-functools-3.5.0-2.el9 291 kB/s | 19 kB 00:00 2024-04-25T15:39:20.854 INFO:teuthology.orchestra.run.smithi064.stdout:(21/174): ceph-common-debuginfo-19.0.0-3291.g99 2.5 MB/s | 420 MB 02:47 2024-04-25T15:39:20.870 INFO:teuthology.orchestra.run.smithi059.stdout:(150/174): python3-jaraco-text-3.2.0-6.el9.noar 294 kB/s | 20 kB 00:00 2024-04-25T15:39:20.912 INFO:teuthology.orchestra.run.smithi059.stdout:(151/174): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-04-25T15:39:20.938 INFO:teuthology.orchestra.run.smithi059.stdout:(152/174): python3-logutils-0.3.5-21.el9.noarch 691 kB/s | 46 kB 00:00 2024-04-25T15:39:20.980 INFO:teuthology.orchestra.run.smithi059.stdout:(153/174): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-04-25T15:39:21.005 INFO:teuthology.orchestra.run.smithi059.stdout:(154/174): python3-natsort-7.1.1-5.el9.noarch.r 863 kB/s | 58 kB 00:00 2024-04-25T15:39:21.055 INFO:teuthology.orchestra.run.smithi059.stdout:(155/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-25T15:39:21.089 INFO:teuthology.orchestra.run.smithi059.stdout:(156/174): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2024-04-25T15:39:21.112 INFO:teuthology.orchestra.run.smithi064.stdout:(22/174): cephfs-mirror-19.0.0-3291.g994e2f20.e 869 kB/s | 224 kB 00:00 2024-04-25T15:39:21.122 INFO:teuthology.orchestra.run.smithi059.stdout:(157/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-25T15:39:21.156 INFO:teuthology.orchestra.run.smithi059.stdout:(158/174): python3-pyperclip-1.8.2-2.el9.noarch 421 kB/s | 28 kB 00:00 2024-04-25T15:39:21.179 INFO:teuthology.orchestra.run.smithi064.stdout:(23/174): cephfs-shell-19.0.0-3291.g994e2f20.el 405 kB/s | 27 kB 00:00 2024-04-25T15:39:21.190 INFO:teuthology.orchestra.run.smithi059.stdout:(159/174): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-04-25T15:39:21.232 INFO:teuthology.orchestra.run.smithi059.stdout:(160/174): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-25T15:39:21.254 INFO:teuthology.orchestra.run.smithi064.stdout:(24/174): libcephfs-devel-19.0.0-3291.g994e2f20 424 kB/s | 32 kB 00:00 2024-04-25T15:39:21.257 INFO:teuthology.orchestra.run.smithi059.stdout:(161/174): python3-rsa-4.9-2.el9.noarch.rpm 885 kB/s | 59 kB 00:00 2024-04-25T15:39:21.299 INFO:teuthology.orchestra.run.smithi059.stdout:(162/174): python3-tempora-5.0.0-2.el9.noarch.r 533 kB/s | 36 kB 00:00 2024-04-25T15:39:21.324 INFO:teuthology.orchestra.run.smithi059.stdout:(163/174): python3-typing-extensions-4.4.0-2.el 758 kB/s | 51 kB 00:00 2024-04-25T15:39:21.375 INFO:teuthology.orchestra.run.smithi059.stdout:(164/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-25T15:39:21.400 INFO:teuthology.orchestra.run.smithi059.stdout:(165/174): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-25T15:39:21.458 INFO:teuthology.orchestra.run.smithi059.stdout:(166/174): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-04-25T15:39:21.484 INFO:teuthology.orchestra.run.smithi059.stdout:(167/174): python3-zc-lockfile-2.0-10.el9.noarc 239 kB/s | 20 kB 00:00 2024-04-25T15:39:21.534 INFO:teuthology.orchestra.run.smithi059.stdout:(168/174): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-25T15:39:21.584 INFO:teuthology.orchestra.run.smithi059.stdout:(169/174): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-25T15:39:21.655 INFO:teuthology.orchestra.run.smithi064.stdout:(25/174): libcephfs2-19.0.0-3291.g994e2f20.el9. 1.8 MB/s | 756 kB 00:00 2024-04-25T15:39:22.701 INFO:teuthology.orchestra.run.smithi059.stdout:(170/174): librbd1-19.0.0-3291.g994e2f20.el9.x8 2.8 MB/s | 3.1 MB 00:01 2024-04-25T15:39:22.760 INFO:teuthology.orchestra.run.smithi059.stdout:(171/174): openssl-3.2.1-1.el9.x86_64.rpm 23 MB/s | 1.3 MB 00:00 2024-04-25T15:39:22.835 INFO:teuthology.orchestra.run.smithi059.stdout:(172/174): openssl-libs-3.2.1-1.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-04-25T15:39:23.061 INFO:teuthology.orchestra.run.smithi059.stdout:(173/174): librados2-19.0.0-3291.g994e2f20.el9. 2.2 MB/s | 3.3 MB 00:01 2024-04-25T15:39:23.213 INFO:teuthology.orchestra.run.smithi064.stdout:(26/174): libcephfs2-debuginfo-19.0.0-3291.g994 3.4 MB/s | 5.4 MB 00:01 2024-04-25T15:39:23.313 INFO:teuthology.orchestra.run.smithi064.stdout:(27/174): libcephsqlite-19.0.0-3291.g994e2f20.e 1.5 MB/s | 158 kB 00:00 2024-04-25T15:39:23.430 INFO:teuthology.orchestra.run.smithi064.stdout:(28/174): librados-devel-19.0.0-3291.g994e2f20. 1.1 MB/s | 127 kB 00:00 2024-04-25T15:39:23.531 INFO:teuthology.orchestra.run.smithi064.stdout:(29/174): librados-devel-debuginfo-19.0.0-3291. 1.0 MB/s | 105 kB 00:00 2024-04-25T15:39:26.547 INFO:teuthology.orchestra.run.smithi064.stdout:(30/174): ceph-radosgw-debuginfo-19.0.0-3291.g9 2.6 MB/s | 192 MB 01:12 2024-04-25T15:39:26.822 INFO:teuthology.orchestra.run.smithi064.stdout:(31/174): libradosstriper1-19.0.0-3291.g994e2f2 1.8 MB/s | 497 kB 00:00 2024-04-25T15:39:35.630 INFO:teuthology.orchestra.run.smithi064.stdout:(32/174): librados2-debuginfo-19.0.0-3291.g994e 3.9 MB/s | 47 MB 00:12 2024-04-25T15:39:37.397 INFO:teuthology.orchestra.run.smithi064.stdout:(33/174): librgw2-19.0.0-3291.g994e2f20.el9.x86 2.9 MB/s | 5.2 MB 00:01 2024-04-25T15:39:37.514 INFO:teuthology.orchestra.run.smithi064.stdout:(34/174): python3-ceph-argparse-19.0.0-3291.g99 387 kB/s | 45 kB 00:00 2024-04-25T15:39:37.623 INFO:teuthology.orchestra.run.smithi064.stdout:(35/174): python3-ceph-common-19.0.0-3291.g994e 1.2 MB/s | 135 kB 00:00 2024-04-25T15:39:37.739 INFO:teuthology.orchestra.run.smithi064.stdout:(36/174): python3-cephfs-19.0.0-3291.g994e2f20. 1.4 MB/s | 161 kB 00:00 2024-04-25T15:39:38.031 INFO:teuthology.orchestra.run.smithi064.stdout:(37/174): python3-cephfs-debuginfo-19.0.0-3291. 2.1 MB/s | 615 kB 00:00 2024-04-25T15:39:38.198 INFO:teuthology.orchestra.run.smithi064.stdout:(38/174): python3-rados-19.0.0-3291.g994e2f20.e 1.9 MB/s | 321 kB 00:00 2024-04-25T15:39:38.765 INFO:teuthology.orchestra.run.smithi064.stdout:(39/174): librbd1-debuginfo-19.0.0-3291.g994e2f 4.5 MB/s | 54 MB 00:11 2024-04-25T15:39:38.799 INFO:teuthology.orchestra.run.smithi064.stdout:(40/174): python3-rados-debuginfo-19.0.0-3291.g 1.3 MB/s | 769 kB 00:00 2024-04-25T15:39:38.882 INFO:teuthology.orchestra.run.smithi064.stdout:(41/174): python3-rbd-19.0.0-3291.g994e2f20.el9 2.5 MB/s | 298 kB 00:00 2024-04-25T15:39:38.966 INFO:teuthology.orchestra.run.smithi064.stdout:(42/174): python3-rgw-19.0.0-3291.g994e2f20.el9 1.2 MB/s | 100 kB 00:00 2024-04-25T15:39:39.066 INFO:teuthology.orchestra.run.smithi064.stdout:(43/174): python3-rgw-debuginfo-19.0.0-3291.g99 3.3 MB/s | 337 kB 00:00 2024-04-25T15:39:39.158 INFO:teuthology.orchestra.run.smithi064.stdout:(44/174): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 941 kB/s | 86 kB 00:00 2024-04-25T15:39:39.225 INFO:teuthology.orchestra.run.smithi064.stdout:(45/174): python3-rbd-debuginfo-19.0.0-3291.g99 2.6 MB/s | 1.1 MB 00:00 2024-04-25T15:39:39.334 INFO:teuthology.orchestra.run.smithi064.stdout:(46/174): rbd-fuse-debuginfo-19.0.0-3291.g994e2 2.9 MB/s | 524 kB 00:00 2024-04-25T15:39:40.292 INFO:teuthology.orchestra.run.smithi064.stdout:(47/174): rbd-mirror-19.0.0-3291.g994e2f20.el9. 2.9 MB/s | 3.0 MB 00:01 2024-04-25T15:39:40.401 INFO:teuthology.orchestra.run.smithi064.stdout:(48/174): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 1.5 MB/s | 169 kB 00:00 2024-04-25T15:39:41.159 INFO:teuthology.orchestra.run.smithi064.stdout:(49/174): rbd-nbd-debuginfo-19.0.0-3291.g994e2f 1.7 MB/s | 1.3 MB 00:00 2024-04-25T15:39:41.568 INFO:teuthology.orchestra.run.smithi064.stdout:(50/174): ceph-grafana-dashboards-19.0.0-3291.g 84 kB/s | 34 kB 00:00 2024-04-25T15:39:41.927 INFO:teuthology.orchestra.run.smithi064.stdout:(51/174): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 397 kB/s | 142 kB 00:00 2024-04-25T15:39:43.318 INFO:teuthology.orchestra.run.smithi064.stdout:(52/174): ceph-mgr-dashboard-19.0.0-3291.g994e2 2.5 MB/s | 3.5 MB 00:01 2024-04-25T15:39:45.869 INFO:teuthology.orchestra.run.smithi064.stdout:(53/174): ceph-mgr-diskprediction-local-19.0.0- 2.9 MB/s | 7.4 MB 00:02 2024-04-25T15:39:45.985 INFO:teuthology.orchestra.run.smithi064.stdout:(54/174): ceph-mgr-modules-core-19.0.0-3291.g99 2.1 MB/s | 249 kB 00:00 2024-04-25T15:39:46.102 INFO:teuthology.orchestra.run.smithi064.stdout:(55/174): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 423 kB/s | 49 kB 00:00 2024-04-25T15:39:46.211 INFO:teuthology.orchestra.run.smithi064.stdout:(56/174): ceph-prometheus-alerts-19.0.0-3291.g9 152 kB/s | 16 kB 00:00 2024-04-25T15:39:46.403 INFO:teuthology.orchestra.run.smithi064.stdout:(57/174): ceph-volume-19.0.0-3291.g994e2f20.el9 1.4 MB/s | 273 kB 00:00 2024-04-25T15:39:46.711 INFO:teuthology.orchestra.run.smithi064.stdout:(58/174): cephadm-19.0.0-3291.g994e2f20.el9.noa 2.4 MB/s | 762 kB 00:00 2024-04-25T15:39:46.820 INFO:teuthology.orchestra.run.smithi064.stdout:(59/174): cephfs-top-19.0.0-3291.g994e2f20.el9. 169 kB/s | 18 kB 00:00 2024-04-25T15:39:46.920 INFO:teuthology.orchestra.run.smithi064.stdout:(60/174): fuse-2.9.9-15.el9.x86_64.rpm 803 kB/s | 80 kB 00:00 2024-04-25T15:39:46.995 INFO:teuthology.orchestra.run.smithi064.stdout:(61/174): libgfortran-11.4.1-3.el9.x86_64.rpm 10 MB/s | 803 kB 00:00 2024-04-25T15:39:47.029 INFO:teuthology.orchestra.run.smithi064.stdout:(62/174): libquadmath-11.4.1-3.el9.x86_64.rpm 5.7 MB/s | 195 kB 00:00 2024-04-25T15:39:47.071 INFO:teuthology.orchestra.run.smithi064.stdout:(63/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.0 MB/s | 253 kB 00:00 2024-04-25T15:39:47.130 INFO:teuthology.orchestra.run.smithi064.stdout:(64/174): python3-cryptography-36.0.1-4.el9.x86 21 MB/s | 1.2 MB 00:00 2024-04-25T15:39:47.164 INFO:teuthology.orchestra.run.smithi064.stdout:(65/174): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 106 kB 00:00 2024-04-25T15:39:47.197 INFO:teuthology.orchestra.run.smithi064.stdout:(66/174): python3-pycparser-2.20-6.el9.noarch.r 4.0 MB/s | 135 kB 00:00 2024-04-25T15:39:47.230 INFO:teuthology.orchestra.run.smithi064.stdout:(67/174): python3-requests-2.25.1-8.el9.noarch. 3.7 MB/s | 125 kB 00:00 2024-04-25T15:39:47.273 INFO:teuthology.orchestra.run.smithi064.stdout:(68/174): python3-urllib3-1.26.5-5.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-04-25T15:39:47.314 INFO:teuthology.orchestra.run.smithi064.stdout:(69/174): automake-1.16.2-8.el9.noarch.rpm 16 MB/s | 689 kB 00:00 2024-04-25T15:39:47.365 INFO:teuthology.orchestra.run.smithi064.stdout:(70/174): bison-3.7.4-5.el9.x86_64.rpm 18 MB/s | 943 kB 00:00 2024-04-25T15:39:47.398 INFO:teuthology.orchestra.run.smithi064.stdout:(71/174): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 107 kB 00:00 2024-04-25T15:39:47.424 INFO:teuthology.orchestra.run.smithi064.stdout:(72/174): elfutils-libelf-devel-0.190-2.el9.x86 859 kB/s | 21 kB 00:00 2024-04-25T15:39:47.466 INFO:teuthology.orchestra.run.smithi064.stdout:(73/174): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 313 kB 00:00 2024-04-25T15:39:47.508 INFO:teuthology.orchestra.run.smithi064.stdout:(74/174): flexiblas-3.0.4-8.el9.x86_64.rpm 785 kB/s | 33 kB 00:00 2024-04-25T15:39:47.600 INFO:teuthology.orchestra.run.smithi064.stdout:(75/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2024-04-25T15:39:47.633 INFO:teuthology.orchestra.run.smithi064.stdout:(76/174): flexiblas-openblas-openmp-3.0.4-8.el9 548 kB/s | 18 kB 00:00 2024-04-25T15:39:47.667 INFO:teuthology.orchestra.run.smithi064.stdout:(77/174): libaio-devel-0.3.111-13.el9.x86_64.rp 335 kB/s | 11 kB 00:00 2024-04-25T15:39:47.826 INFO:teuthology.orchestra.run.smithi064.stdout:(78/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-04-25T15:39:47.859 INFO:teuthology.orchestra.run.smithi064.stdout:(79/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-04-25T15:39:47.909 INFO:teuthology.orchestra.run.smithi064.stdout:(80/174): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-04-25T15:39:47.960 INFO:teuthology.orchestra.run.smithi064.stdout:(81/174): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 582 kB 00:00 2024-04-25T15:39:48.002 INFO:teuthology.orchestra.run.smithi064.stdout:(82/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 616 kB/s | 25 kB 00:00 2024-04-25T15:39:48.044 INFO:teuthology.orchestra.run.smithi064.stdout:(83/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-04-25T15:39:48.086 INFO:teuthology.orchestra.run.smithi064.stdout:(84/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.9 MB/s | 292 kB 00:00 2024-04-25T15:39:48.119 INFO:teuthology.orchestra.run.smithi064.stdout:(85/174): lua-5.4.4-4.el9.x86_64.rpm 5.5 MB/s | 188 kB 00:00 2024-04-25T15:39:48.152 INFO:teuthology.orchestra.run.smithi064.stdout:(86/174): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 35 kB 00:00 2024-04-25T15:39:48.287 INFO:teuthology.orchestra.run.smithi064.stdout:(87/174): openblas-openmp-0.3.21-2.el9.x86_64.r 36 MB/s | 4.7 MB 00:00 2024-04-25T15:39:48.437 INFO:teuthology.orchestra.run.smithi064.stdout:(88/174): openssl-devel-3.2.1-1.el9.x86_64.rpm 30 MB/s | 4.4 MB 00:00 2024-04-25T15:39:48.503 INFO:teuthology.orchestra.run.smithi064.stdout:(89/174): postgresql-13.14-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-04-25T15:39:48.971 INFO:teuthology.orchestra.run.smithi064.stdout:(90/174): rbd-mirror-debuginfo-19.0.0-3291.g994 5.5 MB/s | 53 MB 00:09 2024-04-25T15:39:49.012 INFO:teuthology.orchestra.run.smithi064.stdout:(91/174): postgresql-contrib-13.14-1.el9.x86_64 1.7 MB/s | 911 kB 00:00 2024-04-25T15:39:49.040 INFO:teuthology.orchestra.run.smithi064.stdout:(92/174): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-04-25T15:39:49.282 INFO:teuthology.orchestra.run.smithi064.stdout:(93/174): postgresql-server-13.14-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-04-25T15:39:49.315 INFO:teuthology.orchestra.run.smithi064.stdout:(94/174): protobuf-3.14.0-13.el9.x86_64.rpm 3.7 MB/s | 1.0 MB 00:00 2024-04-25T15:39:49.332 INFO:teuthology.orchestra.run.smithi064.stdout:(95/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.8 MB/s | 87 kB 00:00 2024-04-25T15:39:49.491 INFO:teuthology.orchestra.run.smithi064.stdout:(96/174): python3-babel-2.9.1-2.el9.noarch.rpm 34 MB/s | 6.0 MB 00:00 2024-04-25T15:39:49.516 INFO:teuthology.orchestra.run.smithi064.stdout:(97/174): python3-devel-3.9.18-3.el9.x86_64.rpm 1.3 MB/s | 244 kB 00:00 2024-04-25T15:39:49.541 INFO:teuthology.orchestra.run.smithi064.stdout:(98/174): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-04-25T15:39:49.558 INFO:teuthology.orchestra.run.smithi064.stdout:(99/174): python3-jsonpatch-1.21-16.el9.noarch. 621 kB/s | 26 kB 00:00 2024-04-25T15:39:49.575 INFO:teuthology.orchestra.run.smithi064.stdout:(100/174): python3-jsonpointer-2.0-4.el9.noarch 575 kB/s | 19 kB 00:00 2024-04-25T15:39:49.600 INFO:teuthology.orchestra.run.smithi064.stdout:(101/174): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-04-25T15:39:49.626 INFO:teuthology.orchestra.run.smithi064.stdout:(102/174): python3-markupsafe-1.1.1-12.el9.x86_ 696 kB/s | 35 kB 00:00 2024-04-25T15:39:49.751 INFO:teuthology.orchestra.run.smithi064.stdout:(103/174): python3-numpy-1.20.1-5.el9.x86_64.rp 34 MB/s | 5.1 MB 00:00 2024-04-25T15:39:49.776 INFO:teuthology.orchestra.run.smithi064.stdout:(104/174): python3-numpy-f2py-1.20.1-5.el9.x86_ 1.7 MB/s | 250 kB 00:00 2024-04-25T15:39:49.802 INFO:teuthology.orchestra.run.smithi064.stdout:(105/174): python3-oauthlib-3.1.1-5.el9.noarch. 4.4 MB/s | 222 kB 00:00 2024-04-25T15:39:49.827 INFO:teuthology.orchestra.run.smithi064.stdout:(106/174): python3-packaging-20.9-5.el9.noarch. 1.5 MB/s | 77 kB 00:00 2024-04-25T15:39:49.852 INFO:teuthology.orchestra.run.smithi064.stdout:(107/174): python3-prettytable-0.7.2-27.el9.noa 845 kB/s | 42 kB 00:00 2024-04-25T15:39:49.886 INFO:teuthology.orchestra.run.smithi064.stdout:(108/174): python3-protobuf-3.14.0-13.el9.noarc 4.5 MB/s | 269 kB 00:00 2024-04-25T15:39:49.911 INFO:teuthology.orchestra.run.smithi064.stdout:(109/174): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.7 MB/s | 159 kB 00:00 2024-04-25T15:39:49.936 INFO:teuthology.orchestra.run.smithi064.stdout:(110/174): python3-pyasn1-modules-0.4.8-6.el9.n 5.5 MB/s | 279 kB 00:00 2024-04-25T15:39:49.962 INFO:teuthology.orchestra.run.smithi064.stdout:(111/174): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-25T15:39:49.987 INFO:teuthology.orchestra.run.smithi064.stdout:(112/174): python3-requests-oauthlib-1.3.0-12.e 1.0 MB/s | 54 kB 00:00 2024-04-25T15:39:50.171 INFO:teuthology.orchestra.run.smithi064.stdout:(113/174): python3-toml-0.10.2-6.el9.noarch.rpm 230 kB/s | 42 kB 00:00 2024-04-25T15:39:50.338 INFO:teuthology.orchestra.run.smithi064.stdout:(114/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 43 MB/s | 16 MB 00:00 2024-04-25T15:39:50.363 INFO:teuthology.orchestra.run.smithi064.stdout:(115/174): python3-wcwidth-0.2.5-8.el9.noarch.r 233 kB/s | 44 kB 00:00 2024-04-25T15:39:50.388 INFO:teuthology.orchestra.run.smithi064.stdout:(116/174): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-25T15:39:50.413 INFO:teuthology.orchestra.run.smithi064.stdout:(117/174): qatlib-service-24.02.0-1.el9.x86_64. 720 kB/s | 36 kB 00:00 2024-04-25T15:39:50.438 INFO:teuthology.orchestra.run.smithi064.stdout:(118/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-04-25T15:39:50.464 INFO:teuthology.orchestra.run.smithi064.stdout:(119/174): socat-1.7.4.1-5.el9.x86_64.rpm 6.0 MB/s | 305 kB 00:00 2024-04-25T15:39:50.489 INFO:teuthology.orchestra.run.smithi064.stdout:(120/174): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-25T15:39:50.514 INFO:teuthology.orchestra.run.smithi064.stdout:(121/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-04-25T15:39:50.540 INFO:teuthology.orchestra.run.smithi064.stdout:(122/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-25T15:39:50.573 INFO:teuthology.orchestra.run.smithi064.stdout:(123/174): zlib-devel-1.2.11-41.el9.x86_64.rpm 764 kB/s | 45 kB 00:00 2024-04-25T15:39:50.599 INFO:teuthology.orchestra.run.smithi064.stdout:(124/174): lua-devel-5.4.4-4.el9.x86_64.rpm 380 kB/s | 22 kB 00:00 2024-04-25T15:39:50.641 INFO:teuthology.orchestra.run.smithi064.stdout:(125/174): protobuf-compiler-3.14.0-13.el9.x86_ 13 MB/s | 863 kB 00:00 2024-04-25T15:39:51.524 INFO:teuthology.orchestra.run.smithi064.stdout:(126/174): gperftools-libs-2.9.1-2.el9.x86_64.r 350 kB/s | 309 kB 00:00 2024-04-25T15:39:51.633 INFO:teuthology.orchestra.run.smithi064.stdout:(127/174): grpc-data-1.46.7-10.el9.noarch.rpm 180 kB/s | 19 kB 00:00 2024-04-25T15:39:54.042 INFO:teuthology.orchestra.run.smithi064.stdout:(128/174): ceph-test-debuginfo-19.0.0-3291.g994 7.7 MB/s | 623 MB 01:20 2024-04-25T15:39:54.066 INFO:teuthology.orchestra.run.smithi064.stdout:(129/174): abseil-cpp-20211102.0-3.el9.x86_64.r 158 kB/s | 548 kB 00:03 2024-04-25T15:39:54.225 INFO:teuthology.orchestra.run.smithi064.stdout:(130/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 142 kB/s | 26 kB 00:00 2024-04-25T15:39:54.409 INFO:teuthology.orchestra.run.smithi064.stdout:(131/174): libunwind-1.6.2-1.el9.x86_64.rpm 368 kB/s | 67 kB 00:00 2024-04-25T15:39:54.601 INFO:teuthology.orchestra.run.smithi064.stdout:(132/174): liboath-2.6.7-2.el9.x86_64.rpm 91 kB/s | 49 kB 00:00 2024-04-25T15:39:54.667 INFO:teuthology.orchestra.run.smithi064.stdout:(133/174): luarocks-3.9.2-1.el9.noarch.rpm 584 kB/s | 151 kB 00:00 2024-04-25T15:39:55.409 INFO:teuthology.orchestra.run.smithi064.stdout:(134/174): python3-asyncssh-2.13.2-5.el9.noarch 739 kB/s | 548 kB 00:00 2024-04-25T15:39:55.510 INFO:teuthology.orchestra.run.smithi064.stdout:(135/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 434 kB/s | 43 kB 00:00 2024-04-25T15:39:55.610 INFO:teuthology.orchestra.run.smithi064.stdout:(136/174): python3-cachetools-4.2.4-1.el9.noarc 322 kB/s | 32 kB 00:00 2024-04-25T15:39:55.677 INFO:teuthology.orchestra.run.smithi064.stdout:(137/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 779 kB/s | 838 kB 00:01 2024-04-25T15:39:55.710 INFO:teuthology.orchestra.run.smithi064.stdout:(138/174): python3-certifi-2021.10.8-2.el9.noar 150 kB/s | 15 kB 00:00 2024-04-25T15:39:55.936 INFO:teuthology.orchestra.run.smithi064.stdout:(139/174): python3-cheroot-8.6.0-4.el9.noarch.r 664 kB/s | 172 kB 00:00 2024-04-25T15:39:56.211 INFO:teuthology.orchestra.run.smithi064.stdout:(140/174): python3-cherrypy-18.6.1-2.el9.noarch 717 kB/s | 358 kB 00:00 2024-04-25T15:39:56.303 INFO:teuthology.orchestra.run.smithi064.stdout:(141/174): python3-colorama-0.4.4-12.el9.noarch 385 kB/s | 35 kB 00:00 2024-04-25T15:39:56.353 INFO:teuthology.orchestra.run.smithi064.stdout:(142/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 727 kB/s | 303 kB 00:00 2024-04-25T15:39:56.645 INFO:teuthology.orchestra.run.smithi064.stdout:(143/174): python3-google-auth-2.29.0-1.el9.noa 601 kB/s | 206 kB 00:00 2024-04-25T15:39:56.987 INFO:teuthology.orchestra.run.smithi064.stdout:(144/174): python3-grpcio-tools-1.46.7-10.el9.x 423 kB/s | 144 kB 00:00 2024-04-25T15:39:57.112 INFO:teuthology.orchestra.run.smithi064.stdout:(145/174): python3-jaraco-8.2.1-3.el9.noarch.rp 85 kB/s | 11 kB 00:00 2024-04-25T15:39:57.212 INFO:teuthology.orchestra.run.smithi064.stdout:(146/174): python3-jaraco-classes-3.2.1-5.el9.n 177 kB/s | 18 kB 00:00 2024-04-25T15:39:57.329 INFO:teuthology.orchestra.run.smithi064.stdout:(147/174): python3-jaraco-collections-3.0.0-8.e 198 kB/s | 23 kB 00:00 2024-04-25T15:39:57.471 INFO:teuthology.orchestra.run.smithi064.stdout:(148/174): python3-jaraco-functools-3.5.0-2.el9 137 kB/s | 19 kB 00:00 2024-04-25T15:39:57.655 INFO:teuthology.orchestra.run.smithi064.stdout:(149/174): python3-jaraco-text-3.2.0-6.el9.noar 107 kB/s | 20 kB 00:00 2024-04-25T15:39:58.615 INFO:teuthology.orchestra.run.smithi059.stdout:(174/174): ceph-test-debuginfo-19.0.0-3291.g994 6.3 MB/s | 623 MB 01:38 2024-04-25T15:39:58.622 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-04-25T15:39:58.622 INFO:teuthology.orchestra.run.smithi059.stdout:Total 10 MB/s | 2.1 GB 03:31 2024-04-25T15:39:59.371 INFO:teuthology.orchestra.run.smithi064.stdout:(150/174): libarrow-9.0.0-10.el9.x86_64.rpm 585 kB/s | 4.4 MB 00:07 2024-04-25T15:39:59.480 INFO:teuthology.orchestra.run.smithi064.stdout:(151/174): python3-logutils-0.3.5-21.el9.noarch 428 kB/s | 46 kB 00:00 2024-04-25T15:39:59.664 INFO:teuthology.orchestra.run.smithi064.stdout:(152/174): python3-more-itertools-8.12.0-2.el9. 430 kB/s | 79 kB 00:00 2024-04-25T15:39:59.696 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-04-25T15:39:59.722 INFO:teuthology.orchestra.run.smithi064.stdout:(153/174): python3-kubernetes-26.1.0-2.el9.noar 506 kB/s | 1.0 MB 00:02 2024-04-25T15:39:59.848 INFO:teuthology.orchestra.run.smithi064.stdout:(154/174): python3-natsort-7.1.1-5.el9.noarch.r 314 kB/s | 58 kB 00:00 2024-04-25T15:39:59.862 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-04-25T15:39:59.862 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-04-25T15:39:59.889 INFO:teuthology.orchestra.run.smithi064.stdout:(155/174): python3-grpcio-1.46.7-10.el9.x86_64. 590 kB/s | 2.0 MB 00:03 2024-04-25T15:39:59.948 INFO:teuthology.orchestra.run.smithi064.stdout:(156/174): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-04-25T15:40:00.057 INFO:teuthology.orchestra.run.smithi064.stdout:(157/174): python3-pyperclip-1.8.2-2.el9.noarch 261 kB/s | 28 kB 00:00 2024-04-25T15:40:00.082 INFO:teuthology.orchestra.run.smithi064.stdout:(158/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 468 kB/s | 90 kB 00:00 2024-04-25T15:40:00.157 INFO:teuthology.orchestra.run.smithi064.stdout:(159/174): python3-pecan-1.4.2-3.el9.noarch.rpm 626 kB/s | 272 kB 00:00 2024-04-25T15:40:00.183 INFO:teuthology.orchestra.run.smithi064.stdout:(160/174): python3-repoze-lru-0.7-16.el9.noarch 245 kB/s | 31 kB 00:00 2024-04-25T15:40:00.291 INFO:teuthology.orchestra.run.smithi064.stdout:(161/174): python3-tempora-5.0.0-2.el9.noarch.r 331 kB/s | 36 kB 00:00 2024-04-25T15:40:00.342 INFO:teuthology.orchestra.run.smithi064.stdout:(162/174): python3-rsa-4.9-2.el9.noarch.rpm 322 kB/s | 59 kB 00:00 2024-04-25T15:40:00.392 INFO:teuthology.orchestra.run.smithi064.stdout:(163/174): python3-typing-extensions-4.4.0-2.el 509 kB/s | 51 kB 00:00 2024-04-25T15:40:00.442 INFO:teuthology.orchestra.run.smithi064.stdout:(164/174): python3-routes-2.5.1-5.el9.noarch.rp 525 kB/s | 188 kB 00:00 2024-04-25T15:40:00.567 INFO:teuthology.orchestra.run.smithi064.stdout:(165/174): python3-websocket-client-1.2.3-2.el9 512 kB/s | 90 kB 00:00 2024-04-25T15:40:00.676 INFO:teuthology.orchestra.run.smithi064.stdout:(166/174): python3-zc-lockfile-2.0-10.el9.noarc 184 kB/s | 20 kB 00:00 2024-04-25T15:40:00.709 INFO:teuthology.orchestra.run.smithi064.stdout:(167/174): python3-webob-1.8.7-6.el9.noarch.rpm 625 kB/s | 230 kB 00:00 2024-04-25T15:40:00.943 INFO:teuthology.orchestra.run.smithi064.stdout:(168/174): re2-20211101-3.el9.x86_64.rpm 718 kB/s | 192 kB 00:00 2024-04-25T15:40:01.051 INFO:teuthology.orchestra.run.smithi064.stdout:(169/174): python3-werkzeug-2.0.3-3.el9.1.noarc 701 kB/s | 427 kB 00:00 2024-04-25T15:40:01.327 INFO:teuthology.orchestra.run.smithi064.stdout:(170/174): librbd1-19.0.0-3291.g994e2f20.el9.x8 11 MB/s | 3.1 MB 00:00 2024-04-25T15:40:01.393 INFO:teuthology.orchestra.run.smithi064.stdout:(171/174): openssl-3.2.1-1.el9.x86_64.rpm 20 MB/s | 1.3 MB 00:00 2024-04-25T15:40:01.485 INFO:teuthology.orchestra.run.smithi064.stdout:(172/174): openssl-libs-3.2.1-1.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-04-25T15:40:01.719 INFO:teuthology.orchestra.run.smithi064.stdout:(173/174): librados2-19.0.0-3291.g994e2f20.el9. 4.3 MB/s | 3.3 MB 00:00 2024-04-25T15:40:02.711 INFO:teuthology.orchestra.run.smithi064.stdout:(174/174): thrift-0.15.0-2.el9.x86_64.rpm 809 kB/s | 1.6 MB 00:02 2024-04-25T15:40:02.718 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-04-25T15:40:02.718 INFO:teuthology.orchestra.run.smithi064.stdout:Total 10 MB/s | 2.1 GB 03:35 2024-04-25T15:40:03.801 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-04-25T15:40:03.968 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-04-25T15:40:03.968 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-04-25T15:40:13.669 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-04-25T15:40:13.669 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-04-25T15:40:17.767 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-04-25T15:40:17.767 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-04-25T15:40:32.196 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-04-25T15:40:35.333 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/178 2024-04-25T15:40:35.366 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_6 2/178 2024-04-25T15:40:35.405 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/178 2024-04-25T15:40:35.459 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/178 2024-04-25T15:40:35.493 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/178 2024-04-25T15:40:35.518 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/178 2024-04-25T15:40:35.570 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/178 2024-04-25T15:40:35.922 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/178 2024-04-25T15:40:36.035 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/178 2024-04-25T15:40:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/178 2024-04-25T15:40:36.186 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 10/178 2024-04-25T15:40:36.269 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-04-25T15:40:36.278 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 10/178 2024-04-25T15:40:36.316 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 11/178 2024-04-25T15:40:36.471 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 12/178 2024-04-25T15:40:36.522 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/178 2024-04-25T15:40:36.557 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 14/178 2024-04-25T15:40:36.663 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 14/178 2024-04-25T15:40:36.691 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 15/178 2024-04-25T15:40:36.754 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 15/178 2024-04-25T15:40:36.775 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/178 2024-04-25T15:40:36.802 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/178 2024-04-25T15:40:36.993 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/178 2024-04-25T15:40:37.025 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/178 2024-04-25T15:40:37.135 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : re2-1:20211101-3.el9.x86_64 18/178 2024-04-25T15:40:37.232 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 19/178 2024-04-25T15:40:37.274 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/178 2024-04-25T15:40:37.310 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/178 2024-04-25T15:40:37.385 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/178 2024-04-25T15:40:37.433 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/178 2024-04-25T15:40:37.477 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/178 2024-04-25T15:40:37.510 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/178 2024-04-25T15:40:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/178 2024-04-25T15:40:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/178 2024-04-25T15:40:37.670 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/178 2024-04-25T15:40:37.698 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/178 2024-04-25T15:40:37.742 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/178 2024-04-25T15:40:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/178 2024-04-25T15:40:37.861 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 32/178 2024-04-25T15:40:37.905 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 33/178 2024-04-25T15:40:37.933 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 34/178 2024-04-25T15:40:38.008 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/178 2024-04-25T15:40:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/178 2024-04-25T15:40:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/178 2024-04-25T15:40:38.297 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/178 2024-04-25T15:40:38.361 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/178 2024-04-25T15:40:38.912 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/178 2024-04-25T15:40:38.998 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/178 2024-04-25T15:40:39.033 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/178 2024-04-25T15:40:39.076 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/178 2024-04-25T15:40:39.114 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 44/178 2024-04-25T15:40:39.156 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/178 2024-04-25T15:40:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/178 2024-04-25T15:40:39.400 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/178 2024-04-25T15:40:39.411 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/178 2024-04-25T15:40:39.456 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/178 2024-04-25T15:40:39.470 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_6 2/178 2024-04-25T15:40:39.509 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/178 2024-04-25T15:40:39.531 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/178 2024-04-25T15:40:39.563 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/178 2024-04-25T15:40:39.575 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/178 2024-04-25T15:40:39.605 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/178 2024-04-25T15:40:39.629 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/178 2024-04-25T15:40:39.630 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/178 2024-04-25T15:40:39.665 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/178 2024-04-25T15:40:39.677 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/178 2024-04-25T15:40:39.712 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/178 2024-04-25T15:40:39.763 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 54/178 2024-04-25T15:40:39.805 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 55/178 2024-04-25T15:40:39.967 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 56/178 2024-04-25T15:40:40.011 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 57/178 2024-04-25T15:40:40.017 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/178 2024-04-25T15:40:40.041 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 58/178 2024-04-25T15:40:40.083 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 59/178 2024-04-25T15:40:40.122 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/178 2024-04-25T15:40:40.182 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 60/178 2024-04-25T15:40:40.224 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 61/178 2024-04-25T15:40:40.250 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/178 2024-04-25T15:40:40.264 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 62/178 2024-04-25T15:40:40.289 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 63/178 2024-04-25T15:40:40.290 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 10/178 2024-04-25T15:40:40.314 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 64/178 2024-04-25T15:40:40.382 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 10/178 2024-04-25T15:40:40.392 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 65/178 2024-04-25T15:40:40.411 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 11/178 2024-04-25T15:40:40.521 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 66/178 2024-04-25T15:40:40.555 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 67/178 2024-04-25T15:40:40.567 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 12/178 2024-04-25T15:40:40.583 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 68/178 2024-04-25T15:40:40.617 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 69/178 2024-04-25T15:40:40.634 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/178 2024-04-25T15:40:40.657 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : uuid-1.6.2-55.el9.x86_64 70/178 2024-04-25T15:40:40.661 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 14/178 2024-04-25T15:40:40.696 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 71/178 2024-04-25T15:40:40.734 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 72/178 2024-04-25T15:40:40.767 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 14/178 2024-04-25T15:40:40.777 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 73/178 2024-04-25T15:40:40.795 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 15/178 2024-04-25T15:40:40.810 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/178 2024-04-25T15:40:40.841 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 15/178 2024-04-25T15:40:40.852 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/178 2024-04-25T15:40:40.863 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/178 2024-04-25T15:40:40.882 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/178 2024-04-25T15:40:40.886 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/178 2024-04-25T15:40:40.977 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/178 2024-04-25T15:40:41.026 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 78/178 2024-04-25T15:40:41.056 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 79/178 2024-04-25T15:40:41.080 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/178 2024-04-25T15:40:41.105 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 80/178 2024-04-25T15:40:41.113 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/178 2024-04-25T15:40:41.216 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-packaging-20.9-5.el9.noarch 81/178 2024-04-25T15:40:41.223 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : re2-1:20211101-3.el9.x86_64 18/178 2024-04-25T15:40:41.276 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/178 2024-04-25T15:40:41.319 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 19/178 2024-04-25T15:40:41.353 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/178 2024-04-25T15:40:41.389 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/178 2024-04-25T15:40:41.464 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/178 2024-04-25T15:40:41.504 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/178 2024-04-25T15:40:41.548 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/178 2024-04-25T15:40:41.580 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/178 2024-04-25T15:40:41.607 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/178 2024-04-25T15:40:41.687 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/178 2024-04-25T15:40:41.739 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/178 2024-04-25T15:40:41.769 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/178 2024-04-25T15:40:41.821 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/178 2024-04-25T15:40:41.899 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/178 2024-04-25T15:40:41.940 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 32/178 2024-04-25T15:40:41.984 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 33/178 2024-04-25T15:40:42.012 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 34/178 2024-04-25T15:40:42.038 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/178 2024-04-25T15:40:42.079 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/178 2024-04-25T15:40:42.085 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/178 2024-04-25T15:40:42.113 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/178 2024-04-25T15:40:42.127 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/178 2024-04-25T15:40:42.204 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/178 2024-04-25T15:40:42.216 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/178 2024-04-25T15:40:42.273 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 87/178 2024-04-25T15:40:42.341 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/178 2024-04-25T15:40:42.371 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 88/178 2024-04-25T15:40:42.397 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/178 2024-04-25T15:40:42.407 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 89/178 2024-04-25T15:40:42.590 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-0.3.21-2.el9.x86_64 90/178 2024-04-25T15:40:42.621 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 91/178 2024-04-25T15:40:42.701 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 92/178 2024-04-25T15:40:42.952 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/178 2024-04-25T15:40:43.034 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/178 2024-04-25T15:40:43.070 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/178 2024-04-25T15:40:43.113 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/178 2024-04-25T15:40:43.151 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 44/178 2024-04-25T15:40:43.210 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/178 2024-04-25T15:40:43.375 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/178 2024-04-25T15:40:43.386 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 93/178 2024-04-25T15:40:43.429 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/178 2024-04-25T15:40:43.485 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/178 2024-04-25T15:40:43.515 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 94/178 2024-04-25T15:40:43.559 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/178 2024-04-25T15:40:43.596 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/178 2024-04-25T15:40:43.632 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/178 2024-04-25T15:40:43.680 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/178 2024-04-25T15:40:43.715 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/178 2024-04-25T15:40:43.758 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 54/178 2024-04-25T15:40:43.801 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 55/178 2024-04-25T15:40:43.946 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 56/178 2024-04-25T15:40:43.989 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 57/178 2024-04-25T15:40:44.019 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 58/178 2024-04-25T15:40:44.061 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 59/178 2024-04-25T15:40:44.158 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 60/178 2024-04-25T15:40:44.194 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 61/178 2024-04-25T15:40:44.234 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 62/178 2024-04-25T15:40:44.259 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 63/178 2024-04-25T15:40:44.284 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 64/178 2024-04-25T15:40:44.362 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 65/178 2024-04-25T15:40:44.491 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 66/178 2024-04-25T15:40:44.524 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 67/178 2024-04-25T15:40:44.553 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 68/178 2024-04-25T15:40:44.587 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 69/178 2024-04-25T15:40:44.626 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : uuid-1.6.2-55.el9.x86_64 70/178 2024-04-25T15:40:44.666 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 71/178 2024-04-25T15:40:44.695 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 72/178 2024-04-25T15:40:44.730 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 73/178 2024-04-25T15:40:44.763 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/178 2024-04-25T15:40:44.805 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/178 2024-04-25T15:40:44.817 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/178 2024-04-25T15:40:44.839 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/178 2024-04-25T15:40:44.908 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 96/178 2024-04-25T15:40:44.929 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/178 2024-04-25T15:40:44.956 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 97/178 2024-04-25T15:40:44.978 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 78/178 2024-04-25T15:40:44.986 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 98/178 2024-04-25T15:40:45.009 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 79/178 2024-04-25T15:40:45.057 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 80/178 2024-04-25T15:40:45.160 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-packaging-20.9-5.el9.noarch 81/178 2024-04-25T15:40:45.212 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/178 2024-04-25T15:40:45.323 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 99/178 2024-04-25T15:40:45.365 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 100/178 2024-04-25T15:40:45.457 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 100/178 2024-04-25T15:40:45.487 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 101/178 2024-04-25T15:40:45.523 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 102/178 2024-04-25T15:40:45.983 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/178 2024-04-25T15:40:46.032 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/178 2024-04-25T15:40:46.038 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 103/178 2024-04-25T15:40:46.066 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/178 2024-04-25T15:40:46.068 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 104/178 2024-04-25T15:40:46.123 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 104/178 2024-04-25T15:40:46.153 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 105/178 2024-04-25T15:40:46.169 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/178 2024-04-25T15:40:46.233 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 87/178 2024-04-25T15:40:46.332 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 88/178 2024-04-25T15:40:46.368 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 89/178 2024-04-25T15:40:46.553 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openblas-0.3.21-2.el9.x86_64 90/178 2024-04-25T15:40:46.582 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 91/178 2024-04-25T15:40:46.662 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 92/178 2024-04-25T15:40:47.347 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 93/178 2024-04-25T15:40:47.467 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 94/178 2024-04-25T15:40:48.503 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 106/178 2024-04-25T15:40:48.541 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 106/178 2024-04-25T15:40:48.767 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/178 2024-04-25T15:40:48.860 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 96/178 2024-04-25T15:40:48.889 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 97/178 2024-04-25T15:40:48.922 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 98/178 2024-04-25T15:40:49.127 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 106/178 2024-04-25T15:40:49.178 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 107/178 2024-04-25T15:40:49.259 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 99/178 2024-04-25T15:40:49.269 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 107/178 2024-04-25T15:40:49.269 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T15:40:49.269 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T15:40:49.269 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:40:49.296 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 108/178 2024-04-25T15:40:49.309 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 100/178 2024-04-25T15:40:49.400 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 100/178 2024-04-25T15:40:49.430 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 101/178 2024-04-25T15:40:49.467 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 102/178 2024-04-25T15:40:49.982 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 103/178 2024-04-25T15:40:50.012 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 104/178 2024-04-25T15:40:50.075 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 104/178 2024-04-25T15:40:50.105 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 105/178 2024-04-25T15:40:52.450 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 106/178 2024-04-25T15:40:52.484 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 106/178 2024-04-25T15:40:53.071 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 106/178 2024-04-25T15:40:53.113 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 107/178 2024-04-25T15:40:53.207 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 107/178 2024-04-25T15:40:53.207 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T15:40:53.208 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T15:40:53.208 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:40:53.247 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 108/178 2024-04-25T15:41:02.377 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 108/178 2024-04-25T15:41:02.377 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /sys 2024-04-25T15:41:02.377 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /proc 2024-04-25T15:41:02.377 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /mnt 2024-04-25T15:41:02.377 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /var/tmp 2024-04-25T15:41:02.377 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /home 2024-04-25T15:41:02.377 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /root 2024-04-25T15:41:02.377 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /tmp 2024-04-25T15:41:02.377 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:41:02.616 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 109/178 2024-04-25T15:41:02.632 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 109/178 2024-04-25T15:41:02.632 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:02.632 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T15:41:02.632 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:41:04.294 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 110/178 2024-04-25T15:41:04.321 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 110/178 2024-04-25T15:41:04.321 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:04.321 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T15:41:04.321 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T15:41:04.321 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T15:41:04.321 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:41:04.561 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 111/178 2024-04-25T15:41:04.585 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 111/178 2024-04-25T15:41:04.585 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:04.585 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T15:41:04.585 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T15:41:04.585 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T15:41:04.585 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:41:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 112/178 2024-04-25T15:41:05.093 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 112/178 2024-04-25T15:41:05.094 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:05.094 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T15:41:05.094 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T15:41:05.094 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T15:41:05.094 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:41:05.201 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : automake-1.16.2-8.el9.noarch 113/178 2024-04-25T15:41:05.260 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ply-3.11-14.el9.noarch 114/178 2024-04-25T15:41:05.331 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 115/178 2024-04-25T15:41:05.528 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 116/178 2024-04-25T15:41:05.580 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 117/178 2024-04-25T15:41:05.661 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 118/178 2024-04-25T15:41:05.751 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 119/178 2024-04-25T15:41:05.904 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 120/178 2024-04-25T15:41:05.947 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 121/178 2024-04-25T15:41:05.979 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 122/178 2024-04-25T15:41:06.006 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fuse-2.9.9-15.el9.x86_64 123/178 2024-04-25T15:41:06.412 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 124/178 2024-04-25T15:41:06.439 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 124/178 2024-04-25T15:41:06.471 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 125/178 2024-04-25T15:41:06.544 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 126/178 2024-04-25T15:41:06.569 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 127/178 2024-04-25T15:41:06.859 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 108/178 2024-04-25T15:41:06.860 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /sys 2024-04-25T15:41:06.860 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /proc 2024-04-25T15:41:06.860 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /mnt 2024-04-25T15:41:06.860 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /var/tmp 2024-04-25T15:41:06.860 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /home 2024-04-25T15:41:06.860 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /root 2024-04-25T15:41:06.860 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /tmp 2024-04-25T15:41:06.860 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:41:07.033 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 109/178 2024-04-25T15:41:07.049 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 109/178 2024-04-25T15:41:07.050 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:07.050 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T15:41:07.050 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:41:07.665 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 127/178 2024-04-25T15:41:07.705 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 128/178 2024-04-25T15:41:08.687 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 110/178 2024-04-25T15:41:08.713 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 110/178 2024-04-25T15:41:08.713 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:08.713 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T15:41:08.713 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T15:41:08.713 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T15:41:08.713 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:41:08.717 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 128/178 2024-04-25T15:41:08.738 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 129/178 2024-04-25T15:41:08.847 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 129/178 2024-04-25T15:41:08.945 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 111/178 2024-04-25T15:41:08.968 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 111/178 2024-04-25T15:41:08.969 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:08.969 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T15:41:08.969 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T15:41:08.969 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T15:41:08.969 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:41:09.020 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 130/178 2024-04-25T15:41:09.065 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 131/178 2024-04-25T15:41:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 131/178 2024-04-25T15:41:09.089 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:09.089 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T15:41:09.089 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T15:41:09.089 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T15:41:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:41:09.150 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 132/178 2024-04-25T15:41:09.160 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 132/178 2024-04-25T15:41:09.263 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 133/178 2024-04-25T15:41:09.316 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 134/178 2024-04-25T15:41:09.454 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 112/178 2024-04-25T15:41:09.477 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 112/178 2024-04-25T15:41:09.478 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:09.478 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T15:41:09.478 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T15:41:09.478 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T15:41:09.478 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:41:09.585 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : automake-1.16.2-8.el9.noarch 113/178 2024-04-25T15:41:09.643 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ply-3.11-14.el9.noarch 114/178 2024-04-25T15:41:09.715 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 115/178 2024-04-25T15:41:09.911 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 116/178 2024-04-25T15:41:09.964 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 117/178 2024-04-25T15:41:10.045 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 118/178 2024-04-25T15:41:10.142 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 119/178 2024-04-25T15:41:10.285 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 120/178 2024-04-25T15:41:10.301 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libtool-2.4.6-45.el9.x86_64 135/178 2024-04-25T15:41:10.322 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 121/178 2024-04-25T15:41:10.335 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 136/178 2024-04-25T15:41:10.354 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 122/178 2024-04-25T15:41:10.358 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 136/178 2024-04-25T15:41:10.359 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:10.359 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T15:41:10.359 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:41:10.359 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:41:10.359 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:41:10.381 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : fuse-2.9.9-15.el9.x86_64 123/178 2024-04-25T15:41:10.403 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 137/178 2024-04-25T15:41:10.425 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 137/178 2024-04-25T15:41:10.425 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:10.425 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T15:41:10.425 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:41:10.470 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/178 2024-04-25T15:41:10.493 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/178 2024-04-25T15:41:10.493 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:10.493 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T15:41:10.493 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:41:10.493 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:41:10.493 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:41:10.793 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 124/178 2024-04-25T15:41:10.821 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 124/178 2024-04-25T15:41:10.829 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 139/178 2024-04-25T15:41:10.852 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 139/178 2024-04-25T15:41:10.852 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:10.853 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T15:41:10.853 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T15:41:10.853 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T15:41:10.853 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:41:10.854 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 125/178 2024-04-25T15:41:10.918 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 126/178 2024-04-25T15:41:10.944 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 127/178 2024-04-25T15:41:12.041 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 127/178 2024-04-25T15:41:12.079 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 128/178 2024-04-25T15:41:13.096 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 128/178 2024-04-25T15:41:13.121 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 129/178 2024-04-25T15:41:13.229 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 129/178 2024-04-25T15:41:13.404 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 130/178 2024-04-25T15:41:13.440 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 131/178 2024-04-25T15:41:13.464 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 131/178 2024-04-25T15:41:13.464 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:13.464 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T15:41:13.464 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T15:41:13.464 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T15:41:13.464 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:41:13.515 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 132/178 2024-04-25T15:41:13.526 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 132/178 2024-04-25T15:41:13.629 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 133/178 2024-04-25T15:41:13.690 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 134/178 2024-04-25T15:41:14.679 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libtool-2.4.6-45.el9.x86_64 135/178 2024-04-25T15:41:14.710 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 136/178 2024-04-25T15:41:14.733 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 136/178 2024-04-25T15:41:14.733 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:14.733 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T15:41:14.734 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:41:14.734 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:41:14.734 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:41:14.777 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 137/178 2024-04-25T15:41:14.799 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 137/178 2024-04-25T15:41:14.800 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:14.800 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T15:41:14.800 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:41:14.844 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/178 2024-04-25T15:41:14.867 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/178 2024-04-25T15:41:14.867 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:14.867 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T15:41:14.867 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:41:14.867 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:41:14.867 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:41:15.195 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 139/178 2024-04-25T15:41:15.218 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 139/178 2024-04-25T15:41:15.218 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:41:15.218 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T15:41:15.219 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T15:41:15.219 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T15:41:15.219 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:41:15.358 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 140/178 2024-04-25T15:41:15.400 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 141/178 2024-04-25T15:41:15.440 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 142/178 2024-04-25T15:41:15.472 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 143/178 2024-04-25T15:41:15.499 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 144/178 2024-04-25T15:41:15.692 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 145/178 2024-04-25T15:41:15.737 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 146/178 2024-04-25T15:41:15.767 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 147/178 2024-04-25T15:41:16.392 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 148/178 2024-04-25T15:41:16.431 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 148/178 2024-04-25T15:41:16.451 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 148/178 2024-04-25T15:41:19.799 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 140/178 2024-04-25T15:41:19.841 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 141/178 2024-04-25T15:41:19.881 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 142/178 2024-04-25T15:41:19.913 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 143/178 2024-04-25T15:41:19.940 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 144/178 2024-04-25T15:41:20.139 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 145/178 2024-04-25T15:41:20.186 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 146/178 2024-04-25T15:41:20.216 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 147/178 2024-04-25T15:41:20.836 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 148/178 2024-04-25T15:41:20.871 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 148/178 2024-04-25T15:41:20.891 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 148/178 2024-04-25T15:41:24.193 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 149/178 2024-04-25T15:41:28.605 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 149/178 2024-04-25T15:42:08.226 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-base-debuginfo-2:19.0.0-3291.g994e2f20.el9. 150/178 2024-04-25T15:42:09.010 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-common-debuginfo-2:19.0.0-3291.g994e2f20.el 151/178 2024-04-25T15:42:09.194 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-3291.g994e2f20.el9. 152/178 2024-04-25T15:42:12.675 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-base-debuginfo-2:19.0.0-3291.g994e2f20.el9. 150/178 2024-04-25T15:42:13.372 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-common-debuginfo-2:19.0.0-3291.g994e2f20.el 151/178 2024-04-25T15:42:13.786 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-3291.g994e2f20.el9. 152/178 2024-04-25T15:42:13.974 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-3 153/178 2024-04-25T15:42:16.774 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 154/178 2024-04-25T15:42:18.594 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-3 153/178 2024-04-25T15:42:21.091 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 154/178 2024-04-25T15:42:27.246 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 155/178 2024-04-25T15:42:31.902 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 155/178 2024-04-25T15:42:56.614 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 156/178 2024-04-25T15:43:01.341 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 156/178 2024-04-25T15:43:18.053 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 157/178 2024-04-25T15:43:22.657 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 157/178 2024-04-25T15:44:28.498 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-3291.g994e2f20.e 158/178 2024-04-25T15:44:29.106 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-test-debuginfo-2:19.0.0-3291.g994e2f20.el9. 159/178 2024-04-25T15:44:29.142 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-3291.g994e2f20.el9 160/178 2024-04-25T15:44:33.218 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-3291.g994e2f20.e 158/178 2024-04-25T15:44:33.838 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-test-debuginfo-2:19.0.0-3291.g994e2f20.el9. 159/178 2024-04-25T15:44:33.879 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-3291.g994e2f20.el9 160/178 2024-04-25T15:44:34.522 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librados-devel-debuginfo-2:19.0.0-3291.g994e2f20 161/178 2024-04-25T15:44:39.287 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librados-devel-debuginfo-2:19.0.0-3291.g994e2f20 161/178 2024-04-25T15:44:40.846 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librados2-debuginfo-2:19.0.0-3291.g994e2f20.el9. 162/178 2024-04-25T15:44:41.151 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librbd1-debuginfo-2:19.0.0-3291.g994e2f20.el9.x8 163/178 2024-04-25T15:44:41.467 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-3291.g994e2f20 164/178 2024-04-25T15:44:41.922 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rados-debuginfo-2:19.0.0-3291.g994e2f20. 165/178 2024-04-25T15:44:42.175 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-3291.g994e2f20.el 166/178 2024-04-25T15:44:42.459 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-3291.g994e2f20.el 167/178 2024-04-25T15:44:45.841 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librados2-debuginfo-2:19.0.0-3291.g994e2f20.el9. 162/178 2024-04-25T15:44:46.113 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librbd1-debuginfo-2:19.0.0-3291.g994e2f20.el9.x8 163/178 2024-04-25T15:44:46.397 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-3291.g994e2f20 164/178 2024-04-25T15:44:46.794 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rados-debuginfo-2:19.0.0-3291.g994e2f20. 165/178 2024-04-25T15:44:47.129 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-3291.g994e2f20.el 166/178 2024-04-25T15:44:47.455 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-3291.g994e2f20.el 167/178 2024-04-25T15:44:48.639 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 168/178 2024-04-25T15:44:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-3291.g994e2f20.el9 169/178 2024-04-25T15:44:50.211 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-3291.g994e2f20.el9.x8 170/178 2024-04-25T15:44:50.473 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 171/178 2024-04-25T15:44:50.776 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/178 2024-04-25T15:44:51.073 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/178 2024-04-25T15:44:51.353 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/178 2024-04-25T15:44:51.353 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 175/178 2024-04-25T15:44:51.945 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 175/178 2024-04-25T15:44:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 176/178 2024-04-25T15:44:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/178 2024-04-25T15:44:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/178 2024-04-25T15:44:52.141 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 178/178 2024-04-25T15:44:53.813 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 168/178 2024-04-25T15:44:54.069 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-3291.g994e2f20.el9 169/178 2024-04-25T15:44:55.214 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-3291.g994e2f20.el9.x8 170/178 2024-04-25T15:44:55.438 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 171/178 2024-04-25T15:44:55.758 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/178 2024-04-25T15:44:56.071 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/178 2024-04-25T15:44:56.342 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/178 2024-04-25T15:44:56.342 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 175/178 2024-04-25T15:44:57.259 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 175/178 2024-04-25T15:44:57.503 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 176/178 2024-04-25T15:44:57.503 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/178 2024-04-25T15:44:57.601 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/178 2024-04-25T15:44:57.672 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 178/178 2024-04-25T15:45:00.999 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 178/178 2024-04-25T15:45:01.000 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/178 2024-04-25T15:45:01.000 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/178 2024-04-25T15:45:01.000 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-3291.g994e2f20.el9. 3/178 2024-04-25T15:45:01.000 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 4/178 2024-04-25T15:45:01.000 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-3291.g994e2f20.el 5/178 2024-04-25T15:45:01.000 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_6 6/178 2024-04-25T15:45:01.000 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 7/178 2024-04-25T15:45:01.000 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-3291.g994e2f20.el9. 8/178 2024-04-25T15:45:01.000 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 9/178 2024-04-25T15:45:01.000 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-3 10/178 2024-04-25T15:45:01.000 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 11/178 2024-04-25T15:45:01.000 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 12/178 2024-04-25T15:45:01.001 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 13/178 2024-04-25T15:45:01.001 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 14/178 2024-04-25T15:45:01.001 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 15/178 2024-04-25T15:45:01.001 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 16/178 2024-04-25T15:45:01.001 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 17/178 2024-04-25T15:45:01.001 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 18/178 2024-04-25T15:45:01.001 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 19/178 2024-04-25T15:45:01.001 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-3291.g994e2f20.e 20/178 2024-04-25T15:45:01.001 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 21/178 2024-04-25T15:45:01.001 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 22/178 2024-04-25T15:45:01.001 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-3291.g994e2f20.el9. 23/178 2024-04-25T15:45:01.001 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 24/178 2024-04-25T15:45:01.001 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 25/178 2024-04-25T15:45:01.001 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 26/178 2024-04-25T15:45:01.002 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 27/178 2024-04-25T15:45:01.002 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-3291.g994e2f20.el9 28/178 2024-04-25T15:45:01.002 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 29/178 2024-04-25T15:45:01.002 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 30/178 2024-04-25T15:45:01.002 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-3291.g994e2f20 31/178 2024-04-25T15:45:01.002 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-debuginfo-2:19.0.0-3291.g994e2f20.el9. 32/178 2024-04-25T15:45:01.002 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 33/178 2024-04-25T15:45:01.002 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-debuginfo-2:19.0.0-3291.g994e2f20.el9.x8 34/178 2024-04-25T15:45:01.002 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 35/178 2024-04-25T15:45:01.002 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 36/178 2024-04-25T15:45:01.002 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 37/178 2024-04-25T15:45:01.002 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 38/178 2024-04-25T15:45:01.002 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-3291.g994e2f20 39/178 2024-04-25T15:45:01.003 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 40/178 2024-04-25T15:45:01.003 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-3291.g994e2f20. 41/178 2024-04-25T15:45:01.003 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 42/178 2024-04-25T15:45:01.003 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-3291.g994e2f20.el 43/178 2024-04-25T15:45:01.003 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 44/178 2024-04-25T15:45:01.003 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-3291.g994e2f20.el 45/178 2024-04-25T15:45:01.003 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 46/178 2024-04-25T15:45:01.003 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 47/178 2024-04-25T15:45:01.003 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 48/178 2024-04-25T15:45:01.003 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-3291.g994e2f20.el9 49/178 2024-04-25T15:45:01.003 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 50/178 2024-04-25T15:45:01.003 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-3291.g994e2f20.el9.x8 51/178 2024-04-25T15:45:01.003 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 52/178 2024-04-25T15:45:01.003 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 53/178 2024-04-25T15:45:01.004 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 54/178 2024-04-25T15:45:01.004 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 55/178 2024-04-25T15:45:01.004 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 56/178 2024-04-25T15:45:01.004 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 57/178 2024-04-25T15:45:01.004 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 58/178 2024-04-25T15:45:01.004 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 59/178 2024-04-25T15:45:01.004 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 60/178 2024-04-25T15:45:01.004 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 61/178 2024-04-25T15:45:01.004 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 62/178 2024-04-25T15:45:01.004 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 63/178 2024-04-25T15:45:01.004 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 64/178 2024-04-25T15:45:01.004 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 65/178 2024-04-25T15:45:01.004 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 66/178 2024-04-25T15:45:01.005 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ply-3.11-14.el9.noarch 67/178 2024-04-25T15:45:01.005 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 68/178 2024-04-25T15:45:01.005 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 69/178 2024-04-25T15:45:01.005 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 70/178 2024-04-25T15:45:01.005 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : automake-1.16.2-8.el9.noarch 71/178 2024-04-25T15:45:01.005 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : bison-3.7.4-5.el9.x86_64 72/178 2024-04-25T15:45:01.005 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 73/178 2024-04-25T15:45:01.005 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 74/178 2024-04-25T15:45:01.005 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flex-2.6.4-9.el9.x86_64 75/178 2024-04-25T15:45:01.005 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 76/178 2024-04-25T15:45:01.005 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 77/178 2024-04-25T15:45:01.005 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 78/178 2024-04-25T15:45:01.005 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 79/178 2024-04-25T15:45:01.005 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 80/178 2024-04-25T15:45:01.006 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 81/178 2024-04-25T15:45:01.006 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 82/178 2024-04-25T15:45:01.006 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 83/178 2024-04-25T15:45:01.006 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 84/178 2024-04-25T15:45:01.006 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 85/178 2024-04-25T15:45:01.006 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 86/178 2024-04-25T15:45:01.006 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lua-5.4.4-4.el9.x86_64 87/178 2024-04-25T15:45:01.006 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 88/178 2024-04-25T15:45:01.006 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 89/178 2024-04-25T15:45:01.006 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 90/178 2024-04-25T15:45:01.006 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-13.14-1.el9.x86_64 91/178 2024-04-25T15:45:01.006 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 92/178 2024-04-25T15:45:01.006 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 93/178 2024-04-25T15:45:01.006 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 94/178 2024-04-25T15:45:01.007 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 95/178 2024-04-25T15:45:01.007 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 96/178 2024-04-25T15:45:01.007 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 97/178 2024-04-25T15:45:01.007 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 98/178 2024-04-25T15:45:01.007 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 99/178 2024-04-25T15:45:01.007 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 100/178 2024-04-25T15:45:01.007 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 101/178 2024-04-25T15:45:01.007 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 102/178 2024-04-25T15:45:01.007 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 103/178 2024-04-25T15:45:01.007 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 104/178 2024-04-25T15:45:01.007 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 105/178 2024-04-25T15:45:01.007 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 106/178 2024-04-25T15:45:01.007 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 107/178 2024-04-25T15:45:01.007 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 108/178 2024-04-25T15:45:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 109/178 2024-04-25T15:45:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 110/178 2024-04-25T15:45:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 111/178 2024-04-25T15:45:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 112/178 2024-04-25T15:45:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 113/178 2024-04-25T15:45:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 114/178 2024-04-25T15:45:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 115/178 2024-04-25T15:45:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 116/178 2024-04-25T15:45:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 117/178 2024-04-25T15:45:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 118/178 2024-04-25T15:45:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 119/178 2024-04-25T15:45:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 120/178 2024-04-25T15:45:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 121/178 2024-04-25T15:45:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 122/178 2024-04-25T15:45:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 123/178 2024-04-25T15:45:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 124/178 2024-04-25T15:45:01.009 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 125/178 2024-04-25T15:45:01.009 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 126/178 2024-04-25T15:45:01.009 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 127/178 2024-04-25T15:45:01.009 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 128/178 2024-04-25T15:45:01.009 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 129/178 2024-04-25T15:45:01.009 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 130/178 2024-04-25T15:45:01.009 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 131/178 2024-04-25T15:45:01.009 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 132/178 2024-04-25T15:45:01.009 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 133/178 2024-04-25T15:45:01.009 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 134/178 2024-04-25T15:45:01.009 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 135/178 2024-04-25T15:45:01.009 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 136/178 2024-04-25T15:45:01.009 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 137/178 2024-04-25T15:45:01.009 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 138/178 2024-04-25T15:45:01.009 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 139/178 2024-04-25T15:45:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 140/178 2024-04-25T15:45:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 141/178 2024-04-25T15:45:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 142/178 2024-04-25T15:45:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 143/178 2024-04-25T15:45:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 144/178 2024-04-25T15:45:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 145/178 2024-04-25T15:45:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 146/178 2024-04-25T15:45:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 147/178 2024-04-25T15:45:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 148/178 2024-04-25T15:45:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 149/178 2024-04-25T15:45:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 150/178 2024-04-25T15:45:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 151/178 2024-04-25T15:45:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 152/178 2024-04-25T15:45:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 153/178 2024-04-25T15:45:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 154/178 2024-04-25T15:45:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 155/178 2024-04-25T15:45:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 156/178 2024-04-25T15:45:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 157/178 2024-04-25T15:45:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 158/178 2024-04-25T15:45:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 159/178 2024-04-25T15:45:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 160/178 2024-04-25T15:45:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 161/178 2024-04-25T15:45:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 162/178 2024-04-25T15:45:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 163/178 2024-04-25T15:45:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 164/178 2024-04-25T15:45:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 165/178 2024-04-25T15:45:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 166/178 2024-04-25T15:45:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 167/178 2024-04-25T15:45:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 168/178 2024-04-25T15:45:01.011 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : re2-1:20211101-3.el9.x86_64 169/178 2024-04-25T15:45:01.012 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 170/178 2024-04-25T15:45:01.012 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 171/178 2024-04-25T15:45:01.012 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 172/178 2024-04-25T15:45:01.012 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 173/178 2024-04-25T15:45:01.012 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 174/178 2024-04-25T15:45:01.012 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 175/178 2024-04-25T15:45:01.012 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 176/178 2024-04-25T15:45:01.012 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 177/178 2024-04-25T15:45:03.353 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 178/178 2024-04-25T15:45:03.353 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:03.353 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2024-04-25T15:45:03.353 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.353 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.353 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T15:45:03.353 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T15:45:03.353 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-04-25T15:45:03.354 INFO:teuthology.orchestra.run.smithi059.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T15:45:03.354 INFO:teuthology.orchestra.run.smithi059.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T15:45:03.354 INFO:teuthology.orchestra.run.smithi059.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T15:45:03.354 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T15:45:03.354 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.354 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.354 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.354 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.354 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.354 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.354 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.354 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.354 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:03.355 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.355 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.355 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.355 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.355 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.355 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:03.355 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:03.355 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.355 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:03.355 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:03.355 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:03.355 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.355 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.355 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.356 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.356 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:03.356 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.356 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.356 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.356 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.356 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.356 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:03.356 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:03.356 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.356 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.356 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:03.356 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T15:45:03.356 INFO:teuthology.orchestra.run.smithi059.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T15:45:03.356 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T15:45:03.357 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T15:45:03.357 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T15:45:03.357 INFO:teuthology.orchestra.run.smithi059.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T15:45:03.357 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T15:45:03.357 INFO:teuthology.orchestra.run.smithi059.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T15:45:03.357 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T15:45:03.357 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T15:45:03.357 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T15:45:03.357 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.357 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.357 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.357 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.357 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T15:45:03.357 INFO:teuthology.orchestra.run.smithi059.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T15:45:03.358 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T15:45:03.358 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T15:45:03.358 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T15:45:03.358 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.358 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.358 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.358 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.358 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.358 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T15:45:03.358 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.358 INFO:teuthology.orchestra.run.smithi059.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T15:45:03.358 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T15:45:03.358 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T15:45:03.359 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T15:45:03.359 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T15:45:03.359 INFO:teuthology.orchestra.run.smithi059.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T15:45:03.359 INFO:teuthology.orchestra.run.smithi059.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T15:45:03.359 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T15:45:03.359 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T15:45:03.359 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T15:45:03.359 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T15:45:03.359 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T15:45:03.359 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T15:45:03.359 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T15:45:03.360 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T15:45:03.360 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T15:45:03.360 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T15:45:03.360 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T15:45:03.360 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T15:45:03.360 INFO:teuthology.orchestra.run.smithi059.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T15:45:03.360 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T15:45:03.360 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T15:45:03.360 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T15:45:03.360 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.360 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.360 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.361 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.361 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T15:45:03.361 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T15:45:03.361 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T15:45:03.361 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T15:45:03.361 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T15:45:03.361 INFO:teuthology.orchestra.run.smithi059.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T15:45:03.361 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T15:45:03.361 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T15:45:03.361 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T15:45:03.361 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T15:45:03.361 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T15:45:03.361 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T15:45:03.362 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T15:45:03.362 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T15:45:03.362 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T15:45:03.362 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T15:45:03.362 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T15:45:03.362 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T15:45:03.362 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T15:45:03.362 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T15:45:03.362 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T15:45:03.362 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T15:45:03.362 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T15:45:03.362 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T15:45:03.362 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T15:45:03.363 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T15:45:03.363 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T15:45:03.363 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T15:45:03.363 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T15:45:03.363 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T15:45:03.363 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T15:45:03.363 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T15:45:03.363 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T15:45:03.363 INFO:teuthology.orchestra.run.smithi059.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T15:45:03.363 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T15:45:03.363 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T15:45:03.363 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T15:45:03.363 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T15:45:03.363 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T15:45:03.364 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T15:45:03.364 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.364 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.364 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.364 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.364 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T15:45:03.364 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T15:45:03.364 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T15:45:03.364 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.364 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.364 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T15:45:03.364 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T15:45:03.364 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T15:45:03.364 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T15:45:03.365 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T15:45:03.365 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T15:45:03.365 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T15:45:03.365 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T15:45:03.365 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T15:45:03.365 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T15:45:03.365 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T15:45:03.365 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T15:45:03.365 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T15:45:03.365 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T15:45:03.365 INFO:teuthology.orchestra.run.smithi059.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T15:45:03.365 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.365 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.366 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.366 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.366 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.366 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:03.366 INFO:teuthology.orchestra.run.smithi059.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T15:45:03.366 INFO:teuthology.orchestra.run.smithi059.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T15:45:03.366 INFO:teuthology.orchestra.run.smithi059.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T15:45:03.366 INFO:teuthology.orchestra.run.smithi059.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T15:45:03.366 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T15:45:03.366 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T15:45:03.367 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T15:45:03.367 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:03.367 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-04-25T15:45:03.960 DEBUG:teuthology.parallel:result is None 2024-04-25T15:45:06.447 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 178/178 2024-04-25T15:45:06.447 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/178 2024-04-25T15:45:06.447 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/178 2024-04-25T15:45:06.447 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-3291.g994e2f20.el9. 3/178 2024-04-25T15:45:06.447 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 4/178 2024-04-25T15:45:06.447 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-3291.g994e2f20.el 5/178 2024-04-25T15:45:06.447 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_6 6/178 2024-04-25T15:45:06.447 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 7/178 2024-04-25T15:45:06.447 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-3291.g994e2f20.el9. 8/178 2024-04-25T15:45:06.447 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 9/178 2024-04-25T15:45:06.448 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-3 10/178 2024-04-25T15:45:06.448 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 11/178 2024-04-25T15:45:06.448 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 12/178 2024-04-25T15:45:06.448 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 13/178 2024-04-25T15:45:06.448 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 14/178 2024-04-25T15:45:06.448 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 15/178 2024-04-25T15:45:06.448 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 16/178 2024-04-25T15:45:06.448 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 17/178 2024-04-25T15:45:06.449 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 18/178 2024-04-25T15:45:06.449 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 19/178 2024-04-25T15:45:06.449 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-3291.g994e2f20.e 20/178 2024-04-25T15:45:06.449 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 21/178 2024-04-25T15:45:06.449 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 22/178 2024-04-25T15:45:06.449 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-3291.g994e2f20.el9. 23/178 2024-04-25T15:45:06.449 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 24/178 2024-04-25T15:45:06.449 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 25/178 2024-04-25T15:45:06.449 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 26/178 2024-04-25T15:45:06.449 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 27/178 2024-04-25T15:45:06.449 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-3291.g994e2f20.el9 28/178 2024-04-25T15:45:06.450 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 29/178 2024-04-25T15:45:06.450 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 30/178 2024-04-25T15:45:06.450 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-3291.g994e2f20 31/178 2024-04-25T15:45:06.450 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados2-debuginfo-2:19.0.0-3291.g994e2f20.el9. 32/178 2024-04-25T15:45:06.450 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 33/178 2024-04-25T15:45:06.450 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librbd1-debuginfo-2:19.0.0-3291.g994e2f20.el9.x8 34/178 2024-04-25T15:45:06.450 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 35/178 2024-04-25T15:45:06.450 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 36/178 2024-04-25T15:45:06.450 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 37/178 2024-04-25T15:45:06.450 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 38/178 2024-04-25T15:45:06.450 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-3291.g994e2f20 39/178 2024-04-25T15:45:06.450 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 40/178 2024-04-25T15:45:06.450 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-3291.g994e2f20. 41/178 2024-04-25T15:45:06.450 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 42/178 2024-04-25T15:45:06.451 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-3291.g994e2f20.el 43/178 2024-04-25T15:45:06.451 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 44/178 2024-04-25T15:45:06.451 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-3291.g994e2f20.el 45/178 2024-04-25T15:45:06.451 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 46/178 2024-04-25T15:45:06.451 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-3291.g994e2f20.el9.x 47/178 2024-04-25T15:45:06.451 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 48/178 2024-04-25T15:45:06.451 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-3291.g994e2f20.el9 49/178 2024-04-25T15:45:06.451 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 50/178 2024-04-25T15:45:06.451 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-3291.g994e2f20.el9.x8 51/178 2024-04-25T15:45:06.451 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 52/178 2024-04-25T15:45:06.451 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 53/178 2024-04-25T15:45:06.451 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 54/178 2024-04-25T15:45:06.451 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 55/178 2024-04-25T15:45:06.451 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 56/178 2024-04-25T15:45:06.451 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 57/178 2024-04-25T15:45:06.451 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 58/178 2024-04-25T15:45:06.452 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 59/178 2024-04-25T15:45:06.452 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 60/178 2024-04-25T15:45:06.452 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 61/178 2024-04-25T15:45:06.452 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 62/178 2024-04-25T15:45:06.452 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 63/178 2024-04-25T15:45:06.452 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 64/178 2024-04-25T15:45:06.452 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 65/178 2024-04-25T15:45:06.452 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 66/178 2024-04-25T15:45:06.452 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ply-3.11-14.el9.noarch 67/178 2024-04-25T15:45:06.452 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 68/178 2024-04-25T15:45:06.452 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 69/178 2024-04-25T15:45:06.452 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 70/178 2024-04-25T15:45:06.452 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : automake-1.16.2-8.el9.noarch 71/178 2024-04-25T15:45:06.452 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : bison-3.7.4-5.el9.x86_64 72/178 2024-04-25T15:45:06.453 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 73/178 2024-04-25T15:45:06.453 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 74/178 2024-04-25T15:45:06.453 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flex-2.6.4-9.el9.x86_64 75/178 2024-04-25T15:45:06.453 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 76/178 2024-04-25T15:45:06.453 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 77/178 2024-04-25T15:45:06.453 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 78/178 2024-04-25T15:45:06.453 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 79/178 2024-04-25T15:45:06.453 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 80/178 2024-04-25T15:45:06.453 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 81/178 2024-04-25T15:45:06.453 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 82/178 2024-04-25T15:45:06.453 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 83/178 2024-04-25T15:45:06.453 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 84/178 2024-04-25T15:45:06.453 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 85/178 2024-04-25T15:45:06.453 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 86/178 2024-04-25T15:45:06.453 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : lua-5.4.4-4.el9.x86_64 87/178 2024-04-25T15:45:06.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 88/178 2024-04-25T15:45:06.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 89/178 2024-04-25T15:45:06.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 90/178 2024-04-25T15:45:06.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-13.14-1.el9.x86_64 91/178 2024-04-25T15:45:06.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 92/178 2024-04-25T15:45:06.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 93/178 2024-04-25T15:45:06.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 94/178 2024-04-25T15:45:06.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 95/178 2024-04-25T15:45:06.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 96/178 2024-04-25T15:45:06.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 97/178 2024-04-25T15:45:06.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 98/178 2024-04-25T15:45:06.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 99/178 2024-04-25T15:45:06.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 100/178 2024-04-25T15:45:06.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 101/178 2024-04-25T15:45:06.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 102/178 2024-04-25T15:45:06.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 103/178 2024-04-25T15:45:06.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 104/178 2024-04-25T15:45:06.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 105/178 2024-04-25T15:45:06.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 106/178 2024-04-25T15:45:06.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 107/178 2024-04-25T15:45:06.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 108/178 2024-04-25T15:45:06.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 109/178 2024-04-25T15:45:06.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 110/178 2024-04-25T15:45:06.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 111/178 2024-04-25T15:45:06.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 112/178 2024-04-25T15:45:06.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 113/178 2024-04-25T15:45:06.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 114/178 2024-04-25T15:45:06.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 115/178 2024-04-25T15:45:06.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 116/178 2024-04-25T15:45:06.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 117/178 2024-04-25T15:45:06.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 118/178 2024-04-25T15:45:06.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 119/178 2024-04-25T15:45:06.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 120/178 2024-04-25T15:45:06.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 121/178 2024-04-25T15:45:06.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 122/178 2024-04-25T15:45:06.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 123/178 2024-04-25T15:45:06.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 124/178 2024-04-25T15:45:06.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 125/178 2024-04-25T15:45:06.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 126/178 2024-04-25T15:45:06.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 127/178 2024-04-25T15:45:06.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 128/178 2024-04-25T15:45:06.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 129/178 2024-04-25T15:45:06.457 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 130/178 2024-04-25T15:45:06.457 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 131/178 2024-04-25T15:45:06.457 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 132/178 2024-04-25T15:45:06.457 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 133/178 2024-04-25T15:45:06.457 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 134/178 2024-04-25T15:45:06.457 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 135/178 2024-04-25T15:45:06.457 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 136/178 2024-04-25T15:45:06.457 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 137/178 2024-04-25T15:45:06.457 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 138/178 2024-04-25T15:45:06.457 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 139/178 2024-04-25T15:45:06.457 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 140/178 2024-04-25T15:45:06.457 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 141/178 2024-04-25T15:45:06.457 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 142/178 2024-04-25T15:45:06.457 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 143/178 2024-04-25T15:45:06.458 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 144/178 2024-04-25T15:45:06.458 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 145/178 2024-04-25T15:45:06.458 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 146/178 2024-04-25T15:45:06.458 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 147/178 2024-04-25T15:45:06.458 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 148/178 2024-04-25T15:45:06.458 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 149/178 2024-04-25T15:45:06.458 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 150/178 2024-04-25T15:45:06.458 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 151/178 2024-04-25T15:45:06.458 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 152/178 2024-04-25T15:45:06.458 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 153/178 2024-04-25T15:45:06.458 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 154/178 2024-04-25T15:45:06.458 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 155/178 2024-04-25T15:45:06.458 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 156/178 2024-04-25T15:45:06.458 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 157/178 2024-04-25T15:45:06.459 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 158/178 2024-04-25T15:45:06.459 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 159/178 2024-04-25T15:45:06.459 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 160/178 2024-04-25T15:45:06.459 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 161/178 2024-04-25T15:45:06.459 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 162/178 2024-04-25T15:45:06.459 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 163/178 2024-04-25T15:45:06.459 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 164/178 2024-04-25T15:45:06.459 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 165/178 2024-04-25T15:45:06.459 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 166/178 2024-04-25T15:45:06.459 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 167/178 2024-04-25T15:45:06.459 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 168/178 2024-04-25T15:45:06.459 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : re2-1:20211101-3.el9.x86_64 169/178 2024-04-25T15:45:06.459 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 170/178 2024-04-25T15:45:06.459 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 171/178 2024-04-25T15:45:06.460 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 172/178 2024-04-25T15:45:06.460 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 173/178 2024-04-25T15:45:06.460 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 174/178 2024-04-25T15:45:06.460 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 175/178 2024-04-25T15:45:06.460 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 176/178 2024-04-25T15:45:06.460 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 177/178 2024-04-25T15:45:08.789 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 178/178 2024-04-25T15:45:08.789 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:08.789 INFO:teuthology.orchestra.run.smithi064.stdout:Upgraded: 2024-04-25T15:45:08.790 INFO:teuthology.orchestra.run.smithi064.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.790 INFO:teuthology.orchestra.run.smithi064.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.790 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T15:45:08.790 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T15:45:08.790 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-04-25T15:45:08.790 INFO:teuthology.orchestra.run.smithi064.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T15:45:08.790 INFO:teuthology.orchestra.run.smithi064.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T15:45:08.790 INFO:teuthology.orchestra.run.smithi064.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T15:45:08.790 INFO:teuthology.orchestra.run.smithi064.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T15:45:08.790 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.790 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.790 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.790 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.791 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-common-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.791 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.791 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.791 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-fuse-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.791 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:08.791 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.791 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.791 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.791 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mds-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.791 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.791 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:08.791 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:08.791 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.791 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:08.792 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:08.792 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:08.792 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.792 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mon-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.792 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.792 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-osd-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.792 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:08.792 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.792 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-radosgw-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.792 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.792 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.792 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-test-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.792 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:08.792 INFO:teuthology.orchestra.run.smithi064.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:08.793 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.793 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.793 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:45:08.793 INFO:teuthology.orchestra.run.smithi064.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T15:45:08.793 INFO:teuthology.orchestra.run.smithi064.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T15:45:08.793 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T15:45:08.793 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T15:45:08.793 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T15:45:08.793 INFO:teuthology.orchestra.run.smithi064.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T15:45:08.793 INFO:teuthology.orchestra.run.smithi064.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T15:45:08.793 INFO:teuthology.orchestra.run.smithi064.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T15:45:08.793 INFO:teuthology.orchestra.run.smithi064.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T15:45:08.793 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T15:45:08.793 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T15:45:08.794 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.794 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.794 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs2-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.794 INFO:teuthology.orchestra.run.smithi064.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.794 INFO:teuthology.orchestra.run.smithi064.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T15:45:08.794 INFO:teuthology.orchestra.run.smithi064.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T15:45:08.794 INFO:teuthology.orchestra.run.smithi064.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T15:45:08.794 INFO:teuthology.orchestra.run.smithi064.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T15:45:08.794 INFO:teuthology.orchestra.run.smithi064.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T15:45:08.794 INFO:teuthology.orchestra.run.smithi064.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.794 INFO:teuthology.orchestra.run.smithi064.stdout: librados-devel-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.794 INFO:teuthology.orchestra.run.smithi064.stdout: librados2-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.794 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.794 INFO:teuthology.orchestra.run.smithi064.stdout: librbd1-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.794 INFO:teuthology.orchestra.run.smithi064.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T15:45:08.795 INFO:teuthology.orchestra.run.smithi064.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.795 INFO:teuthology.orchestra.run.smithi064.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T15:45:08.795 INFO:teuthology.orchestra.run.smithi064.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T15:45:08.795 INFO:teuthology.orchestra.run.smithi064.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T15:45:08.795 INFO:teuthology.orchestra.run.smithi064.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T15:45:08.795 INFO:teuthology.orchestra.run.smithi064.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T15:45:08.795 INFO:teuthology.orchestra.run.smithi064.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T15:45:08.795 INFO:teuthology.orchestra.run.smithi064.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T15:45:08.795 INFO:teuthology.orchestra.run.smithi064.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T15:45:08.795 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T15:45:08.795 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T15:45:08.795 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T15:45:08.795 INFO:teuthology.orchestra.run.smithi064.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T15:45:08.795 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T15:45:08.795 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T15:45:08.796 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T15:45:08.796 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T15:45:08.796 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T15:45:08.796 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T15:45:08.796 INFO:teuthology.orchestra.run.smithi064.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T15:45:08.796 INFO:teuthology.orchestra.run.smithi064.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T15:45:08.796 INFO:teuthology.orchestra.run.smithi064.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T15:45:08.796 INFO:teuthology.orchestra.run.smithi064.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T15:45:08.796 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T15:45:08.796 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.796 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.796 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.796 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cephfs-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.796 INFO:teuthology.orchestra.run.smithi064.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T15:45:08.797 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T15:45:08.797 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T15:45:08.797 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T15:45:08.797 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T15:45:08.797 INFO:teuthology.orchestra.run.smithi064.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T15:45:08.797 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T15:45:08.797 INFO:teuthology.orchestra.run.smithi064.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T15:45:08.797 INFO:teuthology.orchestra.run.smithi064.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T15:45:08.797 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T15:45:08.797 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T15:45:08.797 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T15:45:08.797 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T15:45:08.797 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T15:45:08.797 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T15:45:08.797 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T15:45:08.798 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T15:45:08.798 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T15:45:08.798 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T15:45:08.798 INFO:teuthology.orchestra.run.smithi064.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T15:45:08.798 INFO:teuthology.orchestra.run.smithi064.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T15:45:08.798 INFO:teuthology.orchestra.run.smithi064.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T15:45:08.798 INFO:teuthology.orchestra.run.smithi064.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T15:45:08.798 INFO:teuthology.orchestra.run.smithi064.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T15:45:08.798 INFO:teuthology.orchestra.run.smithi064.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T15:45:08.798 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T15:45:08.798 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T15:45:08.798 INFO:teuthology.orchestra.run.smithi064.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T15:45:08.798 INFO:teuthology.orchestra.run.smithi064.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T15:45:08.798 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T15:45:08.799 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T15:45:08.799 INFO:teuthology.orchestra.run.smithi064.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T15:45:08.799 INFO:teuthology.orchestra.run.smithi064.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T15:45:08.799 INFO:teuthology.orchestra.run.smithi064.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T15:45:08.799 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T15:45:08.799 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T15:45:08.799 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T15:45:08.799 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T15:45:08.799 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T15:45:08.799 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T15:45:08.799 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.799 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.799 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.799 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rbd-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.799 INFO:teuthology.orchestra.run.smithi064.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T15:45:08.800 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T15:45:08.800 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T15:45:08.800 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.800 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rgw-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.800 INFO:teuthology.orchestra.run.smithi064.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T15:45:08.800 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T15:45:08.800 INFO:teuthology.orchestra.run.smithi064.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T15:45:08.800 INFO:teuthology.orchestra.run.smithi064.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T15:45:08.800 INFO:teuthology.orchestra.run.smithi064.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T15:45:08.800 INFO:teuthology.orchestra.run.smithi064.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T15:45:08.800 INFO:teuthology.orchestra.run.smithi064.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T15:45:08.800 INFO:teuthology.orchestra.run.smithi064.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T15:45:08.800 INFO:teuthology.orchestra.run.smithi064.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T15:45:08.800 INFO:teuthology.orchestra.run.smithi064.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T15:45:08.801 INFO:teuthology.orchestra.run.smithi064.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T15:45:08.801 INFO:teuthology.orchestra.run.smithi064.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T15:45:08.801 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T15:45:08.801 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T15:45:08.801 INFO:teuthology.orchestra.run.smithi064.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T15:45:08.801 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.801 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-fuse-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.801 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.801 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-mirror-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.801 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.801 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-nbd-debuginfo-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:45:08.801 INFO:teuthology.orchestra.run.smithi064.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T15:45:08.801 INFO:teuthology.orchestra.run.smithi064.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T15:45:08.801 INFO:teuthology.orchestra.run.smithi064.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T15:45:08.802 INFO:teuthology.orchestra.run.smithi064.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T15:45:08.802 INFO:teuthology.orchestra.run.smithi064.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T15:45:08.802 INFO:teuthology.orchestra.run.smithi064.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T15:45:08.802 INFO:teuthology.orchestra.run.smithi064.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T15:45:08.802 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:08.802 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-04-25T15:45:09.397 DEBUG:teuthology.parallel:result is None 2024-04-25T15:45:09.397 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:45:09.538 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T15:45:09.565 INFO:teuthology.orchestra.run.smithi059.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T15:45:09.566 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T15:45:09.566 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T15:45:09.568 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:45:09.790 DEBUG:teuthology.orchestra.run.smithi064:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T15:45:09.812 INFO:teuthology.orchestra.run.smithi064.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T15:45:09.813 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T15:45:09.813 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T15:45:09.815 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T15:45:09.815 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:09.815 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T15:45:09.847 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:45:09.848 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T15:45:09.879 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T15:45:09.879 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:09.879 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T15:45:09.916 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T15:45:09.984 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:45:09.985 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T15:45:10.009 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T15:45:10.073 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T15:45:10.074 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:10.074 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T15:45:10.101 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T15:45:10.168 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:45:10.168 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T15:45:10.193 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T15:45:10.257 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T15:45:10.258 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:10.258 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T15:45:10.284 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T15:45:10.351 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:45:10.351 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T15:45:10.375 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T15:45:10.439 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T15:45:10.528 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T15:45:10.529 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /var/log/ceph 2024-04-25T15:45:10.531 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 777 /var/log/ceph 2024-04-25T15:45:10.555 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T15:45:10.556 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T15:45:10.599 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T15:45:10.625 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T15:45:10.625 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T15:45:10.667 DEBUG:teuthology.orchestra.run.smithi064:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T15:45:10.698 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T15:45:10.698 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T15:45:10.698 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T15:45:10.698 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:10.698 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T15:45:10.747 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T15:45:10.860 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T15:45:10.885 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:45:10.885 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T15:45:10.901 DEBUG:teuthology.orchestra.run.smithi064:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T15:45:11.014 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T15:45:11.045 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T15:45:11.046 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T15:45:11.046 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673226', 'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/fsstress validater/valgrind}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7673226', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240425.015853-debug'}, 'ceph': {'cephfs': {'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 85, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 1880, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'sleep_before_teardown': 0, 'subset': '178/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240425.015853-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi059.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGdemGxTK68nqF3V6Lmt9r8tcb216MI1zS4QEgjsP1aRZvGLT6LWUifVNcR6SteFO1LcYelejf8Ym2jkv/FDopE=', 'smithi064.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKFArLSnqQ2fJgOOsnL3/wiLX/siemldj7xq0Cy0DgHMJCkM55ry4RBTTgQP6sGYbMSmS4OIRwDvD0dIRh+E/V4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_10:00:23', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T15:45:11.047 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T15:45:11.049 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T15:45:11.095 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T15:45:11.106 DEBUG:teuthology.orchestra.run.smithi064:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T15:45:11.158 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:11.158 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T15:45:11.184 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T15:45:11.185 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2024-04-25T15:45:11.239 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T15:45:11.239 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:45:11.239 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-25T15:45:11.239 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:45:11.240 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:45:11.240 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-04-25 15:44:52.521136658 +0000 2024-04-25T15:45:11.240 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-04-25 15:35:38.046381175 +0000 2024-04-25T15:45:11.240 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-04-25 15:35:38.046381175 +0000 2024-04-25T15:45:11.240 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-04-25 15:35:38.046381175 +0000 2024-04-25T15:45:11.240 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T15:45:11.303 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-04-25T15:45:11.303 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-04-25T15:45:11.303 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000200102 s, 2.6 MB/s 2024-04-25T15:45:11.304 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T15:45:11.361 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2024-04-25T15:45:11.417 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T15:45:11.417 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:45:11.417 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-25T15:45:11.417 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:45:11.417 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:45:11.417 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-04-25 15:44:52.521136658 +0000 2024-04-25T15:45:11.417 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-04-25 15:35:38.392376390 +0000 2024-04-25T15:45:11.417 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-04-25 15:35:38.392376390 +0000 2024-04-25T15:45:11.417 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-04-25 15:35:38.392376390 +0000 2024-04-25T15:45:11.417 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T15:45:11.480 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-04-25T15:45:11.481 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-04-25T15:45:11.481 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000188831 s, 2.7 MB/s 2024-04-25T15:45:11.482 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T15:45:11.539 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2024-04-25T15:45:11.594 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T15:45:11.594 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:45:11.594 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T15:45:11.595 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:45:11.595 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:45:11.595 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-04-25 15:44:52.521136658 +0000 2024-04-25T15:45:11.595 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-04-25 15:35:38.725371785 +0000 2024-04-25T15:45:11.595 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-04-25 15:35:38.725371785 +0000 2024-04-25T15:45:11.595 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-04-25 15:35:38.725371785 +0000 2024-04-25T15:45:11.595 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T15:45:11.657 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-04-25T15:45:11.657 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-04-25T15:45:11.657 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000190791 s, 2.7 MB/s 2024-04-25T15:45:11.658 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T15:45:11.714 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2024-04-25T15:45:11.769 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T15:45:11.769 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:45:11.770 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-25T15:45:11.770 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:45:11.770 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:45:11.770 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-04-25 15:44:52.522136644 +0000 2024-04-25T15:45:11.770 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-04-25 15:35:39.076366931 +0000 2024-04-25T15:45:11.770 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-04-25 15:35:39.076366931 +0000 2024-04-25T15:45:11.770 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-04-25 15:35:39.076366931 +0000 2024-04-25T15:45:11.770 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T15:45:11.832 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-04-25T15:45:11.832 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-04-25T15:45:11.832 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000213511 s, 2.4 MB/s 2024-04-25T15:45:11.834 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T15:45:11.890 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:45:11.891 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:45:11.891 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T15:45:11.907 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T15:45:11.908 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_1 2024-04-25T15:45:11.963 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T15:45:11.963 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:45:11.963 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-25T15:45:11.963 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:45:11.963 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:45:11.963 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-04-25 15:44:58.052026199 +0000 2024-04-25T15:45:11.963 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-04-25 15:35:45.926026026 +0000 2024-04-25T15:45:11.963 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-04-25 15:35:45.926026026 +0000 2024-04-25T15:45:11.963 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-04-25 15:35:45.926026026 +0000 2024-04-25T15:45:11.964 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T15:45:12.026 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-04-25T15:45:12.027 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-04-25T15:45:12.027 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000270408 s, 1.9 MB/s 2024-04-25T15:45:12.028 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T15:45:12.085 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_2 2024-04-25T15:45:12.140 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T15:45:12.141 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:45:12.141 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-25T15:45:12.141 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:45:12.141 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:45:12.141 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-04-25 15:44:58.053026178 +0000 2024-04-25T15:45:12.141 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-04-25 15:35:46.294018018 +0000 2024-04-25T15:45:12.141 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-04-25 15:35:46.294018018 +0000 2024-04-25T15:45:12.141 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-04-25 15:35:46.294018018 +0000 2024-04-25T15:45:12.141 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T15:45:12.204 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-04-25T15:45:12.204 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-04-25T15:45:12.205 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000169335 s, 3.0 MB/s 2024-04-25T15:45:12.206 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T15:45:12.263 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_3 2024-04-25T15:45:12.318 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T15:45:12.319 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:45:12.319 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-25T15:45:12.319 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:45:12.319 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:45:12.319 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-04-25 15:44:58.053026178 +0000 2024-04-25T15:45:12.319 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-04-25 15:35:46.635010597 +0000 2024-04-25T15:45:12.319 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-04-25 15:35:46.635010597 +0000 2024-04-25T15:45:12.319 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-04-25 15:35:46.635010597 +0000 2024-04-25T15:45:12.319 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T15:45:12.382 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-04-25T15:45:12.383 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-04-25T15:45:12.383 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000171782 s, 3.0 MB/s 2024-04-25T15:45:12.384 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T15:45:12.439 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_4 2024-04-25T15:45:12.494 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T15:45:12.495 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:45:12.495 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-25T15:45:12.495 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:45:12.495 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:45:12.495 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-04-25 15:44:58.054026157 +0000 2024-04-25T15:45:12.495 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-04-25 15:35:46.984003002 +0000 2024-04-25T15:45:12.495 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-04-25 15:35:46.984003002 +0000 2024-04-25T15:45:12.495 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-04-25 15:35:46.984003002 +0000 2024-04-25T15:45:12.495 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T15:45:12.557 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-04-25T15:45:12.557 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-04-25T15:45:12.557 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000166258 s, 3.1 MB/s 2024-04-25T15:45:12.558 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T15:45:12.614 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:45:12.614 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi064.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T15:45:12.614 INFO:tasks.ceph:Generating config... 2024-04-25T15:45:12.615 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T15:45:12.616 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T15:45:12.616 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T15:45:12.616 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T15:45:12.616 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T15:45:12.616 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-04-25T15:45:12.616 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-04-25T15:45:12.616 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-04-25T15:45:12.616 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T15:45:12.616 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T15:45:12.616 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T15:45:12.616 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T15:45:12.616 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T15:45:12.616 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T15:45:12.616 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-04-25T15:45:12.617 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T15:45:12.617 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T15:45:12.617 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T15:45:12.617 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T15:45:12.617 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T15:45:12.617 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T15:45:12.617 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T15:45:12.617 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T15:45:12.617 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T15:45:12.617 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T15:45:12.617 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T15:45:12.617 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T15:45:12.617 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-04-25T15:45:12.617 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-25T15:45:12.618 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-25T15:45:12.618 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-25T15:45:12.618 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T15:45:12.618 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T15:45:12.618 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T15:45:12.618 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T15:45:12.618 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T15:45:12.618 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T15:45:12.618 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T15:45:12.618 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T15:45:12.618 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T15:45:12.618 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T15:45:12.619 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T15:45:12.619 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-04-25T15:45:12.619 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T15:45:12.619 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T15:45:12.619 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T15:45:12.619 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T15:45:12.685 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T15:45:12.689 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T15:45:12.742 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T15:45:12.767 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.59'), ('mon.b', '172.21.15.64'), ('mon.c', '[v2:172.21.15.64:3301,v1:172.21.15.64:6790]')] 2024-04-25T15:45:12.768 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.59,172.21.15.64,[v2:172.21.15.64:3301,v1:172.21.15.64:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T15:45:12.768 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:12.769 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T15:45:12.824 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.59 --add b 172.21.15.64 --addv c '[v2:172.21.15.64:3301,v1:172.21.15.64:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:45:12.919 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:45:12.920 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: generated fsid 9bb5d7ca-5217-467b-882c-0a18cd57f08f 2024-04-25T15:45:12.920 INFO:teuthology.orchestra.run.smithi059.stdout:setting min_mon_release = quincy 2024-04-25T15:45:12.920 INFO:teuthology.orchestra.run.smithi059.stdout:epoch 0 2024-04-25T15:45:12.920 INFO:teuthology.orchestra.run.smithi059.stdout:fsid 9bb5d7ca-5217-467b-882c-0a18cd57f08f 2024-04-25T15:45:12.920 INFO:teuthology.orchestra.run.smithi059.stdout:last_changed 2024-04-25T15:45:12.920035+0000 2024-04-25T15:45:12.920 INFO:teuthology.orchestra.run.smithi059.stdout:created 2024-04-25T15:45:12.920035+0000 2024-04-25T15:45:12.920 INFO:teuthology.orchestra.run.smithi059.stdout:min_mon_release 17 (quincy) 2024-04-25T15:45:12.920 INFO:teuthology.orchestra.run.smithi059.stdout:election_strategy: 1 2024-04-25T15:45:12.920 INFO:teuthology.orchestra.run.smithi059.stdout:0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-04-25T15:45:12.920 INFO:teuthology.orchestra.run.smithi059.stdout:1: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.b 2024-04-25T15:45:12.920 INFO:teuthology.orchestra.run.smithi059.stdout:2: [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] mon.c 2024-04-25T15:45:12.921 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T15:45:12.922 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T15:45:12.937 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9bb5d7ca-5217-467b-882c-0a18cd57f08f... 2024-04-25T15:45:12.938 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T15:45:12.980 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T15:45:13.019 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2024-04-25T15:45:13.019 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2024-04-25T15:45:13.019 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T15:45:13.019 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2024-04-25T15:45:13.019 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.019 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2024-04-25T15:45:13.019 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.019 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2024-04-25T15:45:13.019 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.020 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2024-04-25T15:45:13.020 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2024-04-25T15:45:13.020 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.020 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2024-04-25T15:45:13.020 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2024-04-25T15:45:13.020 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.020 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T15:45:13.020 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2024-04-25T15:45:13.020 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.020 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T15:45:13.020 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T15:45:13.020 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.020 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2024-04-25T15:45:13.020 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.021 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2024-04-25T15:45:13.021 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2024-04-25T15:45:13.021 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2024-04-25T15:45:13.021 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2024-04-25T15:45:13.021 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2024-04-25T15:45:13.021 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2024-04-25T15:45:13.021 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2024-04-25T15:45:13.021 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T15:45:13.021 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T15:45:13.021 INFO:teuthology.orchestra.run.smithi059.stdout: mon_allow_pool_size_one = true 2024-04-25T15:45:13.021 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.021 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T15:45:13.021 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.021 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2024-04-25T15:45:13.021 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.022 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2024-04-25T15:45:13.022 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.022 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2024-04-25T15:45:13.022 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2024-04-25T15:45:13.022 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2024-04-25T15:45:13.022 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.59,172.21.15.64,[v2:172.21.15.64:3301,v1:172.21.15.64:6790]" 2024-04-25T15:45:13.022 INFO:teuthology.orchestra.run.smithi059.stdout: mds beacon grace = 60 2024-04-25T15:45:13.022 INFO:teuthology.orchestra.run.smithi059.stdout: mds heartbeat grace = 60 2024-04-25T15:45:13.022 INFO:teuthology.orchestra.run.smithi059.stdout: osd heartbeat grace = 60 2024-04-25T15:45:13.022 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = 9bb5d7ca-5217-467b-882c-0a18cd57f08f 2024-04-25T15:45:13.022 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.022 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2024-04-25T15:45:13.022 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2024-04-25T15:45:13.022 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.023 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2024-04-25T15:45:13.023 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 600 2024-04-25T15:45:13.023 INFO:teuthology.orchestra.run.smithi059.stdout: osd mclock profile = high_recovery_ops 2024-04-25T15:45:13.023 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.023 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2024-04-25T15:45:13.023 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2024-04-25T15:45:13.023 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.023 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2024-04-25T15:45:13.023 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2024-04-25T15:45:13.023 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2024-04-25T15:45:13.023 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug trim objects = true 2024-04-25T15:45:13.023 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.023 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2024-04-25T15:45:13.023 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2024-04-25T15:45:13.024 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.024 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2024-04-25T15:45:13.024 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.024 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2024-04-25T15:45:13.024 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.024 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2024-04-25T15:45:13.024 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.024 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2024-04-25T15:45:13.024 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2024-04-25T15:45:13.024 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.024 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2024-04-25T15:45:13.024 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2024-04-25T15:45:13.024 INFO:teuthology.orchestra.run.smithi059.stdout: bdev async discard = True 2024-04-25T15:45:13.024 INFO:teuthology.orchestra.run.smithi059.stdout: bdev enable discard = True 2024-04-25T15:45:13.024 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore allocator = bitmap 2024-04-25T15:45:13.024 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2024-04-25T15:45:13.025 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2024-04-25T15:45:13.025 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 1/20 2024-04-25T15:45:13.025 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 1/20 2024-04-25T15:45:13.025 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T15:45:13.025 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2024-04-25T15:45:13.025 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 4/10 2024-04-25T15:45:13.025 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T15:45:13.025 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2024-04-25T15:45:13.025 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2024-04-25T15:45:13.025 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2024-04-25T15:45:13.025 INFO:teuthology.orchestra.run.smithi059.stdout: osd fast shutdown = False 2024-04-25T15:45:13.025 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2024-04-25T15:45:13.025 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2024-04-25T15:45:13.025 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.025 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2024-04-25T15:45:13.026 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T15:45:13.026 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2024-04-25T15:45:13.026 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-04-25T15:45:13.026 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-04-25T15:45:13.026 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:45:13.026 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:45:13.026 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2024-04-25T15:45:13.026 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2024-04-25T15:45:13.026 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.026 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2024-04-25T15:45:13.026 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T15:45:13.026 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-04-25T15:45:13.026 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2024-04-25T15:45:13.026 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-04-25T15:45:13.027 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2024-04-25T15:45:13.027 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2024-04-25T15:45:13.027 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:45:13.027 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2024-04-25T15:45:13.027 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2024-04-25T15:45:13.027 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:45:13.027 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.027 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T15:45:13.027 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T15:45:13.027 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T15:45:13.027 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.027 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T15:45:13.027 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T15:45:13.027 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T15:45:13.027 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.028 INFO:teuthology.orchestra.run.smithi059.stdout: # 1m isn't quite enough 2024-04-25T15:45:13.028 INFO:teuthology.orchestra.run.smithi059.stdout: mon_down_mkfs_grace = 2m 2024-04-25T15:45:13.028 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.028 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_filestore_osds = false 2024-04-25T15:45:13.028 INFO:teuthology.orchestra.run.smithi059.stdout: mon down mkfs grace = 300 2024-04-25T15:45:13.028 INFO:teuthology.orchestra.run.smithi059.stdout: mon op complaint time = 120 2024-04-25T15:45:13.028 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd crush smoke test = False 2024-04-25T15:45:13.028 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:45:13.028 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2024-04-25T15:45:13.028 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2024-04-25T15:45:13.028 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2024-04-25T15:45:13.028 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2024-04-25T15:45:13.028 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T15:45:13.028 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T15:45:13.029 INFO:teuthology.orchestra.run.smithi059.stdout: client mount timeout = 600 2024-04-25T15:45:13.029 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2024-04-25T15:45:13.029 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T15:45:13.029 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2024-04-25T15:45:13.029 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2024-04-25T15:45:13.029 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2024-04-25T15:45:13.029 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2024-04-25T15:45:13.029 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2024-04-25T15:45:13.029 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2024-04-25T15:45:13.029 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2024-04-25T15:45:13.029 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.e] 2024-04-25T15:45:13.029 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2024-04-25T15:45:13.029 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d] 2024-04-25T15:45:13.029 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.f] 2024-04-25T15:45:13.029 INFO:teuthology.orchestra.run.smithi059.stdout:[mds] 2024-04-25T15:45:13.030 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds = 20 2024-04-25T15:45:13.030 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds balancer = 20 2024-04-25T15:45:13.030 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T15:45:13.030 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug frag = True 2024-04-25T15:45:13.030 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug scatterstat = True 2024-04-25T15:45:13.030 INFO:teuthology.orchestra.run.smithi059.stdout: mds op complaint time = 180 2024-04-25T15:45:13.030 INFO:teuthology.orchestra.run.smithi059.stdout: mds valgrind exit = True 2024-04-25T15:45:13.030 INFO:teuthology.orchestra.run.smithi059.stdout: mds verify scatter = True 2024-04-25T15:45:13.030 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2024-04-25T15:45:13.030 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2024-04-25T15:45:13.030 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2024-04-25T15:45:13.031 INFO:teuthology.orchestra.run.smithi064.stdout:[global] 2024-04-25T15:45:13.031 INFO:teuthology.orchestra.run.smithi064.stdout: chdir = "" 2024-04-25T15:45:13.031 INFO:teuthology.orchestra.run.smithi064.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T15:45:13.031 INFO:teuthology.orchestra.run.smithi064.stdout: auth supported = cephx 2024-04-25T15:45:13.031 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.031 INFO:teuthology.orchestra.run.smithi064.stdout: filestore xattr use omap = true 2024-04-25T15:45:13.031 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.031 INFO:teuthology.orchestra.run.smithi064.stdout: mon clock drift allowed = 1.000 2024-04-25T15:45:13.031 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.031 INFO:teuthology.orchestra.run.smithi064.stdout: osd crush chooseleaf type = 0 2024-04-25T15:45:13.032 INFO:teuthology.orchestra.run.smithi064.stdout: auth debug = true 2024-04-25T15:45:13.032 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.032 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on old message = true 2024-04-25T15:45:13.032 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on bug = true 2024-04-25T15:45:13.032 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.032 INFO:teuthology.orchestra.run.smithi064.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T15:45:13.032 INFO:teuthology.orchestra.run.smithi064.stdout: mon pg warn max object skew = 0 2024-04-25T15:45:13.032 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.032 INFO:teuthology.orchestra.run.smithi064.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T15:45:13.032 INFO:teuthology.orchestra.run.smithi064.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T15:45:13.032 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.032 INFO:teuthology.orchestra.run.smithi064.stdout: osd pool default size = 2 2024-04-25T15:45:13.032 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.032 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd allow primary affinity = true 2024-04-25T15:45:13.033 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd allow pg remap = true 2024-04-25T15:45:13.033 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on legacy crush tunables = false 2024-04-25T15:45:13.033 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on crush straw calc version zero = false 2024-04-25T15:45:13.033 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on no sortbitwise = false 2024-04-25T15:45:13.033 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on osd down out interval zero = false 2024-04-25T15:45:13.033 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on too few osds = false 2024-04-25T15:45:13.033 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T15:45:13.033 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T15:45:13.033 INFO:teuthology.orchestra.run.smithi064.stdout: mon_allow_pool_size_one = true 2024-04-25T15:45:13.033 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.033 INFO:teuthology.orchestra.run.smithi064.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T15:45:13.033 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.033 INFO:teuthology.orchestra.run.smithi064.stdout: osd default data pool replay window = 5 2024-04-25T15:45:13.033 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.033 INFO:teuthology.orchestra.run.smithi064.stdout: mon allow pool delete = true 2024-04-25T15:45:13.034 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.034 INFO:teuthology.orchestra.run.smithi064.stdout: mon cluster log file level = debug 2024-04-25T15:45:13.034 INFO:teuthology.orchestra.run.smithi064.stdout: debug asserts on shutdown = true 2024-04-25T15:45:13.034 INFO:teuthology.orchestra.run.smithi064.stdout: mon health detail to clog = false 2024-04-25T15:45:13.034 INFO:teuthology.orchestra.run.smithi064.stdout: mon host = "172.21.15.59,172.21.15.64,[v2:172.21.15.64:3301,v1:172.21.15.64:6790]" 2024-04-25T15:45:13.034 INFO:teuthology.orchestra.run.smithi064.stdout: mds beacon grace = 60 2024-04-25T15:45:13.034 INFO:teuthology.orchestra.run.smithi064.stdout: mds heartbeat grace = 60 2024-04-25T15:45:13.034 INFO:teuthology.orchestra.run.smithi064.stdout: osd heartbeat grace = 60 2024-04-25T15:45:13.034 INFO:teuthology.orchestra.run.smithi064.stdout: fsid = 9bb5d7ca-5217-467b-882c-0a18cd57f08f 2024-04-25T15:45:13.034 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.034 INFO:teuthology.orchestra.run.smithi064.stdout:[osd] 2024-04-25T15:45:13.034 INFO:teuthology.orchestra.run.smithi064.stdout: osd journal size = 100 2024-04-25T15:45:13.034 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.034 INFO:teuthology.orchestra.run.smithi064.stdout: osd scrub load threshold = 5.0 2024-04-25T15:45:13.035 INFO:teuthology.orchestra.run.smithi064.stdout: osd scrub max interval = 600 2024-04-25T15:45:13.035 INFO:teuthology.orchestra.run.smithi064.stdout: osd mclock profile = high_recovery_ops 2024-04-25T15:45:13.035 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.035 INFO:teuthology.orchestra.run.smithi064.stdout: osd recover clone overlap = true 2024-04-25T15:45:13.035 INFO:teuthology.orchestra.run.smithi064.stdout: osd recovery max chunk = 1048576 2024-04-25T15:45:13.035 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.035 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug shutdown = true 2024-04-25T15:45:13.035 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug op order = true 2024-04-25T15:45:13.035 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug verify stray on activate = true 2024-04-25T15:45:13.035 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug trim objects = true 2024-04-25T15:45:13.035 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.035 INFO:teuthology.orchestra.run.smithi064.stdout: osd open classes on start = true 2024-04-25T15:45:13.035 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug pg log writeout = true 2024-04-25T15:45:13.035 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.036 INFO:teuthology.orchestra.run.smithi064.stdout: osd deep scrub update digest min age = 30 2024-04-25T15:45:13.036 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.036 INFO:teuthology.orchestra.run.smithi064.stdout: osd map max advance = 10 2024-04-25T15:45:13.036 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.036 INFO:teuthology.orchestra.run.smithi064.stdout: journal zero on create = true 2024-04-25T15:45:13.036 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.036 INFO:teuthology.orchestra.run.smithi064.stdout: filestore ondisk finisher threads = 3 2024-04-25T15:45:13.036 INFO:teuthology.orchestra.run.smithi064.stdout: filestore apply finisher threads = 3 2024-04-25T15:45:13.036 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.036 INFO:teuthology.orchestra.run.smithi064.stdout: bdev debug aio = true 2024-04-25T15:45:13.036 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug misdirected ops = true 2024-04-25T15:45:13.036 INFO:teuthology.orchestra.run.smithi064.stdout: bdev async discard = True 2024-04-25T15:45:13.036 INFO:teuthology.orchestra.run.smithi064.stdout: bdev enable discard = True 2024-04-25T15:45:13.036 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore allocator = bitmap 2024-04-25T15:45:13.036 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore block size = 96636764160 2024-04-25T15:45:13.037 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore fsck on mount = True 2024-04-25T15:45:13.037 INFO:teuthology.orchestra.run.smithi064.stdout: debug bluefs = 1/20 2024-04-25T15:45:13.037 INFO:teuthology.orchestra.run.smithi064.stdout: debug bluestore = 1/20 2024-04-25T15:45:13.037 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-04-25T15:45:13.037 INFO:teuthology.orchestra.run.smithi064.stdout: debug osd = 20 2024-04-25T15:45:13.037 INFO:teuthology.orchestra.run.smithi064.stdout: debug rocksdb = 4/10 2024-04-25T15:45:13.037 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T15:45:13.037 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd full ratio = 0.9 2024-04-25T15:45:13.037 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd nearfull ratio = 0.8 2024-04-25T15:45:13.037 INFO:teuthology.orchestra.run.smithi064.stdout: osd failsafe full ratio = 0.95 2024-04-25T15:45:13.037 INFO:teuthology.orchestra.run.smithi064.stdout: osd fast shutdown = False 2024-04-25T15:45:13.037 INFO:teuthology.orchestra.run.smithi064.stdout: osd objectstore = bluestore 2024-04-25T15:45:13.037 INFO:teuthology.orchestra.run.smithi064.stdout: osd op complaint time = 180 2024-04-25T15:45:13.037 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.038 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr] 2024-04-25T15:45:13.038 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-04-25T15:45:13.038 INFO:teuthology.orchestra.run.smithi064.stdout: debug mgr = 20 2024-04-25T15:45:13.038 INFO:teuthology.orchestra.run.smithi064.stdout: debug mon = 20 2024-04-25T15:45:13.038 INFO:teuthology.orchestra.run.smithi064.stdout: debug auth = 20 2024-04-25T15:45:13.038 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:45:13.038 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:45:13.038 INFO:teuthology.orchestra.run.smithi064.stdout: mgr/telemetry/nag = false 2024-04-25T15:45:13.038 INFO:teuthology.orchestra.run.smithi064.stdout: debug client = 20 2024-04-25T15:45:13.038 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.038 INFO:teuthology.orchestra.run.smithi064.stdout:[mon] 2024-04-25T15:45:13.038 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-04-25T15:45:13.038 INFO:teuthology.orchestra.run.smithi064.stdout: debug mon = 20 2024-04-25T15:45:13.038 INFO:teuthology.orchestra.run.smithi064.stdout: debug paxos = 20 2024-04-25T15:45:13.039 INFO:teuthology.orchestra.run.smithi064.stdout: debug auth = 20 2024-04-25T15:45:13.039 INFO:teuthology.orchestra.run.smithi064.stdout: mon data avail warn = 5 2024-04-25T15:45:13.039 INFO:teuthology.orchestra.run.smithi064.stdout: mon mgr mkfs grace = 240 2024-04-25T15:45:13.039 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:45:13.039 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd reporter subtree level = osd 2024-04-25T15:45:13.039 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd prime pg temp = true 2024-04-25T15:45:13.039 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:45:13.039 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.039 INFO:teuthology.orchestra.run.smithi064.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T15:45:13.039 INFO:teuthology.orchestra.run.smithi064.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T15:45:13.039 INFO:teuthology.orchestra.run.smithi064.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T15:45:13.039 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.039 INFO:teuthology.orchestra.run.smithi064.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T15:45:13.039 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T15:45:13.040 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T15:45:13.040 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.040 INFO:teuthology.orchestra.run.smithi064.stdout: # 1m isn't quite enough 2024-04-25T15:45:13.040 INFO:teuthology.orchestra.run.smithi064.stdout: mon_down_mkfs_grace = 2m 2024-04-25T15:45:13.040 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.040 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_filestore_osds = false 2024-04-25T15:45:13.040 INFO:teuthology.orchestra.run.smithi064.stdout: mon down mkfs grace = 300 2024-04-25T15:45:13.040 INFO:teuthology.orchestra.run.smithi064.stdout: mon op complaint time = 120 2024-04-25T15:45:13.040 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd crush smoke test = False 2024-04-25T15:45:13.040 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-04-25T15:45:13.040 INFO:teuthology.orchestra.run.smithi064.stdout:[client] 2024-04-25T15:45:13.040 INFO:teuthology.orchestra.run.smithi064.stdout: rgw cache enabled = true 2024-04-25T15:45:13.040 INFO:teuthology.orchestra.run.smithi064.stdout: rgw enable ops log = true 2024-04-25T15:45:13.040 INFO:teuthology.orchestra.run.smithi064.stdout: rgw enable usage log = true 2024-04-25T15:45:13.041 INFO:teuthology.orchestra.run.smithi064.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T15:45:13.041 INFO:teuthology.orchestra.run.smithi064.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T15:45:13.041 INFO:teuthology.orchestra.run.smithi064.stdout: client mount timeout = 600 2024-04-25T15:45:13.041 INFO:teuthology.orchestra.run.smithi064.stdout: debug client = 20 2024-04-25T15:45:13.041 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-04-25T15:45:13.041 INFO:teuthology.orchestra.run.smithi064.stdout: rados mon op timeout = 900 2024-04-25T15:45:13.041 INFO:teuthology.orchestra.run.smithi064.stdout: rados osd op timeout = 900 2024-04-25T15:45:13.041 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.a] 2024-04-25T15:45:13.041 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.b] 2024-04-25T15:45:13.041 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.c] 2024-04-25T15:45:13.041 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.a] 2024-04-25T15:45:13.041 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.c] 2024-04-25T15:45:13.041 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.e] 2024-04-25T15:45:13.041 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.b] 2024-04-25T15:45:13.041 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.d] 2024-04-25T15:45:13.042 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.f] 2024-04-25T15:45:13.042 INFO:teuthology.orchestra.run.smithi064.stdout:[mds] 2024-04-25T15:45:13.042 INFO:teuthology.orchestra.run.smithi064.stdout: debug mds = 20 2024-04-25T15:45:13.042 INFO:teuthology.orchestra.run.smithi064.stdout: debug mds balancer = 20 2024-04-25T15:45:13.042 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2024-04-25T15:45:13.042 INFO:teuthology.orchestra.run.smithi064.stdout: mds debug frag = True 2024-04-25T15:45:13.042 INFO:teuthology.orchestra.run.smithi064.stdout: mds debug scatterstat = True 2024-04-25T15:45:13.042 INFO:teuthology.orchestra.run.smithi064.stdout: mds op complaint time = 180 2024-04-25T15:45:13.042 INFO:teuthology.orchestra.run.smithi064.stdout: mds valgrind exit = True 2024-04-25T15:45:13.042 INFO:teuthology.orchestra.run.smithi064.stdout: mds verify scatter = True 2024-04-25T15:45:13.042 INFO:teuthology.orchestra.run.smithi064.stdout: osd op complaint time = 180 2024-04-25T15:45:13.042 INFO:teuthology.orchestra.run.smithi064.stdout: rados mon op timeout = 900 2024-04-25T15:45:13.042 INFO:teuthology.orchestra.run.smithi064.stdout: rados osd op timeout = 900 2024-04-25T15:45:13.044 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T15:45:13.044 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T15:45:13.147 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T15:45:13.147 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:13.147 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T15:45:13.162 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:13.163 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T15:45:13.217 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T15:45:13.218 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:13.218 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T15:45:13.218 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T15:45:13.291 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:13.291 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:45:13.346 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi064.front.sepia.ceph.com 2024-04-25T15:45:13.347 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:45:13.348 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T15:45:13.348 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T15:45:13.383 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:45:13.383 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:45:13.439 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T15:45:13.439 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T15:45:13.439 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T15:45:13.498 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T15:45:13.501 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T15:45:13.575 INFO:teuthology.orchestra.run.smithi064.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T15:45:13.579 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T15:45:13.579 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T15:45:13.638 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T15:45:13.641 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T15:45:13.665 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T15:45:13.765 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T15:45:13.767 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T15:45:13.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T15:45:13.890 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T15:45:13.894 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-25T15:45:13.919 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T15:45:13.979 INFO:teuthology.orchestra.run.smithi064.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T15:45:13.982 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T15:45:14.006 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T15:45:14.105 INFO:teuthology.orchestra.run.smithi064.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T15:45:14.108 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T15:45:14.133 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T15:45:14.231 INFO:teuthology.orchestra.run.smithi064.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T15:45:14.234 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-25T15:45:14.258 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T15:45:14.258 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T15:45:14.309 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T15:45:14.322 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T15:45:14.322 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi064.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T15:45:14.322 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T15:45:14.346 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:45:14.346 INFO:tasks.ceph:role: osd.0 2024-04-25T15:45:14.346 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T15:45:14.346 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T15:45:14.418 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:45:14.418 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:45:14.418 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:45:14.419 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:45:14.419 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:45:14.419 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:45:14.419 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:45:14.419 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:45:14.419 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:45:14.419 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:45:14.907 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-04-25T15:45:14.909 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-04-25T15:45:14.909 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T15:45:15.059 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T15:45:15.090 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T15:45:15.154 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:45:15.154 INFO:tasks.ceph:role: osd.1 2024-04-25T15:45:15.155 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T15:45:15.155 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T15:45:15.226 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:45:15.226 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:45:15.226 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:45:15.226 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:45:15.227 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:45:15.227 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:45:15.227 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:45:15.227 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:45:15.227 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:45:15.227 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:45:15.686 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-04-25T15:45:15.688 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-04-25T15:45:15.688 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T15:45:15.768 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T15:45:15.837 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T15:45:15.902 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:45:15.902 INFO:tasks.ceph:role: osd.2 2024-04-25T15:45:15.903 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T15:45:15.903 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T15:45:15.974 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:45:15.975 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:45:15.975 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:45:15.975 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:45:15.975 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:45:15.975 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:45:15.975 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:45:15.975 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:45:15.975 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:45:15.975 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:45:16.464 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-04-25T15:45:16.466 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-04-25T15:45:16.466 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T15:45:16.590 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T15:45:16.673 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T15:45:16.738 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:45:16.738 INFO:tasks.ceph:role: osd.3 2024-04-25T15:45:16.738 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T15:45:16.738 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T15:45:16.810 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:45:16.811 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:45:16.811 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:45:16.811 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:45:16.811 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:45:16.811 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:45:16.812 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:45:16.812 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:45:16.812 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:45:16.812 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:45:17.315 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-04-25T15:45:17.317 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-04-25T15:45:17.318 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T15:45:17.421 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T15:45:17.452 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:45:17.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:17.559+0000 7f86cea1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T15:45:17.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:17.559+0000 7f86cea1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T15:45:17.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:17.559+0000 7f86cea1c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T15:45:17.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:17.559+0000 7f86cea1c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T15:45:17.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:17.559+0000 7f86cea1c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T15:45:17.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:17.560+0000 7f86cea1c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T15:45:20.414 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T15:45:20.444 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:45:20.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:20.547+0000 7fcbddc30640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T15:45:20.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:20.547+0000 7fcbddc30640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T15:45:20.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:20.547+0000 7fcbddc30640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T15:45:20.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:20.547+0000 7fcbddc30640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T15:45:20.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:20.548+0000 7fcbddc30640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T15:45:20.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:20.548+0000 7fcbddc30640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T15:45:23.398 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T15:45:23.427 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:45:23.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:23.529+0000 7fde335ab640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T15:45:23.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:23.530+0000 7fde335ab640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T15:45:23.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:23.530+0000 7fde335ab640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T15:45:23.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:23.530+0000 7fde335ab640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T15:45:23.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:23.530+0000 7fde335ab640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T15:45:23.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:23.530+0000 7fde335ab640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T15:45:26.382 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T15:45:26.411 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:45:26.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:26.514+0000 7facc37cb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T15:45:26.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:26.514+0000 7facc37cb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T15:45:26.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:26.514+0000 7facc37cb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T15:45:26.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:26.514+0000 7facc37cb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T15:45:26.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:26.514+0000 7facc37cb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T15:45:26.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:26.515+0000 7facc37cb640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T15:45:29.377 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T15:45:29.406 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T15:45:29.437 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:45:29.438 INFO:tasks.ceph:role: osd.4 2024-04-25T15:45:29.438 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi064.front.sepia.ceph.com 2024-04-25T15:45:29.438 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T15:45:29.511 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:45:29.512 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:45:29.512 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:45:29.512 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:45:29.512 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:45:29.512 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:45:29.512 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:45:29.512 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:45:29.512 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:45:29.512 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:45:30.010 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2024-04-25T15:45:30.012 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2024-04-25T15:45:30.012 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T15:45:30.164 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T15:45:30.196 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T15:45:30.261 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:45:30.261 INFO:tasks.ceph:role: osd.5 2024-04-25T15:45:30.261 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi064.front.sepia.ceph.com 2024-04-25T15:45:30.261 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T15:45:30.333 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:45:30.333 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:45:30.333 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:45:30.333 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:45:30.334 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:45:30.334 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:45:30.334 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:45:30.334 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:45:30.334 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:45:30.334 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:45:30.789 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2024-04-25T15:45:30.792 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2024-04-25T15:45:30.792 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T15:45:30.889 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T15:45:30.918 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T15:45:30.983 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:45:30.983 INFO:tasks.ceph:role: osd.6 2024-04-25T15:45:30.983 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi064.front.sepia.ceph.com 2024-04-25T15:45:30.983 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T15:45:31.054 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:45:31.054 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:45:31.054 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:45:31.054 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:45:31.055 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:45:31.055 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:45:31.055 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:45:31.055 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:45:31.055 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:45:31.055 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:45:31.549 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2024-04-25T15:45:31.551 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2024-04-25T15:45:31.551 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T15:45:31.700 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T15:45:31.733 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T15:45:31.800 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:45:31.800 INFO:tasks.ceph:role: osd.7 2024-04-25T15:45:31.800 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi064.front.sepia.ceph.com 2024-04-25T15:45:31.800 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T15:45:31.873 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:45:31.873 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:45:31.874 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:45:31.874 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:45:31.874 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:45:31.874 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:45:31.874 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:45:31.874 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:45:31.874 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:45:31.874 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:45:32.383 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2024-04-25T15:45:32.386 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2024-04-25T15:45:32.386 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T15:45:32.518 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T15:45:32.554 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:45:32.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:32.664+0000 7f75db0db640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T15:45:32.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:32.664+0000 7f75db0db640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T15:45:32.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:32.664+0000 7f75db0db640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T15:45:32.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:32.664+0000 7f75db0db640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T15:45:32.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:32.664+0000 7f75db0db640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T15:45:32.665 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:32.665+0000 7f75db0db640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T15:45:35.515 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T15:45:35.545 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:45:35.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:35.647+0000 7f3ae4412640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T15:45:35.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:35.647+0000 7f3ae4412640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T15:45:35.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:35.647+0000 7f3ae4412640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T15:45:35.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:35.647+0000 7f3ae4412640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T15:45:35.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:35.647+0000 7f3ae4412640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T15:45:35.648 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:35.647+0000 7f3ae4412640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T15:45:38.496 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T15:45:38.526 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:45:38.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:38.632+0000 7f19c87d6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T15:45:38.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:38.632+0000 7f19c87d6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T15:45:38.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:38.632+0000 7f19c87d6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T15:45:38.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:38.632+0000 7f19c87d6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T15:45:38.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:38.632+0000 7f19c87d6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T15:45:38.633 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:38.633+0000 7f19c87d6640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T15:45:41.048 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:45:41.051 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:45:41.480 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T15:45:41.506 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:45:41.602 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:41.601+0000 7f0f8a411640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T15:45:41.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:41.602+0000 7f0f8a411640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T15:45:41.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:41.602+0000 7f0f8a411640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T15:45:41.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:41.602+0000 7f0f8a411640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T15:45:41.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:41.602+0000 7f0f8a411640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T15:45:41.603 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:45:41.602+0000 7f0f8a411640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T15:45:44.466 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T15:45:44.493 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T15:45:44.493 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:44.493 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T15:45:44.523 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:44.523 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T15:45:44.592 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:44.592 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T15:45:44.661 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:44.662 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-25T15:45:44.729 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:44.729 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T15:45:44.797 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:44.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T15:45:44.864 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:44.864 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T15:45:44.931 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:44.931 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T15:45:44.998 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:45:44.998 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T15:45:45.029 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:45:45.029 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T15:45:45.096 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:45:45.097 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T15:45:45.164 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:45:45.164 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-25T15:45:45.233 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:45:45.234 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T15:45:45.301 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:45:45.301 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T15:45:45.368 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:45:45.369 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T15:45:45.435 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:45:45.435 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T15:45:45.501 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:45:45.502 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T15:45:45.520 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T15:45:45.520 DEBUG:teuthology.orchestra.run.smithi059:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T15:45:45.564 DEBUG:teuthology.orchestra.run.smithi064:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T15:45:45.588 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.y] 2024-04-25T15:45:45.588 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCJeipm/S24HRAAA3DHjoSJSsdF6wcrjmLAxQ== 2024-04-25T15:45:45.588 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2024-04-25T15:45:45.588 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCJeipmeQcQJhAAIR9clZiAv0LJTNRIME2vjg== 2024-04-25T15:45:45.588 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2024-04-25T15:45:45.588 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCJeipmW/idLRAAeEX1zGPCSQXnDwgIyDQeJA== 2024-04-25T15:45:45.588 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.e] 2024-04-25T15:45:45.588 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCJeipmqGgaNRAAJ6j7BuI7ZOKqB9EyZg45kg== 2024-04-25T15:45:45.589 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.0] 2024-04-25T15:45:45.589 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCNeipmvOpkIRAAIVxarGnhOmPIIzViqlX3pg== 2024-04-25T15:45:45.589 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.1] 2024-04-25T15:45:45.589 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCQeipmzNKyIBAAyXFk/C3Qj5HbUQ+CeEUm0A== 2024-04-25T15:45:45.589 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.2] 2024-04-25T15:45:45.589 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCTeipmCWCjHxAAUWySafyZOJmBVqGdmZRSPg== 2024-04-25T15:45:45.589 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.3] 2024-04-25T15:45:45.589 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCWeipmapG1HhAA+//Rg0Wh0bXsOliqHJ9g3Q== 2024-04-25T15:45:45.589 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.x] 2024-04-25T15:45:45.589 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCJeipmFCpYIhAA4njpQb78ZuiWljgr/clVcA== 2024-04-25T15:45:45.589 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2024-04-25T15:45:45.589 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCJeipmLAFkOhAAtsR168YuNatQyvLU+qCkdQ== 2024-04-25T15:45:45.589 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d] 2024-04-25T15:45:45.590 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCKeipmYtJNBhAAKc7oq2bg3f5TdYdMwMmeyw== 2024-04-25T15:45:45.590 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.f] 2024-04-25T15:45:45.590 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCKeipmjhzTDRAAcEL70FIJJptJGN/CkvIs+w== 2024-04-25T15:45:45.590 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.4] 2024-04-25T15:45:45.590 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCceipmD0mlJxAAzHuVYoI2x2cBWMi43Fvrpw== 2024-04-25T15:45:45.590 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.5] 2024-04-25T15:45:45.590 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCfeipmCdmdJhAAky7LqS9i1lcxjGkDMTpp5A== 2024-04-25T15:45:45.590 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.6] 2024-04-25T15:45:45.590 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCieipmZf+7JRAAMJN3avPYzXGmmLMfqbJHuA== 2024-04-25T15:45:45.590 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.7] 2024-04-25T15:45:45.590 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCleipmOk7uIxAAqag8VuNBps6FD1WbZTtcYg== 2024-04-25T15:45:45.590 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-04-25T15:45:45.590 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCKeipmK8t0EhAApPbujQWYoKM3h/MCysVvYg== 2024-04-25T15:45:45.592 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr.y] 2024-04-25T15:45:45.592 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCJeipm/S24HRAAA3DHjoSJSsdF6wcrjmLAxQ== 2024-04-25T15:45:45.592 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.a] 2024-04-25T15:45:45.592 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCJeipmeQcQJhAAIR9clZiAv0LJTNRIME2vjg== 2024-04-25T15:45:45.592 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.c] 2024-04-25T15:45:45.592 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCJeipmW/idLRAAeEX1zGPCSQXnDwgIyDQeJA== 2024-04-25T15:45:45.592 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.e] 2024-04-25T15:45:45.592 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCJeipmqGgaNRAAJ6j7BuI7ZOKqB9EyZg45kg== 2024-04-25T15:45:45.593 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.0] 2024-04-25T15:45:45.593 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCNeipmvOpkIRAAIVxarGnhOmPIIzViqlX3pg== 2024-04-25T15:45:45.593 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.1] 2024-04-25T15:45:45.593 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCQeipmzNKyIBAAyXFk/C3Qj5HbUQ+CeEUm0A== 2024-04-25T15:45:45.593 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.2] 2024-04-25T15:45:45.593 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCTeipmCWCjHxAAUWySafyZOJmBVqGdmZRSPg== 2024-04-25T15:45:45.593 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.3] 2024-04-25T15:45:45.593 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCWeipmapG1HhAA+//Rg0Wh0bXsOliqHJ9g3Q== 2024-04-25T15:45:45.593 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr.x] 2024-04-25T15:45:45.593 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCJeipmFCpYIhAA4njpQb78ZuiWljgr/clVcA== 2024-04-25T15:45:45.593 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.b] 2024-04-25T15:45:45.593 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCJeipmLAFkOhAAtsR168YuNatQyvLU+qCkdQ== 2024-04-25T15:45:45.593 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.d] 2024-04-25T15:45:45.593 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCKeipmYtJNBhAAKc7oq2bg3f5TdYdMwMmeyw== 2024-04-25T15:45:45.593 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.f] 2024-04-25T15:45:45.594 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCKeipmjhzTDRAAcEL70FIJJptJGN/CkvIs+w== 2024-04-25T15:45:45.594 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.4] 2024-04-25T15:45:45.594 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCceipmD0mlJxAAzHuVYoI2x2cBWMi43Fvrpw== 2024-04-25T15:45:45.594 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.5] 2024-04-25T15:45:45.594 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCfeipmCdmdJhAAky7LqS9i1lcxjGkDMTpp5A== 2024-04-25T15:45:45.594 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.6] 2024-04-25T15:45:45.594 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCieipmZf+7JRAAMJN3avPYzXGmmLMfqbJHuA== 2024-04-25T15:45:45.594 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.7] 2024-04-25T15:45:45.594 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCleipmOk7uIxAAqag8VuNBps6FD1WbZTtcYg== 2024-04-25T15:45:45.594 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2024-04-25T15:45:45.594 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCKeipmK8t0EhAApPbujQWYoKM3h/MCysVvYg== 2024-04-25T15:45:45.595 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:45:45.636 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:45:45.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:45:45.703 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:45:45.766 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:45:45.769 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:45:45.831 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:45:45.834 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:45:45.896 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:45:45.898 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:45:45.958 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:45:45.960 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:45:46.019 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:45:46.022 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:45:46.084 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:45:46.087 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:45:46.146 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:45:46.149 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:45:46.208 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:45:46.210 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:45:46.273 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:45:46.275 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:45:46.337 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:45:46.340 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:45:46.403 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:45:46.405 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:45:46.464 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:45:46.466 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:45:46.527 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:45:46.529 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:45:46.589 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:45:46.592 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:45:46.652 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:45:46.654 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:45:46.718 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T15:45:46.718 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T15:45:46.742 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T15:45:46.847 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T15:45:46.871 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T15:45:46.896 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T15:45:47.003 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T15:45:47.027 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T15:45:47.092 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T15:45:47.199 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T15:45:47.224 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:45:47.226 DEBUG:teuthology.orchestra.run.smithi064:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:45:47.279 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T15:45:47.280 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-25T15:45:47.280 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T15:45:47.280 DEBUG:teuthology.orchestra.run.smithi059:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-04-25T15:45:47.282 INFO:tasks.ceph.mon.a:Started 2024-04-25T15:45:47.283 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-25T15:45:47.283 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T15:45:47.283 DEBUG:teuthology.orchestra.run.smithi064:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-04-25T15:45:47.322 INFO:tasks.ceph.mon.b:Started 2024-04-25T15:45:47.330 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-25T15:45:47.330 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T15:45:47.330 DEBUG:teuthology.orchestra.run.smithi064:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-04-25T15:45:47.332 INFO:tasks.ceph.mon.c:Started 2024-04-25T15:45:47.332 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T15:45:47.332 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T15:45:47.332 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-04-25T15:45:47.335 INFO:tasks.ceph.mgr.y:Started 2024-04-25T15:45:47.335 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T15:45:47.335 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-04-25T15:45:47.337 INFO:tasks.ceph.mgr.x:Started 2024-04-25T15:45:47.337 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T15:45:47.337 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T15:45:47.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:47.449+0000 7fd03e3b2640 1 Processor -- start 2024-04-25T15:45:47.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:47.449+0000 7fd03e3b2640 1 -- start start 2024-04-25T15:45:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:47.451+0000 7fd03e3b2640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd03815d6a0 0x7fd0380cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:47.451+0000 7fd03e3b2640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 0x7fd038152e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:47.451+0000 7fd03e3b2640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0380ca160 con 0x7fd0380c94b0 2024-04-25T15:45:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:47.451+0000 7fd03e3b2640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd03815c970 con 0x7fd03815d6a0 2024-04-25T15:45:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:47.451+0000 7fd03e3b2640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd038159f10 con 0x7fd038072140 2024-04-25T15:45:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:47.451+0000 7fd0377fe640 1 -- >> v1:172.21.15.59:6789/0 conn(0x7fd0380c94b0 legacy=0x7fd0380ca5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.59:6789/0 2024-04-25T15:45:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:47.451+0000 7fd037fff640 1 -- >> v2:172.21.15.59:3300/0 conn(0x7fd03815d6a0 msgr2=0x7fd0380cf1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.59:3300/0 2024-04-25T15:45:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:47.451+0000 7fd037fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd03815d6a0 0x7fd0380cf1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T15:45:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:47.451+0000 7fd03c94f640 1 -- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 msgr2=0x7fd038152e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.64:3301/0 2024-04-25T15:45:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:47.451+0000 7fd03c94f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 0x7fd038152e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T15:45:47.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:47.652+0000 7fd0377fe640 1 -- >> v1:172.21.15.59:6789/0 conn(0x7fd0380c94b0 legacy=0x7fd0380ca5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.59:6789/0 2024-04-25T15:45:47.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:47.652+0000 7fd037fff640 1 -- >> v2:172.21.15.59:3300/0 conn(0x7fd03815d6a0 msgr2=0x7fd0380cf1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.59:3300/0 2024-04-25T15:45:47.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:47.652+0000 7fd037fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd03815d6a0 0x7fd0380cf1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T15:45:47.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:47.652+0000 7fd03c94f640 1 -- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 msgr2=0x7fd038152e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.64:3301/0 2024-04-25T15:45:47.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:47.652+0000 7fd03c94f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 0x7fd038152e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T15:45:48.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:48.053+0000 7fd0377fe640 1 -- >> v1:172.21.15.59:6789/0 conn(0x7fd0380c94b0 legacy=0x7fd0380ca5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.59:6789/0 2024-04-25T15:45:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:48.053+0000 7fd037fff640 1 -- >> v2:172.21.15.59:3300/0 conn(0x7fd03815d6a0 msgr2=0x7fd0380cf1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.59:3300/0 2024-04-25T15:45:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:48.053+0000 7fd037fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd03815d6a0 0x7fd0380cf1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T15:45:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:48.053+0000 7fd03c94f640 1 -- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 msgr2=0x7fd038152e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.64:3301/0 2024-04-25T15:45:48.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:48.053+0000 7fd03c94f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 0x7fd038152e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T15:45:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:48.854+0000 7fd037fff640 1 -- >> v2:172.21.15.59:3300/0 conn(0x7fd03815d6a0 msgr2=0x7fd0380cf1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.59:3300/0 2024-04-25T15:45:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:48.854+0000 7fd0377fe640 1 -- >> v1:172.21.15.59:6789/0 conn(0x7fd0380c94b0 legacy=0x7fd0380ca5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.59:6789/0 2024-04-25T15:45:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:48.854+0000 7fd037fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd03815d6a0 0x7fd0380cf1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T15:45:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:48.854+0000 7fd03c94f640 1 -- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 msgr2=0x7fd038152e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.64:3301/0 2024-04-25T15:45:48.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:48.854+0000 7fd03c94f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 0x7fd038152e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T15:45:50.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:50.451+0000 7fd035ffb640 1 -- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 msgr2=0x7fd038152e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:45:50.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:50.451+0000 7fd035ffb640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 0x7fd038152e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:50.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:50.451+0000 7fd035ffb640 1 -- >> v2:172.21.15.59:3300/0 conn(0x7fd03815d6a0 msgr2=0x7fd0380cf1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:45:50.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:50.451+0000 7fd035ffb640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd03815d6a0 0x7fd0380cf1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:50.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:50.451+0000 7fd035ffb640 1 -- >> v1:172.21.15.59:6789/0 conn(0x7fd0380c94b0 legacy=0x7fd0380ca5d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:45:50.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:50.451+0000 7fd035ffb640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd0240058d0 0x7fd024007da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:50.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:50.451+0000 7fd035ffb640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd03815a1b0 con 0x7fd0240083f0 2024-04-25T15:45:50.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:50.451+0000 7fd035ffb640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fd03815c970 con 0x7fd0240058d0 2024-04-25T15:45:50.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:50.451+0000 7fd037fff640 1 -- >> v2:172.21.15.64:3300/0 conn(0x7fd0240058d0 msgr2=0x7fd024007da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.64:3300/0 2024-04-25T15:45:50.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:50.451+0000 7fd0377fe640 1 -- >> v1:172.21.15.64:6789/0 conn(0x7fd0240083f0 legacy=0x7fd02400a900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.64:6789/0 2024-04-25T15:45:50.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:50.451+0000 7fd037fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd0240058d0 0x7fd024007da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T15:45:50.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:50.652+0000 7fd037fff640 1 -- >> v2:172.21.15.64:3300/0 conn(0x7fd0240058d0 msgr2=0x7fd024007da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.64:3300/0 2024-04-25T15:45:50.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:50.652+0000 7fd0377fe640 1 -- >> v1:172.21.15.64:6789/0 conn(0x7fd0240083f0 legacy=0x7fd02400a900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.64:6789/0 2024-04-25T15:45:50.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:50.652+0000 7fd037fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd0240058d0 0x7fd024007da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T15:45:51.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:51.053+0000 7fd037fff640 1 -- >> v2:172.21.15.64:3300/0 conn(0x7fd0240058d0 msgr2=0x7fd024007da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.64:3300/0 2024-04-25T15:45:51.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:51.053+0000 7fd0377fe640 1 -- >> v1:172.21.15.64:6789/0 conn(0x7fd0240083f0 legacy=0x7fd02400a900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.64:6789/0 2024-04-25T15:45:51.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:51.053+0000 7fd037fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd0240058d0 0x7fd024007da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T15:45:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:51.854+0000 7fd037fff640 1 -- >> v2:172.21.15.64:3300/0 conn(0x7fd0240058d0 msgr2=0x7fd024007da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.64:3300/0 2024-04-25T15:45:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:51.854+0000 7fd0377fe640 1 -- >> v1:172.21.15.64:6789/0 conn(0x7fd0240083f0 legacy=0x7fd02400a900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.64:6789/0 2024-04-25T15:45:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:51.854+0000 7fd037fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd0240058d0 0x7fd024007da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T15:45:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.451+0000 7fd035ffb640 1 -- >> v2:172.21.15.64:3300/0 conn(0x7fd0240058d0 msgr2=0x7fd024007da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:45:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.451+0000 7fd035ffb640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd0240058d0 0x7fd024007da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.451+0000 7fd035ffb640 1 -- >> v1:172.21.15.64:6789/0 conn(0x7fd0240083f0 legacy=0x7fd02400a900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:45:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.451+0000 7fd03c94f640 1 -- reap_dead start 2024-04-25T15:45:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.451+0000 7fd035ffb640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 0x7fd02400c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.451+0000 7fd035ffb640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd02400c720 0x7fd024007da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.451+0000 7fd035ffb640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd02400ccb0 0x7fd02400a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.451+0000 7fd035ffb640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd03815c970 con 0x7fd02400ccb0 2024-04-25T15:45:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.451+0000 7fd035ffb640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fd038159f10 con 0x7fd02400c720 2024-04-25T15:45:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.451+0000 7fd035ffb640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd02400b0d0 con 0x7fd038072140 2024-04-25T15:45:53.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.451+0000 7fd037fff640 1 -- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 msgr2=0x7fd02400c1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.64:3301/0 2024-04-25T15:45:53.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.451+0000 7fd03c94f640 1 -- >> v2:172.21.15.59:3300/0 conn(0x7fd02400ccb0 msgr2=0x7fd02400a900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.59:3300/0 2024-04-25T15:45:53.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.451+0000 7fd0377fe640 1 -- >> v2:172.21.15.64:3300/0 conn(0x7fd02400c720 msgr2=0x7fd024007da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.64:3300/0 2024-04-25T15:45:53.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.451+0000 7fd03c94f640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd02400ccb0 0x7fd02400a900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T15:45:53.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.451+0000 7fd037fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 0x7fd02400c1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T15:45:53.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.451+0000 7fd0377fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd02400c720 0x7fd024007da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T15:45:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.652+0000 7fd03c94f640 1 -- >> v2:172.21.15.59:3300/0 conn(0x7fd02400ccb0 msgr2=0x7fd02400a900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.59:3300/0 2024-04-25T15:45:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.652+0000 7fd03c94f640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd02400ccb0 0x7fd02400a900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T15:45:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.652+0000 7fd037fff640 1 -- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 msgr2=0x7fd02400c1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.64:3301/0 2024-04-25T15:45:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.652+0000 7fd0377fe640 1 -- >> v2:172.21.15.64:3300/0 conn(0x7fd02400c720 msgr2=0x7fd024007da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.64:3300/0 2024-04-25T15:45:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.652+0000 7fd037fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 0x7fd02400c1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T15:45:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:53.652+0000 7fd0377fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd02400c720 0x7fd024007da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T15:45:54.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:54.053+0000 7fd03c94f640 1 -- >> v2:172.21.15.59:3300/0 conn(0x7fd02400ccb0 msgr2=0x7fd02400a900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.59:3300/0 2024-04-25T15:45:54.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:54.053+0000 7fd03c94f640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd02400ccb0 0x7fd02400a900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T15:45:54.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:54.053+0000 7fd0377fe640 1 -- >> v2:172.21.15.64:3300/0 conn(0x7fd02400c720 msgr2=0x7fd024007da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.64:3300/0 2024-04-25T15:45:54.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:54.053+0000 7fd037fff640 1 -- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 msgr2=0x7fd02400c1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.64:3301/0 2024-04-25T15:45:54.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:54.053+0000 7fd0377fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd02400c720 0x7fd024007da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T15:45:54.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:54.053+0000 7fd037fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 0x7fd02400c1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T15:45:54.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:54.854+0000 7fd03c94f640 1 -- >> v2:172.21.15.59:3300/0 conn(0x7fd02400ccb0 msgr2=0x7fd02400a900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.59:3300/0 2024-04-25T15:45:54.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:54.854+0000 7fd03c94f640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd02400ccb0 0x7fd02400a900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T15:45:54.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:54.854+0000 7fd037fff640 1 -- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 msgr2=0x7fd02400c1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.64:3301/0 2024-04-25T15:45:54.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:54.854+0000 7fd0377fe640 1 -- >> v2:172.21.15.64:3300/0 conn(0x7fd02400c720 msgr2=0x7fd024007da0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.64:3300/0 2024-04-25T15:45:54.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:54.854+0000 7fd037fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 0x7fd02400c1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T15:45:54.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:54.854+0000 7fd0377fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd02400c720 0x7fd024007da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T15:45:55.071 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:00:07.676 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T15:45:55.150 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:00:07.714 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T15:45:55.152 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:00:07.716 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T15:45:55.421 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:00:08.026 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T15:45:55.500 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:00:08.063 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T15:45:55.502 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:00:08.065 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T15:45:56.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:56.451+0000 7fd035ffb640 1 -- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 msgr2=0x7fd02400c1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:45:56.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:56.451+0000 7fd035ffb640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd038072140 0x7fd02400c1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:56.451+0000 7fd035ffb640 1 -- >> v2:172.21.15.64:3300/0 conn(0x7fd02400c720 msgr2=0x7fd024007da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:45:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:56.451+0000 7fd035ffb640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd02400c720 0x7fd024007da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:56.451+0000 7fd035ffb640 1 -- >> v2:172.21.15.59:3300/0 conn(0x7fd02400ccb0 msgr2=0x7fd02400a900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:45:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:56.451+0000 7fd035ffb640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd02400ccb0 0x7fd02400a900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:45:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:56.451+0000 7fd035ffb640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0380ca160 con 0x7fd024012400 2024-04-25T15:45:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:56.451+0000 7fd035ffb640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd03815a1b0 con 0x7fd02400b300 2024-04-25T15:45:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:56.451+0000 7fd0377fe640 1 -- >> v1:172.21.15.59:6789/0 conn(0x7fd024012400 legacy=0x7fd024014820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.59:6789/0 2024-04-25T15:45:56.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:56.451+0000 7fd037fff640 1 -- >> v1:172.21.15.64:6789/0 conn(0x7fd02400b300 legacy=0x7fd02400b710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.64:6789/0 2024-04-25T15:45:56.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:56.652+0000 7fd0377fe640 1 -- >> v1:172.21.15.59:6789/0 conn(0x7fd024012400 legacy=0x7fd024014820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.59:6789/0 2024-04-25T15:45:56.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:56.652+0000 7fd037fff640 1 -- >> v1:172.21.15.64:6789/0 conn(0x7fd02400b300 legacy=0x7fd02400b710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.64:6789/0 2024-04-25T15:45:57.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:57.235+0000 7fd0377fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd024012400 0x7fd024014820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54880/0 (socket says 172.21.15.59:54880) 2024-04-25T15:45:57.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:57.235+0000 7fd0377fe640 1 -- 172.21.15.59:0/2139164379 learned_addr learned my addr 172.21.15.59:0/2139164379 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:45:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:57.460+0000 7fd0377fe640 1 -- 172.21.15.59:0/2139164379 >> v1:172.21.15.59:6789/0 conn(0x7fd024012400 legacy=0x7fd024014820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-25T15:45:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:57.460+0000 7fd0377fe640 1 -- 172.21.15.59:0/2139164379 >> v1:172.21.15.59:6789/0 conn(0x7fd024012400 legacy=0x7fd024014820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T15:45:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:57.460+0000 7fd0377fe640 1 --1- 172.21.15.59:0/2139164379 >> v1:172.21.15.59:6789/0 conn(0x7fd024012400 0x7fd024014820 :-1 s=OPENED pgs=1 cs=1 l=1).handle_message read tag failed 2024-04-25T15:45:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:57.460+0000 7fd0377fe640 1 --1- 172.21.15.59:0/2139164379 >> v1:172.21.15.59:6789/0 conn(0x7fd024012400 0x7fd024014820 :-1 s=OPENED pgs=1 cs=1 l=1).fault on lossy channel, failing 2024-04-25T15:45:57.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:57.477+0000 7fd037fff640 1 -- 172.21.15.59:0/2139164379 >> v1:172.21.15.64:6789/0 conn(0x7fd02400b300 legacy=0x7fd02400b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-04-25T15:45:57.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:57.477+0000 7fd037fff640 1 -- 172.21.15.59:0/2139164379 >> v1:172.21.15.64:6789/0 conn(0x7fd02400b300 legacy=0x7fd02400b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T15:45:57.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:57.477+0000 7fd037fff640 1 --1- 172.21.15.59:0/2139164379 >> v1:172.21.15.64:6789/0 conn(0x7fd02400b300 0x7fd02400b710 :-1 s=OPENED pgs=2 cs=1 l=1).handle_message read tag failed 2024-04-25T15:45:57.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:57.477+0000 7fd037fff640 1 --1- 172.21.15.59:0/2139164379 >> v1:172.21.15.64:6789/0 conn(0x7fd02400b300 0x7fd02400b710 :-1 s=OPENED pgs=2 cs=1 l=1).fault on lossy channel, failing 2024-04-25T15:45:57.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:57.477+0000 7fd03c94f640 1 -- 172.21.15.59:0/2139164379 reap_dead start 2024-04-25T15:45:59.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:59.451+0000 7fd035ffb640 1 -- 172.21.15.59:0/2139164379 >> v1:172.21.15.64:6789/0 conn(0x7fd02400b300 legacy=0x7fd02400b710 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T15:45:59.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:59.451+0000 7fd035ffb640 1 -- 172.21.15.59:0/2139164379 >> v1:172.21.15.59:6789/0 conn(0x7fd024012400 legacy=0x7fd024014820 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T15:45:59.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:59.451+0000 7fd035ffb640 1 --2- 172.21.15.59:0/2139164379 >> v2:172.21.15.59:3300/0 conn(0x7fd024007da0 0x7fd02400c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:45:59.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:59.451+0000 7fd035ffb640 1 -- 172.21.15.59:0/2139164379 --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd024017f60 con 0x7fd024012400 2024-04-25T15:45:59.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:59.451+0000 7fd035ffb640 1 -- 172.21.15.59:0/2139164379 --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd02400a010 con 0x7fd02400b300 2024-04-25T15:45:59.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:59.451+0000 7fd035ffb640 1 -- 172.21.15.59:0/2139164379 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd03815c970 con 0x7fd024007da0 2024-04-25T15:45:59.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:59.788+0000 7fd03c94f640 1 --2- 172.21.15.59:0/2139164379 >> v2:172.21.15.59:3300/0 conn(0x7fd024007da0 0x7fd02400c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:45:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:59.805+0000 7fd03c94f640 1 -- 172.21.15.59:0/2139164379 >> v2:172.21.15.59:3300/0 conn(0x7fd024007da0 msgr2=0x7fd02400c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T15:45:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:59.805+0000 7fd03c94f640 1 -- 172.21.15.59:0/2139164379 >> v2:172.21.15.59:3300/0 conn(0x7fd024007da0 msgr2=0x7fd02400c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:45:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:59.805+0000 7fd03c94f640 1 --2- 172.21.15.59:0/2139164379 >> v2:172.21.15.59:3300/0 conn(0x7fd024007da0 0x7fd02400c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:45:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:45:59.805+0000 7fd03c94f640 1 --2- 172.21.15.59:0/2139164379 >> v2:172.21.15.59:3300/0 conn(0x7fd024007da0 0x7fd02400c1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T15:46:00.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:00.024+0000 7fd03c94f640 1 --2- 172.21.15.59:0/2139164379 >> v2:172.21.15.59:3300/0 conn(0x7fd024007da0 0x7fd02400c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:00.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:00.027+0000 7fd03c94f640 1 -- 172.21.15.59:0/2139164379 >> v2:172.21.15.59:3300/0 conn(0x7fd024007da0 msgr2=0x7fd02400c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T15:46:00.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:00.027+0000 7fd03c94f640 1 -- 172.21.15.59:0/2139164379 >> v2:172.21.15.59:3300/0 conn(0x7fd024007da0 msgr2=0x7fd02400c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:46:00.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:00.027+0000 7fd03c94f640 1 --2- 172.21.15.59:0/2139164379 >> v2:172.21.15.59:3300/0 conn(0x7fd024007da0 0x7fd02400c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:46:00.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:00.027+0000 7fd03c94f640 1 --2- 172.21.15.59:0/2139164379 >> v2:172.21.15.59:3300/0 conn(0x7fd024007da0 0x7fd02400c1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T15:46:00.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:00.429+0000 7fd03c94f640 1 --2- 172.21.15.59:0/2139164379 >> v2:172.21.15.59:3300/0 conn(0x7fd024007da0 0x7fd02400c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:00.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:00.430+0000 7fd03c94f640 1 -- 172.21.15.59:0/2139164379 >> v2:172.21.15.59:3300/0 conn(0x7fd024007da0 msgr2=0x7fd02400c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T15:46:00.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:00.430+0000 7fd03c94f640 1 -- 172.21.15.59:0/2139164379 >> v2:172.21.15.59:3300/0 conn(0x7fd024007da0 msgr2=0x7fd02400c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:46:00.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:00.430+0000 7fd03c94f640 1 --2- 172.21.15.59:0/2139164379 >> v2:172.21.15.59:3300/0 conn(0x7fd024007da0 0x7fd02400c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:46:00.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:00.430+0000 7fd03c94f640 1 --2- 172.21.15.59:0/2139164379 >> v2:172.21.15.59:3300/0 conn(0x7fd024007da0 0x7fd02400c1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T15:46:01.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.182+0000 7fd036ffd640 1 -- 172.21.15.59:0/2139164379 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 783343116 0 0) 0x7fd024017f60 con 0x7fd024012400 2024-04-25T15:46:01.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.182+0000 7fd036ffd640 1 -- 172.21.15.59:0/2139164379 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd020003520 con 0x7fd024012400 2024-04-25T15:46:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.228+0000 7fd036ffd640 1 -- 172.21.15.59:0/2139164379 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2624284305 0 0) 0x7fd02400a010 con 0x7fd02400b300 2024-04-25T15:46:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.228+0000 7fd036ffd640 1 -- 172.21.15.59:0/2139164379 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd024017f60 con 0x7fd02400b300 2024-04-25T15:46:01.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.243+0000 7fd03c94f640 1 --2- 172.21.15.59:0/2139164379 >> v2:172.21.15.59:3300/0 conn(0x7fd024007da0 0x7fd02400c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:01.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.255+0000 7fd03c94f640 1 -- 172.21.15.59:0/2139164379 >> v1:172.21.15.64:6789/0 conn(0x7fd02400b300 legacy=0x7fd024009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.255+0000 7fd03c94f640 1 -- 172.21.15.59:0/2139164379 >> v1:172.21.15.59:6789/0 conn(0x7fd024012400 legacy=0x7fd02400b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.255+0000 7fd03c94f640 1 -- 172.21.15.59:0/2139164379 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02400a1e0 con 0x7fd024007da0 2024-04-25T15:46:01.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.274+0000 7fd03c94f640 1 --2- 172.21.15.59:0/2139164379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd024007da0 0x7fd02400c1b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd0380cc240 tx=0x7fd03002b1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b40bcb3a1481ca5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:01.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.319+0000 7fd036ffd640 1 -- 172.21.15.59:0/2139164379 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd030031070 con 0x7fd024007da0 2024-04-25T15:46:01.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.319+0000 7fd036ffd640 1 -- 172.21.15.59:0/2139164379 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd030035400 con 0x7fd024007da0 2024-04-25T15:46:01.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.319+0000 7fd036ffd640 1 -- 172.21.15.59:0/2139164379 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0300357d0 con 0x7fd024007da0 2024-04-25T15:46:01.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.320+0000 7fd03e3b2640 1 -- 172.21.15.59:0/2139164379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd024007da0 msgr2=0x7fd02400c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.320+0000 7fd03e3b2640 1 --2- 172.21.15.59:0/2139164379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd024007da0 0x7fd02400c1b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd0380cc240 tx=0x7fd03002b1d0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.320+0000 7fd03e3b2640 1 -- 172.21.15.59:0/2139164379 shutdown_connections 2024-04-25T15:46:01.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.320+0000 7fd03e3b2640 1 --2- 172.21.15.59:0/2139164379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd024007da0 0x7fd02400c1b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.320+0000 7fd03e3b2640 1 -- 172.21.15.59:0/2139164379 >> 172.21.15.59:0/2139164379 conn(0x7fd038068d80 msgr2=0x7fd038070340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:01.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.320+0000 7fd03e3b2640 1 -- 172.21.15.59:0/2139164379 shutdown_connections 2024-04-25T15:46:01.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.320+0000 7fd03e3b2640 1 -- 172.21.15.59:0/2139164379 wait complete. 2024-04-25T15:46:01.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.322+0000 7fd03e3b2640 1 Processor -- start 2024-04-25T15:46:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.322+0000 7fd03e3b2640 1 -- start start 2024-04-25T15:46:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.323+0000 7fd03e3b2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd024007da0 0x7fd03814ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.323+0000 7fd03e3b2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd02400b300 0x7fd0381edf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.323+0000 7fd03e3b2640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd024012400 0x7fd03806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.323+0000 7fd03e3b2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd0380c9100 con 0x7fd02400b300 2024-04-25T15:46:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.323+0000 7fd03e3b2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd03815cea0 con 0x7fd024007da0 2024-04-25T15:46:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.323+0000 7fd03e3b2640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd0380c9280 con 0x7fd024012400 2024-04-25T15:46:01.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.328+0000 7fd0377fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd02400b300 0x7fd0381edf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:01.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.329+0000 7fd03c94f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd024012400 0x7fd03806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:01.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.330+0000 7fd03c94f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd024012400 0x7fd03806d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:45032/0 (socket says 172.21.15.59:45032) 2024-04-25T15:46:01.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.330+0000 7fd03c94f640 1 -- 172.21.15.59:0/1243049397 learned_addr learned my addr 172.21.15.59:0/1243049397 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.349+0000 7fd03c94f640 1 -- 172.21.15.59:0/1243049397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd024007da0 msgr2=0x7fd03814ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.349+0000 7fd03c94f640 1 --2- 172.21.15.59:0/1243049397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd024007da0 0x7fd03814ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.349+0000 7fd03c94f640 1 -- 172.21.15.59:0/1243049397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd02400b300 msgr2=0x7fd0381edf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:01.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.349+0000 7fd03c94f640 1 --2- 172.21.15.59:0/1243049397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd02400b300 0x7fd0381edf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:01.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.349+0000 7fd03c94f640 1 -- 172.21.15.59:0/1243049397 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0381ee460 con 0x7fd024012400 2024-04-25T15:46:01.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.370+0000 7fd03c94f640 1 --2- 172.21.15.59:0/1243049397 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd024012400 0x7fd03806d8e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd030000f80 tx=0x7fd030005f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:01.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.441+0000 7fd034ff9640 1 -- 172.21.15.59:0/1243049397 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd030040850 con 0x7fd024012400 2024-04-25T15:46:01.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.441+0000 7fd034ff9640 1 -- 172.21.15.59:0/1243049397 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd030047070 con 0x7fd024012400 2024-04-25T15:46:01.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.441+0000 7fd03e3b2640 1 -- 172.21.15.59:0/1243049397 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0380ceb00 con 0x7fd024012400 2024-04-25T15:46:01.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.442+0000 7fd034ff9640 1 -- 172.21.15.59:0/1243049397 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd030040bf0 con 0x7fd024012400 2024-04-25T15:46:01.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.442+0000 7fd03e3b2640 1 -- 172.21.15.59:0/1243049397 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd03814d7a0 con 0x7fd024012400 2024-04-25T15:46:01.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.442+0000 7fd03e3b2640 1 -- 172.21.15.59:0/1243049397 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd038069fb0 con 0x7fd024012400 2024-04-25T15:46:01.543 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:01.542+0000 7fa6fbd21040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T15:46:01.603 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:01.602+0000 7f4fb7587040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T15:46:01.701 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:01.700+0000 7fa6fbd21040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:46:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.703+0000 7fd034ff9640 1 -- 172.21.15.59:0/1243049397 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd030013040 con 0x7fd024012400 2024-04-25T15:46:01.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.710+0000 7fd034ff9640 1 -- 172.21.15.59:0/1243049397 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd03004c8b0 con 0x7fd024012400 2024-04-25T15:46:01.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.710+0000 7fd034ff9640 1 -- 172.21.15.59:0/1243049397 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd0300073e0 con 0x7fd024012400 2024-04-25T15:46:01.758 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:01.758+0000 7fa6fbd21040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T15:46:01.762 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:01.762+0000 7f4fb7587040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:46:01.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:01.777+0000 7fd03e3b2640 1 -- 172.21.15.59:0/1243049397 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fd0380b3c90 con 0x7fd024012400 2024-04-25T15:46:01.819 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:01.818+0000 7f4fb7587040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T15:46:02.015 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:02.014+0000 7fa6fbd21040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T15:46:02.063 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:02.063+0000 7fa6fbd21040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T15:46:02.070 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:02.070+0000 7f4fb7587040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T15:46:02.121 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:02.120+0000 7f4fb7587040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T15:46:02.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:02.164+0000 7fd034ff9640 1 -- 172.21.15.59:0/1243049397 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fd030040d90 con 0x7fd024012400 2024-04-25T15:46:02.165 INFO:teuthology.orchestra.run.smithi059.stderr:adjusted tunables profile to default 2024-04-25T15:46:02.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:02.164+0000 7fd03e3b2640 1 -- 172.21.15.59:0/1243049397 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd024012400 msgr2=0x7fd03806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:02.165+0000 7fd03e3b2640 1 --2- 172.21.15.59:0/1243049397 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd024012400 0x7fd03806d8e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd030000f80 tx=0x7fd030005f50 comp rx=0 tx=0).stop 2024-04-25T15:46:02.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:02.165+0000 7fd03e3b2640 1 -- 172.21.15.59:0/1243049397 shutdown_connections 2024-04-25T15:46:02.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:02.165+0000 7fd03e3b2640 1 --2- 172.21.15.59:0/1243049397 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd024012400 0x7fd03806d8e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:02.165+0000 7fd03e3b2640 1 --2- 172.21.15.59:0/1243049397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd02400b300 0x7fd0381edf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:02.165+0000 7fd03e3b2640 1 --2- 172.21.15.59:0/1243049397 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd024007da0 0x7fd03814ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:02.165+0000 7fd03e3b2640 1 -- 172.21.15.59:0/1243049397 >> 172.21.15.59:0/1243049397 conn(0x7fd038068d80 msgr2=0x7fd038157d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:02.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:02.165+0000 7fd03e3b2640 1 -- 172.21.15.59:0/1243049397 shutdown_connections 2024-04-25T15:46:02.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:02.165+0000 7fd03e3b2640 1 -- 172.21.15.59:0/1243049397 wait complete. 2024-04-25T15:46:02.179 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T15:46:02.179 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T15:46:02.179 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:46:02.179 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T15:46:02.207 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:46:02.207 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T15:46:02.272 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:46:02.272 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T15:46:02.335 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:46:02.336 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T15:46:02.403 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:46:02.403 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T15:46:02.428 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:46:02.428 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T15:46:02.496 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:46:02.496 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T15:46:02.561 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-04-25T15:46:02.561 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T15:46:02.628 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new 34cee654-11dd-4f4b-99fe-093462f8abad 0 2024-04-25T15:46:02.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.780+0000 7f1daae0c640 1 Processor -- start 2024-04-25T15:46:02.781 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.781+0000 7f1daae0c640 1 -- start start 2024-04-25T15:46:02.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.782+0000 7f1daae0c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1da406c580 0x7f1da406c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.782 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.782+0000 7f1daae0c640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1da4152fe0 con 0x7f1da40c7640 2024-04-25T15:46:02.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.782+0000 7f1daae0c640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1da40c94b0 con 0x7f1da4152bd0 2024-04-25T15:46:02.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.782+0000 7f1daae0c640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1da40c9750 con 0x7f1da406c580 2024-04-25T15:46:02.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.783+0000 7f1da93a9640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1da406c580 0x7f1da406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.783+0000 7f1da8ba8640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f1da4152bd0 0x7f1da40c4b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:55220/0 (socket says 172.21.15.64:55220) 2024-04-25T15:46:02.783 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.783+0000 7f1da8ba8640 1 -- 172.21.15.64:0/1160430676 learned_addr learned my addr 172.21.15.64:0/1160430676 (peer_addr_for_me v1:172.21.15.64:0/0) 2024-04-25T15:46:02.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.787+0000 7f1da93a9640 1 -- 172.21.15.64:0/1160430676 >> v1:172.21.15.64:6789/0 conn(0x7f1da4152bd0 legacy=0x7f1da40c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.787+0000 7f1da93a9640 1 -- 172.21.15.64:0/1160430676 >> v1:172.21.15.59:6789/0 conn(0x7f1da40c7640 legacy=0x7f1da4158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.788 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.787+0000 7f1da93a9640 1 -- 172.21.15.64:0/1160430676 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da40c53e0 con 0x7f1da406c580 2024-04-25T15:46:02.795 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.795+0000 7f1da93a9640 1 --2- 172.21.15.64:0/1160430676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da406c580 0x7f1da406c990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00aea0 tx=0x7f1d9c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2281797a3a99c28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:02.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.800+0000 7f1da37fe640 1 -- 172.21.15.64:0/1160430676 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c038070 con 0x7f1da406c580 2024-04-25T15:46:02.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.800+0000 7f1da37fe640 1 -- 172.21.15.64:0/1160430676 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d9c008640 con 0x7f1da406c580 2024-04-25T15:46:02.801 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.800+0000 7f1da37fe640 1 -- 172.21.15.64:0/1160430676 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c008a10 con 0x7f1da406c580 2024-04-25T15:46:02.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.801+0000 7f1daae0c640 1 -- 172.21.15.64:0/1160430676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da406c580 msgr2=0x7f1da406c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.801+0000 7f1daae0c640 1 --2- 172.21.15.64:0/1160430676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da406c580 0x7f1da406c990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00aea0 tx=0x7f1d9c02b840 comp rx=0 tx=0).stop 2024-04-25T15:46:02.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.801+0000 7f1daae0c640 1 -- 172.21.15.64:0/1160430676 shutdown_connections 2024-04-25T15:46:02.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.801+0000 7f1daae0c640 1 --2- 172.21.15.64:0/1160430676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da406c580 0x7f1da406c990 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.801+0000 7f1daae0c640 1 -- 172.21.15.64:0/1160430676 >> 172.21.15.64:0/1160430676 conn(0x7f1da4071720 msgr2=0x7f1da40ca140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:02.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.801+0000 7f1daae0c640 1 -- 172.21.15.64:0/1160430676 shutdown_connections 2024-04-25T15:46:02.802 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.801+0000 7f1daae0c640 1 -- 172.21.15.64:0/1160430676 wait complete. 2024-04-25T15:46:02.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.803+0000 7f1daae0c640 1 Processor -- start 2024-04-25T15:46:02.804 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.803+0000 7f1daae0c640 1 -- start start 2024-04-25T15:46:02.806 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.805+0000 7f1daae0c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da406c580 0x7f1da40ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.805+0000 7f1daae0c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1da40c7640 0x7f1da413dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.809 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.805+0000 7f1daae0c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1da4152bd0 0x7f1da413e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:02.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.805+0000 7f1daae0c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1da40c56a0 con 0x7f1da406c580 2024-04-25T15:46:02.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.805+0000 7f1daae0c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1da40c9cf0 con 0x7f1da4152bd0 2024-04-25T15:46:02.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.805+0000 7f1daae0c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1da40c5980 con 0x7f1da40c7640 2024-04-25T15:46:02.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.805+0000 7f1da3fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1da40c7640 0x7f1da413dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.805+0000 7f1da93a9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1da4152bd0 0x7f1da413e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.805+0000 7f1da8ba8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da406c580 0x7f1da40ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:02.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.806+0000 7f1da3fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1da40c7640 0x7f1da413dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:60768/0 (socket says 172.21.15.64:60768) 2024-04-25T15:46:02.810 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.806+0000 7f1da3fff640 1 -- 172.21.15.64:0/527219480 learned_addr learned my addr 172.21.15.64:0/527219480 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-25T15:46:02.811 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.810+0000 7f1da8ba8640 1 -- 172.21.15.64:0/527219480 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1da40c7640 msgr2=0x7f1da413dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.810+0000 7f1da8ba8640 1 --2- 172.21.15.64:0/527219480 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1da40c7640 0x7f1da413dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.810+0000 7f1da8ba8640 1 -- 172.21.15.64:0/527219480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1da4152bd0 msgr2=0x7f1da413e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:02.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.810+0000 7f1da8ba8640 1 --2- 172.21.15.64:0/527219480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1da4152bd0 0x7f1da413e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:02.812 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.810+0000 7f1da8ba8640 1 -- 172.21.15.64:0/527219480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da413e770 con 0x7f1da406c580 2024-04-25T15:46:02.813 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.812+0000 7f1da8ba8640 1 --2- 172.21.15.64:0/527219480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da406c580 0x7f1da40ca370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800c390 tx=0x7f1d9800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:02.818 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:02.817+0000 7fa6fbd21040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T15:46:02.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.817+0000 7f1da17fa640 1 -- 172.21.15.64:0/527219480 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98017070 con 0x7f1da406c580 2024-04-25T15:46:02.819 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.817+0000 7f1da17fa640 1 -- 172.21.15.64:0/527219480 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d980074e0 con 0x7f1da406c580 2024-04-25T15:46:02.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.818+0000 7f1da17fa640 1 -- 172.21.15.64:0/527219480 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d980059a0 con 0x7f1da406c580 2024-04-25T15:46:02.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.818+0000 7f1daae0c640 1 -- 172.21.15.64:0/527219480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da41490e0 con 0x7f1da406c580 2024-04-25T15:46:02.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.818+0000 7f1daae0c640 1 -- 172.21.15.64:0/527219480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da4149380 con 0x7f1da406c580 2024-04-25T15:46:02.820 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:02.818+0000 7f1daae0c640 1 -- 172.21.15.64:0/527219480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da4069910 con 0x7f1da406c580 2024-04-25T15:46:02.922 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:02.921+0000 7f4fb7587040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T15:46:02.974 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:02.973+0000 7fa6fbd21040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T15:46:03.020 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:03.019+0000 7f4fb7587040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T15:46:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.033+0000 7f1da17fa640 1 -- 172.21.15.64:0/527219480 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1d9801a070 con 0x7f1da406c580 2024-04-25T15:46:03.047 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:03.047+0000 7fa6fbd21040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T15:46:03.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.050+0000 7f1da17fa640 1 -- 172.21.15.64:0/527219480 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f1d98012400 con 0x7f1da406c580 2024-04-25T15:46:03.051 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.050+0000 7f1da17fa640 1 -- 172.21.15.64:0/527219480 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1d98005b40 con 0x7f1da406c580 2024-04-25T15:46:03.068 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:03.068+0000 7f4fb7587040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T15:46:03.148 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.148+0000 7f1daae0c640 1 -- 172.21.15.64:0/527219480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "34cee654-11dd-4f4b-99fe-093462f8abad", "id": 0} v 0) -- 0x7f1da414c930 con 0x7f1da406c580 2024-04-25T15:46:03.243 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:03.242+0000 7fa6fbd21040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T15:46:03.247 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:03.246+0000 7f4fb7587040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T15:46:03.275 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.275+0000 7f1da17fa640 1 -- 172.21.15.64:0/527219480 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "34cee654-11dd-4f4b-99fe-093462f8abad", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f1d98005d80 con 0x7f1da406c580 2024-04-25T15:46:03.276 INFO:teuthology.orchestra.run.smithi064.stdout:0 2024-04-25T15:46:03.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.276+0000 7f1daae0c640 1 -- 172.21.15.64:0/527219480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da406c580 msgr2=0x7f1da40ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.276 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.276+0000 7f1daae0c640 1 --2- 172.21.15.64:0/527219480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da406c580 0x7f1da40ca370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800c390 tx=0x7f1d9800c850 comp rx=0 tx=0).stop 2024-04-25T15:46:03.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.276+0000 7f1daae0c640 1 -- 172.21.15.64:0/527219480 shutdown_connections 2024-04-25T15:46:03.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.276+0000 7f1daae0c640 1 --2- 172.21.15.64:0/527219480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1da4152bd0 0x7f1da413e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.276+0000 7f1daae0c640 1 --2- 172.21.15.64:0/527219480 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1da40c7640 0x7f1da413dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.276+0000 7f1daae0c640 1 --2- 172.21.15.64:0/527219480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da406c580 0x7f1da40ca370 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.276+0000 7f1daae0c640 1 -- 172.21.15.64:0/527219480 >> 172.21.15.64:0/527219480 conn(0x7f1da4071720 msgr2=0x7f1da4150250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:03.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.276+0000 7f1daae0c640 1 -- 172.21.15.64:0/527219480 shutdown_connections 2024-04-25T15:46:03.277 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.276+0000 7f1daae0c640 1 -- 172.21.15.64:0/527219480 wait complete. 2024-04-25T15:46:03.288 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new 3c15505b-4abd-4a24-b30c-edc2732f8ac4 1 2024-04-25T15:46:03.294 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:03.293+0000 7fa6fbd21040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T15:46:03.305 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:03.305+0000 7f4fb7587040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T15:46:03.351 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:03.350+0000 7fa6fbd21040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T15:46:03.366 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:03.366+0000 7f4fb7587040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T15:46:03.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.405+0000 7f35d6470640 1 Processor -- start 2024-04-25T15:46:03.406 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.405+0000 7f35d6470640 1 -- start start 2024-04-25T15:46:03.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.407+0000 7f35d6470640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f35d015a290 0x7f35d015e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.407 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.407+0000 7f35d6470640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35d00b1470 con 0x7f35d00b0bf0 2024-04-25T15:46:03.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.407+0000 7f35d6470640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35d00b1950 con 0x7f35d00c9190 2024-04-25T15:46:03.408 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.407+0000 7f35d6470640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f35d00b1c30 con 0x7f35d015a290 2024-04-25T15:46:03.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.417+0000 7f35cffff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f35d015a290 0x7f35d015e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.418 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.418+0000 7f35d4a0d640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f35d00b0bf0 0x7f35d0164c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.64:42876/0 (socket says 172.21.15.64:42876) 2024-04-25T15:46:03.419 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.418+0000 7f35d4a0d640 1 -- 172.21.15.64:0/1494653882 learned_addr learned my addr 172.21.15.64:0/1494653882 (peer_addr_for_me v1:172.21.15.64:0/0) 2024-04-25T15:46:03.426 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.423+0000 7f35cffff640 1 -- 172.21.15.64:0/1494653882 >> v1:172.21.15.64:6789/0 conn(0x7f35d00c9190 legacy=0x7f35d0070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:03.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.423+0000 7f35cffff640 1 -- 172.21.15.64:0/1494653882 >> v1:172.21.15.59:6789/0 conn(0x7f35d00b0bf0 legacy=0x7f35d0164c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.427 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.423+0000 7f35cffff640 1 -- 172.21.15.64:0/1494653882 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d015d9b0 con 0x7f35d015a290 2024-04-25T15:46:03.431 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.431+0000 7f35cffff640 1 --2- 172.21.15.64:0/1494653882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35d015a290 0x7f35d015e1b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009790 tx=0x7f35c002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e895aaa8519b0d45 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:03.436 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.435+0000 7f35ceffd640 1 -- 172.21.15.64:0/1494653882 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c0037070 con 0x7f35d015a290 2024-04-25T15:46:03.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.436+0000 7f35ceffd640 1 -- 172.21.15.64:0/1494653882 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35c002ae40 con 0x7f35d015a290 2024-04-25T15:46:03.437 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.436+0000 7f35ceffd640 1 -- 172.21.15.64:0/1494653882 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c0032660 con 0x7f35d015a290 2024-04-25T15:46:03.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.437+0000 7f35d6470640 1 -- 172.21.15.64:0/1494653882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35d015a290 msgr2=0x7f35d015e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.437+0000 7f35d6470640 1 --2- 172.21.15.64:0/1494653882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35d015a290 0x7f35d015e1b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009790 tx=0x7f35c002a130 comp rx=0 tx=0).stop 2024-04-25T15:46:03.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.437+0000 7f35d6470640 1 -- 172.21.15.64:0/1494653882 shutdown_connections 2024-04-25T15:46:03.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.437+0000 7f35d6470640 1 --2- 172.21.15.64:0/1494653882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35d015a290 0x7f35d015e1b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.437+0000 7f35d6470640 1 -- 172.21.15.64:0/1494653882 >> 172.21.15.64:0/1494653882 conn(0x7f35d00ce790 msgr2=0x7f35d00ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:03.439 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.437+0000 7f35d6470640 1 -- 172.21.15.64:0/1494653882 shutdown_connections 2024-04-25T15:46:03.440 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.437+0000 7f35d6470640 1 -- 172.21.15.64:0/1494653882 wait complete. 2024-04-25T15:46:03.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.439+0000 7f35d6470640 1 Processor -- start 2024-04-25T15:46:03.442 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.439+0000 7f35d6470640 1 -- start start 2024-04-25T15:46:03.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.440+0000 7f35d6470640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35d00b0bf0 0x7f35d01f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.440+0000 7f35d6470640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35d00c9190 0x7f35d014c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.440+0000 7f35d6470640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35d015a290 0x7f35d014c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.440+0000 7f35d6470640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f35d015e6f0 con 0x7f35d015a290 2024-04-25T15:46:03.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.440+0000 7f35d6470640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f35d00c96d0 con 0x7f35d00b0bf0 2024-04-25T15:46:03.443 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.440+0000 7f35d6470640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f35d0071270 con 0x7f35d00c9190 2024-04-25T15:46:03.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.441+0000 7f35d4a0d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35d015a290 0x7f35d014c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.441+0000 7f35cf7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35d00c9190 0x7f35d014c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.441+0000 7f35d4a0d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35d015a290 0x7f35d014c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.64:56144/0 (socket says 172.21.15.64:56144) 2024-04-25T15:46:03.444 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.441+0000 7f35d4a0d640 1 -- 172.21.15.64:0/1074155578 learned_addr learned my addr 172.21.15.64:0/1074155578 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-25T15:46:03.445 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.444+0000 7f35cffff640 1 --2- 172.21.15.64:0/1074155578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35d00b0bf0 0x7f35d01f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.445+0000 7f35d4a0d640 1 -- 172.21.15.64:0/1074155578 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35d00c9190 msgr2=0x7f35d014c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.445+0000 7f35d4a0d640 1 --2- 172.21.15.64:0/1074155578 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35d00c9190 0x7f35d014c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.445+0000 7f35d4a0d640 1 -- 172.21.15.64:0/1074155578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35d00b0bf0 msgr2=0x7f35d01f18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.445+0000 7f35d4a0d640 1 --2- 172.21.15.64:0/1074155578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35d00b0bf0 0x7f35d01f18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.446 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.445+0000 7f35d4a0d640 1 -- 172.21.15.64:0/1074155578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d01f0e40 con 0x7f35d015a290 2024-04-25T15:46:03.448 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.448+0000 7f35d4a0d640 1 --2- 172.21.15.64:0/1074155578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35d015a290 0x7f35d014c5e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35c800ca70 tx=0x7f35c800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:03.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.453+0000 7f35ccff9640 1 -- 172.21.15.64:0/1074155578 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c8017070 con 0x7f35d015a290 2024-04-25T15:46:03.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.453+0000 7f35ccff9640 1 -- 172.21.15.64:0/1074155578 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35c800ab70 con 0x7f35d015a290 2024-04-25T15:46:03.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.453+0000 7f35ccff9640 1 -- 172.21.15.64:0/1074155578 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c8012400 con 0x7f35d015a290 2024-04-25T15:46:03.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.453+0000 7f35d6470640 1 -- 172.21.15.64:0/1074155578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35d00c9f50 con 0x7f35d015a290 2024-04-25T15:46:03.454 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.453+0000 7f35d6470640 1 -- 172.21.15.64:0/1074155578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35d015b5f0 con 0x7f35d015a290 2024-04-25T15:46:03.455 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.454+0000 7f35d6470640 1 -- 172.21.15.64:0/1074155578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35d0069fb0 con 0x7f35d015a290 2024-04-25T15:46:03.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.457+0000 7f35ccff9640 1 -- 172.21.15.64:0/1074155578 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f35c801a070 con 0x7f35d015a290 2024-04-25T15:46:03.457 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.457+0000 7f35ccff9640 1 -- 172.21.15.64:0/1074155578 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f35c801c790 con 0x7f35d015a290 2024-04-25T15:46:03.472 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:03.472+0000 7fa6fbd21040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:46:03.509 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:03.509+0000 7f4fb7587040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:46:03.567 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.566+0000 7f35ccff9640 1 -- 172.21.15.64:0/1074155578 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f35c8021020 con 0x7f35d015a290 2024-04-25T15:46:03.642 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.641+0000 7f35d6470640 1 -- 172.21.15.64:0/1074155578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3c15505b-4abd-4a24-b30c-edc2732f8ac4", "id": 1} v 0) -- 0x7f35d01591c0 con 0x7f35d015a290 2024-04-25T15:46:03.686 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.686+0000 7f35ccff9640 1 -- 172.21.15.64:0/1074155578 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3c15505b-4abd-4a24-b30c-edc2732f8ac4", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f35c801ca60 con 0x7f35d015a290 2024-04-25T15:46:03.687 INFO:teuthology.orchestra.run.smithi064.stdout:1 2024-04-25T15:46:03.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.687+0000 7f35d6470640 1 -- 172.21.15.64:0/1074155578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35d015a290 msgr2=0x7f35d014c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.687+0000 7f35d6470640 1 --2- 172.21.15.64:0/1074155578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35d015a290 0x7f35d014c5e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35c800ca70 tx=0x7f35c800cf30 comp rx=0 tx=0).stop 2024-04-25T15:46:03.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.687+0000 7f35d6470640 1 -- 172.21.15.64:0/1074155578 shutdown_connections 2024-04-25T15:46:03.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.687+0000 7f35d6470640 1 --2- 172.21.15.64:0/1074155578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35d015a290 0x7f35d014c5e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.687+0000 7f35d6470640 1 --2- 172.21.15.64:0/1074155578 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f35d00c9190 0x7f35d014c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.688 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.687+0000 7f35d6470640 1 --2- 172.21.15.64:0/1074155578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35d00b0bf0 0x7f35d01f18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.687+0000 7f35d6470640 1 -- 172.21.15.64:0/1074155578 >> 172.21.15.64:0/1074155578 conn(0x7f35d00ce790 msgr2=0x7f35d01599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:03.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.687+0000 7f35d6470640 1 -- 172.21.15.64:0/1074155578 shutdown_connections 2024-04-25T15:46:03.689 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.687+0000 7f35d6470640 1 -- 172.21.15.64:0/1074155578 wait complete. 2024-04-25T15:46:03.700 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new 5884bf21-e6b4-4813-b8bc-6baa92443c87 2 2024-04-25T15:46:03.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.851+0000 7f2d05a6e640 1 Processor -- start 2024-04-25T15:46:03.852 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.851+0000 7f2d05a6e640 1 -- start start 2024-04-25T15:46:03.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.853+0000 7f2d05a6e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2d0015d190 0x7f2d000cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.853+0000 7f2d05a6e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2d000cb340 0x7f2d000cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.853+0000 7f2d05a6e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d0006e590 con 0x7f2d001569c0 2024-04-25T15:46:03.853 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.853+0000 7f2d05a6e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f2d0006d730 con 0x7f2d0015d190 2024-04-25T15:46:03.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.853+0000 7f2d05a6e640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0006da10 con 0x7f2d000cb340 2024-04-25T15:46:03.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.853+0000 7f2cfffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2d000cb340 0x7f2d000cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.854+0000 7f2cfffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2d000cb340 0x7f2d000cfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:60798/0 (socket says 172.21.15.64:60798) 2024-04-25T15:46:03.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.854+0000 7f2cfffff640 1 -- 172.21.15.64:0/2575517018 learned_addr learned my addr 172.21.15.64:0/2575517018 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-25T15:46:03.854 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.854+0000 7f2cff7fe640 1 --2- 172.21.15.64:0/2575517018 >> v2:172.21.15.64:3300/0 conn(0x7f2d0015d190 0x7f2d000cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.857+0000 7f2cff7fe640 1 -- 172.21.15.64:0/2575517018 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2d000cb340 msgr2=0x7f2d000cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:03.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.857+0000 7f2cff7fe640 1 --2- 172.21.15.64:0/2575517018 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2d000cb340 0x7f2d000cfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.857+0000 7f2cff7fe640 1 -- 172.21.15.64:0/2575517018 >> v1:172.21.15.64:6789/0 conn(0x7f2d001569c0 legacy=0x7f2d000cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.857+0000 7f2cff7fe640 1 -- 172.21.15.64:0/2575517018 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0006dcf0 con 0x7f2d0015d190 2024-04-25T15:46:03.863 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.863+0000 7f2cff7fe640 1 --2- 172.21.15.64:0/2575517018 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d0015d190 0x7f2d000cf9b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00097a0 tx=0x7f2cf002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f26263b169787092 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:03.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.868+0000 7f2cfe7fc640 1 -- 172.21.15.64:0/2575517018 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0037070 con 0x7f2d0015d190 2024-04-25T15:46:03.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.868+0000 7f2cfe7fc640 1 -- 172.21.15.64:0/2575517018 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cf0032440 con 0x7f2d0015d190 2024-04-25T15:46:03.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.868+0000 7f2cfe7fc640 1 -- 172.21.15.64:0/2575517018 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0032810 con 0x7f2d0015d190 2024-04-25T15:46:03.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.869+0000 7f2d05a6e640 1 -- 172.21.15.64:0/2575517018 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d0015d190 msgr2=0x7f2d000cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.869+0000 7f2d05a6e640 1 --2- 172.21.15.64:0/2575517018 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d0015d190 0x7f2d000cf9b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00097a0 tx=0x7f2cf002a210 comp rx=0 tx=0).stop 2024-04-25T15:46:03.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.869+0000 7f2d05a6e640 1 -- 172.21.15.64:0/2575517018 shutdown_connections 2024-04-25T15:46:03.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.869+0000 7f2d05a6e640 1 --2- 172.21.15.64:0/2575517018 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2d000cb340 0x7f2d000cfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.869+0000 7f2d05a6e640 1 --2- 172.21.15.64:0/2575517018 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d0015d190 0x7f2d000cf9b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.869+0000 7f2d05a6e640 1 -- 172.21.15.64:0/2575517018 >> 172.21.15.64:0/2575517018 conn(0x7f2d0006c760 msgr2=0x7f2d0006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:03.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.869+0000 7f2d05a6e640 1 -- 172.21.15.64:0/2575517018 shutdown_connections 2024-04-25T15:46:03.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.869+0000 7f2d05a6e640 1 -- 172.21.15.64:0/2575517018 wait complete. 2024-04-25T15:46:03.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.871+0000 7f2d05a6e640 1 Processor -- start 2024-04-25T15:46:03.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.871+0000 7f2d05a6e640 1 -- start start 2024-04-25T15:46:03.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.872+0000 7f2d05a6e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d000cb340 0x7f2d001f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.872+0000 7f2d05a6e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2d001569c0 0x7f2d00155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.872+0000 7f2d05a6e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d0015d190 0x7f2d0014fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:03.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.872+0000 7f2d05a6e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0015fdc0 con 0x7f2d000cb340 2024-04-25T15:46:03.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.872+0000 7f2d05a6e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0006e2b0 con 0x7f2d0015d190 2024-04-25T15:46:03.873 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.872+0000 7f2d05a6e640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0015ff40 con 0x7f2d001569c0 2024-04-25T15:46:03.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.873+0000 7f2cfffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d0015d190 0x7f2d0014fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.873+0000 7f2cfeffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2d001569c0 0x7f2d00155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.873+0000 7f2cff7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d000cb340 0x7f2d001f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:03.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.873+0000 7f2cfffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d0015d190 0x7f2d0014fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53702/0 (socket says 172.21.15.64:53702) 2024-04-25T15:46:03.874 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.873+0000 7f2cfffff640 1 -- 172.21.15.64:0/2490734461 learned_addr learned my addr 172.21.15.64:0/2490734461 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-25T15:46:03.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.877+0000 7f2cff7fe640 1 -- 172.21.15.64:0/2490734461 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2d001569c0 msgr2=0x7f2d00155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.877+0000 7f2cff7fe640 1 --2- 172.21.15.64:0/2490734461 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2d001569c0 0x7f2d00155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.877+0000 7f2cff7fe640 1 -- 172.21.15.64:0/2490734461 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d0015d190 msgr2=0x7f2d0014fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:03.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.877+0000 7f2cff7fe640 1 --2- 172.21.15.64:0/2490734461 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d0015d190 0x7f2d0014fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:03.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.877+0000 7f2cff7fe640 1 -- 172.21.15.64:0/2490734461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d001f64b0 con 0x7f2d000cb340 2024-04-25T15:46:03.879 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:03.878+0000 7fa6fbd21040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T15:46:03.880 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.880+0000 7f2cff7fe640 1 --2- 172.21.15.64:0/2490734461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d000cb340 0x7f2d001f5f70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2d000d06c0 tx=0x7f2cf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:03.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.884+0000 7f2ce7fff640 1 -- 172.21.15.64:0/2490734461 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0041030 con 0x7f2d000cb340 2024-04-25T15:46:03.885 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.884+0000 7f2ce7fff640 1 -- 172.21.15.64:0/2490734461 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cf0030500 con 0x7f2d000cb340 2024-04-25T15:46:03.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.884+0000 7f2d05a6e640 1 -- 172.21.15.64:0/2490734461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d001f5a90 con 0x7f2d000cb340 2024-04-25T15:46:03.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.884+0000 7f2ce7fff640 1 -- 172.21.15.64:0/2490734461 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0037040 con 0x7f2d000cb340 2024-04-25T15:46:03.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.884+0000 7f2d05a6e640 1 -- 172.21.15.64:0/2490734461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d00151200 con 0x7f2d000cb340 2024-04-25T15:46:03.886 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.885+0000 7f2d05a6e640 1 -- 172.21.15.64:0/2490734461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d000cc130 con 0x7f2d000cb340 2024-04-25T15:46:03.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.888+0000 7f2ce7fff640 1 -- 172.21.15.64:0/2490734461 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2cf0044070 con 0x7f2d000cb340 2024-04-25T15:46:03.889 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:03.888+0000 7f2ce7fff640 1 -- 172.21.15.64:0/2490734461 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f2cf004faa0 con 0x7f2d000cb340 2024-04-25T15:46:03.925 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:03.925+0000 7f4fb7587040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T15:46:04.001 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.001+0000 7f2ce7fff640 1 -- 172.21.15.64:0/2490734461 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2d000cc130 con 0x7f2d000cb340 2024-04-25T15:46:04.077 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.077+0000 7f2d05a6e640 1 -- 172.21.15.64:0/2490734461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5884bf21-e6b4-4813-b8bc-6baa92443c87", "id": 2} v 0) -- 0x7f2d000ca3c0 con 0x7f2d000cb340 2024-04-25T15:46:04.115 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.113+0000 7f2ce7fff640 1 -- 172.21.15.64:0/2490734461 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5884bf21-e6b4-4813-b8bc-6baa92443c87", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f2d000ca3c0 con 0x7f2d000cb340 2024-04-25T15:46:04.116 INFO:teuthology.orchestra.run.smithi064.stdout:2 2024-04-25T15:46:04.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.114+0000 7f2d05a6e640 1 -- 172.21.15.64:0/2490734461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d000cb340 msgr2=0x7f2d001f5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.114+0000 7f2d05a6e640 1 --2- 172.21.15.64:0/2490734461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d000cb340 0x7f2d001f5f70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2d000d06c0 tx=0x7f2cf00046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.114+0000 7f2d05a6e640 1 -- 172.21.15.64:0/2490734461 shutdown_connections 2024-04-25T15:46:04.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.114+0000 7f2d05a6e640 1 --2- 172.21.15.64:0/2490734461 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2d0015d190 0x7f2d0014fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.114+0000 7f2d05a6e640 1 --2- 172.21.15.64:0/2490734461 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2d001569c0 0x7f2d00155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.114+0000 7f2d05a6e640 1 --2- 172.21.15.64:0/2490734461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d000cb340 0x7f2d001f5f70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.114+0000 7f2d05a6e640 1 -- 172.21.15.64:0/2490734461 >> 172.21.15.64:0/2490734461 conn(0x7f2d0006c760 msgr2=0x7f2d000cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:04.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.114+0000 7f2d05a6e640 1 -- 172.21.15.64:0/2490734461 shutdown_connections 2024-04-25T15:46:04.117 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.114+0000 7f2d05a6e640 1 -- 172.21.15.64:0/2490734461 wait complete. 2024-04-25T15:46:04.126 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new 6ff71700-3b00-4350-b3c9-f6c41ec46b00 3 2024-04-25T15:46:04.154 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:04.153+0000 7fa6fbd21040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T15:46:04.209 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:04.208+0000 7fa6fbd21040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T15:46:04.227 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:04.226+0000 7f4fb7587040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T15:46:04.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.238+0000 7f4c565a8640 1 Processor -- start 2024-04-25T15:46:04.239 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.238+0000 7f4c565a8640 1 -- start start 2024-04-25T15:46:04.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.239+0000 7f4c565a8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4c500c9400 0x7f4c500cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.239+0000 7f4c565a8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c50153450 0x7f4c5006c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.239+0000 7f4c565a8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c50159d90 con 0x7f4c500c8f30 2024-04-25T15:46:04.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.239+0000 7f4c565a8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f4c5015a2f0 con 0x7f4c500c9400 2024-04-25T15:46:04.240 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.239+0000 7f4c565a8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f4c5015a030 con 0x7f4c50153450 2024-04-25T15:46:04.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.240+0000 7f4c54b45640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c50153450 0x7f4c5006c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.240+0000 7f4c4f7fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4c500c9400 0x7f4c500cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.241 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.241+0000 7f4c54b45640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c50153450 0x7f4c5006c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:60816/0 (socket says 172.21.15.64:60816) 2024-04-25T15:46:04.242 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.241+0000 7f4c54b45640 1 -- 172.21.15.64:0/2475831145 learned_addr learned my addr 172.21.15.64:0/2475831145 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-25T15:46:04.246 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.243+0000 7f4c54b45640 1 -- 172.21.15.64:0/2475831145 >> v2:172.21.15.64:3300/0 conn(0x7f4c500c9400 msgr2=0x7f4c500cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:04.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.243+0000 7f4c54b45640 1 --2- 172.21.15.64:0/2475831145 >> v2:172.21.15.64:3300/0 conn(0x7f4c500c9400 0x7f4c500cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.243+0000 7f4c54b45640 1 -- 172.21.15.64:0/2475831145 >> v1:172.21.15.64:6789/0 conn(0x7f4c500c8f30 legacy=0x7f4c500c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:04.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.243+0000 7f4c54b45640 1 -- 172.21.15.64:0/2475831145 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c500c8170 con 0x7f4c50153450 2024-04-25T15:46:04.247 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.245+0000 7f4c54b45640 1 --2- 172.21.15.64:0/2475831145 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c50153450 0x7f4c5006c580 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4c5006f170 tx=0x7f4c4802c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19964bf0ce4ea290 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:04.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.250+0000 7f4c4effd640 1 -- 172.21.15.64:0/2475831145 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c48038070 con 0x7f4c50153450 2024-04-25T15:46:04.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.250+0000 7f4c4effd640 1 -- 172.21.15.64:0/2475831145 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c48009600 con 0x7f4c50153450 2024-04-25T15:46:04.250 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.250+0000 7f4c4effd640 1 -- 172.21.15.64:0/2475831145 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c480099d0 con 0x7f4c50153450 2024-04-25T15:46:04.251 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.250+0000 7f4c565a8640 1 -- 172.21.15.64:0/2475831145 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c50153450 msgr2=0x7f4c5006c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.250+0000 7f4c565a8640 1 --2- 172.21.15.64:0/2475831145 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c50153450 0x7f4c5006c580 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4c5006f170 tx=0x7f4c4802c780 comp rx=0 tx=0).stop 2024-04-25T15:46:04.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.251+0000 7f4c565a8640 1 -- 172.21.15.64:0/2475831145 shutdown_connections 2024-04-25T15:46:04.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.251+0000 7f4c565a8640 1 --2- 172.21.15.64:0/2475831145 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c50153450 0x7f4c5006c580 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.251+0000 7f4c565a8640 1 --2- 172.21.15.64:0/2475831145 >> v2:172.21.15.64:3300/0 conn(0x7f4c500c9400 0x7f4c500cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.251+0000 7f4c565a8640 1 -- 172.21.15.64:0/2475831145 >> 172.21.15.64:0/2475831145 conn(0x7f4c50071720 msgr2=0x7f4c500ca140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:04.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.251+0000 7f4c565a8640 1 -- 172.21.15.64:0/2475831145 shutdown_connections 2024-04-25T15:46:04.252 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.251+0000 7f4c565a8640 1 -- 172.21.15.64:0/2475831145 wait complete. 2024-04-25T15:46:04.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.253+0000 7f4c565a8640 1 Processor -- start 2024-04-25T15:46:04.253 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.253+0000 7f4c565a8640 1 -- start start 2024-04-25T15:46:04.254 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.254+0000 7f4c565a8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c500c9400 0x7f4c5013f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.254+0000 7f4c565a8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c50153450 0x7f4c50141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.254+0000 7f4c565a8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c50156fd0 0x7f4c50142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.254+0000 7f4c565a8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4c500c8a10 con 0x7f4c500c9400 2024-04-25T15:46:04.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.254+0000 7f4c565a8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4c500c8730 con 0x7f4c50153450 2024-04-25T15:46:04.255 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.254+0000 7f4c565a8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f4c500c7830 con 0x7f4c50156fd0 2024-04-25T15:46:04.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.255+0000 7f4c54b45640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c50156fd0 0x7f4c50142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.255+0000 7f4c4f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c50153450 0x7f4c50141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.255+0000 7f4c4ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c500c9400 0x7f4c5013f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.255+0000 7f4c54b45640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c50156fd0 0x7f4c50142300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:60826/0 (socket says 172.21.15.64:60826) 2024-04-25T15:46:04.256 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.255+0000 7f4c54b45640 1 -- 172.21.15.64:0/1040651463 learned_addr learned my addr 172.21.15.64:0/1040651463 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-25T15:46:04.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.259+0000 7f4c54b45640 1 -- 172.21.15.64:0/1040651463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c50153450 msgr2=0x7f4c50141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.259+0000 7f4c54b45640 1 --2- 172.21.15.64:0/1040651463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c50153450 0x7f4c50141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.259+0000 7f4c54b45640 1 -- 172.21.15.64:0/1040651463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c500c9400 msgr2=0x7f4c5013f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.259+0000 7f4c54b45640 1 --2- 172.21.15.64:0/1040651463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c500c9400 0x7f4c5013f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.260 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.259+0000 7f4c54b45640 1 -- 172.21.15.64:0/1040651463 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c501eedc0 con 0x7f4c50156fd0 2024-04-25T15:46:04.262 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.261+0000 7f4c54b45640 1 --2- 172.21.15.64:0/1040651463 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c50156fd0 0x7f4c50142300 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800d210 tx=0x7f4c48004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:04.266 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.265+0000 7f4c4cff9640 1 -- 172.21.15.64:0/1040651463 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c48038050 con 0x7f4c50156fd0 2024-04-25T15:46:04.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.265+0000 7f4c4cff9640 1 -- 172.21.15.64:0/1040651463 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c48044070 con 0x7f4c50156fd0 2024-04-25T15:46:04.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.265+0000 7f4c565a8640 1 -- 172.21.15.64:0/1040651463 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c5013fcf0 con 0x7f4c50156fd0 2024-04-25T15:46:04.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.265+0000 7f4c4cff9640 1 -- 172.21.15.64:0/1040651463 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4800b720 con 0x7f4c50156fd0 2024-04-25T15:46:04.267 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.265+0000 7f4c565a8640 1 -- 172.21.15.64:0/1040651463 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c501ee2e0 con 0x7f4c50156fd0 2024-04-25T15:46:04.268 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.266+0000 7f4c565a8640 1 -- 172.21.15.64:0/1040651463 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c5013fa50 con 0x7f4c50156fd0 2024-04-25T15:46:04.287 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:04.286+0000 7f4fb7587040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T15:46:04.331 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:04.331+0000 7fa6fbd21040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T15:46:04.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.382+0000 7f4c4cff9640 1 -- 172.21.15.64:0/1040651463 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4c4803da70 con 0x7f4c50156fd0 2024-04-25T15:46:04.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.382+0000 7f4c4cff9640 1 -- 172.21.15.64:0/1040651463 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f4c4803f450 con 0x7f4c50156fd0 2024-04-25T15:46:04.383 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.382+0000 7f4c4cff9640 1 -- 172.21.15.64:0/1040651463 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f4c5013fa50 con 0x7f4c50156fd0 2024-04-25T15:46:04.409 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:04.409+0000 7f4fb7587040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T15:46:04.460 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.459+0000 7f4c565a8640 1 -- 172.21.15.64:0/1040651463 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6ff71700-3b00-4350-b3c9-f6c41ec46b00", "id": 3} v 0) -- 0x7f4c50069910 con 0x7f4c50156fd0 2024-04-25T15:46:04.584 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.584+0000 7f4c4cff9640 1 -- 172.21.15.64:0/1040651463 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6ff71700-3b00-4350-b3c9-f6c41ec46b00", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f4c48049460 con 0x7f4c50156fd0 2024-04-25T15:46:04.585 INFO:teuthology.orchestra.run.smithi064.stdout:3 2024-04-25T15:46:04.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.585+0000 7f4c565a8640 1 -- 172.21.15.64:0/1040651463 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c50156fd0 msgr2=0x7f4c50142300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.585+0000 7f4c565a8640 1 --2- 172.21.15.64:0/1040651463 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c50156fd0 0x7f4c50142300 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800d210 tx=0x7f4c48004a40 comp rx=0 tx=0).stop 2024-04-25T15:46:04.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.585+0000 7f4c565a8640 1 -- 172.21.15.64:0/1040651463 shutdown_connections 2024-04-25T15:46:04.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.585+0000 7f4c565a8640 1 --2- 172.21.15.64:0/1040651463 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c50156fd0 0x7f4c50142300 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.585+0000 7f4c565a8640 1 --2- 172.21.15.64:0/1040651463 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c50153450 0x7f4c50141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.585+0000 7f4c565a8640 1 --2- 172.21.15.64:0/1040651463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c500c9400 0x7f4c5013f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.585+0000 7f4c565a8640 1 -- 172.21.15.64:0/1040651463 >> 172.21.15.64:0/1040651463 conn(0x7f4c50071720 msgr2=0x7f4c500c4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:04.586 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.585+0000 7f4c565a8640 1 -- 172.21.15.64:0/1040651463 shutdown_connections 2024-04-25T15:46:04.587 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.585+0000 7f4c565a8640 1 -- 172.21.15.64:0/1040651463 wait complete. 2024-04-25T15:46:04.596 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new d0a72143-93fd-4712-aadb-f3fade303426 4 2024-04-25T15:46:04.628 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:04.628+0000 7fa6fbd21040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T15:46:04.678 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:04.677+0000 7fa6fbd21040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T15:46:04.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.705+0000 7ffa64934640 1 Processor -- start 2024-04-25T15:46:04.706 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.705+0000 7ffa64934640 1 -- start start 2024-04-25T15:46:04.708 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.707+0000 7ffa64934640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa60156790 0x7ffa600cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.707+0000 7ffa64934640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ffa6008d410 0x7ffa6008d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.707+0000 7ffa64934640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa6015c720 con 0x7ffa600c73c0 2024-04-25T15:46:04.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.707+0000 7ffa64934640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ffa6015ca00 con 0x7ffa60156790 2024-04-25T15:46:04.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.707+0000 7ffa64934640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7ffa6015cce0 con 0x7ffa6008d410 2024-04-25T15:46:04.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.708+0000 7ffa5e59c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa60156790 0x7ffa600cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.708+0000 7ffa5ed9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ffa6008d410 0x7ffa6008d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.708+0000 7ffa5e59c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa60156790 0x7ffa600cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.64:56162/0 (socket says 172.21.15.64:56162) 2024-04-25T15:46:04.709 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.708+0000 7ffa5e59c640 1 -- 172.21.15.64:0/1422055525 learned_addr learned my addr 172.21.15.64:0/1422055525 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-25T15:46:04.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.711+0000 7ffa5e59c640 1 -- 172.21.15.64:0/1422055525 >> v2:172.21.15.64:3300/0 conn(0x7ffa6008d410 msgr2=0x7ffa6008d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:04.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.711+0000 7ffa5e59c640 1 --2- 172.21.15.64:0/1422055525 >> v2:172.21.15.64:3300/0 conn(0x7ffa6008d410 0x7ffa6008d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.711+0000 7ffa5e59c640 1 -- 172.21.15.64:0/1422055525 >> v1:172.21.15.64:6789/0 conn(0x7ffa600c73c0 legacy=0x7ffa600c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.711 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.711+0000 7ffa5e59c640 1 -- 172.21.15.64:0/1422055525 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6015cfc0 con 0x7ffa60156790 2024-04-25T15:46:04.712 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:04.711+0000 7f4fb7587040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T15:46:04.714 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.713+0000 7ffa5e59c640 1 --2- 172.21.15.64:0/1422055525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa60156790 0x7ffa600cc5b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffa6008e7d0 tx=0x7ffa5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c9f1bd77159c65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:04.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.717+0000 7ffa5d59a640 1 -- 172.21.15.64:0/1422055525 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54037070 con 0x7ffa60156790 2024-04-25T15:46:04.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.717+0000 7ffa5d59a640 1 -- 172.21.15.64:0/1422055525 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa54032440 con 0x7ffa60156790 2024-04-25T15:46:04.717 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.717+0000 7ffa5d59a640 1 -- 172.21.15.64:0/1422055525 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54032810 con 0x7ffa60156790 2024-04-25T15:46:04.718 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.717+0000 7ffa64934640 1 -- 172.21.15.64:0/1422055525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa60156790 msgr2=0x7ffa600cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.717+0000 7ffa64934640 1 --2- 172.21.15.64:0/1422055525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa60156790 0x7ffa600cc5b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffa6008e7d0 tx=0x7ffa5402a270 comp rx=0 tx=0).stop 2024-04-25T15:46:04.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.718+0000 7ffa64934640 1 -- 172.21.15.64:0/1422055525 shutdown_connections 2024-04-25T15:46:04.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.718+0000 7ffa64934640 1 --2- 172.21.15.64:0/1422055525 >> v2:172.21.15.64:3300/0 conn(0x7ffa6008d410 0x7ffa6008d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.718+0000 7ffa64934640 1 --2- 172.21.15.64:0/1422055525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa60156790 0x7ffa600cc5b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.718+0000 7ffa64934640 1 -- 172.21.15.64:0/1422055525 >> 172.21.15.64:0/1422055525 conn(0x7ffa6006f400 msgr2=0x7ffa600684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:04.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.718+0000 7ffa64934640 1 -- 172.21.15.64:0/1422055525 shutdown_connections 2024-04-25T15:46:04.719 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.718+0000 7ffa64934640 1 -- 172.21.15.64:0/1422055525 wait complete. 2024-04-25T15:46:04.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.720+0000 7ffa64934640 1 Processor -- start 2024-04-25T15:46:04.720 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.720+0000 7ffa64934640 1 -- start start 2024-04-25T15:46:04.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.721+0000 7ffa64934640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa6008d410 0x7ffa601521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.721+0000 7ffa64934640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa600c73c0 0x7ffa600ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.721+0000 7ffa64934640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffa60156790 0x7ffa6014d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:04.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.721+0000 7ffa64934640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffa600ccde0 con 0x7ffa6008d410 2024-04-25T15:46:04.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.721+0000 7ffa64934640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ffa600ccaf0 con 0x7ffa600c73c0 2024-04-25T15:46:04.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.721+0000 7ffa64934640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6008dd60 con 0x7ffa60156790 2024-04-25T15:46:04.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.721+0000 7ffa5e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa6008d410 0x7ffa601521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.721+0000 7ffa5ed9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffa60156790 0x7ffa6014d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.721+0000 7ffa5dd9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa600c73c0 0x7ffa600ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:04.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.722+0000 7ffa5e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa6008d410 0x7ffa601521e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.64:56166/0 (socket says 172.21.15.64:56166) 2024-04-25T15:46:04.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.722+0000 7ffa5e59c640 1 -- 172.21.15.64:0/3464364002 learned_addr learned my addr 172.21.15.64:0/3464364002 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-25T15:46:04.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.726+0000 7ffa5e59c640 1 -- 172.21.15.64:0/3464364002 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffa60156790 msgr2=0x7ffa6014d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.726+0000 7ffa5e59c640 1 --2- 172.21.15.64:0/3464364002 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffa60156790 0x7ffa6014d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.726 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.726+0000 7ffa5e59c640 1 -- 172.21.15.64:0/3464364002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa600c73c0 msgr2=0x7ffa600ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.726+0000 7ffa5e59c640 1 --2- 172.21.15.64:0/3464364002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa600c73c0 0x7ffa600ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.727 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.726+0000 7ffa5e59c640 1 -- 172.21.15.64:0/3464364002 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa60152720 con 0x7ffa6008d410 2024-04-25T15:46:04.728 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.728+0000 7ffa5e59c640 1 --2- 172.21.15.64:0/3464364002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa6008d410 0x7ffa601521e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffa54000c00 tx=0x7ffa540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:04.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.732+0000 7ffa4effd640 1 -- 172.21.15.64:0/3464364002 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54037040 con 0x7ffa6008d410 2024-04-25T15:46:04.732 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.732+0000 7ffa4effd640 1 -- 172.21.15.64:0/3464364002 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa54042070 con 0x7ffa6008d410 2024-04-25T15:46:04.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.732+0000 7ffa4effd640 1 -- 172.21.15.64:0/3464364002 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54030880 con 0x7ffa6008d410 2024-04-25T15:46:04.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.732+0000 7ffa64934640 1 -- 172.21.15.64:0/3464364002 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa601f6380 con 0x7ffa6008d410 2024-04-25T15:46:04.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.732+0000 7ffa64934640 1 -- 172.21.15.64:0/3464364002 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa601f6940 con 0x7ffa6008d410 2024-04-25T15:46:04.733 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.733+0000 7ffa64934640 1 -- 172.21.15.64:0/3464364002 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa60069910 con 0x7ffa6008d410 2024-04-25T15:46:04.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.735+0000 7ffa4effd640 1 -- 172.21.15.64:0/3464364002 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffa54030a20 con 0x7ffa6008d410 2024-04-25T15:46:04.735 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.735+0000 7ffa4effd640 1 -- 172.21.15.64:0/3464364002 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7ffa54047b80 con 0x7ffa6008d410 2024-04-25T15:46:04.764 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:04.763+0000 7f4fb7587040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T15:46:04.844 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:04.843+0000 7fa6fbd21040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T15:46:04.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.847+0000 7ffa4effd640 1 -- 172.21.15.64:0/3464364002 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ffa54047d80 con 0x7ffa6008d410 2024-04-25T15:46:04.922 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.921+0000 7ffa64934640 1 -- 172.21.15.64:0/3464364002 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d0a72143-93fd-4712-aadb-f3fade303426", "id": 4} v 0) -- 0x7ffa600cbdb0 con 0x7ffa6008d410 2024-04-25T15:46:04.928 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:04.927+0000 7f4fb7587040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T15:46:04.957 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.956+0000 7ffa4effd640 1 -- 172.21.15.64:0/3464364002 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d0a72143-93fd-4712-aadb-f3fade303426", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7ffa54030d10 con 0x7ffa6008d410 2024-04-25T15:46:04.957 INFO:teuthology.orchestra.run.smithi064.stdout:4 2024-04-25T15:46:04.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.957+0000 7ffa64934640 1 -- 172.21.15.64:0/3464364002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa6008d410 msgr2=0x7ffa601521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:04.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.957+0000 7ffa64934640 1 --2- 172.21.15.64:0/3464364002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa6008d410 0x7ffa601521e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffa54000c00 tx=0x7ffa540046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.958 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.957+0000 7ffa64934640 1 -- 172.21.15.64:0/3464364002 shutdown_connections 2024-04-25T15:46:04.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.957+0000 7ffa64934640 1 --2- 172.21.15.64:0/3464364002 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffa60156790 0x7ffa6014d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.957+0000 7ffa64934640 1 --2- 172.21.15.64:0/3464364002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa600c73c0 0x7ffa600ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.957+0000 7ffa64934640 1 --2- 172.21.15.64:0/3464364002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa6008d410 0x7ffa601521e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:04.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.957+0000 7ffa64934640 1 -- 172.21.15.64:0/3464364002 >> 172.21.15.64:0/3464364002 conn(0x7ffa6006f400 msgr2=0x7ffa600b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:04.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.957+0000 7ffa64934640 1 -- 172.21.15.64:0/3464364002 shutdown_connections 2024-04-25T15:46:04.959 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:04.957+0000 7ffa64934640 1 -- 172.21.15.64:0/3464364002 wait complete. 2024-04-25T15:46:04.970 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new 9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa 5 2024-04-25T15:46:04.989 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:04.989+0000 7fa6fbd21040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T15:46:05.042 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:05.041+0000 7fa6fbd21040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T15:46:05.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.083+0000 7f054939d640 1 Processor -- start 2024-04-25T15:46:05.084 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.083+0000 7f054939d640 1 -- start start 2024-04-25T15:46:05.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.084+0000 7f054939d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05440b33a0 0x7f05440cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.084+0000 7f054939d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0544071b90 0x7f0544071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.084+0000 7f054939d640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f054415faa0 con 0x7f0544156700 2024-04-25T15:46:05.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.084+0000 7f054939d640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f054415d2f0 con 0x7f0544071b90 2024-04-25T15:46:05.085 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.084+0000 7f054939d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f05440caea0 con 0x7f05440b33a0 2024-04-25T15:46:05.086 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:05.085+0000 7f4fb7587040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T15:46:05.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.085+0000 7f0543fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05440b33a0 0x7f05440cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.085+0000 7f0548b9c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0544071b90 0x7f0544071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.086 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.085+0000 7f0543fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05440b33a0 0x7f05440cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:60832/0 (socket says 172.21.15.64:60832) 2024-04-25T15:46:05.087 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.085+0000 7f0543fff640 1 -- 172.21.15.64:0/1370354472 learned_addr learned my addr 172.21.15.64:0/1370354472 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-25T15:46:05.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.088+0000 7f0543fff640 1 -- 172.21.15.64:0/1370354472 >> v2:172.21.15.59:3300/0 conn(0x7f0544071b90 msgr2=0x7f0544071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:05.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.088+0000 7f0543fff640 1 --2- 172.21.15.64:0/1370354472 >> v2:172.21.15.59:3300/0 conn(0x7f0544071b90 0x7f0544071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.088+0000 7f0543fff640 1 -- 172.21.15.64:0/1370354472 >> v1:172.21.15.59:6789/0 conn(0x7f0544156700 legacy=0x7f0544160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.089 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.088+0000 7f0543fff640 1 -- 172.21.15.64:0/1370354472 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0544160940 con 0x7f05440b33a0 2024-04-25T15:46:05.091 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.090+0000 7f0543fff640 1 --2- 172.21.15.64:0/1370354472 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05440b33a0 0x7f05440cec40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0538009870 tx=0x7f053802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb4a71c55bc0549b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:05.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.094+0000 7f0542ffd640 1 -- 172.21.15.64:0/1370354472 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538037070 con 0x7f05440b33a0 2024-04-25T15:46:05.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.094+0000 7f0542ffd640 1 -- 172.21.15.64:0/1370354472 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0538032440 con 0x7f05440b33a0 2024-04-25T15:46:05.095 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.094+0000 7f0542ffd640 1 -- 172.21.15.64:0/1370354472 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538032810 con 0x7f05440b33a0 2024-04-25T15:46:05.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.095+0000 7f054939d640 1 -- 172.21.15.64:0/1370354472 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05440b33a0 msgr2=0x7f05440cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.095+0000 7f054939d640 1 --2- 172.21.15.64:0/1370354472 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05440b33a0 0x7f05440cec40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0538009870 tx=0x7f053802a1c0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.095+0000 7f054939d640 1 -- 172.21.15.64:0/1370354472 shutdown_connections 2024-04-25T15:46:05.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.095+0000 7f054939d640 1 --2- 172.21.15.64:0/1370354472 >> v2:172.21.15.59:3300/0 conn(0x7f0544071b90 0x7f0544071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.096 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.095+0000 7f054939d640 1 --2- 172.21.15.64:0/1370354472 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f05440b33a0 0x7f05440cec40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.095+0000 7f054939d640 1 -- 172.21.15.64:0/1370354472 >> 172.21.15.64:0/1370354472 conn(0x7f05440747b0 msgr2=0x7f054406ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:05.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.095+0000 7f054939d640 1 -- 172.21.15.64:0/1370354472 shutdown_connections 2024-04-25T15:46:05.097 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.095+0000 7f054939d640 1 -- 172.21.15.64:0/1370354472 wait complete. 2024-04-25T15:46:05.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.097+0000 7f054939d640 1 Processor -- start 2024-04-25T15:46:05.098 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.098+0000 7f054939d640 1 -- start start 2024-04-25T15:46:05.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.099+0000 7f054939d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0544071b90 0x7f0544158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.099+0000 7f054939d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05440b33a0 0x7f05441f2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.099+0000 7f054939d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0544156700 0x7f05441e9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.099+0000 7f054939d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f05440cb420 con 0x7f05440b33a0 2024-04-25T15:46:05.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.099+0000 7f054939d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f05440c4440 con 0x7f0544071b90 2024-04-25T15:46:05.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.099+0000 7f054939d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f0544156b10 con 0x7f0544156700 2024-04-25T15:46:05.101 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.099+0000 7f0548b9c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0544156700 0x7f05441e9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.100+0000 7f05437fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05440b33a0 0x7f05441f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.100+0000 7f0543fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0544071b90 0x7f0544158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.100+0000 7f0548b9c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0544156700 0x7f05441e9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:60834/0 (socket says 172.21.15.64:60834) 2024-04-25T15:46:05.102 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.100+0000 7f0548b9c640 1 -- 172.21.15.64:0/1104011587 learned_addr learned my addr 172.21.15.64:0/1104011587 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-25T15:46:05.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.104+0000 7f05437fe640 1 -- 172.21.15.64:0/1104011587 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0544156700 msgr2=0x7f05441e9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.104 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.104+0000 7f05437fe640 1 --2- 172.21.15.64:0/1104011587 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0544156700 0x7f05441e9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.104+0000 7f05437fe640 1 -- 172.21.15.64:0/1104011587 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0544071b90 msgr2=0x7f0544158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.104+0000 7f05437fe640 1 --2- 172.21.15.64:0/1104011587 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0544071b90 0x7f0544158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.105 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.104+0000 7f05437fe640 1 -- 172.21.15.64:0/1104011587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05441590d0 con 0x7f05440b33a0 2024-04-25T15:46:05.107 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.106+0000 7f05437fe640 1 --2- 172.21.15.64:0/1104011587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05440b33a0 0x7f05441f2280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f053400c390 tx=0x7f053400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:05.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.110+0000 7f0540ff9640 1 -- 172.21.15.64:0/1104011587 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05340052d0 con 0x7f05440b33a0 2024-04-25T15:46:05.111 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.110+0000 7f0540ff9640 1 -- 172.21.15.64:0/1104011587 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0534005490 con 0x7f05440b33a0 2024-04-25T15:46:05.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.110+0000 7f0540ff9640 1 -- 172.21.15.64:0/1104011587 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0534007260 con 0x7f05440b33a0 2024-04-25T15:46:05.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.110+0000 7f054939d640 1 -- 172.21.15.64:0/1104011587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05441593b0 con 0x7f05440b33a0 2024-04-25T15:46:05.112 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.110+0000 7f054939d640 1 -- 172.21.15.64:0/1104011587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0544159970 con 0x7f05440b33a0 2024-04-25T15:46:05.113 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.111+0000 7f054939d640 1 -- 172.21.15.64:0/1104011587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0544050820 con 0x7f05440b33a0 2024-04-25T15:46:05.116 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:05.116+0000 7fa6fbd21040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T15:46:05.141 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:05.141+0000 7f4fb7587040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T15:46:05.164 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:05.164+0000 7fa6fbd21040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T15:46:05.215 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:05.214+0000 7f4fb7587040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T15:46:05.219 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.218+0000 7f0540ff9640 1 -- 172.21.15.64:0/1104011587 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0534007400 con 0x7f05440b33a0 2024-04-25T15:46:05.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.223+0000 7f0540ff9640 1 -- 172.21.15.64:0/1104011587 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f0534011590 con 0x7f05440b33a0 2024-04-25T15:46:05.223 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.223+0000 7f0540ff9640 1 -- 172.21.15.64:0/1104011587 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f05340039a0 con 0x7f05440b33a0 2024-04-25T15:46:05.263 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:05.262+0000 7f4fb7587040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T15:46:05.298 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.298+0000 7f054939d640 1 -- 172.21.15.64:0/1104011587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa", "id": 5} v 0) -- 0x7f05440cf290 con 0x7f05440b33a0 2024-04-25T15:46:05.339 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.339+0000 7f0540ff9640 1 -- 172.21.15.64:0/1104011587 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f0534003b80 con 0x7f05440b33a0 2024-04-25T15:46:05.339 INFO:teuthology.orchestra.run.smithi064.stdout:5 2024-04-25T15:46:05.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.340+0000 7f054939d640 1 -- 172.21.15.64:0/1104011587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05440b33a0 msgr2=0x7f05441f2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.340+0000 7f054939d640 1 --2- 172.21.15.64:0/1104011587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05440b33a0 0x7f05441f2280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f053400c390 tx=0x7f053400c850 comp rx=0 tx=0).stop 2024-04-25T15:46:05.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.340+0000 7f054939d640 1 -- 172.21.15.64:0/1104011587 shutdown_connections 2024-04-25T15:46:05.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.340+0000 7f054939d640 1 --2- 172.21.15.64:0/1104011587 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0544156700 0x7f05441e9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.340+0000 7f054939d640 1 --2- 172.21.15.64:0/1104011587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05440b33a0 0x7f05441f2280 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.340+0000 7f054939d640 1 --2- 172.21.15.64:0/1104011587 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0544071b90 0x7f0544158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.340+0000 7f054939d640 1 -- 172.21.15.64:0/1104011587 >> 172.21.15.64:0/1104011587 conn(0x7f05440747b0 msgr2=0x7f0544155970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:05.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.340+0000 7f054939d640 1 -- 172.21.15.64:0/1104011587 shutdown_connections 2024-04-25T15:46:05.341 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.340+0000 7f054939d640 1 -- 172.21.15.64:0/1104011587 wait complete. 2024-04-25T15:46:05.353 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new 311d9a6b-8fbc-4809-8d33-b9248a3562f7 6 2024-04-25T15:46:05.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.468+0000 7fe2ad0e0640 1 Processor -- start 2024-04-25T15:46:05.469 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.468+0000 7fe2ad0e0640 1 -- start start 2024-04-25T15:46:05.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.470+0000 7fe2ad0e0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe2a81536d0 0x7fe2a80ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.470+0000 7fe2ad0e0640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe2a80c37b0 0x7fe2a80cb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.470 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.470+0000 7fe2ad0e0640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2a80cafb0 con 0x7fe2a80cb760 2024-04-25T15:46:05.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.470+0000 7fe2ad0e0640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fe2a8159f60 con 0x7fe2a80c37b0 2024-04-25T15:46:05.471 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.470+0000 7fe2ad0e0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a8159390 con 0x7fe2a81536d0 2024-04-25T15:46:05.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.470+0000 7fe2a6d9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe2a81536d0 0x7fe2a80ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.470+0000 7fe2a759e640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe2a80cb760 0x7fe2a815c870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.64:42884/0 (socket says 172.21.15.64:42884) 2024-04-25T15:46:05.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.470+0000 7fe2a759e640 1 -- 172.21.15.64:0/4129745507 learned_addr learned my addr 172.21.15.64:0/4129745507 (peer_addr_for_me v1:172.21.15.64:0/0) 2024-04-25T15:46:05.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.473+0000 7fe2a5d9b640 1 -- 172.21.15.64:0/4129745507 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3716574357 0 0) 0x7fe2a80cafb0 con 0x7fe2a80cb760 2024-04-25T15:46:05.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.473+0000 7fe2a5d9b640 1 -- 172.21.15.64:0/4129745507 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe290003520 con 0x7fe2a80cb760 2024-04-25T15:46:05.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.473+0000 7fe2a6d9d640 1 -- 172.21.15.64:0/4129745507 >> v2:172.21.15.64:3300/0 conn(0x7fe2a80c37b0 msgr2=0x7fe2a80cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:05.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.473+0000 7fe2a6d9d640 1 --2- 172.21.15.64:0/4129745507 >> v2:172.21.15.64:3300/0 conn(0x7fe2a80c37b0 0x7fe2a80cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.473+0000 7fe2a6d9d640 1 -- 172.21.15.64:0/4129745507 >> v1:172.21.15.59:6789/0 conn(0x7fe2a80cb760 legacy=0x7fe2a815c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.475 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.473+0000 7fe2a6d9d640 1 -- 172.21.15.64:0/4129745507 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a8159630 con 0x7fe2a81536d0 2024-04-25T15:46:05.476 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.475+0000 7fe2a6d9d640 1 --2- 172.21.15.64:0/4129745507 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe2a81536d0 0x7fe2a80ca970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe298009790 tx=0x7fe29802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd4a7b93d4c7443 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:05.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.479+0000 7fe2a5d9b640 1 -- 172.21.15.64:0/4129745507 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298037070 con 0x7fe2a81536d0 2024-04-25T15:46:05.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.479+0000 7fe2a5d9b640 1 -- 172.21.15.64:0/4129745507 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe298032440 con 0x7fe2a81536d0 2024-04-25T15:46:05.480 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.479+0000 7fe2a5d9b640 1 -- 172.21.15.64:0/4129745507 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298032810 con 0x7fe2a81536d0 2024-04-25T15:46:05.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.480+0000 7fe2ad0e0640 1 -- 172.21.15.64:0/4129745507 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe2a81536d0 msgr2=0x7fe2a80ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.480+0000 7fe2ad0e0640 1 --2- 172.21.15.64:0/4129745507 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe2a81536d0 0x7fe2a80ca970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe298009790 tx=0x7fe29802a210 comp rx=0 tx=0).stop 2024-04-25T15:46:05.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.480+0000 7fe2ad0e0640 1 -- 172.21.15.64:0/4129745507 shutdown_connections 2024-04-25T15:46:05.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.480+0000 7fe2ad0e0640 1 --2- 172.21.15.64:0/4129745507 >> v2:172.21.15.64:3300/0 conn(0x7fe2a80c37b0 0x7fe2a80cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.481 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.480+0000 7fe2ad0e0640 1 --2- 172.21.15.64:0/4129745507 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe2a81536d0 0x7fe2a80ca970 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.480+0000 7fe2ad0e0640 1 -- 172.21.15.64:0/4129745507 >> 172.21.15.64:0/4129745507 conn(0x7fe2a80ce790 msgr2=0x7fe2a80ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:05.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.480+0000 7fe2ad0e0640 1 -- 172.21.15.64:0/4129745507 shutdown_connections 2024-04-25T15:46:05.482 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.480+0000 7fe2ad0e0640 1 -- 172.21.15.64:0/4129745507 wait complete. 2024-04-25T15:46:05.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.482+0000 7fe2ad0e0640 1 Processor -- start 2024-04-25T15:46:05.483 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.483+0000 7fe2ad0e0640 1 -- start start 2024-04-25T15:46:05.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.484+0000 7fe2ad0e0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2a80c37b0 0x7fe2a81585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.484+0000 7fe2ad0e0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe2a80cb760 0x7fe2a815b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.484+0000 7fe2ad0e0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a81536d0 0x7fe2a81470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.484+0000 7fe2ad0e0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a80b1260 con 0x7fe2a81536d0 2024-04-25T15:46:05.485 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.484+0000 7fe2ad0e0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a8159bf0 con 0x7fe2a80c37b0 2024-04-25T15:46:05.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.484+0000 7fe2ad0e0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a80c3bc0 con 0x7fe2a80cb760 2024-04-25T15:46:05.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.484+0000 7fe2a659c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe2a80cb760 0x7fe2a815b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.484+0000 7fe2a759e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a81536d0 0x7fe2a81470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.484+0000 7fe2a6d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2a80c37b0 0x7fe2a81585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.485+0000 7fe2a659c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe2a80cb760 0x7fe2a815b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:60852/0 (socket says 172.21.15.64:60852) 2024-04-25T15:46:05.486 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.485+0000 7fe2a659c640 1 -- 172.21.15.64:0/2337680498 learned_addr learned my addr 172.21.15.64:0/2337680498 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-25T15:46:05.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.488+0000 7fe2a759e640 1 -- 172.21.15.64:0/2337680498 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe2a80cb760 msgr2=0x7fe2a815b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.488+0000 7fe2a759e640 1 --2- 172.21.15.64:0/2337680498 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe2a80cb760 0x7fe2a815b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.488+0000 7fe2a759e640 1 -- 172.21.15.64:0/2337680498 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2a80c37b0 msgr2=0x7fe2a81585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.488+0000 7fe2a759e640 1 --2- 172.21.15.64:0/2337680498 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2a80c37b0 0x7fe2a81585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.489 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.489+0000 7fe2a759e640 1 -- 172.21.15.64:0/2337680498 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a80b4840 con 0x7fe2a81536d0 2024-04-25T15:46:05.491 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.491+0000 7fe2a759e640 1 --2- 172.21.15.64:0/2337680498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a81536d0 0x7fe2a81470f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000caa0 tx=0x7fe2a000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:05.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.494+0000 7fe28f7fe640 1 -- 172.21.15.64:0/2337680498 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0017070 con 0x7fe2a81536d0 2024-04-25T15:46:05.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.495+0000 7fe28f7fe640 1 -- 172.21.15.64:0/2337680498 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a000ab40 con 0x7fe2a81536d0 2024-04-25T15:46:05.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.495+0000 7fe28f7fe640 1 -- 172.21.15.64:0/2337680498 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0012400 con 0x7fe2a81536d0 2024-04-25T15:46:05.495 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.495+0000 7fe2ad0e0640 1 -- 172.21.15.64:0/2337680498 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a8158ae0 con 0x7fe2a81536d0 2024-04-25T15:46:05.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.495+0000 7fe2ad0e0640 1 -- 172.21.15.64:0/2337680498 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a8157010 con 0x7fe2a81536d0 2024-04-25T15:46:05.496 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.496+0000 7fe2ad0e0640 1 -- 172.21.15.64:0/2337680498 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a8071080 con 0x7fe2a81536d0 2024-04-25T15:46:05.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.498+0000 7fe28f7fe640 1 -- 172.21.15.64:0/2337680498 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe2a001a070 con 0x7fe2a81536d0 2024-04-25T15:46:05.499 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.498+0000 7fe28f7fe640 1 -- 172.21.15.64:0/2337680498 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fe2a0007660 con 0x7fe2a81536d0 2024-04-25T15:46:05.610 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.610+0000 7fe28f7fe640 1 -- 172.21.15.64:0/2337680498 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe2a8071080 con 0x7fe2a81536d0 2024-04-25T15:46:05.673 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:05.672+0000 7fa6fbd21040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T15:46:05.684 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.684+0000 7fe2ad0e0640 1 -- 172.21.15.64:0/2337680498 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "311d9a6b-8fbc-4809-8d33-b9248a3562f7", "id": 6} v 0) -- 0x7fe2a80c9200 con 0x7fe2a81536d0 2024-04-25T15:46:05.721 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.720+0000 7fe28f7fe640 1 -- 172.21.15.64:0/2337680498 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "311d9a6b-8fbc-4809-8d33-b9248a3562f7", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fe2a0007a40 con 0x7fe2a81536d0 2024-04-25T15:46:05.721 INFO:teuthology.orchestra.run.smithi064.stdout:6 2024-04-25T15:46:05.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.721+0000 7fe2ad0e0640 1 -- 172.21.15.64:0/2337680498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a81536d0 msgr2=0x7fe2a81470f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.721+0000 7fe2ad0e0640 1 --2- 172.21.15.64:0/2337680498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a81536d0 0x7fe2a81470f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000caa0 tx=0x7fe2a000cea0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.721+0000 7fe2ad0e0640 1 -- 172.21.15.64:0/2337680498 shutdown_connections 2024-04-25T15:46:05.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.721+0000 7fe2ad0e0640 1 --2- 172.21.15.64:0/2337680498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a81536d0 0x7fe2a81470f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.721+0000 7fe2ad0e0640 1 --2- 172.21.15.64:0/2337680498 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe2a80cb760 0x7fe2a815b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.722 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.721+0000 7fe2ad0e0640 1 --2- 172.21.15.64:0/2337680498 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2a80c37b0 0x7fe2a81585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.721+0000 7fe2ad0e0640 1 -- 172.21.15.64:0/2337680498 >> 172.21.15.64:0/2337680498 conn(0x7fe2a80ce790 msgr2=0x7fe2a806cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:05.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.721+0000 7fe2ad0e0640 1 -- 172.21.15.64:0/2337680498 shutdown_connections 2024-04-25T15:46:05.723 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.721+0000 7fe2ad0e0640 1 -- 172.21.15.64:0/2337680498 wait complete. 2024-04-25T15:46:05.734 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new d0f7436e-882f-4aa7-b2ae-684b9894b1f0 7 2024-04-25T15:46:05.795 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:05.795+0000 7fa6fbd21040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T15:46:05.831 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:05.831+0000 7f4fb7587040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T15:46:05.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.845+0000 7f9ef8b72640 1 Processor -- start 2024-04-25T15:46:05.846 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.845+0000 7f9ef8b72640 1 -- start start 2024-04-25T15:46:05.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.846+0000 7f9ef8b72640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9ef4154780 0x7f9ef40cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.846+0000 7f9ef8b72640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ef40cb5d0 con 0x7f9ef40ccd60 2024-04-25T15:46:05.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.846+0000 7f9ef8b72640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ef40cac30 con 0x7f9ef40b51b0 2024-04-25T15:46:05.847 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.846+0000 7f9ef8b72640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f9ef40c9840 con 0x7f9ef4154780 2024-04-25T15:46:05.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.847+0000 7f9ef259c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9ef40ccd60 0x7f9ef415e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.64:42900/0 (socket says 172.21.15.64:42900) 2024-04-25T15:46:05.848 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.847+0000 7f9ef259c640 1 -- 172.21.15.64:0/74722820 learned_addr learned my addr 172.21.15.64:0/74722820 (peer_addr_for_me v1:172.21.15.64:0/0) 2024-04-25T15:46:05.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.850+0000 7f9ef1d9b640 1 -- 172.21.15.64:0/74722820 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 247776779 0 0) 0x7f9ef40cb5d0 con 0x7f9ef40ccd60 2024-04-25T15:46:05.850 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.850+0000 7f9ef1d9b640 1 -- 172.21.15.64:0/74722820 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ee0003520 con 0x7f9ef40ccd60 2024-04-25T15:46:05.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.856+0000 7f9ef1d9b640 1 -- 172.21.15.64:0/74722820 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2428457551 0 0) 0x7f9ee0003520 con 0x7f9ef40ccd60 2024-04-25T15:46:05.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.856+0000 7f9ef1d9b640 1 -- 172.21.15.64:0/74722820 >> v2:172.21.15.64:3300/0 conn(0x7f9ef4154780 msgr2=0x7f9ef40cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:05.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.856+0000 7f9ef1d9b640 1 --2- 172.21.15.64:0/74722820 >> v2:172.21.15.64:3300/0 conn(0x7f9ef4154780 0x7f9ef40cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.856+0000 7f9ef1d9b640 1 -- 172.21.15.64:0/74722820 >> v1:172.21.15.64:6789/0 conn(0x7f9ef40b51b0 legacy=0x7f9ef415b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:05.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.856+0000 7f9ef1d9b640 1 -- 172.21.15.64:0/74722820 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef40caef0 con 0x7f9ef40ccd60 2024-04-25T15:46:05.857 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.856+0000 7f9ef1d9b640 1 -- 172.21.15.64:0/74722820 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 763030806 0 0) 0x7f9ee4001670 con 0x7f9ef40ccd60 2024-04-25T15:46:05.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.856+0000 7f9ef1d9b640 1 -- 172.21.15.64:0/74722820 >> v1:172.21.15.59:6789/0 conn(0x7f9ef40ccd60 legacy=0x7f9ef415e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.856+0000 7f9ef1d9b640 1 --2- 172.21.15.64:0/74722820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ee0003a00 0x7f9ee0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.856+0000 7f9ef1d9b640 1 --2- 172.21.15.64:0/74722820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ee0004800 0x7f9ee0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.856+0000 7f9ef1d9b640 1 --2- 172.21.15.64:0/74722820 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9ee00053a0 0x7f9ee000ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.856+0000 7f9ef1d9b640 1 -- 172.21.15.64:0/74722820 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef40c9840 con 0x7f9ee0003a00 2024-04-25T15:46:05.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.856+0000 7f9ef1d9b640 1 -- 172.21.15.64:0/74722820 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee000c300 con 0x7f9ee0004800 2024-04-25T15:46:05.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.856+0000 7f9ef1d9b640 1 -- 172.21.15.64:0/74722820 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f9ee000c500 con 0x7f9ee00053a0 2024-04-25T15:46:05.858 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.856+0000 7f9ef2d9d640 1 --2- 172.21.15.64:0/74722820 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9ee00053a0 0x7f9ee000ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.859 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.857+0000 7f9ef259c640 1 --2- 172.21.15.64:0/74722820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ee0003a00 0x7f9ee0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.860+0000 7f9ef2d9d640 1 -- 172.21.15.64:0/74722820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ee0004800 msgr2=0x7f9ee0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:05.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.860+0000 7f9ef2d9d640 1 --2- 172.21.15.64:0/74722820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ee0004800 0x7f9ee0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.860+0000 7f9ef2d9d640 1 -- 172.21.15.64:0/74722820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ee0003a00 msgr2=0x7f9ee0003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:05.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.860+0000 7f9ef2d9d640 1 --2- 172.21.15.64:0/74722820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ee0003a00 0x7f9ee0003e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.861 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.860+0000 7f9ef2d9d640 1 -- 172.21.15.64:0/74722820 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee0003520 con 0x7f9ee00053a0 2024-04-25T15:46:05.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.861+0000 7f9ef2d9d640 1 -- 172.21.15.64:0/74722820 reap_dead start 2024-04-25T15:46:05.862 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.862+0000 7f9ef2d9d640 1 --2- 172.21.15.64:0/74722820 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9ee00053a0 0x7f9ee000ba20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009e40 tx=0x7f9ee0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a05d005ff219014 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:05.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.866+0000 7f9ef1d9b640 1 -- 172.21.15.64:0/74722820 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec009a10 con 0x7f9ee00053a0 2024-04-25T15:46:05.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.866+0000 7f9ef1d9b640 1 -- 172.21.15.64:0/74722820 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eec006e50 con 0x7f9ee00053a0 2024-04-25T15:46:05.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.866+0000 7f9ef1d9b640 1 -- 172.21.15.64:0/74722820 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec003df0 con 0x7f9ee00053a0 2024-04-25T15:46:05.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.867+0000 7f9ef8b72640 1 -- 172.21.15.64:0/74722820 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9ee00053a0 msgr2=0x7f9ee000ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.867+0000 7f9ef8b72640 1 --2- 172.21.15.64:0/74722820 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9ee00053a0 0x7f9ee000ba20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009e40 tx=0x7f9ee0005830 comp rx=0 tx=0).stop 2024-04-25T15:46:05.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.867+0000 7f9ef8b72640 1 -- 172.21.15.64:0/74722820 shutdown_connections 2024-04-25T15:46:05.868 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.867+0000 7f9ef8b72640 1 --2- 172.21.15.64:0/74722820 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9ee00053a0 0x7f9ee000ba20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.867+0000 7f9ef8b72640 1 -- 172.21.15.64:0/74722820 >> 172.21.15.64:0/74722820 conn(0x7f9ef406c760 msgr2=0x7f9ef406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:05.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.867+0000 7f9ef8b72640 1 -- 172.21.15.64:0/74722820 shutdown_connections 2024-04-25T15:46:05.869 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.867+0000 7f9ef8b72640 1 -- 172.21.15.64:0/74722820 wait complete. 2024-04-25T15:46:05.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.869+0000 7f9ef8b72640 1 Processor -- start 2024-04-25T15:46:05.870 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.869+0000 7f9ef8b72640 1 -- start start 2024-04-25T15:46:05.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.870+0000 7f9ef8b72640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ee00053a0 0x7f9ef4145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.871 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.870+0000 7f9ef8b72640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9ef4146f40 0x7f9ef40b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.870+0000 7f9ef8b72640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ef41f5b70 0x7f9ef41f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:05.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.870+0000 7f9ef8b72640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef40cb1d0 con 0x7f9ee00053a0 2024-04-25T15:46:05.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.870+0000 7f9ef8b72640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef40cc8d0 con 0x7f9ef41f5b70 2024-04-25T15:46:05.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.870+0000 7f9ef8b72640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f9ef40cc280 con 0x7f9ef4146f40 2024-04-25T15:46:05.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.871+0000 7f9eebfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9ef4146f40 0x7f9ef40b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.871+0000 7f9ef2d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ef41f5b70 0x7f9ef41f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:05.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.871+0000 7f9eebfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9ef4146f40 0x7f9ef40b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:60882/0 (socket says 172.21.15.64:60882) 2024-04-25T15:46:05.872 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.871+0000 7f9eebfff640 1 -- 172.21.15.64:0/1558678321 learned_addr learned my addr 172.21.15.64:0/1558678321 (peer_addr_for_me v2:172.21.15.64:0/0) 2024-04-25T15:46:05.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.875+0000 7f9eebfff640 1 -- 172.21.15.64:0/1558678321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ef41f5b70 msgr2=0x7f9ef41f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.875+0000 7f9eebfff640 1 --2- 172.21.15.64:0/1558678321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ef41f5b70 0x7f9ef41f5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.875+0000 7f9eebfff640 1 -- 172.21.15.64:0/1558678321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ee00053a0 msgr2=0x7f9ef4145800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:05.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.875+0000 7f9eebfff640 1 --2- 172.21.15.64:0/1558678321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ee00053a0 0x7f9ef4145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:05.876 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.875+0000 7f9eebfff640 1 -- 172.21.15.64:0/1558678321 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef414af00 con 0x7f9ef4146f40 2024-04-25T15:46:05.878 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.877+0000 7f9eebfff640 1 --2- 172.21.15.64:0/1558678321 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9ef4146f40 0x7f9ef40b4750 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00c440 tx=0x7f9edc001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:05.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.882+0000 7f9eeaffd640 1 -- 172.21.15.64:0/1558678321 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc017070 con 0x7f9ef4146f40 2024-04-25T15:46:05.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.882+0000 7f9eeaffd640 1 -- 172.21.15.64:0/1558678321 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9edc0035f0 con 0x7f9ef4146f40 2024-04-25T15:46:05.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.882+0000 7f9eeaffd640 1 -- 172.21.15.64:0/1558678321 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc0039e0 con 0x7f9ef4146f40 2024-04-25T15:46:05.883 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.882+0000 7f9ef8b72640 1 -- 172.21.15.64:0/1558678321 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ef41e5480 con 0x7f9ef4146f40 2024-04-25T15:46:05.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.882+0000 7f9ef8b72640 1 -- 172.21.15.64:0/1558678321 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ef4146180 con 0x7f9ef4146f40 2024-04-25T15:46:05.884 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:05.883+0000 7f9ef8b72640 1 -- 172.21.15.64:0/1558678321 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ef4069fb0 con 0x7f9ef4146f40 2024-04-25T15:46:05.967 INFO:tasks.ceph.mgr.x.smithi064.stderr:2024-04-25T15:46:05.967+0000 7f4fb7587040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T15:46:06.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:06.002+0000 7f9eeaffd640 1 -- 172.21.15.64:0/1558678321 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9edc01a070 con 0x7f9ef4146f40 2024-04-25T15:46:06.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:06.002+0000 7f9eeaffd640 1 -- 172.21.15.64:0/1558678321 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f9edc01ba10 con 0x7f9ef4146f40 2024-04-25T15:46:06.003 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:06.002+0000 7f9eeaffd640 1 -- 172.21.15.64:0/1558678321 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9edc021020 con 0x7f9ef4146f40 2024-04-25T15:46:06.079 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:06.078+0000 7f9ef8b72640 1 -- 172.21.15.64:0/1558678321 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d0f7436e-882f-4aa7-b2ae-684b9894b1f0", "id": 7} v 0) -- 0x7f9ef414aab0 con 0x7f9ef4146f40 2024-04-25T15:46:06.310 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:06.309+0000 7f9eeaffd640 1 -- 172.21.15.64:0/1558678321 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mgrmap(e 2) ==== 48416+0+0 (secure 0 0 0) 0x7f9edc003b80 con 0x7f9ef4146f40 2024-04-25T15:46:06.748 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:06.747+0000 7f9eeaffd640 1 -- 172.21.15.64:0/1558678321 <== mon.2 v2:172.21.15.64:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d0f7436e-882f-4aa7-b2ae-684b9894b1f0", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f9edc01a360 con 0x7f9ef4146f40 2024-04-25T15:46:06.748 INFO:teuthology.orchestra.run.smithi064.stdout:7 2024-04-25T15:46:06.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:06.748+0000 7f9ef8b72640 1 -- 172.21.15.64:0/1558678321 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9ef4146f40 msgr2=0x7f9ef40b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:06.748+0000 7f9ef8b72640 1 --2- 172.21.15.64:0/1558678321 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9ef4146f40 0x7f9ef40b4750 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00c440 tx=0x7f9edc001e70 comp rx=0 tx=0).stop 2024-04-25T15:46:06.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:06.748+0000 7f9ef8b72640 1 -- 172.21.15.64:0/1558678321 shutdown_connections 2024-04-25T15:46:06.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:06.748+0000 7f9ef8b72640 1 --2- 172.21.15.64:0/1558678321 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9ef41f5b70 0x7f9ef41f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:06.748+0000 7f9ef8b72640 1 --2- 172.21.15.64:0/1558678321 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9ef4146f40 0x7f9ef40b4750 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:06.748+0000 7f9ef8b72640 1 --2- 172.21.15.64:0/1558678321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ee00053a0 0x7f9ef4145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:06.748+0000 7f9ef8b72640 1 -- 172.21.15.64:0/1558678321 >> 172.21.15.64:0/1558678321 conn(0x7f9ef406c760 msgr2=0x7f9ef41521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:06.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:06.748+0000 7f9ef8b72640 1 -- 172.21.15.64:0/1558678321 shutdown_connections 2024-04-25T15:46:06.749 INFO:teuthology.orchestra.run.smithi064.stderr:2024-04-25T15:46:06.748+0000 7f9ef8b72640 1 -- 172.21.15.64:0/1558678321 wait complete. 2024-04-25T15:46:06.761 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T15:46:06.761 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-04-25T15:46:06.763 INFO:tasks.ceph.osd.0:Started 2024-04-25T15:46:06.764 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T15:46:06.764 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-04-25T15:46:06.772 INFO:tasks.ceph.osd.1:Started 2024-04-25T15:46:06.772 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T15:46:06.772 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-04-25T15:46:06.775 INFO:tasks.ceph.osd.2:Started 2024-04-25T15:46:06.775 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T15:46:06.775 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-04-25T15:46:06.777 INFO:tasks.ceph.osd.3:Started 2024-04-25T15:46:06.777 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T15:46:06.777 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-04-25T15:46:06.779 INFO:tasks.ceph.osd.4:Started 2024-04-25T15:46:06.779 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T15:46:06.779 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-04-25T15:46:06.781 INFO:tasks.ceph.osd.5:Started 2024-04-25T15:46:06.781 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T15:46:06.782 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-04-25T15:46:06.783 INFO:tasks.ceph.osd.6:Started 2024-04-25T15:46:06.784 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T15:46:06.784 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-04-25T15:46:06.787 INFO:tasks.ceph.osd.7:Started 2024-04-25T15:46:06.787 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:06.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.917+0000 7facf0fd5640 1 Processor -- start 2024-04-25T15:46:06.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.917+0000 7facf0fd5640 1 -- start start 2024-04-25T15:46:06.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.919+0000 7facf0fd5640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7facec0b41c0 0x7facec0cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.919+0000 7facf0fd5640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7facec0ce540 0x7facec0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.919+0000 7facf0fd5640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facec15cd60 con 0x7facec0cd680 2024-04-25T15:46:06.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.919+0000 7facf0fd5640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7facec15d040 con 0x7facec0b41c0 2024-04-25T15:46:06.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.919+0000 7facf0fd5640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7facec15d320 con 0x7facec0ce540 2024-04-25T15:46:06.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.938+0000 7facea59c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7facec0b41c0 0x7facec0cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.939+0000 7facea59c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7facec0b41c0 0x7facec0cd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51796/0 (socket says 172.21.15.59:51796) 2024-04-25T15:46:06.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.939+0000 7facea59c640 1 -- 172.21.15.59:0/2700601477 learned_addr learned my addr 172.21.15.59:0/2700601477 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:06.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.962+0000 7facead9d640 1 --2- 172.21.15.59:0/2700601477 >> v2:172.21.15.64:3300/0 conn(0x7facec0ce540 0x7facec0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.967+0000 7facead9d640 1 -- 172.21.15.59:0/2700601477 >> v2:172.21.15.59:3300/0 conn(0x7facec0b41c0 msgr2=0x7facec0cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:06.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.967+0000 7facead9d640 1 --2- 172.21.15.59:0/2700601477 >> v2:172.21.15.59:3300/0 conn(0x7facec0b41c0 0x7facec0cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.967+0000 7facead9d640 1 -- 172.21.15.59:0/2700601477 >> v1:172.21.15.59:6789/0 conn(0x7facec0cd680 legacy=0x7facec15c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.967+0000 7facead9d640 1 -- 172.21.15.59:0/2700601477 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec15d600 con 0x7facec0ce540 2024-04-25T15:46:06.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.969+0000 7facead9d640 1 --2- 172.21.15.59:0/2700601477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec0ce540 0x7facec0ce950 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7facec06ea80 tx=0x7face402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58be7f6f2248465c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:06.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.973+0000 7face959a640 1 -- 172.21.15.59:0/2700601477 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4007740 con 0x7facec0ce540 2024-04-25T15:46:06.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.973+0000 7face959a640 1 -- 172.21.15.59:0/2700601477 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face40078e0 con 0x7facec0ce540 2024-04-25T15:46:06.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.973+0000 7face959a640 1 -- 172.21.15.59:0/2700601477 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4007cb0 con 0x7facec0ce540 2024-04-25T15:46:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.974+0000 7facf0fd5640 1 -- 172.21.15.59:0/2700601477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec0ce540 msgr2=0x7facec0ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.974+0000 7facf0fd5640 1 --2- 172.21.15.59:0/2700601477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec0ce540 0x7facec0ce950 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7facec06ea80 tx=0x7face402a680 comp rx=0 tx=0).stop 2024-04-25T15:46:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.974+0000 7facf0fd5640 1 -- 172.21.15.59:0/2700601477 shutdown_connections 2024-04-25T15:46:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.974+0000 7facf0fd5640 1 --2- 172.21.15.59:0/2700601477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec0ce540 0x7facec0ce950 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.974+0000 7facf0fd5640 1 --2- 172.21.15.59:0/2700601477 >> v2:172.21.15.59:3300/0 conn(0x7facec0b41c0 0x7facec0cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.974+0000 7facf0fd5640 1 -- 172.21.15.59:0/2700601477 >> 172.21.15.59:0/2700601477 conn(0x7facec06ed70 msgr2=0x7facec06f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.974+0000 7facf0fd5640 1 -- 172.21.15.59:0/2700601477 shutdown_connections 2024-04-25T15:46:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.974+0000 7facf0fd5640 1 -- 172.21.15.59:0/2700601477 wait complete. 2024-04-25T15:46:06.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.976+0000 7facf0fd5640 1 Processor -- start 2024-04-25T15:46:06.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.976+0000 7facf0fd5640 1 -- start start 2024-04-25T15:46:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.977+0000 7facf0fd5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec0b41c0 0x7facec0ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.977+0000 7facf0fd5640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7facec0cd680 0x7facec1f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.977+0000 7facf0fd5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec0ce540 0x7facec153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.977+0000 7facf0fd5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7facec0cee90 con 0x7facec0ce540 2024-04-25T15:46:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.977+0000 7facf0fd5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7facec0b78a0 con 0x7facec0b41c0 2024-04-25T15:46:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.977+0000 7facf0fd5640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7facec0c51e0 con 0x7facec0cd680 2024-04-25T15:46:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.978+0000 7face9d9b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7facec0cd680 0x7facec1f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.978+0000 7facea59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec0b41c0 0x7facec0ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.978+0000 7face9d9b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7facec0cd680 0x7facec1f3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:54648/0 (socket says 172.21.15.59:54648) 2024-04-25T15:46:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.978+0000 7face9d9b640 1 -- 172.21.15.59:0/175457474 learned_addr learned my addr 172.21.15.59:0/175457474 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.982+0000 7face9d9b640 1 -- 172.21.15.59:0/175457474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec0b41c0 msgr2=0x7facec0ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.982+0000 7face9d9b640 1 --2- 172.21.15.59:0/175457474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec0b41c0 0x7facec0ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.982+0000 7face9d9b640 1 -- 172.21.15.59:0/175457474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec0ce540 msgr2=0x7facec153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.982+0000 7face9d9b640 1 --2- 172.21.15.59:0/175457474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec0ce540 0x7facec153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.982+0000 7face9d9b640 1 -- 172.21.15.59:0/175457474 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec0cafc0 con 0x7facec0cd680 2024-04-25T15:46:06.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.985+0000 7face9d9b640 1 --2- 172.21.15.59:0/175457474 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7facec0cd680 0x7facec1f3c20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7face000c3f0 tx=0x7face000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:06.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.989+0000 7facdaffd640 1 -- 172.21.15.59:0/175457474 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face00052d0 con 0x7facec0cd680 2024-04-25T15:46:06.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.989+0000 7facdaffd640 1 -- 172.21.15.59:0/175457474 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face0005470 con 0x7facec0cd680 2024-04-25T15:46:06.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.989+0000 7facf0fd5640 1 -- 172.21.15.59:0/175457474 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facec155ed0 con 0x7facec0cd680 2024-04-25T15:46:06.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.989+0000 7facdaffd640 1 -- 172.21.15.59:0/175457474 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face0007260 con 0x7facec0cd680 2024-04-25T15:46:06.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.989+0000 7facf0fd5640 1 -- 172.21.15.59:0/175457474 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7facec0c99d0 con 0x7facec0cd680 2024-04-25T15:46:06.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:06.990+0000 7facf0fd5640 1 -- 172.21.15.59:0/175457474 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facec0698a0 con 0x7facec0cd680 2024-04-25T15:46:07.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:07.113+0000 7facdaffd640 1 -- 172.21.15.59:0/175457474 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 2) ==== 48416+0+0 (secure 0 0 0) 0x7face0007400 con 0x7facec0cd680 2024-04-25T15:46:07.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:07.124+0000 7facdaffd640 1 -- 172.21.15.59:0/175457474 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7face0019d80 con 0x7facec0cd680 2024-04-25T15:46:07.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:07.124+0000 7facdaffd640 1 -- 172.21.15.59:0/175457474 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7face001a360 con 0x7facec0cd680 2024-04-25T15:46:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:07.189+0000 7facf0fd5640 1 -- 172.21.15.59:0/175457474 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7facec158be0 con 0x7facec0cd680 2024-04-25T15:46:07.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:07.312+0000 7facdaffd640 1 -- 172.21.15.59:0/175457474 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7face00067d0 con 0x7facec0cd680 2024-04-25T15:46:07.313 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:07.313 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":10,"fsid":"9bb5d7ca-5217-467b-882c-0a18cd57f08f","created":"2024-04-25T15:46:00.198001+0000","modified":"2024-04-25T15:46:06.311980+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T15:46:06.311980+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"34cee654-11dd-4f4b-99fe-093462f8abad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3c15505b-4abd-4a24-b30c-edc2732f8ac4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5884bf21-e6b4-4813-b8bc-6baa92443c87","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6ff71700-3b00-4350-b3c9-f6c41ec46b00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d0a72143-93fd-4712-aadb-f3fade303426","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"311d9a6b-8fbc-4809-8d33-b9248a3562f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d0f7436e-882f-4aa7-b2ae-684b9894b1f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:07.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:07.313+0000 7facf0fd5640 1 -- 172.21.15.59:0/175457474 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7facec0cd680 msgr2=0x7facec1f3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:07.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:07.313+0000 7facf0fd5640 1 --2- 172.21.15.59:0/175457474 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7facec0cd680 0x7facec1f3c20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7face000c3f0 tx=0x7face000c7f0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:07.313+0000 7facf0fd5640 1 -- 172.21.15.59:0/175457474 shutdown_connections 2024-04-25T15:46:07.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:07.313+0000 7facf0fd5640 1 --2- 172.21.15.59:0/175457474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec0ce540 0x7facec153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:07.313+0000 7facf0fd5640 1 --2- 172.21.15.59:0/175457474 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7facec0cd680 0x7facec1f3c20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:07.313+0000 7facf0fd5640 1 --2- 172.21.15.59:0/175457474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7facec0b41c0 0x7facec0ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:07.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:07.313+0000 7facf0fd5640 1 -- 172.21.15.59:0/175457474 >> 172.21.15.59:0/175457474 conn(0x7facec06ed70 msgr2=0x7facec155240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:07.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:07.313+0000 7facf0fd5640 1 -- 172.21.15.59:0/175457474 shutdown_connections 2024-04-25T15:46:07.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:07.313+0000 7facf0fd5640 1 -- 172.21.15.59:0/175457474 wait complete. 2024-04-25T15:46:07.324 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T15:46:07.325 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T15:46:07.384 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-25T15:46:07.383+0000 7f82a4a0e640 -1 Falling back to public interface 2024-04-25T15:46:07.409 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-04-25T15:46:07.408+0000 7f3c3980d640 -1 Falling back to public interface 2024-04-25T15:46:07.418 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-04-25T15:46:07.417+0000 7fc9d420d640 -1 Falling back to public interface 2024-04-25T15:46:07.430 INFO:tasks.ceph.osd.7.smithi064.stderr:2024-04-25T15:46:07.430+0000 7ff17102c640 -1 Falling back to public interface 2024-04-25T15:46:07.433 INFO:tasks.ceph.osd.6.smithi064.stderr:2024-04-25T15:46:07.432+0000 7f9e155bc640 -1 Falling back to public interface 2024-04-25T15:46:07.441 INFO:tasks.ceph.osd.4.smithi064.stderr:2024-04-25T15:46:07.441+0000 7fb08e82d640 -1 Falling back to public interface 2024-04-25T15:46:07.467 INFO:tasks.ceph.osd.5.smithi064.stderr:2024-04-25T15:46:07.466+0000 7f93d240e640 -1 Falling back to public interface 2024-04-25T15:46:07.477 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-04-25T15:46:07.477+0000 7f18c0424640 -1 Falling back to public interface 2024-04-25T15:46:07.754 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:07.754+0000 7fa69bf80640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T15:46:07.781 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T15:46:07.780+0000 7fa69bf80640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T15:46:08.133 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:08.248 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.247+0000 7f09686bf640 1 Processor -- start 2024-04-25T15:46:08.248 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.247+0000 7f09686bf640 1 -- start start 2024-04-25T15:46:08.249 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.249+0000 7f09686bf640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0960160640 0x7f09600cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.249 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.249+0000 7f09686bf640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0960156910 con 0x7f09600cc4a0 2024-04-25T15:46:08.250 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.249+0000 7f09686bf640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09600c7fc0 con 0x7f09600c7bb0 2024-04-25T15:46:08.250 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.249+0000 7f09686bf640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f09600cd960 con 0x7f0960160640 2024-04-25T15:46:08.310 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.309+0000 7f0966c5c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0960160640 0x7f09600cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.310 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.309+0000 7f0966c5c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0960160640 0x7f09600cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51824/0 (socket says 172.21.15.59:51824) 2024-04-25T15:46:08.310 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.309+0000 7f0966c5c640 1 -- 172.21.15.59:0/2153909260 learned_addr learned my addr 172.21.15.59:0/2153909260 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:08.314 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.313+0000 7f0966c5c640 1 -- 172.21.15.59:0/2153909260 >> v1:172.21.15.64:6789/0 conn(0x7f09600c7bb0 legacy=0x7f09600cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:08.314 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.313+0000 7f0966c5c640 1 -- 172.21.15.59:0/2153909260 >> v1:172.21.15.59:6789/0 conn(0x7f09600cc4a0 legacy=0x7f096015ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.314 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.313+0000 7f0966c5c640 1 -- 172.21.15.59:0/2153909260 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096015c730 con 0x7f0960160640 2024-04-25T15:46:08.317 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.316+0000 7f0966c5c640 1 --2- 172.21.15.59:0/2153909260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0960160640 0x7f09600cc8b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0958009e50 tx=0x7f095802a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d80e0947a6bda9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:08.324 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.323+0000 7f0965459640 1 -- 172.21.15.59:0/2153909260 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958036070 con 0x7f0960160640 2024-04-25T15:46:08.324 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.323+0000 7f0965459640 1 -- 172.21.15.59:0/2153909260 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0958031600 con 0x7f0960160640 2024-04-25T15:46:08.324 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.323+0000 7f0965459640 1 -- 172.21.15.59:0/2153909260 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09580319d0 con 0x7f0960160640 2024-04-25T15:46:08.325 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.324+0000 7f09686bf640 1 -- 172.21.15.59:0/2153909260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0960160640 msgr2=0x7f09600cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.325 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.324+0000 7f09686bf640 1 --2- 172.21.15.59:0/2153909260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0960160640 0x7f09600cc8b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0958009e50 tx=0x7f095802a7f0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.325 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.324+0000 7f09686bf640 1 -- 172.21.15.59:0/2153909260 shutdown_connections 2024-04-25T15:46:08.325 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.324+0000 7f09686bf640 1 --2- 172.21.15.59:0/2153909260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0960160640 0x7f09600cc8b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.325 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.324+0000 7f09686bf640 1 -- 172.21.15.59:0/2153909260 >> 172.21.15.59:0/2153909260 conn(0x7f096006f370 msgr2=0x7f0960073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:08.325 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.324+0000 7f09686bf640 1 -- 172.21.15.59:0/2153909260 shutdown_connections 2024-04-25T15:46:08.325 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.324+0000 7f09686bf640 1 -- 172.21.15.59:0/2153909260 wait complete. 2024-04-25T15:46:08.327 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.326+0000 7f09686bf640 1 Processor -- start 2024-04-25T15:46:08.327 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.326+0000 7f09686bf640 1 -- start start 2024-04-25T15:46:08.328 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.327+0000 7f09686bf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09600c7bb0 0x7f096015a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.328 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.327+0000 7f09686bf640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f09600cc4a0 0x7f096015e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.328 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.327+0000 7f09686bf640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0960160640 0x7f096015e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.328 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.327+0000 7f09686bf640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f096015cfd0 con 0x7f09600c7bb0 2024-04-25T15:46:08.328 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.327+0000 7f09686bf640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f096015ccf0 con 0x7f0960160640 2024-04-25T15:46:08.328 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.327+0000 7f09686bf640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f096015d2b0 con 0x7f09600cc4a0 2024-04-25T15:46:08.329 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.328+0000 7f096645b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09600c7bb0 0x7f096015a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.329 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.328+0000 7f0965c5a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f09600cc4a0 0x7f096015e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.329 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.328+0000 7f0965c5a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f09600cc4a0 0x7f096015e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:54660/0 (socket says 172.21.15.59:54660) 2024-04-25T15:46:08.329 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.328+0000 7f0965c5a640 1 -- 172.21.15.59:0/3196288920 learned_addr learned my addr 172.21.15.59:0/3196288920 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:08.333 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.332+0000 7f0965c5a640 1 -- 172.21.15.59:0/3196288920 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0960160640 msgr2=0x7f096015e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.333 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.332+0000 7f0965c5a640 1 --2- 172.21.15.59:0/3196288920 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0960160640 0x7f096015e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.333 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.332+0000 7f0965c5a640 1 -- 172.21.15.59:0/3196288920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09600c7bb0 msgr2=0x7f096015a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:08.333 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.332+0000 7f0965c5a640 1 --2- 172.21.15.59:0/3196288920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09600c7bb0 0x7f096015a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:08.333 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.332+0000 7f0965c5a640 1 -- 172.21.15.59:0/3196288920 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096015a860 con 0x7f09600cc4a0 2024-04-25T15:46:08.337 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.336+0000 7f0965c5a640 1 --2- 172.21.15.59:0/3196288920 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f09600cc4a0 0x7f096015e270 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f095000c470 tx=0x7f095000c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:08.341 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.340+0000 7f0956ffd640 1 -- 172.21.15.59:0/3196288920 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09500052d0 con 0x7f09600cc4a0 2024-04-25T15:46:08.342 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.340+0000 7f0956ffd640 1 -- 172.21.15.59:0/3196288920 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0950005490 con 0x7f09600cc4a0 2024-04-25T15:46:08.342 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.340+0000 7f09686bf640 1 -- 172.21.15.59:0/3196288920 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09600cf650 con 0x7f09600cc4a0 2024-04-25T15:46:08.342 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.340+0000 7f0956ffd640 1 -- 172.21.15.59:0/3196288920 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950007260 con 0x7f09600cc4a0 2024-04-25T15:46:08.342 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.341+0000 7f09686bf640 1 -- 172.21.15.59:0/3196288920 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09600d0610 con 0x7f09600cc4a0 2024-04-25T15:46:08.343 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.341+0000 7f09686bf640 1 -- 172.21.15.59:0/3196288920 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09600cdf30 con 0x7f09600cc4a0 2024-04-25T15:46:08.371 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.370+0000 7f0956ffd640 1 -- 172.21.15.59:0/3196288920 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 3) ==== 96620+0+0 (secure 0 0 0) 0x7f0950007400 con 0x7f09600cc4a0 2024-04-25T15:46:08.372 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.371+0000 7f0956ffd640 1 --2- 172.21.15.59:0/3196288920 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f0944074350 0x7f0944076860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:08.372 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.371+0000 7f0956ffd640 1 -- 172.21.15.59:0/3196288920 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f0950093640 con 0x7f09600cc4a0 2024-04-25T15:46:08.372 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.371+0000 7f096645b640 1 --2- 172.21.15.59:0/3196288920 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f0944074350 0x7f0944076860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:08.372 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.371+0000 7f096645b640 1 --2- 172.21.15.59:0/3196288920 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f0944074350 0x7f0944076860 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f095c006fd0 tx=0x7f095c009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:08.657 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.657+0000 7f0956ffd640 1 -- 172.21.15.59:0/3196288920 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f09600cdf30 con 0x7f09600cc4a0 2024-04-25T15:46:08.850 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:08.849+0000 7f09686bf640 1 -- 172.21.15.59:0/3196288920 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09600698a0 con 0x7f09600cc4a0 2024-04-25T15:46:09.148 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:09.147+0000 7f0956ffd640 1 -- 172.21.15.59:0/3196288920 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mgrmap(e 4) ==== 96726+0+0 (secure 0 0 0) 0x7f095005ae00 con 0x7f09600cc4a0 2024-04-25T15:46:09.173 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:09.172+0000 7f0956ffd640 1 -- 172.21.15.59:0/3196288920 <== mon.2 v2:172.21.15.64:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f09500655d0 con 0x7f09600cc4a0 2024-04-25T15:46:09.173 INFO:teuthology.misc.health.smithi059.stdout: 2024-04-25T15:46:09.173 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":10,"fsid":"9bb5d7ca-5217-467b-882c-0a18cd57f08f","created":"2024-04-25T15:46:00.198001+0000","modified":"2024-04-25T15:46:06.311980+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T15:46:06.311980+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"34cee654-11dd-4f4b-99fe-093462f8abad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3c15505b-4abd-4a24-b30c-edc2732f8ac4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5884bf21-e6b4-4813-b8bc-6baa92443c87","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6ff71700-3b00-4350-b3c9-f6c41ec46b00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d0a72143-93fd-4712-aadb-f3fade303426","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"311d9a6b-8fbc-4809-8d33-b9248a3562f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d0f7436e-882f-4aa7-b2ae-684b9894b1f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:09.175 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:09.174+0000 7f09686bf640 1 -- 172.21.15.59:0/3196288920 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f0944074350 msgr2=0x7f0944076860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:09.175 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:09.174+0000 7f09686bf640 1 --2- 172.21.15.59:0/3196288920 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f0944074350 0x7f0944076860 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f095c006fd0 tx=0x7f095c009060 comp rx=0 tx=0).stop 2024-04-25T15:46:09.175 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:09.174+0000 7f09686bf640 1 -- 172.21.15.59:0/3196288920 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f09600cc4a0 msgr2=0x7f096015e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:09.175 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:09.174+0000 7f09686bf640 1 --2- 172.21.15.59:0/3196288920 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f09600cc4a0 0x7f096015e270 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f095000c470 tx=0x7f095000c930 comp rx=0 tx=0).stop 2024-04-25T15:46:09.176 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:09.174+0000 7f09686bf640 1 -- 172.21.15.59:0/3196288920 shutdown_connections 2024-04-25T15:46:09.176 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:09.174+0000 7f09686bf640 1 --2- 172.21.15.59:0/3196288920 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f0944074350 0x7f0944076860 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:09.176 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:09.174+0000 7f09686bf640 1 --2- 172.21.15.59:0/3196288920 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0960160640 0x7f096015e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:09.176 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:09.174+0000 7f09686bf640 1 --2- 172.21.15.59:0/3196288920 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f09600cc4a0 0x7f096015e270 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:09.176 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:09.174+0000 7f09686bf640 1 --2- 172.21.15.59:0/3196288920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09600c7bb0 0x7f096015a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:09.176 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:09.174+0000 7f09686bf640 1 -- 172.21.15.59:0/3196288920 >> 172.21.15.59:0/3196288920 conn(0x7f096006f370 msgr2=0x7f0960152dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:09.176 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:09.174+0000 7f09686bf640 1 -- 172.21.15.59:0/3196288920 shutdown_connections 2024-04-25T15:46:09.176 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:09.174+0000 7f09686bf640 1 -- 172.21.15.59:0/3196288920 wait complete. 2024-04-25T15:46:09.186 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T15:46:10.829 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-25T15:46:10.828+0000 7f82a4a0e640 -1 osd.0 0 log_to_monitors true 2024-04-25T15:46:10.882 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-04-25T15:46:10.878+0000 7f3c3980d640 -1 osd.2 0 log_to_monitors true 2024-04-25T15:46:10.886 INFO:tasks.ceph.osd.7.smithi064.stderr:2024-04-25T15:46:10.885+0000 7ff17102c640 -1 osd.7 0 log_to_monitors true 2024-04-25T15:46:10.903 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-04-25T15:46:10.902+0000 7fc9d420d640 -1 osd.3 0 log_to_monitors true 2024-04-25T15:46:10.919 INFO:tasks.ceph.osd.6.smithi064.stderr:2024-04-25T15:46:10.918+0000 7f9e155bc640 -1 osd.6 0 log_to_monitors true 2024-04-25T15:46:10.934 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-04-25T15:46:10.933+0000 7f18c0424640 -1 osd.1 0 log_to_monitors true 2024-04-25T15:46:10.945 INFO:tasks.ceph.osd.4.smithi064.stderr:2024-04-25T15:46:10.944+0000 7fb08e82d640 -1 osd.4 0 log_to_monitors true 2024-04-25T15:46:10.968 INFO:tasks.ceph.osd.5.smithi064.stderr:2024-04-25T15:46:10.968+0000 7f93d240e640 -1 osd.5 0 log_to_monitors true 2024-04-25T15:46:11.121 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:46:11.123 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:46:13.624 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-04-25T15:46:13.623+0000 7fc9d0338640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T15:46:13.812 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-04-25T15:46:13.811+0000 7fc9c791f640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:46:13.832 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-25T15:46:13.831+0000 7f82a0be2640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T15:46:13.923 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-25T15:46:13.923+0000 7f82981c9640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:46:14.592 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-04-25T15:46:14.591+0000 7f18bbd1a640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T15:46:14.625 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-04-25T15:46:14.625+0000 7f3c35238640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T15:46:14.644 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-04-25T15:46:14.644+0000 7f18b3b15640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:46:14.658 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-04-25T15:46:14.658+0000 7f3c2d033640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:46:15.400 INFO:tasks.ceph.osd.4.smithi064.stderr:2024-04-25T15:46:15.399+0000 7fb08a58c640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T15:46:15.487 INFO:tasks.ceph.osd.6.smithi064.stderr:2024-04-25T15:46:15.487+0000 7f9e11552640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T15:46:15.495 INFO:tasks.ceph.osd.7.smithi064.stderr:2024-04-25T15:46:15.495+0000 7ff16c580640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T15:46:15.504 INFO:tasks.ceph.osd.5.smithi064.stderr:2024-04-25T15:46:15.503+0000 7f93ce518640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T15:46:15.505 INFO:tasks.ceph.osd.4.smithi064.stderr:2024-04-25T15:46:15.505+0000 7fb081b73640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:46:15.522 INFO:tasks.ceph.osd.7.smithi064.stderr:2024-04-25T15:46:15.522+0000 7ff16438c640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:46:15.546 INFO:tasks.ceph.osd.5.smithi064.stderr:2024-04-25T15:46:15.546+0000 7f93c5aff640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:46:15.547 INFO:tasks.ceph.osd.6.smithi064.stderr:2024-04-25T15:46:15.546+0000 7f9e0934d640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:46:15.992 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:16.097 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.096+0000 7f07570f9640 1 Processor -- start 2024-04-25T15:46:16.097 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.096+0000 7f07570f9640 1 -- start start 2024-04-25T15:46:16.098 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.097+0000 7f07570f9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07500c8c60 0x7f07500ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.098 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.098+0000 7f07570f9640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f075015d510 con 0x7f075015d020 2024-04-25T15:46:16.098 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.098+0000 7f07570f9640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07500cdb50 con 0x7f07500b73a0 2024-04-25T15:46:16.098 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.098+0000 7f07570f9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f07500cc6d0 con 0x7f07500c8c60 2024-04-25T15:46:16.099 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.098+0000 7f0754e95640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f075015d020 0x7f0750156730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51422/0 (socket says 172.21.15.59:51422) 2024-04-25T15:46:16.099 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.098+0000 7f0754e95640 1 -- 172.21.15.59:0/3295239077 learned_addr learned my addr 172.21.15.59:0/3295239077 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:16.101 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.100+0000 7f074f7fe640 1 -- 172.21.15.59:0/3295239077 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3890119706 0 0) 0x7f075015d510 con 0x7f075015d020 2024-04-25T15:46:16.101 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.101+0000 7f074f7fe640 1 -- 172.21.15.59:0/3295239077 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0738003520 con 0x7f075015d020 2024-04-25T15:46:16.106 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.105+0000 7f074f7fe640 1 -- 172.21.15.59:0/3295239077 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2386725980 0 0) 0x7f0738003520 con 0x7f075015d020 2024-04-25T15:46:16.106 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.105+0000 7f074f7fe640 1 -- 172.21.15.59:0/3295239077 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07500c8c60 msgr2=0x7f07500ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:16.106 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.105+0000 7f074f7fe640 1 --2- 172.21.15.59:0/3295239077 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07500c8c60 0x7f07500ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.106 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.105+0000 7f074f7fe640 1 -- 172.21.15.59:0/3295239077 >> v1:172.21.15.64:6789/0 conn(0x7f07500b73a0 legacy=0x7f075008d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:16.106 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.105+0000 7f074f7fe640 1 -- 172.21.15.59:0/3295239077 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07500cddf0 con 0x7f075015d020 2024-04-25T15:46:16.107 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.105+0000 7f074f7fe640 1 -- 172.21.15.59:0/3295239077 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 763030806 0 0) 0x7f0740001670 con 0x7f075015d020 2024-04-25T15:46:16.107 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.105+0000 7f074f7fe640 1 -- 172.21.15.59:0/3295239077 >> v1:172.21.15.59:6789/0 conn(0x7f075015d020 legacy=0x7f0750156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.107 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.105+0000 7f074f7fe640 1 --2- 172.21.15.59:0/3295239077 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07500c8c60 0x7f07380039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.107 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.105+0000 7f074f7fe640 1 --2- 172.21.15.59:0/3295239077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07380040c0 0x7f0738004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.107 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.105+0000 7f074f7fe640 1 --2- 172.21.15.59:0/3295239077 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0738004e60 0x7f07380052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.107 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.105+0000 7f074f7fe640 1 -- 172.21.15.59:0/3295239077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f07500cc6d0 con 0x7f07380040c0 2024-04-25T15:46:16.107 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.105+0000 7f074f7fe640 1 -- 172.21.15.59:0/3295239077 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f073800bca0 con 0x7f0738004e60 2024-04-25T15:46:16.107 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.105+0000 7f074f7fe640 1 -- 172.21.15.59:0/3295239077 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f073800bea0 con 0x7f07500c8c60 2024-04-25T15:46:16.108 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.108+0000 7f074ffff640 1 --2- 172.21.15.59:0/3295239077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07380040c0 0x7f0738004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:16.112 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.111+0000 7f074ffff640 1 -- 172.21.15.59:0/3295239077 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07500c8c60 msgr2=0x7f07380039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:16.112 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.111+0000 7f074ffff640 1 --2- 172.21.15.59:0/3295239077 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07500c8c60 0x7f07380039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.112 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.111+0000 7f074ffff640 1 -- 172.21.15.59:0/3295239077 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0738004e60 msgr2=0x7f07380052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:16.112 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.111+0000 7f074ffff640 1 --2- 172.21.15.59:0/3295239077 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0738004e60 0x7f07380052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.112 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.111+0000 7f074ffff640 1 -- 172.21.15.59:0/3295239077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0738003520 con 0x7f07380040c0 2024-04-25T15:46:16.114 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.113+0000 7f074ffff640 1 --2- 172.21.15.59:0/3295239077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07380040c0 0x7f0738004800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0744001650 tx=0x7f0738005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b18c92a044c3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:16.118 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.118+0000 7f074f7fe640 1 -- 172.21.15.59:0/3295239077 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744001220 con 0x7f07380040c0 2024-04-25T15:46:16.118 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.118+0000 7f074f7fe640 1 -- 172.21.15.59:0/3295239077 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f074402e070 con 0x7f07380040c0 2024-04-25T15:46:16.118 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.118+0000 7f074f7fe640 1 -- 172.21.15.59:0/3295239077 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074402a7f0 con 0x7f07380040c0 2024-04-25T15:46:16.119 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.118+0000 7f07570f9640 1 -- 172.21.15.59:0/3295239077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07380040c0 msgr2=0x7f0738004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.119 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.118+0000 7f07570f9640 1 --2- 172.21.15.59:0/3295239077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07380040c0 0x7f0738004800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0744001650 tx=0x7f0738005830 comp rx=0 tx=0).stop 2024-04-25T15:46:16.119 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.118+0000 7f0755696640 1 -- 172.21.15.59:0/3295239077 reap_dead start 2024-04-25T15:46:16.120 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.118+0000 7f07570f9640 1 -- 172.21.15.59:0/3295239077 shutdown_connections 2024-04-25T15:46:16.120 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.118+0000 7f07570f9640 1 -- 172.21.15.59:0/3295239077 >> 172.21.15.59:0/3295239077 conn(0x7f0750074320 msgr2=0x7f07500d1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:16.120 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.118+0000 7f07570f9640 1 -- 172.21.15.59:0/3295239077 shutdown_connections 2024-04-25T15:46:16.120 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.119+0000 7f07570f9640 1 -- 172.21.15.59:0/3295239077 wait complete. 2024-04-25T15:46:16.121 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.120+0000 7f07570f9640 1 Processor -- start 2024-04-25T15:46:16.121 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.120+0000 7f07570f9640 1 -- start start 2024-04-25T15:46:16.123 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.122+0000 7f07570f9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07380040c0 0x7f07501f2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.123 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.122+0000 7f07570f9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f075014f600 0x7f0750158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.123 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.122+0000 7f07570f9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0750158bc0 0x7f0750156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.123 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.122+0000 7f07570f9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f075008db20 con 0x7f075014f600 2024-04-25T15:46:16.123 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.122+0000 7f07570f9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f07500d2730 con 0x7f0750158bc0 2024-04-25T15:46:16.123 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.122+0000 7f07570f9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f075008dca0 con 0x7f07380040c0 2024-04-25T15:46:16.123 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.122+0000 7f074ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f075014f600 0x7f0750158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:16.124 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.123+0000 7f074ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f075014f600 0x7f0750158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35580/0 (socket says 172.21.15.59:35580) 2024-04-25T15:46:16.124 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.123+0000 7f074ffff640 1 -- 172.21.15.59:0/1729748184 learned_addr learned my addr 172.21.15.59:0/1729748184 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:16.127 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.126+0000 7f074ffff640 1 -- 172.21.15.59:0/1729748184 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07380040c0 msgr2=0x7f07501f2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.127 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.126+0000 7f074ffff640 1 --2- 172.21.15.59:0/1729748184 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07380040c0 0x7f07501f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.127 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.127+0000 7f074ffff640 1 -- 172.21.15.59:0/1729748184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0750158bc0 msgr2=0x7f0750156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.127 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.127+0000 7f074ffff640 1 --2- 172.21.15.59:0/1729748184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0750158bc0 0x7f0750156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.128 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.127+0000 7f074ffff640 1 -- 172.21.15.59:0/1729748184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07501f2650 con 0x7f075014f600 2024-04-25T15:46:16.129 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.129+0000 7f074ffff640 1 --2- 172.21.15.59:0/1729748184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f075014f600 0x7f0750158680 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0744001770 tx=0x7f0744000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:16.134 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.133+0000 7f074d7fa640 1 -- 172.21.15.59:0/1729748184 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744043070 con 0x7f075014f600 2024-04-25T15:46:16.134 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.133+0000 7f074d7fa640 1 -- 172.21.15.59:0/1729748184 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0744007250 con 0x7f075014f600 2024-04-25T15:46:16.134 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.133+0000 7f07570f9640 1 -- 172.21.15.59:0/1729748184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07501f5600 con 0x7f075014f600 2024-04-25T15:46:16.135 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.133+0000 7f074d7fa640 1 -- 172.21.15.59:0/1729748184 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744007660 con 0x7f075014f600 2024-04-25T15:46:16.135 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.133+0000 7f07570f9640 1 -- 172.21.15.59:0/1729748184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07501f5bc0 con 0x7f075014f600 2024-04-25T15:46:16.135 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.135+0000 7f07570f9640 1 -- 172.21.15.59:0/1729748184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07500c9cf0 con 0x7f075014f600 2024-04-25T15:46:16.158 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.158+0000 7f074d7fa640 1 -- 172.21.15.59:0/1729748184 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) ==== 96726+0+0 (secure 0 0 0) 0x7f0744046070 con 0x7f075014f600 2024-04-25T15:46:16.159 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.159+0000 7f074d7fa640 1 --2- 172.21.15.59:0/1729748184 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f073c074470 0x7f073c076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.159 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.159+0000 7f0754e95640 1 --2- 172.21.15.59:0/1729748184 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f073c074470 0x7f073c076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:16.159 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.159+0000 7f0754e95640 1 --2- 172.21.15.59:0/1729748184 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f073c074470 0x7f073c076980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0740001eb0 tx=0x7f0740001560 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:16.165 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.165+0000 7f074d7fa640 1 -- 172.21.15.59:0/1729748184 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2791+0+0 (secure 0 0 0) 0x7f074407b390 con 0x7f075014f600 2024-04-25T15:46:16.448 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.446+0000 7f074d7fa640 1 -- 172.21.15.59:0/1729748184 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f074407f800 con 0x7f075014f600 2024-04-25T15:46:16.653 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.652+0000 7f07570f9640 1 -- 172.21.15.59:0/1729748184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0750159ee0 con 0x7f075014f600 2024-04-25T15:46:16.710 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.709+0000 7f074d7fa640 1 -- 172.21.15.59:0/1729748184 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+10895 (secure 0 0 0) 0x7f074407f100 con 0x7f075014f600 2024-04-25T15:46:16.710 INFO:teuthology.misc.health.smithi059.stdout: 2024-04-25T15:46:16.711 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":15,"fsid":"9bb5d7ca-5217-467b-882c-0a18cd57f08f","created":"2024-04-25T15:46:00.198001+0000","modified":"2024-04-25T15:46:15.850827+0000","last_up_change":"2024-04-25T15:46:15.850827+0000","last_in_change":"2024-04-25T15:46:06.311980+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"34cee654-11dd-4f4b-99fe-093462f8abad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6803","nonce":1314235095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6805","nonce":1314235095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6809","nonce":1314235095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6807","nonce":1314235095}]},"public_addr":"172.21.15.59:6803/1314235095","cluster_addr":"172.21.15.59:6805/1314235095","heartbeat_back_addr":"172.21.15.59:6809/1314235095","heartbeat_front_addr":"172.21.15.59:6807/1314235095","state":["exists","up"]},{"osd":1,"uuid":"3c15505b-4abd-4a24-b30c-edc2732f8ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6827","nonce":3550810151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6829","nonce":3550810151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6833","nonce":3550810151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6831","nonce":3550810151}]},"public_addr":"172.21.15.59:6827/3550810151","cluster_addr":"172.21.15.59:6829/3550810151","heartbeat_back_addr":"172.21.15.59:6833/3550810151","heartbeat_front_addr":"172.21.15.59:6831/3550810151","state":["exists","up"]},{"osd":2,"uuid":"5884bf21-e6b4-4813-b8bc-6baa92443c87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6811","nonce":1651189093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6813","nonce":1651189093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6817","nonce":1651189093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6815","nonce":1651189093}]},"public_addr":"172.21.15.59:6811/1651189093","cluster_addr":"172.21.15.59:6813/1651189093","heartbeat_back_addr":"172.21.15.59:6817/1651189093","heartbeat_front_addr":"172.21.15.59:6815/1651189093","state":["exists","up"]},{"osd":3,"uuid":"6ff71700-3b00-4350-b3c9-f6c41ec46b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6819","nonce":1300858236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6821","nonce":1300858236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6825","nonce":1300858236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6823","nonce":1300858236}]},"public_addr":"172.21.15.59:6819/1300858236","cluster_addr":"172.21.15.59:6821/1300858236","heartbeat_back_addr":"172.21.15.59:6825/1300858236","heartbeat_front_addr":"172.21.15.59:6823/1300858236","state":["exists","up"]},{"osd":4,"uuid":"d0a72143-93fd-4712-aadb-f3fade303426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6817","nonce":2206186554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6819","nonce":2206186554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6823","nonce":2206186554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6821","nonce":2206186554}]},"public_addr":"172.21.15.64:6817/2206186554","cluster_addr":"172.21.15.64:6819/2206186554","heartbeat_back_addr":"172.21.15.64:6823/2206186554","heartbeat_front_addr":"172.21.15.64:6821/2206186554","state":["exists","up"]},{"osd":5,"uuid":"9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6825","nonce":639697697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6827","nonce":639697697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6831","nonce":639697697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6829","nonce":639697697}]},"public_addr":"172.21.15.64:6825/639697697","cluster_addr":"172.21.15.64:6827/639697697","heartbeat_back_addr":"172.21.15.64:6831/639697697","heartbeat_front_addr":"172.21.15.64:6829/639697697","state":["exists","up"]},{"osd":6,"uuid":"311d9a6b-8fbc-4809-8d33-b9248a3562f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6809","nonce":2335675289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6811","nonce":2335675289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6815","nonce":2335675289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6813","nonce":2335675289}]},"public_addr":"172.21.15.64:6809/2335675289","cluster_addr":"172.21.15.64:6811/2335675289","heartbeat_back_addr":"172.21.15.64:6815/2335675289","heartbeat_front_addr":"172.21.15.64:6813/2335675289","state":["exists","up"]},{"osd":7,"uuid":"d0f7436e-882f-4aa7-b2ae-684b9894b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6801","nonce":970439753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6803","nonce":970439753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6807","nonce":970439753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6805","nonce":970439753}]},"public_addr":"172.21.15.64:6801/970439753","cluster_addr":"172.21.15.64:6803/970439753","heartbeat_back_addr":"172.21.15.64:6807/970439753","heartbeat_front_addr":"172.21.15.64:6805/970439753","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.807777+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.943537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:16.713 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.711+0000 7f07570f9640 1 -- 172.21.15.59:0/1729748184 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f073c074470 msgr2=0x7f073c076980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.713 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.711+0000 7f07570f9640 1 --2- 172.21.15.59:0/1729748184 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f073c074470 0x7f073c076980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0740001eb0 tx=0x7f0740001560 comp rx=0 tx=0).stop 2024-04-25T15:46:16.713 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.711+0000 7f07570f9640 1 -- 172.21.15.59:0/1729748184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f075014f600 msgr2=0x7f0750158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.713 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.711+0000 7f07570f9640 1 --2- 172.21.15.59:0/1729748184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f075014f600 0x7f0750158680 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0744001770 tx=0x7f0744000fb0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.713 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.711+0000 7f07570f9640 1 -- 172.21.15.59:0/1729748184 shutdown_connections 2024-04-25T15:46:16.714 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.711+0000 7f07570f9640 1 --2- 172.21.15.59:0/1729748184 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f073c074470 0x7f073c076980 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.714 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.711+0000 7f07570f9640 1 --2- 172.21.15.59:0/1729748184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0750158bc0 0x7f0750156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.714 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.711+0000 7f07570f9640 1 --2- 172.21.15.59:0/1729748184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f075014f600 0x7f0750158680 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.714 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.711+0000 7f07570f9640 1 --2- 172.21.15.59:0/1729748184 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07380040c0 0x7f07501f2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.714 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.711+0000 7f07570f9640 1 -- 172.21.15.59:0/1729748184 >> 172.21.15.59:0/1729748184 conn(0x7f0750074320 msgr2=0x7f0750155a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:16.714 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.711+0000 7f07570f9640 1 -- 172.21.15.59:0/1729748184 shutdown_connections 2024-04-25T15:46:16.714 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T15:46:16.711+0000 7f07570f9640 1 -- 172.21.15.59:0/1729748184 wait complete. 2024-04-25T15:46:16.723 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T15:46:16.723 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T15:46:16.723 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-25T15:46:16.724 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T15:46:16.724 DEBUG:teuthology.orchestra.run.smithi059:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-04-25T15:46:16.726 INFO:tasks.ceph.mds.a:Started 2024-04-25T15:46:16.726 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-25T15:46:16.726 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T15:46:16.726 DEBUG:teuthology.orchestra.run.smithi059:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-04-25T15:46:16.728 INFO:tasks.ceph.mds.c:Started 2024-04-25T15:46:16.728 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-25T15:46:16.729 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-25T15:46:16.729 DEBUG:teuthology.orchestra.run.smithi059:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-04-25T15:46:16.731 INFO:tasks.ceph.mds.e:Started 2024-04-25T15:46:16.731 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-25T15:46:16.731 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T15:46:16.731 DEBUG:teuthology.orchestra.run.smithi064:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-04-25T15:46:16.733 INFO:tasks.ceph.mds.b:Started 2024-04-25T15:46:16.734 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-25T15:46:16.734 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T15:46:16.734 DEBUG:teuthology.orchestra.run.smithi064:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-04-25T15:46:16.736 INFO:tasks.ceph.mds.d:Started 2024-04-25T15:46:16.736 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-04-25T15:46:16.736 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-25T15:46:16.736 DEBUG:teuthology.orchestra.run.smithi064:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-04-25T15:46:16.738 INFO:tasks.ceph.mds.f:Started 2024-04-25T15:46:16.738 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T15:46:16.739 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:16.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.887+0000 7f7851e84640 1 Processor -- start 2024-04-25T15:46:16.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.887+0000 7f7851e84640 1 -- start start 2024-04-25T15:46:16.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.888+0000 7f7851e84640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f784c0c9610 0x7f784c0c8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.888+0000 7f7851e84640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f784c0c90c0 0x7f784c073a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.888+0000 7f7851e84640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f784c0c63c0 con 0x7f784c152d00 2024-04-25T15:46:16.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.888+0000 7f7851e84640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f784c0c5f30 con 0x7f784c0c9610 2024-04-25T15:46:16.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.888+0000 7f7851e84640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f784c0c8ca0 con 0x7f784c0c90c0 2024-04-25T15:46:16.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.889+0000 7f784bfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f784c0c90c0 0x7f784c073a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:16.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.890+0000 7f784b7fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f784c152d00 0x7f784c0c9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.59:46904/0 (socket says 172.21.15.59:46904) 2024-04-25T15:46:16.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.890+0000 7f784b7fe640 1 -- 172.21.15.59:0/81808327 learned_addr learned my addr 172.21.15.59:0/81808327 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:16.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.899+0000 7f784bfff640 1 -- 172.21.15.59:0/81808327 >> v2:172.21.15.59:3300/0 conn(0x7f784c0c9610 msgr2=0x7f784c0c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:16.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.899+0000 7f784bfff640 1 --2- 172.21.15.59:0/81808327 >> v2:172.21.15.59:3300/0 conn(0x7f784c0c9610 0x7f784c0c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.899+0000 7f784bfff640 1 -- 172.21.15.59:0/81808327 >> v1:172.21.15.64:6789/0 conn(0x7f784c152d00 legacy=0x7f784c0c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.899+0000 7f784bfff640 1 -- 172.21.15.59:0/81808327 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784c0c5220 con 0x7f784c0c90c0 2024-04-25T15:46:16.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.903+0000 7f784bfff640 1 --2- 172.21.15.59:0/81808327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f784c0c90c0 0x7f784c073a80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f784c0c69e0 tx=0x7f784402c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=467053ffd778aab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:16.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.910+0000 7f784a7fc640 1 -- 172.21.15.59:0/81808327 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7844032790 con 0x7f784c0c90c0 2024-04-25T15:46:16.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.910+0000 7f784a7fc640 1 -- 172.21.15.59:0/81808327 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7844038070 con 0x7f784c0c90c0 2024-04-25T15:46:16.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.910+0000 7f784a7fc640 1 -- 172.21.15.59:0/81808327 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7844032b50 con 0x7f784c0c90c0 2024-04-25T15:46:16.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.911+0000 7f7851e84640 1 -- 172.21.15.59:0/81808327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f784c0c90c0 msgr2=0x7f784c073a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.911+0000 7f7851e84640 1 --2- 172.21.15.59:0/81808327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f784c0c90c0 0x7f784c073a80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f784c0c69e0 tx=0x7f784402c890 comp rx=0 tx=0).stop 2024-04-25T15:46:16.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.911+0000 7f7851e84640 1 -- 172.21.15.59:0/81808327 shutdown_connections 2024-04-25T15:46:16.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.911+0000 7f7851e84640 1 --2- 172.21.15.59:0/81808327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f784c0c90c0 0x7f784c073a80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.911+0000 7f7851e84640 1 --2- 172.21.15.59:0/81808327 >> v2:172.21.15.59:3300/0 conn(0x7f784c0c9610 0x7f784c0c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.911+0000 7f7851e84640 1 -- 172.21.15.59:0/81808327 >> 172.21.15.59:0/81808327 conn(0x7f784c0ca780 msgr2=0x7f784c0cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:16.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.911+0000 7f7851e84640 1 -- 172.21.15.59:0/81808327 shutdown_connections 2024-04-25T15:46:16.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.911+0000 7f7851e84640 1 -- 172.21.15.59:0/81808327 wait complete. 2024-04-25T15:46:16.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.914+0000 7f7851e84640 1 Processor -- start 2024-04-25T15:46:16.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.914+0000 7f7851e84640 1 -- start start 2024-04-25T15:46:16.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.916+0000 7f7851e84640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f784c0c90c0 0x7f784c14ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.916+0000 7f7851e84640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784c0c9610 0x7f784c0cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.917+0000 7f7851e84640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f784c152d00 0x7f784c1f6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.917+0000 7f7851e84640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f784c0ca270 con 0x7f784c0c9610 2024-04-25T15:46:16.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.917+0000 7f7851e84640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f784c0c5bc0 con 0x7f784c0c90c0 2024-04-25T15:46:16.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.917+0000 7f7851e84640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f784c0c57e0 con 0x7f784c152d00 2024-04-25T15:46:16.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.917+0000 7f784b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f784c0c90c0 0x7f784c14ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:16.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.918+0000 7f784b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f784c0c90c0 0x7f784c14ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:42276/0 (socket says 172.21.15.59:42276) 2024-04-25T15:46:16.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.918+0000 7f784b7fe640 1 -- 172.21.15.59:0/2526510116 learned_addr learned my addr 172.21.15.59:0/2526510116 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:16.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.924+0000 7f784b7fe640 1 -- 172.21.15.59:0/2526510116 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f784c152d00 msgr2=0x7f784c1f6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.924+0000 7f784b7fe640 1 --2- 172.21.15.59:0/2526510116 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f784c152d00 0x7f784c1f6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.924+0000 7f784b7fe640 1 -- 172.21.15.59:0/2526510116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784c0c9610 msgr2=0x7f784c0cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:16.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.924+0000 7f784b7fe640 1 --2- 172.21.15.59:0/2526510116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784c0c9610 0x7f784c0cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:16.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.924+0000 7f784b7fe640 1 -- 172.21.15.59:0/2526510116 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784c0cc730 con 0x7f784c0c90c0 2024-04-25T15:46:16.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.927+0000 7f784b7fe640 1 --2- 172.21.15.59:0/2526510116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f784c0c90c0 0x7f784c14ed70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f783c00c3c0 tx=0x7f783c00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:16.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.932+0000 7f7833fff640 1 -- 172.21.15.59:0/2526510116 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c017070 con 0x7f784c0c90c0 2024-04-25T15:46:16.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.932+0000 7f7833fff640 1 -- 172.21.15.59:0/2526510116 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f783c005ce0 con 0x7f784c0c90c0 2024-04-25T15:46:16.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.932+0000 7f7851e84640 1 -- 172.21.15.59:0/2526510116 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f784c14db50 con 0x7f784c0c90c0 2024-04-25T15:46:16.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.932+0000 7f7833fff640 1 -- 172.21.15.59:0/2526510116 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c0072f0 con 0x7f784c0c90c0 2024-04-25T15:46:16.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.932+0000 7f7851e84640 1 -- 172.21.15.59:0/2526510116 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f784c0cbcd0 con 0x7f784c0c90c0 2024-04-25T15:46:16.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.933+0000 7f7851e84640 1 -- 172.21.15.59:0/2526510116 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f784c069fb0 con 0x7f784c0c90c0 2024-04-25T15:46:16.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.970+0000 7f7833fff640 1 -- 172.21.15.59:0/2526510116 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 4) ==== 96726+0+0 (secure 0 0 0) 0x7f783c01a070 con 0x7f784c0c90c0 2024-04-25T15:46:16.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.970+0000 7f7833fff640 1 --2- 172.21.15.59:0/2526510116 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f7838074450 0x7f7838076960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:16.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.970+0000 7f784affd640 1 --2- 172.21.15.59:0/2526510116 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f7838074450 0x7f7838076960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:16.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:16.971+0000 7f784affd640 1 --2- 172.21.15.59:0/2526510116 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f7838074450 0x7f7838076960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f784c0c4f50 tx=0x7f7840006bf0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:17.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.233+0000 7f7833fff640 1 -- 172.21.15.59:0/2526510116 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4471+0+0 (secure 0 0 0) 0x7f783c05ad00 con 0x7f784c0c90c0 2024-04-25T15:46:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.297+0000 7f7833fff640 1 -- 172.21.15.59:0/2526510116 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f783c021020 con 0x7f784c0c90c0 2024-04-25T15:46:17.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.525+0000 7f7851e84640 1 -- 172.21.15.59:0/2526510116 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f784c1562b0 con 0x7f784c0c90c0 2024-04-25T15:46:17.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.698+0000 7f7833fff640 1 -- 172.21.15.59:0/2526510116 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+10895 (secure 0 0 0) 0x7f783c05f170 con 0x7f784c0c90c0 2024-04-25T15:46:17.700 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:17.701 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":15,"fsid":"9bb5d7ca-5217-467b-882c-0a18cd57f08f","created":"2024-04-25T15:46:00.198001+0000","modified":"2024-04-25T15:46:15.850827+0000","last_up_change":"2024-04-25T15:46:15.850827+0000","last_in_change":"2024-04-25T15:46:06.311980+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"34cee654-11dd-4f4b-99fe-093462f8abad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6803","nonce":1314235095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6805","nonce":1314235095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6809","nonce":1314235095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6807","nonce":1314235095}]},"public_addr":"172.21.15.59:6803/1314235095","cluster_addr":"172.21.15.59:6805/1314235095","heartbeat_back_addr":"172.21.15.59:6809/1314235095","heartbeat_front_addr":"172.21.15.59:6807/1314235095","state":["exists","up"]},{"osd":1,"uuid":"3c15505b-4abd-4a24-b30c-edc2732f8ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6827","nonce":3550810151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6829","nonce":3550810151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6833","nonce":3550810151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6831","nonce":3550810151}]},"public_addr":"172.21.15.59:6827/3550810151","cluster_addr":"172.21.15.59:6829/3550810151","heartbeat_back_addr":"172.21.15.59:6833/3550810151","heartbeat_front_addr":"172.21.15.59:6831/3550810151","state":["exists","up"]},{"osd":2,"uuid":"5884bf21-e6b4-4813-b8bc-6baa92443c87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6811","nonce":1651189093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6813","nonce":1651189093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6817","nonce":1651189093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6815","nonce":1651189093}]},"public_addr":"172.21.15.59:6811/1651189093","cluster_addr":"172.21.15.59:6813/1651189093","heartbeat_back_addr":"172.21.15.59:6817/1651189093","heartbeat_front_addr":"172.21.15.59:6815/1651189093","state":["exists","up"]},{"osd":3,"uuid":"6ff71700-3b00-4350-b3c9-f6c41ec46b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6819","nonce":1300858236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6821","nonce":1300858236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6825","nonce":1300858236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6823","nonce":1300858236}]},"public_addr":"172.21.15.59:6819/1300858236","cluster_addr":"172.21.15.59:6821/1300858236","heartbeat_back_addr":"172.21.15.59:6825/1300858236","heartbeat_front_addr":"172.21.15.59:6823/1300858236","state":["exists","up"]},{"osd":4,"uuid":"d0a72143-93fd-4712-aadb-f3fade303426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6817","nonce":2206186554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6819","nonce":2206186554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6823","nonce":2206186554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6821","nonce":2206186554}]},"public_addr":"172.21.15.64:6817/2206186554","cluster_addr":"172.21.15.64:6819/2206186554","heartbeat_back_addr":"172.21.15.64:6823/2206186554","heartbeat_front_addr":"172.21.15.64:6821/2206186554","state":["exists","up"]},{"osd":5,"uuid":"9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6825","nonce":639697697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6827","nonce":639697697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6831","nonce":639697697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6829","nonce":639697697}]},"public_addr":"172.21.15.64:6825/639697697","cluster_addr":"172.21.15.64:6827/639697697","heartbeat_back_addr":"172.21.15.64:6831/639697697","heartbeat_front_addr":"172.21.15.64:6829/639697697","state":["exists","up"]},{"osd":6,"uuid":"311d9a6b-8fbc-4809-8d33-b9248a3562f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6809","nonce":2335675289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6811","nonce":2335675289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6815","nonce":2335675289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6813","nonce":2335675289}]},"public_addr":"172.21.15.64:6809/2335675289","cluster_addr":"172.21.15.64:6811/2335675289","heartbeat_back_addr":"172.21.15.64:6815/2335675289","heartbeat_front_addr":"172.21.15.64:6813/2335675289","state":["exists","up"]},{"osd":7,"uuid":"d0f7436e-882f-4aa7-b2ae-684b9894b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6801","nonce":970439753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6803","nonce":970439753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6807","nonce":970439753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6805","nonce":970439753}]},"public_addr":"172.21.15.64:6801/970439753","cluster_addr":"172.21.15.64:6803/970439753","heartbeat_back_addr":"172.21.15.64:6807/970439753","heartbeat_front_addr":"172.21.15.64:6805/970439753","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.807777+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.943537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:17.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.700+0000 7f7851e84640 1 -- 172.21.15.59:0/2526510116 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f7838074450 msgr2=0x7f7838076960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:17.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.700+0000 7f7851e84640 1 --2- 172.21.15.59:0/2526510116 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f7838074450 0x7f7838076960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f784c0c4f50 tx=0x7f7840006bf0 comp rx=0 tx=0).stop 2024-04-25T15:46:17.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.700+0000 7f7851e84640 1 -- 172.21.15.59:0/2526510116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f784c0c90c0 msgr2=0x7f784c14ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:17.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.700+0000 7f7851e84640 1 --2- 172.21.15.59:0/2526510116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f784c0c90c0 0x7f784c14ed70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f783c00c3c0 tx=0x7f783c00c880 comp rx=0 tx=0).stop 2024-04-25T15:46:17.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.700+0000 7f7851e84640 1 -- 172.21.15.59:0/2526510116 shutdown_connections 2024-04-25T15:46:17.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.700+0000 7f7851e84640 1 --2- 172.21.15.59:0/2526510116 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f7838074450 0x7f7838076960 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:17.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.700+0000 7f7851e84640 1 --2- 172.21.15.59:0/2526510116 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f784c152d00 0x7f784c1f6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:17.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.700+0000 7f7851e84640 1 --2- 172.21.15.59:0/2526510116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784c0c9610 0x7f784c0cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:17.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.700+0000 7f7851e84640 1 --2- 172.21.15.59:0/2526510116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f784c0c90c0 0x7f784c14ed70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:17.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.700+0000 7f7851e84640 1 -- 172.21.15.59:0/2526510116 >> 172.21.15.59:0/2526510116 conn(0x7f784c0ca780 msgr2=0x7f784c0684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:17.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.701+0000 7f7851e84640 1 -- 172.21.15.59:0/2526510116 shutdown_connections 2024-04-25T15:46:17.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.701+0000 7f7851e84640 1 -- 172.21.15.59:0/2526510116 wait complete. 2024-04-25T15:46:17.716 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-04-25T15:46:17.716 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:17.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.829+0000 7fad94451640 1 Processor -- start 2024-04-25T15:46:17.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.830+0000 7fad94451640 1 -- start start 2024-04-25T15:46:17.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.831+0000 7fad94451640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad8c0c46c0 0x7fad8c154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:17.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.831+0000 7fad94451640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fad8c0cbb00 0x7fad8c15acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:17.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.831+0000 7fad94451640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad8c0cf8d0 0x7fad8c0cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:17.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.831+0000 7fad94451640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fad8c0cb240 con 0x7fad8c0c46c0 2024-04-25T15:46:17.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.831+0000 7fad94451640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fad8c15a820 con 0x7fad8c0cbb00 2024-04-25T15:46:17.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.831+0000 7fad94451640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fad8c08d750 con 0x7fad8c0cf8d0 2024-04-25T15:46:17.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.833+0000 7fad919ec640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fad8c0cbb00 0x7fad8c15acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:17.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.834+0000 7fad919ec640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fad8c0cbb00 0x7fad8c15acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:42280/0 (socket says 172.21.15.59:42280) 2024-04-25T15:46:17.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.834+0000 7fad919ec640 1 -- 172.21.15.59:0/3805878430 learned_addr learned my addr 172.21.15.59:0/3805878430 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:17.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.837+0000 7fad919ec640 1 -- 172.21.15.59:0/3805878430 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad8c0cf8d0 msgr2=0x7fad8c0cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:17.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.837+0000 7fad919ec640 1 --2- 172.21.15.59:0/3805878430 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad8c0cf8d0 0x7fad8c0cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:17.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.837+0000 7fad919ec640 1 -- 172.21.15.59:0/3805878430 >> v2:172.21.15.59:3300/0 conn(0x7fad8c0c46c0 msgr2=0x7fad8c154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:17.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.837+0000 7fad919ec640 1 --2- 172.21.15.59:0/3805878430 >> v2:172.21.15.59:3300/0 conn(0x7fad8c0c46c0 0x7fad8c154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:17.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.837+0000 7fad919ec640 1 -- 172.21.15.59:0/3805878430 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8c0cb490 con 0x7fad8c0cbb00 2024-04-25T15:46:17.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.839+0000 7fad919ec640 1 --2- 172.21.15.59:0/3805878430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad8c0cbb00 0x7fad8c15acb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fad8c08d4f0 tx=0x7fad7c02a280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14efe6e650810942 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:17.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.843+0000 7fad911eb640 1 -- 172.21.15.59:0/3805878430 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c037070 con 0x7fad8c0cbb00 2024-04-25T15:46:17.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.843+0000 7fad911eb640 1 -- 172.21.15.59:0/3805878430 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad7c032440 con 0x7fad8c0cbb00 2024-04-25T15:46:17.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.843+0000 7fad911eb640 1 -- 172.21.15.59:0/3805878430 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c032810 con 0x7fad8c0cbb00 2024-04-25T15:46:17.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.844+0000 7fad94451640 1 -- 172.21.15.59:0/3805878430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad8c0cbb00 msgr2=0x7fad8c15acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:17.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.844+0000 7fad94451640 1 --2- 172.21.15.59:0/3805878430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad8c0cbb00 0x7fad8c15acb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fad8c08d4f0 tx=0x7fad7c02a280 comp rx=0 tx=0).stop 2024-04-25T15:46:17.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.844+0000 7fad94451640 1 -- 172.21.15.59:0/3805878430 shutdown_connections 2024-04-25T15:46:17.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.844+0000 7fad94451640 1 --2- 172.21.15.59:0/3805878430 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad8c0cf8d0 0x7fad8c0cfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:17.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.844+0000 7fad94451640 1 --2- 172.21.15.59:0/3805878430 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad8c0cbb00 0x7fad8c15acb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:17.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.844+0000 7fad94451640 1 --2- 172.21.15.59:0/3805878430 >> v2:172.21.15.59:3300/0 conn(0x7fad8c0c46c0 0x7fad8c154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:17.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.844+0000 7fad94451640 1 -- 172.21.15.59:0/3805878430 >> 172.21.15.59:0/3805878430 conn(0x7fad8c072fd0 msgr2=0x7fad8c0733e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:17.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.844+0000 7fad94451640 1 -- 172.21.15.59:0/3805878430 shutdown_connections 2024-04-25T15:46:17.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.845+0000 7fad94451640 1 -- 172.21.15.59:0/3805878430 wait complete. 2024-04-25T15:46:17.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.847+0000 7fad94451640 1 Processor -- start 2024-04-25T15:46:17.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.847+0000 7fad94451640 1 -- start start 2024-04-25T15:46:17.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.850+0000 7fad94451640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad8c0c46c0 0x7fad8c1f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:17.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.850+0000 7fad94451640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad8c0cbb00 0x7fad8c06de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:17.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.850+0000 7fad94451640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad8c0cf8d0 0x7fad8c151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:17.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.850+0000 7fad94451640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c0c4d80 con 0x7fad8c0c46c0 2024-04-25T15:46:17.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.850+0000 7fad94451640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c15a4b0 con 0x7fad8c0cf8d0 2024-04-25T15:46:17.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.850+0000 7fad94451640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fad8c0b23b0 con 0x7fad8c0cbb00 2024-04-25T15:46:17.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.851+0000 7fad929ee640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad8c0cf8d0 0x7fad8c151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:17.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.851+0000 7fad929ee640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad8c0cf8d0 0x7fad8c151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:42290/0 (socket says 172.21.15.59:42290) 2024-04-25T15:46:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.851+0000 7fad929ee640 1 -- 172.21.15.59:0/98870060 learned_addr learned my addr 172.21.15.59:0/98870060 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:17.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.855+0000 7fad929ee640 1 -- 172.21.15.59:0/98870060 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad8c0cbb00 msgr2=0x7fad8c06de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:17.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.855+0000 7fad929ee640 1 --2- 172.21.15.59:0/98870060 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad8c0cbb00 0x7fad8c06de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:17.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.855+0000 7fad929ee640 1 -- 172.21.15.59:0/98870060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad8c0c46c0 msgr2=0x7fad8c1f6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:17.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.855+0000 7fad929ee640 1 --2- 172.21.15.59:0/98870060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad8c0c46c0 0x7fad8c1f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:17.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.855+0000 7fad929ee640 1 -- 172.21.15.59:0/98870060 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8c06f6a0 con 0x7fad8c0cf8d0 2024-04-25T15:46:17.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.858+0000 7fad929ee640 1 --2- 172.21.15.59:0/98870060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad8c0cf8d0 0x7fad8c151570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fad8400b9e0 tx=0x7fad8400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:17.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.863+0000 7fad82ffd640 1 -- 172.21.15.59:0/98870060 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84019070 con 0x7fad8c0cf8d0 2024-04-25T15:46:17.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.863+0000 7fad82ffd640 1 -- 172.21.15.59:0/98870060 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad8400cb20 con 0x7fad8c0cf8d0 2024-04-25T15:46:17.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.863+0000 7fad82ffd640 1 -- 172.21.15.59:0/98870060 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84014440 con 0x7fad8c0cf8d0 2024-04-25T15:46:17.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.863+0000 7fad94451640 1 -- 172.21.15.59:0/98870060 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad8c06e3d0 con 0x7fad8c0cf8d0 2024-04-25T15:46:17.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.863+0000 7fad94451640 1 -- 172.21.15.59:0/98870060 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad8c1f2e50 con 0x7fad8c0cf8d0 2024-04-25T15:46:17.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.865+0000 7fad94451640 1 -- 172.21.15.59:0/98870060 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad8c0698a0 con 0x7fad8c0cf8d0 2024-04-25T15:46:17.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.941+0000 7fad82ffd640 1 -- 172.21.15.59:0/98870060 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 4) ==== 96726+0+0 (secure 0 0 0) 0x7fad8401c070 con 0x7fad8c0cf8d0 2024-04-25T15:46:17.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.942+0000 7fad82ffd640 1 --2- 172.21.15.59:0/98870060 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fad700744a0 0x7fad700769b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:17.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.942+0000 7fad921ed640 1 --2- 172.21.15.59:0/98870060 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fad700744a0 0x7fad700769b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:17.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:17.942+0000 7fad921ed640 1 --2- 172.21.15.59:0/98870060 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fad700744a0 0x7fad700769b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fad88009670 tx=0x7fad88006bf0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:18.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:18.181+0000 7fad82ffd640 1 -- 172.21.15.59:0/98870060 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4471+0+0 (secure 0 0 0) 0x7fad8405b650 con 0x7fad8c0cf8d0 2024-04-25T15:46:18.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:18.200+0000 7fad82ffd640 1 -- 172.21.15.59:0/98870060 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fad84023020 con 0x7fad8c0cf8d0 2024-04-25T15:46:18.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:18.427+0000 7fad94451640 1 -- 172.21.15.59:0/98870060 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad8c0cb8e0 con 0x7fad8c0cf8d0 2024-04-25T15:46:18.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:18.650+0000 7fad82ffd640 1 -- 172.21.15.59:0/98870060 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7fad8c06f6a0 con 0x7fad8c0cf8d0 2024-04-25T15:46:18.652 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:18.652 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-25T15:46:18.652 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 1 2024-04-25T15:46:18.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:18.652+0000 7fad94451640 1 -- 172.21.15.59:0/98870060 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fad700744a0 msgr2=0x7fad700769b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:18.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:18.652+0000 7fad94451640 1 --2- 172.21.15.59:0/98870060 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fad700744a0 0x7fad700769b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fad88009670 tx=0x7fad88006bf0 comp rx=0 tx=0).stop 2024-04-25T15:46:18.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:18.652+0000 7fad94451640 1 -- 172.21.15.59:0/98870060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad8c0cf8d0 msgr2=0x7fad8c151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:18.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:18.652+0000 7fad94451640 1 --2- 172.21.15.59:0/98870060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad8c0cf8d0 0x7fad8c151570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fad8400b9e0 tx=0x7fad8400bea0 comp rx=0 tx=0).stop 2024-04-25T15:46:18.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:18.652+0000 7fad94451640 1 -- 172.21.15.59:0/98870060 shutdown_connections 2024-04-25T15:46:18.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:18.652+0000 7fad94451640 1 --2- 172.21.15.59:0/98870060 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fad700744a0 0x7fad700769b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:18.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:18.652+0000 7fad94451640 1 --2- 172.21.15.59:0/98870060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad8c0cf8d0 0x7fad8c151570 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:18.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:18.652+0000 7fad94451640 1 --2- 172.21.15.59:0/98870060 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad8c0cbb00 0x7fad8c06de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:18.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:18.652+0000 7fad94451640 1 --2- 172.21.15.59:0/98870060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad8c0c46c0 0x7fad8c1f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:18.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:18.652+0000 7fad94451640 1 -- 172.21.15.59:0/98870060 >> 172.21.15.59:0/98870060 conn(0x7fad8c072fd0 msgr2=0x7fad8c0c4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:18.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:18.652+0000 7fad94451640 1 -- 172.21.15.59:0/98870060 shutdown_connections 2024-04-25T15:46:18.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:18.652+0000 7fad94451640 1 -- 172.21.15.59:0/98870060 wait complete. 2024-04-25T15:46:20.670 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:20.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.789+0000 7f453ffe3640 1 Processor -- start 2024-04-25T15:46:20.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.790+0000 7f453ffe3640 1 -- start start 2024-04-25T15:46:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.791+0000 7f453ffe3640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4538068810 0x7f453815cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.791+0000 7f453ffe3640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f45380c9320 0x7f45380c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.791+0000 7f453ffe3640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45380cebe0 con 0x7f4538156610 2024-04-25T15:46:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.791+0000 7f453ffe3640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f45380c7180 con 0x7f4538068810 2024-04-25T15:46:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.791+0000 7f453ffe3640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f45380c7fc0 con 0x7f45380c9320 2024-04-25T15:46:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.792+0000 7f453dd7f640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4538068810 0x7f453815cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:20.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.792+0000 7f453dd7f640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4538068810 0x7f453815cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35634/0 (socket says 172.21.15.59:35634) 2024-04-25T15:46:20.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.792+0000 7f453dd7f640 1 -- 172.21.15.59:0/3532289889 learned_addr learned my addr 172.21.15.59:0/3532289889 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:20.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.792+0000 7f453e580640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f45380c9320 0x7f45380c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:20.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.796+0000 7f453e580640 1 -- 172.21.15.59:0/3532289889 >> v2:172.21.15.59:3300/0 conn(0x7f4538068810 msgr2=0x7f453815cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:20.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.796+0000 7f453e580640 1 --2- 172.21.15.59:0/3532289889 >> v2:172.21.15.59:3300/0 conn(0x7f4538068810 0x7f453815cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:20.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.796+0000 7f453e580640 1 -- 172.21.15.59:0/3532289889 >> v1:172.21.15.59:6789/0 conn(0x7f4538156610 legacy=0x7f45380c51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:20.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.796+0000 7f453e580640 1 -- 172.21.15.59:0/3532289889 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45380c73b0 con 0x7f45380c9320 2024-04-25T15:46:20.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.799+0000 7f453e580640 1 --2- 172.21.15.59:0/3532289889 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f45380c9320 0x7f45380c9730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f45380c8140 tx=0x7f453002a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6049a64d858c608 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:20.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.804+0000 7f453cd7d640 1 -- 172.21.15.59:0/3532289889 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453002ae60 con 0x7f45380c9320 2024-04-25T15:46:20.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.804+0000 7f453cd7d640 1 -- 172.21.15.59:0/3532289889 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4530007740 con 0x7f45380c9320 2024-04-25T15:46:20.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.804+0000 7f453cd7d640 1 -- 172.21.15.59:0/3532289889 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4530007b10 con 0x7f45380c9320 2024-04-25T15:46:20.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.805+0000 7f453ffe3640 1 -- 172.21.15.59:0/3532289889 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f45380c9320 msgr2=0x7f45380c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:20.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.805+0000 7f453ffe3640 1 --2- 172.21.15.59:0/3532289889 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f45380c9320 0x7f45380c9730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f45380c8140 tx=0x7f453002a640 comp rx=0 tx=0).stop 2024-04-25T15:46:20.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.806+0000 7f453ffe3640 1 -- 172.21.15.59:0/3532289889 shutdown_connections 2024-04-25T15:46:20.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.806+0000 7f453ffe3640 1 --2- 172.21.15.59:0/3532289889 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f45380c9320 0x7f45380c9730 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:20.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.806+0000 7f453ffe3640 1 --2- 172.21.15.59:0/3532289889 >> v2:172.21.15.59:3300/0 conn(0x7f4538068810 0x7f453815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:20.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.806+0000 7f453ffe3640 1 -- 172.21.15.59:0/3532289889 >> 172.21.15.59:0/3532289889 conn(0x7f45380cdd30 msgr2=0x7f45380ce140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:20.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.806+0000 7f453ffe3640 1 -- 172.21.15.59:0/3532289889 shutdown_connections 2024-04-25T15:46:20.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.806+0000 7f453ffe3640 1 -- 172.21.15.59:0/3532289889 wait complete. 2024-04-25T15:46:20.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.809+0000 7f453ffe3640 1 Processor -- start 2024-04-25T15:46:20.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.809+0000 7f453ffe3640 1 -- start start 2024-04-25T15:46:20.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.811+0000 7f453ffe3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4538068810 0x7f45381f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:20.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.811+0000 7f453ffe3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45380c9320 0x7f4538152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:20.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.811+0000 7f453ffe3640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4538156610 0x7f453814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:20.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.811+0000 7f453ffe3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f45380c7c50 con 0x7f4538068810 2024-04-25T15:46:20.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.811+0000 7f453ffe3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f45380c7970 con 0x7f45380c9320 2024-04-25T15:46:20.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.812+0000 7f453ffe3640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f45380c9c70 con 0x7f4538156610 2024-04-25T15:46:20.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.812+0000 7f453e580640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4538156610 0x7f453814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:20.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.812+0000 7f453d57e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45380c9320 0x7f4538152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:20.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.812+0000 7f453dd7f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4538068810 0x7f45381f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:20.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.813+0000 7f453d57e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45380c9320 0x7f4538152f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:42312/0 (socket says 172.21.15.59:42312) 2024-04-25T15:46:20.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.813+0000 7f453d57e640 1 -- 172.21.15.59:0/3525484976 learned_addr learned my addr 172.21.15.59:0/3525484976 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:20.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.817+0000 7f453d57e640 1 -- 172.21.15.59:0/3525484976 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4538156610 msgr2=0x7f453814f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:20.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.817+0000 7f453d57e640 1 --2- 172.21.15.59:0/3525484976 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4538156610 0x7f453814f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:20.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.817+0000 7f453d57e640 1 -- 172.21.15.59:0/3525484976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4538068810 msgr2=0x7f45381f2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:20.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.817+0000 7f453d57e640 1 --2- 172.21.15.59:0/3525484976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4538068810 0x7f45381f2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:20.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.817+0000 7f453d57e640 1 -- 172.21.15.59:0/3525484976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45381f3800 con 0x7f45380c9320 2024-04-25T15:46:20.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.820+0000 7f453d57e640 1 --2- 172.21.15.59:0/3525484976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45380c9320 0x7f4538152f40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f452800c400 tx=0x7f452800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:20.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.826+0000 7f452e7fc640 1 -- 172.21.15.59:0/3525484976 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528017070 con 0x7f45380c9320 2024-04-25T15:46:20.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.826+0000 7f452e7fc640 1 -- 172.21.15.59:0/3525484976 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45280052d0 con 0x7f45380c9320 2024-04-25T15:46:20.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.826+0000 7f452e7fc640 1 -- 172.21.15.59:0/3525484976 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528003830 con 0x7f45380c9320 2024-04-25T15:46:20.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.827+0000 7f453ffe3640 1 -- 172.21.15.59:0/3525484976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4538153480 con 0x7f45380c9320 2024-04-25T15:46:20.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.827+0000 7f453ffe3640 1 -- 172.21.15.59:0/3525484976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4538152740 con 0x7f45380c9320 2024-04-25T15:46:20.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.828+0000 7f453ffe3640 1 -- 172.21.15.59:0/3525484976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45381f3d20 con 0x7f45380c9320 2024-04-25T15:46:20.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.901+0000 7f452e7fc640 1 -- 172.21.15.59:0/3525484976 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 4) ==== 96726+0+0 (secure 0 0 0) 0x7f452801a070 con 0x7f45380c9320 2024-04-25T15:46:20.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.902+0000 7f452e7fc640 1 --2- 172.21.15.59:0/3525484976 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f451c074420 0x7f451c076930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:20.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.902+0000 7f453dd7f640 1 --2- 172.21.15.59:0/3525484976 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f451c074420 0x7f451c076930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:20.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:20.903+0000 7f453dd7f640 1 --2- 172.21.15.59:0/3525484976 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f451c074420 0x7f451c076930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4534009b30 tx=0x7f4534009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:21.192+0000 7f452e7fc640 1 -- 172.21.15.59:0/3525484976 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f45280650e0 con 0x7f45380c9320 2024-04-25T15:46:21.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:21.205+0000 7f452e7fc640 1 -- 172.21.15.59:0/3525484976 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f45381f3d20 con 0x7f45380c9320 2024-04-25T15:46:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:21.439+0000 7f453ffe3640 1 -- 172.21.15.59:0/3525484976 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45380c9140 con 0x7f45380c9320 2024-04-25T15:46:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:21.634+0000 7f452e7fc640 1 -- 172.21.15.59:0/3525484976 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f45380c9140 con 0x7f45380c9320 2024-04-25T15:46:21.636 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:21.636 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-25T15:46:21.637 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 1 2024-04-25T15:46:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:21.636+0000 7f453ffe3640 1 -- 172.21.15.59:0/3525484976 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f451c074420 msgr2=0x7f451c076930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:21.636+0000 7f453ffe3640 1 --2- 172.21.15.59:0/3525484976 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f451c074420 0x7f451c076930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4534009b30 tx=0x7f4534009240 comp rx=0 tx=0).stop 2024-04-25T15:46:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:21.636+0000 7f453ffe3640 1 -- 172.21.15.59:0/3525484976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45380c9320 msgr2=0x7f4538152f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:21.636+0000 7f453ffe3640 1 --2- 172.21.15.59:0/3525484976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45380c9320 0x7f4538152f40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f452800c400 tx=0x7f452800c8c0 comp rx=0 tx=0).stop 2024-04-25T15:46:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:21.636+0000 7f453ffe3640 1 -- 172.21.15.59:0/3525484976 shutdown_connections 2024-04-25T15:46:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:21.636+0000 7f453ffe3640 1 --2- 172.21.15.59:0/3525484976 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f451c074420 0x7f451c076930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:21.636+0000 7f453ffe3640 1 --2- 172.21.15.59:0/3525484976 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4538156610 0x7f453814f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:21.636+0000 7f453ffe3640 1 --2- 172.21.15.59:0/3525484976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45380c9320 0x7f4538152f40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:21.636+0000 7f453ffe3640 1 --2- 172.21.15.59:0/3525484976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4538068810 0x7f45381f2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:21.636+0000 7f453ffe3640 1 -- 172.21.15.59:0/3525484976 >> 172.21.15.59:0/3525484976 conn(0x7f45380cdd30 msgr2=0x7f4538151c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:21.636+0000 7f453ffe3640 1 -- 172.21.15.59:0/3525484976 shutdown_connections 2024-04-25T15:46:21.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:21.636+0000 7f453ffe3640 1 -- 172.21.15.59:0/3525484976 wait complete. 2024-04-25T15:46:23.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.761+0000 7efe3a1f8640 1 Processor -- start 2024-04-25T15:46:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.761+0000 7efe3a1f8640 1 -- start start 2024-04-25T15:46:23.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.764+0000 7efe3a1f8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe34156770 0x7efe340cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:23.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.764+0000 7efe3a1f8640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe340cfad0 0x7efe340cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:23.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.764+0000 7efe3a1f8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efe3415fc80 0x7efe34160090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:23.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.764+0000 7efe3a1f8640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7efe340cb420 con 0x7efe340cfad0 2024-04-25T15:46:23.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.764+0000 7efe3a1f8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7efe3415d340 con 0x7efe3415fc80 2024-04-25T15:46:23.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.764+0000 7efe3a1f8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7efe3408d750 con 0x7efe34156770 2024-04-25T15:46:23.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.764+0000 7efe32ffd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe340cfad0 0x7efe340cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:23.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.764+0000 7efe33fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efe3415fc80 0x7efe34160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:23.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.764+0000 7efe32ffd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe340cfad0 0x7efe340cfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60810/0 (socket says 172.21.15.59:60810) 2024-04-25T15:46:23.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.764+0000 7efe32ffd640 1 -- 172.21.15.59:0/879358268 learned_addr learned my addr 172.21.15.59:0/879358268 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:23.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.766+0000 7efe32ffd640 1 -- 172.21.15.59:0/879358268 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe34156770 msgr2=0x7efe340cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:23.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.766+0000 7efe32ffd640 1 --2- 172.21.15.59:0/879358268 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe34156770 0x7efe340cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:23.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.766+0000 7efe32ffd640 1 -- 172.21.15.59:0/879358268 >> v2:172.21.15.64:3300/0 conn(0x7efe3415fc80 msgr2=0x7efe34160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:23.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.766+0000 7efe32ffd640 1 --2- 172.21.15.59:0/879358268 >> v2:172.21.15.64:3300/0 conn(0x7efe3415fc80 0x7efe34160090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:23.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.766+0000 7efe32ffd640 1 -- 172.21.15.59:0/879358268 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3415c730 con 0x7efe340cfad0 2024-04-25T15:46:23.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.769+0000 7efe32ffd640 1 --2- 172.21.15.59:0/879358268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe340cfad0 0x7efe340cfee0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efe34072d50 tx=0x7efe2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b00455b71948b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:23.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.773+0000 7efe327fc640 1 -- 172.21.15.59:0/879358268 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe28037070 con 0x7efe340cfad0 2024-04-25T15:46:23.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.773+0000 7efe327fc640 1 -- 172.21.15.59:0/879358268 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe28032440 con 0x7efe340cfad0 2024-04-25T15:46:23.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.773+0000 7efe327fc640 1 -- 172.21.15.59:0/879358268 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe28032810 con 0x7efe340cfad0 2024-04-25T15:46:23.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.774+0000 7efe3a1f8640 1 -- 172.21.15.59:0/879358268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe340cfad0 msgr2=0x7efe340cfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:23.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.774+0000 7efe3a1f8640 1 --2- 172.21.15.59:0/879358268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe340cfad0 0x7efe340cfee0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efe34072d50 tx=0x7efe2802a270 comp rx=0 tx=0).stop 2024-04-25T15:46:23.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.774+0000 7efe3a1f8640 1 -- 172.21.15.59:0/879358268 shutdown_connections 2024-04-25T15:46:23.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.774+0000 7efe3a1f8640 1 --2- 172.21.15.59:0/879358268 >> v2:172.21.15.64:3300/0 conn(0x7efe3415fc80 0x7efe34160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:23.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.774+0000 7efe3a1f8640 1 --2- 172.21.15.59:0/879358268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe340cfad0 0x7efe340cfee0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:23.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.774+0000 7efe3a1f8640 1 --2- 172.21.15.59:0/879358268 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe34156770 0x7efe340cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:23.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.774+0000 7efe3a1f8640 1 -- 172.21.15.59:0/879358268 >> 172.21.15.59:0/879358268 conn(0x7efe34073200 msgr2=0x7efe34073610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:23.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.774+0000 7efe3a1f8640 1 -- 172.21.15.59:0/879358268 shutdown_connections 2024-04-25T15:46:23.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.774+0000 7efe3a1f8640 1 -- 172.21.15.59:0/879358268 wait complete. 2024-04-25T15:46:23.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.775+0000 7efe3a1f8640 1 Processor -- start 2024-04-25T15:46:23.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.776+0000 7efe3a1f8640 1 -- start start 2024-04-25T15:46:23.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.778+0000 7efe3a1f8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe340cfad0 0x7efe341486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:23.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.778+0000 7efe3a1f8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe34156770 0x7efe3415eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:23.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.778+0000 7efe3a1f8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe3415fc80 0x7efe3415f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:23.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.778+0000 7efe3a1f8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efe3415cfd0 con 0x7efe340cfad0 2024-04-25T15:46:23.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.778+0000 7efe3a1f8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efe3415ccf0 con 0x7efe34156770 2024-04-25T15:46:23.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.778+0000 7efe3a1f8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7efe341605d0 con 0x7efe3415fc80 2024-04-25T15:46:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.778+0000 7efe337fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe340cfad0 0x7efe341486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.778+0000 7efe32ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe34156770 0x7efe3415eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.778+0000 7efe337fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe340cfad0 0x7efe341486b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60812/0 (socket says 172.21.15.59:60812) 2024-04-25T15:46:23.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.778+0000 7efe337fe640 1 -- 172.21.15.59:0/314394543 learned_addr learned my addr 172.21.15.59:0/314394543 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:23.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.783+0000 7efe337fe640 1 -- 172.21.15.59:0/314394543 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe3415fc80 msgr2=0x7efe3415f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:23.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.783+0000 7efe337fe640 1 --2- 172.21.15.59:0/314394543 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe3415fc80 0x7efe3415f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:23.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.783+0000 7efe337fe640 1 -- 172.21.15.59:0/314394543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe34156770 msgr2=0x7efe3415eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:23.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.783+0000 7efe337fe640 1 --2- 172.21.15.59:0/314394543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe34156770 0x7efe3415eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:23.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.783+0000 7efe337fe640 1 -- 172.21.15.59:0/314394543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3406f090 con 0x7efe340cfad0 2024-04-25T15:46:23.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.786+0000 7efe337fe640 1 --2- 172.21.15.59:0/314394543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe340cfad0 0x7efe341486b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efe2400b440 tx=0x7efe2400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:23.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.791+0000 7efe1bfff640 1 -- 172.21.15.59:0/314394543 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe24015020 con 0x7efe340cfad0 2024-04-25T15:46:23.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.791+0000 7efe1bfff640 1 -- 172.21.15.59:0/314394543 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe24011830 con 0x7efe340cfad0 2024-04-25T15:46:23.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.791+0000 7efe3a1f8640 1 -- 172.21.15.59:0/314394543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe3406dab0 con 0x7efe340cfad0 2024-04-25T15:46:23.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.791+0000 7efe1bfff640 1 -- 172.21.15.59:0/314394543 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe24011c20 con 0x7efe340cfad0 2024-04-25T15:46:23.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.791+0000 7efe3a1f8640 1 -- 172.21.15.59:0/314394543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe3406e2d0 con 0x7efe340cfad0 2024-04-25T15:46:23.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:23.792+0000 7efe3a1f8640 1 -- 172.21.15.59:0/314394543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe340698a0 con 0x7efe340cfad0 2024-04-25T15:46:24.102 INFO:tasks.ceph.mds.f.smithi064.stdout:starting mds.f at 2024-04-25T15:46:24.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.145+0000 7efe1bfff640 1 -- 172.21.15.59:0/314394543 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7efe24018020 con 0x7efe340cfad0 2024-04-25T15:46:24.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.146+0000 7efe1bfff640 1 --2- 172.21.15.59:0/314394543 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7efe20074530 0x7efe20076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:24.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.146+0000 7efe32ffd640 1 --2- 172.21.15.59:0/314394543 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7efe20074530 0x7efe20076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:24.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.146+0000 7efe32ffd640 1 --2- 172.21.15.59:0/314394543 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7efe20074530 0x7efe20076a40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efe28034000 tx=0x7efe2802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:24.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.163+0000 7efe1bfff640 1 -- 172.21.15.59:0/314394543 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7efe24065fa0 con 0x7efe340cfad0 2024-04-25T15:46:24.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.163+0000 7efe1bfff640 1 -- 172.21.15.59:0/314394543 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efe2401f020 con 0x7efe340cfad0 2024-04-25T15:46:24.172 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-04-25T15:46:24.178 INFO:tasks.ceph.mds.b.smithi064.stdout:starting mds.b at 2024-04-25T15:46:24.216 INFO:tasks.ceph.mds.e.smithi059.stdout:starting mds.e at 2024-04-25T15:46:24.248 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-04-25T15:46:24.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.457+0000 7efe3a1f8640 1 -- 172.21.15.59:0/314394543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe3414c3d0 con 0x7efe340cfad0 2024-04-25T15:46:24.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.483+0000 7efe1bfff640 1 -- 172.21.15.59:0/314394543 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7efe2405fe00 con 0x7efe340cfad0 2024-04-25T15:46:24.484 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:24.485 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-25T15:46:24.485 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 1 2024-04-25T15:46:24.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.486+0000 7efe3a1f8640 1 -- 172.21.15.59:0/314394543 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7efe20074530 msgr2=0x7efe20076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.486+0000 7efe3a1f8640 1 --2- 172.21.15.59:0/314394543 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7efe20074530 0x7efe20076a40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efe28034000 tx=0x7efe2802e000 comp rx=0 tx=0).stop 2024-04-25T15:46:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.486+0000 7efe3a1f8640 1 -- 172.21.15.59:0/314394543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe340cfad0 msgr2=0x7efe341486b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.486+0000 7efe3a1f8640 1 --2- 172.21.15.59:0/314394543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe340cfad0 0x7efe341486b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efe2400b440 tx=0x7efe2400b900 comp rx=0 tx=0).stop 2024-04-25T15:46:24.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.486+0000 7efe3a1f8640 1 -- 172.21.15.59:0/314394543 shutdown_connections 2024-04-25T15:46:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.486+0000 7efe3a1f8640 1 --2- 172.21.15.59:0/314394543 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7efe20074530 0x7efe20076a40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.486+0000 7efe3a1f8640 1 --2- 172.21.15.59:0/314394543 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe3415fc80 0x7efe3415f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.486+0000 7efe3a1f8640 1 --2- 172.21.15.59:0/314394543 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe34156770 0x7efe3415eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.486+0000 7efe3a1f8640 1 --2- 172.21.15.59:0/314394543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe340cfad0 0x7efe341486b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:24.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.486+0000 7efe3a1f8640 1 -- 172.21.15.59:0/314394543 >> 172.21.15.59:0/314394543 conn(0x7efe34073200 msgr2=0x7efe340c6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:24.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.486+0000 7efe3a1f8640 1 -- 172.21.15.59:0/314394543 shutdown_connections 2024-04-25T15:46:24.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:24.487+0000 7efe3a1f8640 1 -- 172.21.15.59:0/314394543 wait complete. 2024-04-25T15:46:24.692 INFO:tasks.ceph.mds.d.smithi064.stdout:starting mds.d at 2024-04-25T15:46:26.503 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:26.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.614+0000 7f6eaae9a640 1 Processor -- start 2024-04-25T15:46:26.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.615+0000 7f6eaae9a640 1 -- start start 2024-04-25T15:46:26.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.616+0000 7f6eaae9a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ea415aaa0 0x7f6ea415aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:26.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.616+0000 7f6eaae9a640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ea4159330 con 0x7f6ea4161a90 2024-04-25T15:46:26.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.616+0000 7f6eaae9a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ea4159610 con 0x7f6ea4070640 2024-04-25T15:46:26.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.616+0000 7f6eaae9a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea415a610 con 0x7f6ea415aaa0 2024-04-25T15:46:26.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.617+0000 7f6ea9437640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6ea4161a90 0x7f6ea4163eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60952/0 (socket says 172.21.15.59:60952) 2024-04-25T15:46:26.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.617+0000 7f6ea9437640 1 -- 172.21.15.59:0/1997088380 learned_addr learned my addr 172.21.15.59:0/1997088380 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:26.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.617+0000 7f6ea3fff640 1 --2- 172.21.15.59:0/1997088380 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ea415aaa0 0x7f6ea415aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:26.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.619+0000 7f6ea37fe640 1 -- 172.21.15.59:0/1997088380 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2109514497 0 0) 0x7f6ea4159330 con 0x7f6ea4161a90 2024-04-25T15:46:26.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.619+0000 7f6ea37fe640 1 -- 172.21.15.59:0/1997088380 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e8c003520 con 0x7f6ea4161a90 2024-04-25T15:46:26.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.620+0000 7f6ea37fe640 1 -- 172.21.15.59:0/1997088380 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 35904623 0 0) 0x7f6ea4159610 con 0x7f6ea4070640 2024-04-25T15:46:26.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.620+0000 7f6ea37fe640 1 -- 172.21.15.59:0/1997088380 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ea4159330 con 0x7f6ea4070640 2024-04-25T15:46:26.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.620+0000 7f6ea3fff640 1 -- 172.21.15.59:0/1997088380 >> v1:172.21.15.64:6789/0 conn(0x7f6ea4070640 legacy=0x7f6ea40ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:26.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.620+0000 7f6ea3fff640 1 -- 172.21.15.59:0/1997088380 >> v1:172.21.15.59:6789/0 conn(0x7f6ea4161a90 legacy=0x7f6ea4163eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:26.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.620+0000 7f6ea3fff640 1 -- 172.21.15.59:0/1997088380 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea41598f0 con 0x7f6ea415aaa0 2024-04-25T15:46:26.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.622+0000 7f6ea3fff640 1 --2- 172.21.15.59:0/1997088380 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ea415aaa0 0x7f6ea415aeb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6e980097d0 tx=0x7f6e9802a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22ade0b1004140e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:26.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.626+0000 7f6ea37fe640 1 -- 172.21.15.59:0/1997088380 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e98037070 con 0x7f6ea415aaa0 2024-04-25T15:46:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.627+0000 7f6ea37fe640 1 -- 172.21.15.59:0/1997088380 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e98032440 con 0x7f6ea415aaa0 2024-04-25T15:46:26.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.627+0000 7f6ea37fe640 1 -- 172.21.15.59:0/1997088380 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e980327f0 con 0x7f6ea415aaa0 2024-04-25T15:46:26.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.627+0000 7f6eaae9a640 1 -- 172.21.15.59:0/1997088380 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ea415aaa0 msgr2=0x7f6ea415aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:26.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.627+0000 7f6eaae9a640 1 --2- 172.21.15.59:0/1997088380 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ea415aaa0 0x7f6ea415aeb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6e980097d0 tx=0x7f6e9802a290 comp rx=0 tx=0).stop 2024-04-25T15:46:26.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.628+0000 7f6eaae9a640 1 -- 172.21.15.59:0/1997088380 shutdown_connections 2024-04-25T15:46:26.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.628+0000 7f6eaae9a640 1 --2- 172.21.15.59:0/1997088380 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ea415aaa0 0x7f6ea415aeb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:26.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.628+0000 7f6eaae9a640 1 -- 172.21.15.59:0/1997088380 >> 172.21.15.59:0/1997088380 conn(0x7f6ea406d690 msgr2=0x7f6ea406daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:26.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.628+0000 7f6eaae9a640 1 -- 172.21.15.59:0/1997088380 shutdown_connections 2024-04-25T15:46:26.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.628+0000 7f6eaae9a640 1 -- 172.21.15.59:0/1997088380 wait complete. 2024-04-25T15:46:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.629+0000 7f6eaae9a640 1 Processor -- start 2024-04-25T15:46:26.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.629+0000 7f6eaae9a640 1 -- start start 2024-04-25T15:46:26.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.631+0000 7f6eaae9a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ea4070640 0x7f6ea40c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:26.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.631+0000 7f6eaae9a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ea415aaa0 0x7f6ea41f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:26.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.631+0000 7f6eaae9a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ea4161a90 0x7f6ea414fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:26.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.631+0000 7f6eaae9a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea415b3f0 con 0x7f6ea415aaa0 2024-04-25T15:46:26.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.631+0000 7f6eaae9a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea4159eb0 con 0x7f6ea4161a90 2024-04-25T15:46:26.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.631+0000 7f6eaae9a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea406fa30 con 0x7f6ea4070640 2024-04-25T15:46:26.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.631+0000 7f6ea3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ea415aaa0 0x7f6ea41f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:26.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.631+0000 7f6ea8c36640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ea4070640 0x7f6ea40c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:26.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.631+0000 7f6ea9437640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ea4161a90 0x7f6ea414fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:26.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.632+0000 7f6ea8c36640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ea4070640 0x7f6ea40c6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:35320/0 (socket says 172.21.15.59:35320) 2024-04-25T15:46:26.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.632+0000 7f6ea8c36640 1 -- 172.21.15.59:0/32233623 learned_addr learned my addr 172.21.15.59:0/32233623 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:26.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.635+0000 7f6ea3fff640 1 -- 172.21.15.59:0/32233623 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ea4070640 msgr2=0x7f6ea40c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:26.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.635+0000 7f6ea3fff640 1 --2- 172.21.15.59:0/32233623 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ea4070640 0x7f6ea40c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:26.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.635+0000 7f6ea3fff640 1 -- 172.21.15.59:0/32233623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ea4161a90 msgr2=0x7f6ea414fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:26.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.635+0000 7f6ea3fff640 1 --2- 172.21.15.59:0/32233623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ea4161a90 0x7f6ea414fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:26.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.635+0000 7f6ea3fff640 1 -- 172.21.15.59:0/32233623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea40c6970 con 0x7f6ea415aaa0 2024-04-25T15:46:26.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.638+0000 7f6ea3fff640 1 --2- 172.21.15.59:0/32233623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ea415aaa0 0x7f6ea41f4450 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6e98031000 tx=0x7f6e980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:26.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.642+0000 7f6ea17fa640 1 -- 172.21.15.59:0/32233623 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e98037040 con 0x7f6ea415aaa0 2024-04-25T15:46:26.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.642+0000 7f6ea17fa640 1 -- 172.21.15.59:0/32233623 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e98003c90 con 0x7f6ea415aaa0 2024-04-25T15:46:26.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.642+0000 7f6eaae9a640 1 -- 172.21.15.59:0/32233623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea41f4990 con 0x7f6ea415aaa0 2024-04-25T15:46:26.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.642+0000 7f6ea17fa640 1 -- 172.21.15.59:0/32233623 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e98006e10 con 0x7f6ea415aaa0 2024-04-25T15:46:26.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.642+0000 7f6eaae9a640 1 -- 172.21.15.59:0/32233623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea414f6d0 con 0x7f6ea415aaa0 2024-04-25T15:46:26.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.643+0000 7f6eaae9a640 1 -- 172.21.15.59:0/32233623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea4069fb0 con 0x7f6ea415aaa0 2024-04-25T15:46:26.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.666+0000 7f6ea17fa640 1 -- 172.21.15.59:0/32233623 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6e98044020 con 0x7f6ea415aaa0 2024-04-25T15:46:26.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.667+0000 7f6ea17fa640 1 --2- 172.21.15.59:0/32233623 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f6e900744e0 0x7f6e900769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:26.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.667+0000 7f6ea8c36640 1 --2- 172.21.15.59:0/32233623 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f6e900744e0 0x7f6e900769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:26.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.667+0000 7f6ea8c36640 1 --2- 172.21.15.59:0/32233623 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f6e900744e0 0x7f6e900769f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c001560 tx=0x7f6e9c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:26.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.670+0000 7f6ea17fa640 1 -- 172.21.15.59:0/32233623 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f6e9807c3e0 con 0x7f6ea415aaa0 2024-04-25T15:46:26.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:26.956+0000 7f6ea17fa640 1 -- 172.21.15.59:0/32233623 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6e98080150 con 0x7f6ea415aaa0 2024-04-25T15:46:27.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.203+0000 7f6eaae9a640 1 -- 172.21.15.59:0/32233623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ea4070c70 con 0x7f6ea415aaa0 2024-04-25T15:46:27.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.244+0000 7f6ea17fa640 1 -- 172.21.15.59:0/32233623 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5509 (secure 0 0 0) 0x7f6e98084450 con 0x7f6ea415aaa0 2024-04-25T15:46:27.245 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:27.245 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/783440137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":783440137},{"type":"v1","addr":"172.21.15.64:6835","nonce":783440137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2150121481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2150121481},{"type":"v1","addr":"172.21.15.59:6835","nonce":2150121481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4208,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2853549826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2853549826},{"type":"v1","addr":"172.21.15.64:6833","nonce":2853549826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4217,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/2036351360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2036351360},{"type":"v1","addr":"172.21.15.59:6837","nonce":2036351360}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/4162601241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4162601241},{"type":"v1","addr":"172.21.15.59:6839","nonce":4162601241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/2368752795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2368752795},{"type":"v1","addr":"172.21.15.64:6837","nonce":2368752795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T15:46:27.245 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 3 2024-04-25T15:46:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.246+0000 7f6eaae9a640 1 -- 172.21.15.59:0/32233623 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f6e900744e0 msgr2=0x7f6e900769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.246+0000 7f6eaae9a640 1 --2- 172.21.15.59:0/32233623 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f6e900744e0 0x7f6e900769f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c001560 tx=0x7f6e9c009040 comp rx=0 tx=0).stop 2024-04-25T15:46:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.246+0000 7f6eaae9a640 1 -- 172.21.15.59:0/32233623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ea415aaa0 msgr2=0x7f6ea41f4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.246+0000 7f6eaae9a640 1 --2- 172.21.15.59:0/32233623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ea415aaa0 0x7f6ea41f4450 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6e98031000 tx=0x7f6e980046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.246+0000 7f6eaae9a640 1 -- 172.21.15.59:0/32233623 shutdown_connections 2024-04-25T15:46:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.246+0000 7f6eaae9a640 1 --2- 172.21.15.59:0/32233623 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f6e900744e0 0x7f6e900769f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.246+0000 7f6eaae9a640 1 --2- 172.21.15.59:0/32233623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ea4161a90 0x7f6ea414fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.246+0000 7f6eaae9a640 1 --2- 172.21.15.59:0/32233623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ea415aaa0 0x7f6ea41f4450 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.246+0000 7f6eaae9a640 1 --2- 172.21.15.59:0/32233623 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ea4070640 0x7f6ea40c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.246+0000 7f6eaae9a640 1 -- 172.21.15.59:0/32233623 >> 172.21.15.59:0/32233623 conn(0x7f6ea406d690 msgr2=0x7f6ea406daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.246+0000 7f6eaae9a640 1 -- 172.21.15.59:0/32233623 shutdown_connections 2024-04-25T15:46:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.246+0000 7f6eaae9a640 1 -- 172.21.15.59:0/32233623 wait complete. 2024-04-25T15:46:27.259 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:27.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.370+0000 7f964d8c6640 1 Processor -- start 2024-04-25T15:46:27.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.370+0000 7f964d8c6640 1 -- start start 2024-04-25T15:46:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.371+0000 7f964d8c6640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9648156640 0x7f964815c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.371+0000 7f964d8c6640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96480c6f20 con 0x7f96480cc480 2024-04-25T15:46:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.371+0000 7f964d8c6640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9648160570 con 0x7f96480c7cc0 2024-04-25T15:46:27.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.371+0000 7f964d8c6640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f9648160850 con 0x7f9648156640 2024-04-25T15:46:27.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.372+0000 7f9646ffd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9648156640 0x7f964815c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:27.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.372+0000 7f963ffff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f96480c7cc0 0x7f96480b52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.59:36584/0 (socket says 172.21.15.59:36584) 2024-04-25T15:46:27.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.372+0000 7f963ffff640 1 -- 172.21.15.59:0/168302747 learned_addr learned my addr 172.21.15.59:0/168302747 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:27.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.375+0000 7f96467fc640 1 -- 172.21.15.59:0/168302747 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1340431812 0 0) 0x7f9648160570 con 0x7f96480c7cc0 2024-04-25T15:46:27.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.375+0000 7f96467fc640 1 -- 172.21.15.59:0/168302747 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9634003520 con 0x7f96480c7cc0 2024-04-25T15:46:27.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.376+0000 7f9646ffd640 1 -- 172.21.15.59:0/168302747 >> v1:172.21.15.64:6789/0 conn(0x7f96480c7cc0 legacy=0x7f96480b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:27.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.376+0000 7f9646ffd640 1 -- 172.21.15.59:0/168302747 >> v1:172.21.15.59:6789/0 conn(0x7f96480cc480 legacy=0x7f964815fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:27.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.376+0000 7f9646ffd640 1 -- 172.21.15.59:0/168302747 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96480c71e0 con 0x7f9648156640 2024-04-25T15:46:27.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.381+0000 7f9646ffd640 1 --2- 172.21.15.59:0/168302747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9648156640 0x7f964815c410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f96380097a0 tx=0x7f963802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2a68832bbe4394 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:27.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.385+0000 7f96467fc640 1 -- 172.21.15.59:0/168302747 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9638037070 con 0x7f9648156640 2024-04-25T15:46:27.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.385+0000 7f96467fc640 1 -- 172.21.15.59:0/168302747 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9638032440 con 0x7f9648156640 2024-04-25T15:46:27.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.385+0000 7f96467fc640 1 -- 172.21.15.59:0/168302747 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9638032810 con 0x7f9648156640 2024-04-25T15:46:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.386+0000 7f964d8c6640 1 -- 172.21.15.59:0/168302747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9648156640 msgr2=0x7f964815c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.386+0000 7f964d8c6640 1 --2- 172.21.15.59:0/168302747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9648156640 0x7f964815c410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f96380097a0 tx=0x7f963802a230 comp rx=0 tx=0).stop 2024-04-25T15:46:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.386+0000 7f964d8c6640 1 -- 172.21.15.59:0/168302747 shutdown_connections 2024-04-25T15:46:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.386+0000 7f964d8c6640 1 --2- 172.21.15.59:0/168302747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9648156640 0x7f964815c410 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.386+0000 7f964d8c6640 1 -- 172.21.15.59:0/168302747 >> 172.21.15.59:0/168302747 conn(0x7f964806f330 msgr2=0x7f96480684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.386+0000 7f964d8c6640 1 -- 172.21.15.59:0/168302747 shutdown_connections 2024-04-25T15:46:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.386+0000 7f964d8c6640 1 -- 172.21.15.59:0/168302747 wait complete. 2024-04-25T15:46:27.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.388+0000 7f964d8c6640 1 Processor -- start 2024-04-25T15:46:27.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.388+0000 7f964d8c6640 1 -- start start 2024-04-25T15:46:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.389+0000 7f964d8c6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96480c7cc0 0x7f96481f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.389+0000 7f964d8c6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f96480cc480 0x7f964808da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.389+0000 7f964d8c6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9648156640 0x7f9648152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.389+0000 7f964d8c6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9648160110 con 0x7f9648156640 2024-04-25T15:46:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.389+0000 7f964d8c6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f96480c77a0 con 0x7f96480c7cc0 2024-04-25T15:46:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.389+0000 7f964d8c6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f9648160290 con 0x7f96480cc480 2024-04-25T15:46:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.390+0000 7f963ffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f96480cc480 0x7f964808da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.390+0000 7f96477fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9648156640 0x7f9648152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.390+0000 7f9646ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96480c7cc0 0x7f96481f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.390+0000 7f963ffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f96480cc480 0x7f964808da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:35332/0 (socket says 172.21.15.59:35332) 2024-04-25T15:46:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.390+0000 7f963ffff640 1 -- 172.21.15.59:0/2223294155 learned_addr learned my addr 172.21.15.59:0/2223294155 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:27.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.394+0000 7f9646ffd640 1 -- 172.21.15.59:0/2223294155 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f96480cc480 msgr2=0x7f964808da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:27.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.394+0000 7f9646ffd640 1 --2- 172.21.15.59:0/2223294155 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f96480cc480 0x7f964808da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:27.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.394+0000 7f9646ffd640 1 -- 172.21.15.59:0/2223294155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9648156640 msgr2=0x7f9648152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:27.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.394+0000 7f9646ffd640 1 --2- 172.21.15.59:0/2223294155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9648156640 0x7f9648152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:27.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.394+0000 7f9646ffd640 1 -- 172.21.15.59:0/2223294155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96481f6430 con 0x7f96480c7cc0 2024-04-25T15:46:27.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.397+0000 7f9646ffd640 1 --2- 172.21.15.59:0/2223294155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96480c7cc0 0x7f96481f5ef0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9638031000 tx=0x7f96380046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:27.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.401+0000 7f9644ff9640 1 -- 172.21.15.59:0/2223294155 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9638037050 con 0x7f96480c7cc0 2024-04-25T15:46:27.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.402+0000 7f9644ff9640 1 -- 172.21.15.59:0/2223294155 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9638038040 con 0x7f96480c7cc0 2024-04-25T15:46:27.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.402+0000 7f9644ff9640 1 -- 172.21.15.59:0/2223294155 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9638030970 con 0x7f96480c7cc0 2024-04-25T15:46:27.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.402+0000 7f964d8c6640 1 -- 172.21.15.59:0/2223294155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96480b6ae0 con 0x7f96480c7cc0 2024-04-25T15:46:27.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.402+0000 7f964d8c6640 1 -- 172.21.15.59:0/2223294155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96480cb210 con 0x7f96480c7cc0 2024-04-25T15:46:27.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.403+0000 7f964d8c6640 1 -- 172.21.15.59:0/2223294155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96480698a0 con 0x7f96480c7cc0 2024-04-25T15:46:27.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.700+0000 7f9644ff9640 1 -- 172.21.15.59:0/2223294155 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9638045020 con 0x7f96480c7cc0 2024-04-25T15:46:27.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.701+0000 7f9644ff9640 1 --2- 172.21.15.59:0/2223294155 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f96280744b0 0x7f96280769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:27.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.701+0000 7f9644ff9640 1 -- 172.21.15.59:0/2223294155 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f96380b5810 con 0x7f96480c7cc0 2024-04-25T15:46:27.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.701+0000 7f963ffff640 1 --2- 172.21.15.59:0/2223294155 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f96280744b0 0x7f96280769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:27.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.701+0000 7f963ffff640 1 --2- 172.21.15.59:0/2223294155 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f96280744b0 0x7f96280769c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f96480d2830 tx=0x7f9630009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:27.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.711+0000 7f9644ff9640 1 -- 172.21.15.59:0/2223294155 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f963804c020 con 0x7f96480c7cc0 2024-04-25T15:46:27.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:27.897+0000 7f964d8c6640 1 -- 172.21.15.59:0/2223294155 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96480cd030 con 0x7f96480c7cc0 2024-04-25T15:46:28.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.005+0000 7f9644ff9640 1 -- 172.21.15.59:0/2223294155 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12824 (secure 0 0 0) 0x7f9638088350 con 0x7f96480c7cc0 2024-04-25T15:46:28.006 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:28.007 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":18,"fsid":"9bb5d7ca-5217-467b-882c-0a18cd57f08f","created":"2024-04-25T15:46:00.198001+0000","modified":"2024-04-25T15:46:20.894845+0000","last_up_change":"2024-04-25T15:46:15.850827+0000","last_in_change":"2024-04-25T15:46:06.311980+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:46:16.936340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34cee654-11dd-4f4b-99fe-093462f8abad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6803","nonce":1314235095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6805","nonce":1314235095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6809","nonce":1314235095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6807","nonce":1314235095}]},"public_addr":"172.21.15.59:6803/1314235095","cluster_addr":"172.21.15.59:6805/1314235095","heartbeat_back_addr":"172.21.15.59:6809/1314235095","heartbeat_front_addr":"172.21.15.59:6807/1314235095","state":["exists","up"]},{"osd":1,"uuid":"3c15505b-4abd-4a24-b30c-edc2732f8ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6827","nonce":3550810151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6829","nonce":3550810151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6833","nonce":3550810151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6831","nonce":3550810151}]},"public_addr":"172.21.15.59:6827/3550810151","cluster_addr":"172.21.15.59:6829/3550810151","heartbeat_back_addr":"172.21.15.59:6833/3550810151","heartbeat_front_addr":"172.21.15.59:6831/3550810151","state":["exists","up"]},{"osd":2,"uuid":"5884bf21-e6b4-4813-b8bc-6baa92443c87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6811","nonce":1651189093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6813","nonce":1651189093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6817","nonce":1651189093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6815","nonce":1651189093}]},"public_addr":"172.21.15.59:6811/1651189093","cluster_addr":"172.21.15.59:6813/1651189093","heartbeat_back_addr":"172.21.15.59:6817/1651189093","heartbeat_front_addr":"172.21.15.59:6815/1651189093","state":["exists","up"]},{"osd":3,"uuid":"6ff71700-3b00-4350-b3c9-f6c41ec46b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6819","nonce":1300858236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6821","nonce":1300858236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6825","nonce":1300858236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6823","nonce":1300858236}]},"public_addr":"172.21.15.59:6819/1300858236","cluster_addr":"172.21.15.59:6821/1300858236","heartbeat_back_addr":"172.21.15.59:6825/1300858236","heartbeat_front_addr":"172.21.15.59:6823/1300858236","state":["exists","up"]},{"osd":4,"uuid":"d0a72143-93fd-4712-aadb-f3fade303426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6817","nonce":2206186554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6819","nonce":2206186554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6823","nonce":2206186554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6821","nonce":2206186554}]},"public_addr":"172.21.15.64:6817/2206186554","cluster_addr":"172.21.15.64:6819/2206186554","heartbeat_back_addr":"172.21.15.64:6823/2206186554","heartbeat_front_addr":"172.21.15.64:6821/2206186554","state":["exists","up"]},{"osd":5,"uuid":"9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6825","nonce":639697697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6827","nonce":639697697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6831","nonce":639697697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6829","nonce":639697697}]},"public_addr":"172.21.15.64:6825/639697697","cluster_addr":"172.21.15.64:6827/639697697","heartbeat_back_addr":"172.21.15.64:6831/639697697","heartbeat_front_addr":"172.21.15.64:6829/639697697","state":["exists","up"]},{"osd":6,"uuid":"311d9a6b-8fbc-4809-8d33-b9248a3562f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6809","nonce":2335675289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6811","nonce":2335675289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6815","nonce":2335675289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6813","nonce":2335675289}]},"public_addr":"172.21.15.64:6809/2335675289","cluster_addr":"172.21.15.64:6811/2335675289","heartbeat_back_addr":"172.21.15.64:6815/2335675289","heartbeat_front_addr":"172.21.15.64:6813/2335675289","state":["exists","up"]},{"osd":7,"uuid":"d0f7436e-882f-4aa7-b2ae-684b9894b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6801","nonce":970439753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6803","nonce":970439753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6807","nonce":970439753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6805","nonce":970439753}]},"public_addr":"172.21.15.64:6801/970439753","cluster_addr":"172.21.15.64:6803/970439753","heartbeat_back_addr":"172.21.15.64:6807/970439753","heartbeat_front_addr":"172.21.15.64:6805/970439753","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.807777+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.945589+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.926832+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.943537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.925062+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.957550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.913559+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.839159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:28.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.007+0000 7f964d8c6640 1 -- 172.21.15.59:0/2223294155 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f96280744b0 msgr2=0x7f96280769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.007+0000 7f964d8c6640 1 --2- 172.21.15.59:0/2223294155 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f96280744b0 0x7f96280769c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f96480d2830 tx=0x7f9630009040 comp rx=0 tx=0).stop 2024-04-25T15:46:28.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.007+0000 7f964d8c6640 1 -- 172.21.15.59:0/2223294155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96480c7cc0 msgr2=0x7f96481f5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.007+0000 7f964d8c6640 1 --2- 172.21.15.59:0/2223294155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96480c7cc0 0x7f96481f5ef0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9638031000 tx=0x7f96380046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.007+0000 7f964d8c6640 1 -- 172.21.15.59:0/2223294155 shutdown_connections 2024-04-25T15:46:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.007+0000 7f964d8c6640 1 --2- 172.21.15.59:0/2223294155 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f96280744b0 0x7f96280769c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.007+0000 7f964d8c6640 1 --2- 172.21.15.59:0/2223294155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9648156640 0x7f9648152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.007+0000 7f964d8c6640 1 --2- 172.21.15.59:0/2223294155 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f96480cc480 0x7f964808da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.007+0000 7f964d8c6640 1 --2- 172.21.15.59:0/2223294155 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96480c7cc0 0x7f96481f5ef0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.008+0000 7f964d8c6640 1 -- 172.21.15.59:0/2223294155 >> 172.21.15.59:0/2223294155 conn(0x7f964806f330 msgr2=0x7f964815ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:28.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.008+0000 7f964d8c6640 1 -- 172.21.15.59:0/2223294155 shutdown_connections 2024-04-25T15:46:28.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.008+0000 7f964d8c6640 1 -- 172.21.15.59:0/2223294155 wait complete. 2024-04-25T15:46:28.020 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:46:16.936340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:46:28.021 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:46:28.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.134+0000 7f03cefa8640 1 Processor -- start 2024-04-25T15:46:28.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.134+0000 7f03cefa8640 1 -- start start 2024-04-25T15:46:28.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.135+0000 7f03cefa8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f03c8156790 0x7f03c80cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.135+0000 7f03cefa8640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f03c80c73c0 0x7f03c80c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.135+0000 7f03cefa8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03c815c720 con 0x7f03c808d410 2024-04-25T15:46:28.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.135+0000 7f03cefa8640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f03c815ca00 con 0x7f03c80c73c0 2024-04-25T15:46:28.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.135+0000 7f03cefa8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f03c815cce0 con 0x7f03c8156790 2024-04-25T15:46:28.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.136+0000 7f03c7fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f03c80c73c0 0x7f03c80c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.136+0000 7f03ccd44640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f03c8156790 0x7f03c80cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.136+0000 7f03c7fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f03c80c73c0 0x7f03c80c77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60884/0 (socket says 172.21.15.59:60884) 2024-04-25T15:46:28.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.136+0000 7f03c7fff640 1 -- 172.21.15.59:0/1224791661 learned_addr learned my addr 172.21.15.59:0/1224791661 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:28.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.139+0000 7f03c7fff640 1 -- 172.21.15.59:0/1224791661 >> v2:172.21.15.64:3300/0 conn(0x7f03c8156790 msgr2=0x7f03c80cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:28.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.139+0000 7f03c7fff640 1 --2- 172.21.15.59:0/1224791661 >> v2:172.21.15.64:3300/0 conn(0x7f03c8156790 0x7f03c80cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.139+0000 7f03c7fff640 1 -- 172.21.15.59:0/1224791661 >> v1:172.21.15.64:6789/0 conn(0x7f03c808d410 legacy=0x7f03c808d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.139+0000 7f03c7fff640 1 -- 172.21.15.59:0/1224791661 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c815cfc0 con 0x7f03c80c73c0 2024-04-25T15:46:28.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.143+0000 7f03c7fff640 1 --2- 172.21.15.59:0/1224791661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c80c73c0 0x7f03c80c77d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f03c80cf020 tx=0x7f03b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee6172a6c6042ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:28.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.149+0000 7f03c77fe640 1 -- 172.21.15.59:0/1224791661 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b4037070 con 0x7f03c80c73c0 2024-04-25T15:46:28.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.149+0000 7f03c77fe640 1 -- 172.21.15.59:0/1224791661 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03b4032440 con 0x7f03c80c73c0 2024-04-25T15:46:28.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.149+0000 7f03c77fe640 1 -- 172.21.15.59:0/1224791661 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b4032810 con 0x7f03c80c73c0 2024-04-25T15:46:28.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.150+0000 7f03cefa8640 1 -- 172.21.15.59:0/1224791661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c80c73c0 msgr2=0x7f03c80c77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.150+0000 7f03cefa8640 1 --2- 172.21.15.59:0/1224791661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c80c73c0 0x7f03c80c77d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f03c80cf020 tx=0x7f03b402a270 comp rx=0 tx=0).stop 2024-04-25T15:46:28.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.150+0000 7f03cefa8640 1 -- 172.21.15.59:0/1224791661 shutdown_connections 2024-04-25T15:46:28.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.150+0000 7f03cefa8640 1 --2- 172.21.15.59:0/1224791661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c80c73c0 0x7f03c80c77d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.150+0000 7f03cefa8640 1 --2- 172.21.15.59:0/1224791661 >> v2:172.21.15.64:3300/0 conn(0x7f03c8156790 0x7f03c80cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.150+0000 7f03cefa8640 1 -- 172.21.15.59:0/1224791661 >> 172.21.15.59:0/1224791661 conn(0x7f03c806f400 msgr2=0x7f03c80684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:28.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.150+0000 7f03cefa8640 1 -- 172.21.15.59:0/1224791661 shutdown_connections 2024-04-25T15:46:28.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.150+0000 7f03cefa8640 1 -- 172.21.15.59:0/1224791661 wait complete. 2024-04-25T15:46:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.152+0000 7f03cefa8640 1 Processor -- start 2024-04-25T15:46:28.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.152+0000 7f03cefa8640 1 -- start start 2024-04-25T15:46:28.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.154+0000 7f03cefa8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03c808d410 0x7f03c8155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.154+0000 7f03cefa8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c80c73c0 0x7f03c81f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.154+0000 7f03cefa8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03c8156790 0x7f03c81e7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.154+0000 7f03cefa8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f03c80c7d10 con 0x7f03c80c73c0 2024-04-25T15:46:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.154+0000 7f03cefa8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f03c80ccaf0 con 0x7f03c808d410 2024-04-25T15:46:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.154+0000 7f03cefa8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f03c80ccde0 con 0x7f03c8156790 2024-04-25T15:46:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.154+0000 7f03cd545640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03c8156790 0x7f03c81e7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.154+0000 7f03ccd44640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03c808d410 0x7f03c8155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.155+0000 7f03cd545640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03c8156790 0x7f03c81e7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:35340/0 (socket says 172.21.15.59:35340) 2024-04-25T15:46:28.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.155+0000 7f03cd545640 1 -- 172.21.15.59:0/2882905875 learned_addr learned my addr 172.21.15.59:0/2882905875 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:28.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.158+0000 7f03c7fff640 1 --2- 172.21.15.59:0/2882905875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c80c73c0 0x7f03c81f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.158+0000 7f03cd545640 1 -- 172.21.15.59:0/2882905875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03c808d410 msgr2=0x7f03c8155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.158+0000 7f03cd545640 1 --2- 172.21.15.59:0/2882905875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03c808d410 0x7f03c8155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.158+0000 7f03cd545640 1 -- 172.21.15.59:0/2882905875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c80c73c0 msgr2=0x7f03c81f2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.158+0000 7f03cd545640 1 --2- 172.21.15.59:0/2882905875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c80c73c0 0x7f03c81f2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.158+0000 7f03cd545640 1 -- 172.21.15.59:0/2882905875 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c81f6120 con 0x7f03c8156790 2024-04-25T15:46:28.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.161+0000 7f03cd545640 1 --2- 172.21.15.59:0/2882905875 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03c8156790 0x7f03c81e7e40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f03c000c6b0 tx=0x7f03c000cb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.165+0000 7f03c57fa640 1 -- 172.21.15.59:0/2882905875 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c0003b70 con 0x7f03c8156790 2024-04-25T15:46:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.165+0000 7f03c57fa640 1 -- 172.21.15.59:0/2882905875 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c0003d30 con 0x7f03c8156790 2024-04-25T15:46:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.165+0000 7f03cefa8640 1 -- 172.21.15.59:0/2882905875 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c8156020 con 0x7f03c8156790 2024-04-25T15:46:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.165+0000 7f03c57fa640 1 -- 172.21.15.59:0/2882905875 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c0005310 con 0x7f03c8156790 2024-04-25T15:46:28.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.166+0000 7f03cefa8640 1 -- 172.21.15.59:0/2882905875 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c81f66a0 con 0x7f03c8156790 2024-04-25T15:46:28.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.167+0000 7f03cefa8640 1 -- 172.21.15.59:0/2882905875 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03c8069910 con 0x7f03c8156790 2024-04-25T15:46:28.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.539+0000 7f03c57fa640 1 -- 172.21.15.59:0/2882905875 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f03c00054b0 con 0x7f03c8156790 2024-04-25T15:46:28.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.539+0000 7f03c57fa640 1 --2- 172.21.15.59:0/2882905875 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f03ac0744e0 0x7f03ac0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.540+0000 7f03c57fa640 1 -- 172.21.15.59:0/2882905875 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f03c0095700 con 0x7f03c8156790 2024-04-25T15:46:28.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.540+0000 7f03ccd44640 1 --2- 172.21.15.59:0/2882905875 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f03ac0744e0 0x7f03ac0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.540+0000 7f03ccd44640 1 --2- 172.21.15.59:0/2882905875 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f03ac0744e0 0x7f03ac0769f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009aa0 tx=0x7f03bc009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:28.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.550+0000 7f03c57fa640 1 -- 172.21.15.59:0/2882905875 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f03c81f6120 con 0x7f03c8156790 2024-04-25T15:46:28.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.738+0000 7f03cefa8640 1 -- 172.21.15.59:0/2882905875 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f03c80cfca0 con 0x7f03c8156790 2024-04-25T15:46:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.765+0000 7f03c57fa640 1 -- 172.21.15.59:0/2882905875 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (secure 0 0 0) 0x7f03c0060250 con 0x7f03c8156790 2024-04-25T15:46:28.766 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T15:46:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.767+0000 7f03cefa8640 1 -- 172.21.15.59:0/2882905875 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f03ac0744e0 msgr2=0x7f03ac0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.767+0000 7f03cefa8640 1 --2- 172.21.15.59:0/2882905875 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f03ac0744e0 0x7f03ac0769f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009aa0 tx=0x7f03bc009190 comp rx=0 tx=0).stop 2024-04-25T15:46:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.767+0000 7f03cefa8640 1 -- 172.21.15.59:0/2882905875 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03c8156790 msgr2=0x7f03c81e7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.767+0000 7f03cefa8640 1 --2- 172.21.15.59:0/2882905875 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03c8156790 0x7f03c81e7e40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f03c000c6b0 tx=0x7f03c000cb70 comp rx=0 tx=0).stop 2024-04-25T15:46:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.767+0000 7f03cefa8640 1 -- 172.21.15.59:0/2882905875 shutdown_connections 2024-04-25T15:46:28.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.767+0000 7f03cefa8640 1 --2- 172.21.15.59:0/2882905875 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f03ac0744e0 0x7f03ac0769f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.767+0000 7f03cefa8640 1 --2- 172.21.15.59:0/2882905875 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03c8156790 0x7f03c81e7e40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.767+0000 7f03cefa8640 1 --2- 172.21.15.59:0/2882905875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03c80c73c0 0x7f03c81f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.767+0000 7f03cefa8640 1 --2- 172.21.15.59:0/2882905875 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03c808d410 0x7f03c8155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.767+0000 7f03cefa8640 1 -- 172.21.15.59:0/2882905875 >> 172.21.15.59:0/2882905875 conn(0x7f03c806f400 msgr2=0x7f03c80cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.767+0000 7f03cefa8640 1 -- 172.21.15.59:0/2882905875 shutdown_connections 2024-04-25T15:46:28.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.767+0000 7f03cefa8640 1 -- 172.21.15.59:0/2882905875 wait complete. 2024-04-25T15:46:28.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T15:46:28.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.890+0000 7f5602135640 1 Processor -- start 2024-04-25T15:46:28.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.890+0000 7f5602135640 1 -- start start 2024-04-25T15:46:28.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.892+0000 7f5602135640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f55fc1564a0 0x7f55fc0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.892+0000 7f5602135640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55fc073ad0 0x7f55fc073ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.892+0000 7f5602135640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55fc0ccd10 con 0x7f55fc0c5290 2024-04-25T15:46:28.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.892+0000 7f5602135640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f55fc0cdc90 con 0x7f55fc1564a0 2024-04-25T15:46:28.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.892+0000 7f5602135640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f55fc0c5870 con 0x7f55fc073ad0 2024-04-25T15:46:28.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.892+0000 7f55fbfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55fc073ad0 0x7f55fc073ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.892+0000 7f55fb7fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f55fc0c5290 0x7f55fc15ced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60972/0 (socket says 172.21.15.59:60972) 2024-04-25T15:46:28.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.892+0000 7f55fb7fe640 1 -- 172.21.15.59:0/1442305847 learned_addr learned my addr 172.21.15.59:0/1442305847 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:28.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.892+0000 7f55faffd640 1 --2- 172.21.15.59:0/1442305847 >> v2:172.21.15.64:3300/0 conn(0x7f55fc1564a0 0x7f55fc0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.895+0000 7f55fbfff640 1 -- 172.21.15.59:0/1442305847 >> v2:172.21.15.64:3300/0 conn(0x7f55fc1564a0 msgr2=0x7f55fc0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:28.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.895+0000 7f55fbfff640 1 --2- 172.21.15.59:0/1442305847 >> v2:172.21.15.64:3300/0 conn(0x7f55fc1564a0 0x7f55fc0cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.895+0000 7f55fbfff640 1 -- 172.21.15.59:0/1442305847 >> v1:172.21.15.59:6789/0 conn(0x7f55fc0c5290 legacy=0x7f55fc15ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.895+0000 7f55fbfff640 1 -- 172.21.15.59:0/1442305847 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55fc0c72e0 con 0x7f55fc073ad0 2024-04-25T15:46:28.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.895+0000 7f55fa7fc640 1 -- 172.21.15.59:0/1442305847 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3201985554 0 0) 0x7f55fc0ccd10 con 0x7f55fc0c5290 2024-04-25T15:46:28.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.897+0000 7f55fbfff640 1 --2- 172.21.15.59:0/1442305847 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55fc073ad0 0x7f55fc073ee0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f55f4009d90 tx=0x7f55f402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9b7b2ee2fac9022 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:28.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.901+0000 7f55fa7fc640 1 -- 172.21.15.59:0/1442305847 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4007740 con 0x7f55fc073ad0 2024-04-25T15:46:28.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.901+0000 7f55fa7fc640 1 -- 172.21.15.59:0/1442305847 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f40078e0 con 0x7f55fc073ad0 2024-04-25T15:46:28.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.901+0000 7f55fa7fc640 1 -- 172.21.15.59:0/1442305847 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4007cb0 con 0x7f55fc073ad0 2024-04-25T15:46:28.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.902+0000 7f5602135640 1 -- 172.21.15.59:0/1442305847 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55fc073ad0 msgr2=0x7f55fc073ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.902+0000 7f5602135640 1 --2- 172.21.15.59:0/1442305847 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55fc073ad0 0x7f55fc073ee0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f55f4009d90 tx=0x7f55f402a660 comp rx=0 tx=0).stop 2024-04-25T15:46:28.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.902+0000 7f5602135640 1 -- 172.21.15.59:0/1442305847 shutdown_connections 2024-04-25T15:46:28.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.902+0000 7f5602135640 1 --2- 172.21.15.59:0/1442305847 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55fc073ad0 0x7f55fc073ee0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.902+0000 7f5602135640 1 --2- 172.21.15.59:0/1442305847 >> v2:172.21.15.64:3300/0 conn(0x7f55fc1564a0 0x7f55fc0cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.902+0000 7f5602135640 1 -- 172.21.15.59:0/1442305847 >> 172.21.15.59:0/1442305847 conn(0x7f55fc0cde10 msgr2=0x7f55fc0ce220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:28.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.902+0000 7f5602135640 1 -- 172.21.15.59:0/1442305847 shutdown_connections 2024-04-25T15:46:28.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.902+0000 7f5602135640 1 -- 172.21.15.59:0/1442305847 wait complete. 2024-04-25T15:46:28.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.903+0000 7f5602135640 1 Processor -- start 2024-04-25T15:46:28.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.904+0000 7f5602135640 1 -- start start 2024-04-25T15:46:28.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.905+0000 7f5602135640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55fc073ad0 0x7f55fc15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.905+0000 7f5602135640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55fc0c5290 0x7f55fc158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.905+0000 7f5602135640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55fc1564a0 0x7f55fc14e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:28.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.905+0000 7f5602135640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc1568b0 con 0x7f55fc073ad0 2024-04-25T15:46:28.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.905+0000 7f5602135640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc0c78a0 con 0x7f55fc1564a0 2024-04-25T15:46:28.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.905+0000 7f5602135640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f55fc0c5b50 con 0x7f55fc0c5290 2024-04-25T15:46:28.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.905+0000 7f55fb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55fc073ad0 0x7f55fc15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.905+0000 7f55faffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55fc0c5290 0x7f55fc158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.906+0000 7f55fbfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55fc1564a0 0x7f55fc14e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:28.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.906+0000 7f55faffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55fc0c5290 0x7f55fc158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:35358/0 (socket says 172.21.15.59:35358) 2024-04-25T15:46:28.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.906+0000 7f55faffd640 1 -- 172.21.15.59:0/3682944464 learned_addr learned my addr 172.21.15.59:0/3682944464 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:28.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.910+0000 7f55faffd640 1 -- 172.21.15.59:0/3682944464 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55fc1564a0 msgr2=0x7f55fc14e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.910+0000 7f55faffd640 1 --2- 172.21.15.59:0/3682944464 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55fc1564a0 0x7f55fc14e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.910+0000 7f55faffd640 1 -- 172.21.15.59:0/3682944464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55fc073ad0 msgr2=0x7f55fc15cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:28.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.910+0000 7f55faffd640 1 --2- 172.21.15.59:0/3682944464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55fc073ad0 0x7f55fc15cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:28.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.910+0000 7f55faffd640 1 -- 172.21.15.59:0/3682944464 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55fc150850 con 0x7f55fc0c5290 2024-04-25T15:46:28.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.912+0000 7f55faffd640 1 --2- 172.21.15.59:0/3682944464 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55fc0c5290 0x7f55fc158c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f55f000e870 tx=0x7f55f000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.916+0000 7f55e3fff640 1 -- 172.21.15.59:0/3682944464 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0017070 con 0x7f55fc0c5290 2024-04-25T15:46:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.916+0000 7f55e3fff640 1 -- 172.21.15.59:0/3682944464 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f000ee60 con 0x7f55fc0c5290 2024-04-25T15:46:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.916+0000 7f5602135640 1 -- 172.21.15.59:0/3682944464 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55fc15bce0 con 0x7f55fc0c5290 2024-04-25T15:46:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.916+0000 7f55e3fff640 1 -- 172.21.15.59:0/3682944464 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f000cb80 con 0x7f55fc0c5290 2024-04-25T15:46:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.916+0000 7f5602135640 1 -- 172.21.15.59:0/3682944464 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f55fc15c560 con 0x7f55fc0c5290 2024-04-25T15:46:28.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:28.917+0000 7f5602135640 1 -- 172.21.15.59:0/3682944464 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55fc0c8ad0 con 0x7f55fc0c5290 2024-04-25T15:46:29.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.222+0000 7f55e3fff640 1 -- 172.21.15.59:0/3682944464 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f55f001a070 con 0x7f55fc0c5290 2024-04-25T15:46:29.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.223+0000 7f55e3fff640 1 --2- 172.21.15.59:0/3682944464 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f55e80744e0 0x7f55e80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:29.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.223+0000 7f55fb7fe640 1 --2- 172.21.15.59:0/3682944464 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f55e80744e0 0x7f55e80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:29.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.223+0000 7f55fb7fe640 1 --2- 172.21.15.59:0/3682944464 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f55e80744e0 0x7f55e80769f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55ec000f60 tx=0x7f55ec007e40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:29.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.227+0000 7f55e3fff640 1 -- 172.21.15.59:0/3682944464 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f55f000cd20 con 0x7f55fc0c5290 2024-04-25T15:46:29.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.238+0000 7f55e3fff640 1 -- 172.21.15.59:0/3682944464 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f55fc0c8ad0 con 0x7f55fc0c5290 2024-04-25T15:46:29.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.432+0000 7f5602135640 1 -- 172.21.15.59:0/3682944464 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f55fc0698a0 con 0x7f55fc0c5290 2024-04-25T15:46:29.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.482+0000 7f55e3fff640 1 -- 172.21.15.59:0/3682944464 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f55f005f9d0 con 0x7f55fc0c5290 2024-04-25T15:46:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:29.483 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-04-25T15:46:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T15:46:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-04-25T15:46:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-04-25T15:46:29.484 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T15:46:29.484 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-04-25T15:46:29.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.484+0000 7f5602135640 1 -- 172.21.15.59:0/3682944464 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f55e80744e0 msgr2=0x7f55e80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:29.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.484+0000 7f5602135640 1 --2- 172.21.15.59:0/3682944464 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f55e80744e0 0x7f55e80769f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55ec000f60 tx=0x7f55ec007e40 comp rx=0 tx=0).stop 2024-04-25T15:46:29.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.484+0000 7f5602135640 1 -- 172.21.15.59:0/3682944464 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55fc0c5290 msgr2=0x7f55fc158c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:29.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.484+0000 7f5602135640 1 --2- 172.21.15.59:0/3682944464 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55fc0c5290 0x7f55fc158c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f55f000e870 tx=0x7f55f000ed30 comp rx=0 tx=0).stop 2024-04-25T15:46:29.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.485+0000 7f5602135640 1 -- 172.21.15.59:0/3682944464 shutdown_connections 2024-04-25T15:46:29.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.485+0000 7f5602135640 1 --2- 172.21.15.59:0/3682944464 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f55e80744e0 0x7f55e80769f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.485+0000 7f5602135640 1 --2- 172.21.15.59:0/3682944464 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55fc1564a0 0x7f55fc14e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.485+0000 7f5602135640 1 --2- 172.21.15.59:0/3682944464 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55fc0c5290 0x7f55fc158c70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.485+0000 7f5602135640 1 --2- 172.21.15.59:0/3682944464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55fc073ad0 0x7f55fc15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.485+0000 7f5602135640 1 -- 172.21.15.59:0/3682944464 >> 172.21.15.59:0/3682944464 conn(0x7f55fc0cde10 msgr2=0x7f55fc0cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:29.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.485+0000 7f5602135640 1 -- 172.21.15.59:0/3682944464 shutdown_connections 2024-04-25T15:46:29.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.485+0000 7f5602135640 1 -- 172.21.15.59:0/3682944464 wait complete. 2024-04-25T15:46:29.496 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T15:46:29.497 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T15:46:29.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.611+0000 7f534b234640 1 Processor -- start 2024-04-25T15:46:29.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.611+0000 7f534b234640 1 -- start start 2024-04-25T15:46:29.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.613+0000 7f534b234640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5344156810 0x7f534415d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:29.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.613+0000 7f534b234640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f53440cd710 0x7f53440c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:29.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.613+0000 7f534b234640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f534415fb60 con 0x7f53440cd300 2024-04-25T15:46:29.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.613+0000 7f534b234640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f534415d550 con 0x7f53440cd710 2024-04-25T15:46:29.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.613+0000 7f534b234640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f534415fe00 con 0x7f5344156810 2024-04-25T15:46:29.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.613+0000 7f5348fd0640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5344156810 0x7f534415d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:29.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.613+0000 7f53497d1640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f53440cd710 0x7f53440c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:29.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.614+0000 7f5348fd0640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5344156810 0x7f534415d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:40614/0 (socket says 172.21.15.59:40614) 2024-04-25T15:46:29.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.614+0000 7f5348fd0640 1 -- 172.21.15.59:0/1828486002 learned_addr learned my addr 172.21.15.59:0/1828486002 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:29.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.617+0000 7f5348fd0640 1 -- 172.21.15.59:0/1828486002 >> v2:172.21.15.59:3300/0 conn(0x7f53440cd710 msgr2=0x7f53440c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:29.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.617+0000 7f5348fd0640 1 --2- 172.21.15.59:0/1828486002 >> v2:172.21.15.59:3300/0 conn(0x7f53440cd710 0x7f53440c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.617+0000 7f5348fd0640 1 -- 172.21.15.59:0/1828486002 >> v1:172.21.15.59:6789/0 conn(0x7f53440cd300 legacy=0x7f53440cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:29.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.617+0000 7f5348fd0640 1 -- 172.21.15.59:0/1828486002 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53441600e0 con 0x7f5344156810 2024-04-25T15:46:29.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.619+0000 7f5348fd0640 1 --2- 172.21.15.59:0/1828486002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5344156810 0x7f534415d010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f53440d29f0 tx=0x7f533c02a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=655b7f521e9b73ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:29.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.623+0000 7f53437fe640 1 -- 172.21.15.59:0/1828486002 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c036070 con 0x7f5344156810 2024-04-25T15:46:29.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.623+0000 7f53437fe640 1 -- 172.21.15.59:0/1828486002 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f533c031600 con 0x7f5344156810 2024-04-25T15:46:29.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.623+0000 7f53437fe640 1 -- 172.21.15.59:0/1828486002 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c0319d0 con 0x7f5344156810 2024-04-25T15:46:29.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.623+0000 7f534b234640 1 -- 172.21.15.59:0/1828486002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5344156810 msgr2=0x7f534415d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:29.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.623+0000 7f534b234640 1 --2- 172.21.15.59:0/1828486002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5344156810 0x7f534415d010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f53440d29f0 tx=0x7f533c02a730 comp rx=0 tx=0).stop 2024-04-25T15:46:29.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.624+0000 7f534b234640 1 -- 172.21.15.59:0/1828486002 shutdown_connections 2024-04-25T15:46:29.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.624+0000 7f534b234640 1 --2- 172.21.15.59:0/1828486002 >> v2:172.21.15.59:3300/0 conn(0x7f53440cd710 0x7f53440c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.624+0000 7f534b234640 1 --2- 172.21.15.59:0/1828486002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5344156810 0x7f534415d010 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.624+0000 7f534b234640 1 -- 172.21.15.59:0/1828486002 >> 172.21.15.59:0/1828486002 conn(0x7f53440684e0 msgr2=0x7f53440688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:29.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.624+0000 7f534b234640 1 -- 172.21.15.59:0/1828486002 shutdown_connections 2024-04-25T15:46:29.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.624+0000 7f534b234640 1 -- 172.21.15.59:0/1828486002 wait complete. 2024-04-25T15:46:29.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.625+0000 7f534b234640 1 Processor -- start 2024-04-25T15:46:29.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.625+0000 7f534b234640 1 -- start start 2024-04-25T15:46:29.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.627+0000 7f534b234640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f53440cd300 0x7f53441f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:29.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.627+0000 7f534b234640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53440cd710 0x7f53441e59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:29.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.627+0000 7f534b234640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f534414bef0 0x7f534414aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:29.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.627+0000 7f534b234640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53440cccd0 con 0x7f534414bef0 2024-04-25T15:46:29.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.627+0000 7f534b234640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f53441606a0 con 0x7f53440cd710 2024-04-25T15:46:29.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.627+0000 7f534b234640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f53440cce50 con 0x7f53440cd300 2024-04-25T15:46:29.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.627+0000 7f53497d1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f534414bef0 0x7f534414aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:29.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.627+0000 7f5348fd0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f53440cd300 0x7f53441f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:29.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.627+0000 7f5343fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53440cd710 0x7f53441e59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:29.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.628+0000 7f5348fd0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f53440cd300 0x7f53441f2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:35362/0 (socket says 172.21.15.59:35362) 2024-04-25T15:46:29.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.628+0000 7f5348fd0640 1 -- 172.21.15.59:0/2489164468 learned_addr learned my addr 172.21.15.59:0/2489164468 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.632+0000 7f5343fff640 1 -- 172.21.15.59:0/2489164468 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f53440cd300 msgr2=0x7f53441f2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.632+0000 7f5343fff640 1 --2- 172.21.15.59:0/2489164468 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f53440cd300 0x7f53441f2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.632+0000 7f5343fff640 1 -- 172.21.15.59:0/2489164468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f534414bef0 msgr2=0x7f534414aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.632+0000 7f5343fff640 1 --2- 172.21.15.59:0/2489164468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f534414bef0 0x7f534414aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.632+0000 7f5343fff640 1 -- 172.21.15.59:0/2489164468 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534415ac70 con 0x7f53440cd710 2024-04-25T15:46:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.632+0000 7f5348fd0640 1 --2- 172.21.15.59:0/2489164468 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f53440cd300 0x7f53441f2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:46:29.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.634+0000 7f5343fff640 1 --2- 172.21.15.59:0/2489164468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53440cd710 0x7f53441e59c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f533800c420 tx=0x7f533800c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:29.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.638+0000 7f53417fa640 1 -- 172.21.15.59:0/2489164468 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53380052d0 con 0x7f53440cd710 2024-04-25T15:46:29.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.638+0000 7f53417fa640 1 -- 172.21.15.59:0/2489164468 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5338005490 con 0x7f53440cd710 2024-04-25T15:46:29.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.638+0000 7f53417fa640 1 -- 172.21.15.59:0/2489164468 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338007260 con 0x7f53440cd710 2024-04-25T15:46:29.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.638+0000 7f534b234640 1 -- 172.21.15.59:0/2489164468 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53441e6250 con 0x7f53440cd710 2024-04-25T15:46:29.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.639+0000 7f534b234640 1 -- 172.21.15.59:0/2489164468 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f534414aba0 con 0x7f53440cd710 2024-04-25T15:46:29.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.639+0000 7f534b234640 1 -- 172.21.15.59:0/2489164468 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53440cf290 con 0x7f53440cd710 2024-04-25T15:46:29.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.957+0000 7f53417fa640 1 -- 172.21.15.59:0/2489164468 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5338007400 con 0x7f53440cd710 2024-04-25T15:46:29.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.957+0000 7f53417fa640 1 --2- 172.21.15.59:0/2489164468 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5330074500 0x7f5330076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:29.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.957+0000 7f53417fa640 1 -- 172.21.15.59:0/2489164468 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f53380948d0 con 0x7f53440cd710 2024-04-25T15:46:29.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.958+0000 7f5348fd0640 1 --2- 172.21.15.59:0/2489164468 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5330074500 0x7f5330076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:29.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.958+0000 7f5348fd0640 1 --2- 172.21.15.59:0/2489164468 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5330074500 0x7f5330076a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f533c000f80 tx=0x7f533c009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:29.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:29.970+0000 7f53417fa640 1 -- 172.21.15.59:0/2489164468 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f53440cf290 con 0x7f53440cd710 2024-04-25T15:46:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.156+0000 7f534b234640 1 -- 172.21.15.59:0/2489164468 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f5344152f70 con 0x7f53440cd710 2024-04-25T15:46:30.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.705+0000 7f53417fa640 1 -- 172.21.15.59:0/2489164468 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7f534415ac70 con 0x7f53440cd710 2024-04-25T15:46:30.706 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-04-25T15:46:30.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.707+0000 7f534b234640 1 -- 172.21.15.59:0/2489164468 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5330074500 msgr2=0x7f5330076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:30.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.707+0000 7f534b234640 1 --2- 172.21.15.59:0/2489164468 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5330074500 0x7f5330076a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f533c000f80 tx=0x7f533c009000 comp rx=0 tx=0).stop 2024-04-25T15:46:30.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.707+0000 7f534b234640 1 -- 172.21.15.59:0/2489164468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53440cd710 msgr2=0x7f53441e59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:30.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.707+0000 7f534b234640 1 --2- 172.21.15.59:0/2489164468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53440cd710 0x7f53441e59c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f533800c420 tx=0x7f533800c8e0 comp rx=0 tx=0).stop 2024-04-25T15:46:30.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.707+0000 7f534b234640 1 -- 172.21.15.59:0/2489164468 shutdown_connections 2024-04-25T15:46:30.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.707+0000 7f534b234640 1 --2- 172.21.15.59:0/2489164468 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5330074500 0x7f5330076a10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:30.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.707+0000 7f534b234640 1 --2- 172.21.15.59:0/2489164468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f534414bef0 0x7f534414aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:30.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.707+0000 7f534b234640 1 --2- 172.21.15.59:0/2489164468 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53440cd710 0x7f53441e59c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:30.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.707+0000 7f534b234640 1 --2- 172.21.15.59:0/2489164468 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f53440cd300 0x7f53441f2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:30.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.707+0000 7f534b234640 1 -- 172.21.15.59:0/2489164468 >> 172.21.15.59:0/2489164468 conn(0x7f53440684e0 msgr2=0x7f53440cde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:30.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.708+0000 7f534b234640 1 -- 172.21.15.59:0/2489164468 shutdown_connections 2024-04-25T15:46:30.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.708+0000 7f534b234640 1 -- 172.21.15.59:0/2489164468 wait complete. 2024-04-25T15:46:30.719 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T15:46:30.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.836+0000 7fa1c4d6c640 1 Processor -- start 2024-04-25T15:46:30.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.837+0000 7fa1c4d6c640 1 -- start start 2024-04-25T15:46:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.838+0000 7fa1c4d6c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa1c00b5220 0x7fa1c00c7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.838+0000 7fa1c4d6c640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1c00c78a0 con 0x7fa1c0160600 2024-04-25T15:46:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.838+0000 7fa1c4d6c640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1c00c7b40 con 0x7fa1c00b4670 2024-04-25T15:46:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.838+0000 7fa1c4d6c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fa1c0160170 con 0x7fa1c00b5220 2024-04-25T15:46:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.839+0000 7fa1bdd9b640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa1c0160600 0x7fa1c0164e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60992/0 (socket says 172.21.15.59:60992) 2024-04-25T15:46:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.839+0000 7fa1bdd9b640 1 -- 172.21.15.59:0/2798264280 learned_addr learned my addr 172.21.15.59:0/2798264280 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:30.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.839+0000 7fa1bed9d640 1 --2- 172.21.15.59:0/2798264280 >> v2:172.21.15.64:3300/0 conn(0x7fa1c00b5220 0x7fa1c00c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:30.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.842+0000 7fa1bd59a640 1 -- 172.21.15.59:0/2798264280 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 430407294 0 0) 0x7fa1c00c78a0 con 0x7fa1c0160600 2024-04-25T15:46:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.842+0000 7fa1bd59a640 1 -- 172.21.15.59:0/2798264280 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1a8003520 con 0x7fa1c0160600 2024-04-25T15:46:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.843+0000 7fa1bed9d640 1 -- 172.21.15.59:0/2798264280 >> v1:172.21.15.64:6789/0 conn(0x7fa1c00b4670 legacy=0x7fa1c00cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.843+0000 7fa1bed9d640 1 -- 172.21.15.59:0/2798264280 >> v1:172.21.15.59:6789/0 conn(0x7fa1c0160600 legacy=0x7fa1c0164e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.843+0000 7fa1bed9d640 1 -- 172.21.15.59:0/2798264280 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c015fb20 con 0x7fa1c00b5220 2024-04-25T15:46:30.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.847+0000 7fa1bed9d640 1 --2- 172.21.15.59:0/2798264280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1c00b5220 0x7fa1c00c7160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009d90 tx=0x7fa1b802a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d333ca028d60780 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:30.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.854+0000 7fa1bd59a640 1 -- 172.21.15.59:0/2798264280 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8037070 con 0x7fa1c00b5220 2024-04-25T15:46:30.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.854+0000 7fa1bd59a640 1 -- 172.21.15.59:0/2798264280 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b8007740 con 0x7fa1c00b5220 2024-04-25T15:46:30.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.854+0000 7fa1bd59a640 1 -- 172.21.15.59:0/2798264280 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8007b10 con 0x7fa1c00b5220 2024-04-25T15:46:30.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.854+0000 7fa1c4d6c640 1 -- 172.21.15.59:0/2798264280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1c00b5220 msgr2=0x7fa1c00c7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:30.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.854+0000 7fa1c4d6c640 1 --2- 172.21.15.59:0/2798264280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1c00b5220 0x7fa1c00c7160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009d90 tx=0x7fa1b802a780 comp rx=0 tx=0).stop 2024-04-25T15:46:30.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.855+0000 7fa1c4d6c640 1 -- 172.21.15.59:0/2798264280 shutdown_connections 2024-04-25T15:46:30.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.855+0000 7fa1c4d6c640 1 --2- 172.21.15.59:0/2798264280 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1c00b5220 0x7fa1c00c7160 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:30.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.855+0000 7fa1c4d6c640 1 -- 172.21.15.59:0/2798264280 >> 172.21.15.59:0/2798264280 conn(0x7fa1c006f300 msgr2=0x7fa1c00684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:30.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.855+0000 7fa1c4d6c640 1 -- 172.21.15.59:0/2798264280 shutdown_connections 2024-04-25T15:46:30.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.855+0000 7fa1c4d6c640 1 -- 172.21.15.59:0/2798264280 wait complete. 2024-04-25T15:46:30.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.856+0000 7fa1c4d6c640 1 Processor -- start 2024-04-25T15:46:30.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.857+0000 7fa1c4d6c640 1 -- start start 2024-04-25T15:46:30.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.858+0000 7fa1c4d6c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1c00b4670 0x7fa1c00c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:30.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.858+0000 7fa1c4d6c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa1c00b5220 0x7fa1c00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:30.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.858+0000 7fa1c4d6c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1c0160600 0x7fa1c014c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:30.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.858+0000 7fa1c4d6c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c00c7e20 con 0x7fa1c0160600 2024-04-25T15:46:30.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.858+0000 7fa1c4d6c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c00b5630 con 0x7fa1c00b4670 2024-04-25T15:46:30.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.858+0000 7fa1c4d6c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fa1c00c7fa0 con 0x7fa1c00b5220 2024-04-25T15:46:30.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.858+0000 7fa1bed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1c0160600 0x7fa1c014c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:30.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.859+0000 7fa1bdd9b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa1c00b5220 0x7fa1c00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:30.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.859+0000 7fa1be59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1c00b4670 0x7fa1c00c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:30.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.859+0000 7fa1bed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1c0160600 0x7fa1c014c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60924/0 (socket says 172.21.15.59:60924) 2024-04-25T15:46:30.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.859+0000 7fa1bed9d640 1 -- 172.21.15.59:0/3311790958 learned_addr learned my addr 172.21.15.59:0/3311790958 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:30.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.863+0000 7fa1bed9d640 1 -- 172.21.15.59:0/3311790958 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa1c00b5220 msgr2=0x7fa1c00d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:30.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.863+0000 7fa1bed9d640 1 --2- 172.21.15.59:0/3311790958 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa1c00b5220 0x7fa1c00d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:30.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.863+0000 7fa1bed9d640 1 -- 172.21.15.59:0/3311790958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1c00b4670 msgr2=0x7fa1c00c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:30.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.863+0000 7fa1bed9d640 1 --2- 172.21.15.59:0/3311790958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1c00b4670 0x7fa1c00c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:30.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.863+0000 7fa1bed9d640 1 -- 172.21.15.59:0/3311790958 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c00c9dc0 con 0x7fa1c0160600 2024-04-25T15:46:30.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.865+0000 7fa1bed9d640 1 --2- 172.21.15.59:0/3311790958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1c0160600 0x7fa1c014c570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa1b802ad70 tx=0x7fa1b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:30.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.870+0000 7fa1aeffd640 1 -- 172.21.15.59:0/3311790958 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8042020 con 0x7fa1c0160600 2024-04-25T15:46:30.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.870+0000 7fa1aeffd640 1 -- 172.21.15.59:0/3311790958 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1b8038040 con 0x7fa1c0160600 2024-04-25T15:46:30.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.870+0000 7fa1c4d6c640 1 -- 172.21.15.59:0/3311790958 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c00ce4b0 con 0x7fa1c0160600 2024-04-25T15:46:30.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.870+0000 7fa1aeffd640 1 -- 172.21.15.59:0/3311790958 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8037070 con 0x7fa1c0160600 2024-04-25T15:46:30.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.870+0000 7fa1c4d6c640 1 -- 172.21.15.59:0/3311790958 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c00cea70 con 0x7fa1c0160600 2024-04-25T15:46:30.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.871+0000 7fa1c4d6c640 1 -- 172.21.15.59:0/3311790958 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1c00c70e0 con 0x7fa1c0160600 2024-04-25T15:46:30.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.894+0000 7fa1aeffd640 1 -- 172.21.15.59:0/3311790958 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa1b8045020 con 0x7fa1c0160600 2024-04-25T15:46:30.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.894+0000 7fa1aeffd640 1 --2- 172.21.15.59:0/3311790958 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fa1a00744e0 0x7fa1a00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:30.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.895+0000 7fa1be59c640 1 --2- 172.21.15.59:0/3311790958 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fa1a00744e0 0x7fa1a00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:30.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.895+0000 7fa1be59c640 1 --2- 172.21.15.59:0/3311790958 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fa1a00744e0 0x7fa1a00769f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0000f60 tx=0x7fa1b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:30.898+0000 7fa1aeffd640 1 -- 172.21.15.59:0/3311790958 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7fa1b8032d80 con 0x7fa1c0160600 2024-04-25T15:46:31.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.179+0000 7fa1aeffd640 1 -- 172.21.15.59:0/3311790958 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa1b804c030 con 0x7fa1c0160600 2024-04-25T15:46:31.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.363+0000 7fa1c4d6c640 1 -- 172.21.15.59:0/3311790958 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa1c0069910 con 0x7fa1c0160600 2024-04-25T15:46:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.652+0000 7fa1aeffd640 1 -- 172.21.15.59:0/3311790958 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) ==== 170+0+0 (secure 0 0 0) 0x7fa1b8080690 con 0x7fa1c0160600 2024-04-25T15:46:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-04-25T15:46:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.654+0000 7fa1c4d6c640 1 -- 172.21.15.59:0/3311790958 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fa1a00744e0 msgr2=0x7fa1a00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.654+0000 7fa1c4d6c640 1 --2- 172.21.15.59:0/3311790958 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fa1a00744e0 0x7fa1a00769f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0000f60 tx=0x7fa1b0009040 comp rx=0 tx=0).stop 2024-04-25T15:46:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.654+0000 7fa1c4d6c640 1 -- 172.21.15.59:0/3311790958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1c0160600 msgr2=0x7fa1c014c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.654+0000 7fa1c4d6c640 1 --2- 172.21.15.59:0/3311790958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1c0160600 0x7fa1c014c570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa1b802ad70 tx=0x7fa1b8004a40 comp rx=0 tx=0).stop 2024-04-25T15:46:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.654+0000 7fa1c4d6c640 1 -- 172.21.15.59:0/3311790958 shutdown_connections 2024-04-25T15:46:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.654+0000 7fa1c4d6c640 1 --2- 172.21.15.59:0/3311790958 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fa1a00744e0 0x7fa1a00769f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.654+0000 7fa1c4d6c640 1 --2- 172.21.15.59:0/3311790958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1c0160600 0x7fa1c014c570 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.654+0000 7fa1c4d6c640 1 --2- 172.21.15.59:0/3311790958 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa1c00b5220 0x7fa1c00d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.654+0000 7fa1c4d6c640 1 --2- 172.21.15.59:0/3311790958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1c00b4670 0x7fa1c00c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.654+0000 7fa1c4d6c640 1 -- 172.21.15.59:0/3311790958 >> 172.21.15.59:0/3311790958 conn(0x7fa1c006f300 msgr2=0x7fa1c014e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.654+0000 7fa1c4d6c640 1 -- 172.21.15.59:0/3311790958 shutdown_connections 2024-04-25T15:46:31.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.654+0000 7fa1c4d6c640 1 -- 172.21.15.59:0/3311790958 wait complete. 2024-04-25T15:46:31.667 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T15:46:31.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.798+0000 7fd222396640 1 Processor -- start 2024-04-25T15:46:31.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.798+0000 7fd222396640 1 -- start start 2024-04-25T15:46:31.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.800+0000 7fd222396640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd21c0b5590 0x7fd21c0b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.800+0000 7fd222396640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd21c15fce0 0x7fd21c1600f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.800+0000 7fd222396640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd21c15c5b0 con 0x7fd21c0b6a20 2024-04-25T15:46:31.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.800+0000 7fd222396640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd21c0b6e30 con 0x7fd21c0b5590 2024-04-25T15:46:31.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.800+0000 7fd222396640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fd21c15d480 con 0x7fd21c15fce0 2024-04-25T15:46:31.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.820+0000 7fd21b7fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd21c0b5590 0x7fd21c0b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.825+0000 7fd21b7fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd21c0b5590 0x7fd21c0b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60934/0 (socket says 172.21.15.59:60934) 2024-04-25T15:46:31.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.825+0000 7fd21b7fe640 1 -- 172.21.15.59:0/1895816374 learned_addr learned my addr 172.21.15.59:0/1895816374 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:31.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.828+0000 7fd21b7fe640 1 -- 172.21.15.59:0/1895816374 >> v2:172.21.15.64:3300/0 conn(0x7fd21c15fce0 msgr2=0x7fd21c1600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:31.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.828+0000 7fd21b7fe640 1 --2- 172.21.15.59:0/1895816374 >> v2:172.21.15.64:3300/0 conn(0x7fd21c15fce0 0x7fd21c1600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.828+0000 7fd21b7fe640 1 -- 172.21.15.59:0/1895816374 >> v1:172.21.15.59:6789/0 conn(0x7fd21c0b6a20 legacy=0x7fd21c08d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:31.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.828+0000 7fd21b7fe640 1 -- 172.21.15.59:0/1895816374 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c15c870 con 0x7fd21c0b5590 2024-04-25T15:46:31.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.830+0000 7fd21b7fe640 1 --2- 172.21.15.59:0/1895816374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21c0b5590 0x7fd21c0b59a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd21c08fb10 tx=0x7fd20402a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7092279d54bd254 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:31.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.834+0000 7fd21affd640 1 -- 172.21.15.59:0/1895816374 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204037070 con 0x7fd21c0b5590 2024-04-25T15:46:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.836+0000 7fd21affd640 1 -- 172.21.15.59:0/1895816374 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd204032440 con 0x7fd21c0b5590 2024-04-25T15:46:31.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.836+0000 7fd21affd640 1 -- 172.21.15.59:0/1895816374 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204032810 con 0x7fd21c0b5590 2024-04-25T15:46:31.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.837+0000 7fd222396640 1 -- 172.21.15.59:0/1895816374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21c0b5590 msgr2=0x7fd21c0b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.837+0000 7fd222396640 1 --2- 172.21.15.59:0/1895816374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21c0b5590 0x7fd21c0b59a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd21c08fb10 tx=0x7fd20402a290 comp rx=0 tx=0).stop 2024-04-25T15:46:31.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.837+0000 7fd222396640 1 -- 172.21.15.59:0/1895816374 shutdown_connections 2024-04-25T15:46:31.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.837+0000 7fd222396640 1 --2- 172.21.15.59:0/1895816374 >> v2:172.21.15.64:3300/0 conn(0x7fd21c15fce0 0x7fd21c1600f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.837+0000 7fd222396640 1 --2- 172.21.15.59:0/1895816374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21c0b5590 0x7fd21c0b59a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.837+0000 7fd222396640 1 -- 172.21.15.59:0/1895816374 >> 172.21.15.59:0/1895816374 conn(0x7fd21c0684e0 msgr2=0x7fd21c0688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:31.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.837+0000 7fd222396640 1 -- 172.21.15.59:0/1895816374 shutdown_connections 2024-04-25T15:46:31.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.837+0000 7fd222396640 1 -- 172.21.15.59:0/1895816374 wait complete. 2024-04-25T15:46:31.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.839+0000 7fd222396640 1 Processor -- start 2024-04-25T15:46:31.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.839+0000 7fd222396640 1 -- start start 2024-04-25T15:46:31.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.840+0000 7fd222396640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd21c0b5590 0x7fd21c1523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.840+0000 7fd222396640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21c0b6a20 0x7fd21c152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.840+0000 7fd222396640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd21c15fce0 0x7fd21c146470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:31.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.840+0000 7fd222396640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c15d110 con 0x7fd21c0b6a20 2024-04-25T15:46:31.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.840+0000 7fd222396640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c15ce30 con 0x7fd21c0b5590 2024-04-25T15:46:31.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.840+0000 7fd222396640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd21c0b5ee0 con 0x7fd21c15fce0 2024-04-25T15:46:31.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.841+0000 7fd220933640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd21c15fce0 0x7fd21c146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.841+0000 7fd220933640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd21c15fce0 0x7fd21c146470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:35380/0 (socket says 172.21.15.59:35380) 2024-04-25T15:46:31.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.841+0000 7fd220933640 1 -- 172.21.15.59:0/1690565850 learned_addr learned my addr 172.21.15.59:0/1690565850 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:31.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.843+0000 7fd21b7fe640 1 --2- 172.21.15.59:0/1690565850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21c0b6a20 0x7fd21c152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:31.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.846+0000 7fd220933640 1 -- 172.21.15.59:0/1690565850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd21c0b5590 msgr2=0x7fd21c1523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.846+0000 7fd220933640 1 --2- 172.21.15.59:0/1690565850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd21c0b5590 0x7fd21c1523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.846+0000 7fd220933640 1 -- 172.21.15.59:0/1690565850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21c0b6a20 msgr2=0x7fd21c152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:31.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.846+0000 7fd220933640 1 --2- 172.21.15.59:0/1690565850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21c0b6a20 0x7fd21c152900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:31.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.846+0000 7fd220933640 1 -- 172.21.15.59:0/1690565850 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c1f6890 con 0x7fd21c15fce0 2024-04-25T15:46:31.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.849+0000 7fd220933640 1 --2- 172.21.15.59:0/1690565850 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd21c15fce0 0x7fd21c146470 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd21400ba10 tx=0x7fd21400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:31.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.853+0000 7fd218ff9640 1 -- 172.21.15.59:0/1690565850 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214019070 con 0x7fd21c15fce0 2024-04-25T15:46:31.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.853+0000 7fd218ff9640 1 -- 172.21.15.59:0/1690565850 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd21400cb40 con 0x7fd21c15fce0 2024-04-25T15:46:31.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.853+0000 7fd222396640 1 -- 172.21.15.59:0/1690565850 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21c1f2880 con 0x7fd21c15fce0 2024-04-25T15:46:31.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.853+0000 7fd218ff9640 1 -- 172.21.15.59:0/1690565850 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214014440 con 0x7fd21c15fce0 2024-04-25T15:46:31.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.853+0000 7fd222396640 1 -- 172.21.15.59:0/1690565850 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd21c15a770 con 0x7fd21c15fce0 2024-04-25T15:46:31.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:31.854+0000 7fd222396640 1 -- 172.21.15.59:0/1690565850 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd21c1f2670 con 0x7fd21c15fce0 2024-04-25T15:46:32.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:32.257+0000 7fd218ff9640 1 -- 172.21.15.59:0/1690565850 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd21401c070 con 0x7fd21c15fce0 2024-04-25T15:46:32.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:32.257+0000 7fd218ff9640 1 --2- 172.21.15.59:0/1690565850 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd1fc0744b0 0x7fd1fc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:32.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:32.257+0000 7fd218ff9640 1 -- 172.21.15.59:0/1690565850 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7fd2140953d0 con 0x7fd21c15fce0 2024-04-25T15:46:32.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:32.257+0000 7fd21bfff640 1 --2- 172.21.15.59:0/1690565850 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd1fc0744b0 0x7fd1fc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:32.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:32.258+0000 7fd21bfff640 1 --2- 172.21.15.59:0/1690565850 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd1fc0744b0 0x7fd1fc0769c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd20c006fd0 tx=0x7fd20c006bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:32.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:32.278+0000 7fd218ff9640 1 -- 172.21.15.59:0/1690565850 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd214023020 con 0x7fd21c15fce0 2024-04-25T15:46:32.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:32.522+0000 7fd222396640 1 -- 172.21.15.59:0/1690565850 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd21c1f65f0 con 0x7fd21c15fce0 2024-04-25T15:46:33.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.418+0000 7fd218ff9640 1 -- 172.21.15.59:0/1690565850 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fd21c1f65f0 con 0x7fd21c15fce0 2024-04-25T15:46:33.419 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T15:46:33.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.420+0000 7fd222396640 1 -- 172.21.15.59:0/1690565850 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd1fc0744b0 msgr2=0x7fd1fc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.420+0000 7fd222396640 1 --2- 172.21.15.59:0/1690565850 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd1fc0744b0 0x7fd1fc0769c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd20c006fd0 tx=0x7fd20c006bc0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.420+0000 7fd222396640 1 -- 172.21.15.59:0/1690565850 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd21c15fce0 msgr2=0x7fd21c146470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.420+0000 7fd222396640 1 --2- 172.21.15.59:0/1690565850 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd21c15fce0 0x7fd21c146470 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd21400ba10 tx=0x7fd21400bed0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.420+0000 7fd222396640 1 -- 172.21.15.59:0/1690565850 shutdown_connections 2024-04-25T15:46:33.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.420+0000 7fd222396640 1 --2- 172.21.15.59:0/1690565850 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd1fc0744b0 0x7fd1fc0769c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.420+0000 7fd222396640 1 --2- 172.21.15.59:0/1690565850 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd21c15fce0 0x7fd21c146470 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.420+0000 7fd222396640 1 --2- 172.21.15.59:0/1690565850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd21c0b6a20 0x7fd21c152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.420+0000 7fd222396640 1 --2- 172.21.15.59:0/1690565850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd21c0b5590 0x7fd21c1523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.420+0000 7fd222396640 1 -- 172.21.15.59:0/1690565850 >> 172.21.15.59:0/1690565850 conn(0x7fd21c0684e0 msgr2=0x7fd21c0cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:33.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.420+0000 7fd222396640 1 -- 172.21.15.59:0/1690565850 shutdown_connections 2024-04-25T15:46:33.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.420+0000 7fd222396640 1 -- 172.21.15.59:0/1690565850 wait complete. 2024-04-25T15:46:33.433 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:33.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.544+0000 7f0043f8f640 1 Processor -- start 2024-04-25T15:46:33.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.545+0000 7f0043f8f640 1 -- start start 2024-04-25T15:46:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.546+0000 7f0043f8f640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f003c0ce7c0 0x7f003c0ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.546+0000 7f0043f8f640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f003c0c49d0 con 0x7f003c150f50 2024-04-25T15:46:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.546+0000 7f0043f8f640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f003c0c4cb0 con 0x7f003c151360 2024-04-25T15:46:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.546+0000 7f0043f8f640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f003c068d30 con 0x7f003c0ce7c0 2024-04-25T15:46:33.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.547+0000 7f0041d2b640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f003c0ce7c0 0x7f003c0ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.547+0000 7f004252c640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f003c151360 0x7f003c15dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.59:36620/0 (socket says 172.21.15.59:36620) 2024-04-25T15:46:33.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.547+0000 7f004252c640 1 -- 172.21.15.59:0/4148348468 learned_addr learned my addr 172.21.15.59:0/4148348468 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:33.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.549+0000 7f0040d29640 1 -- 172.21.15.59:0/4148348468 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3277894288 0 0) 0x7f003c0c4cb0 con 0x7f003c151360 2024-04-25T15:46:33.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.550+0000 7f0040d29640 1 -- 172.21.15.59:0/4148348468 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0028003520 con 0x7f003c151360 2024-04-25T15:46:33.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.550+0000 7f0041d2b640 1 -- 172.21.15.59:0/4148348468 >> v1:172.21.15.64:6789/0 conn(0x7f003c151360 legacy=0x7f003c15dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.550+0000 7f0041d2b640 1 -- 172.21.15.59:0/4148348468 >> v1:172.21.15.59:6789/0 conn(0x7f003c150f50 legacy=0x7f003c0c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.550+0000 7f0041d2b640 1 -- 172.21.15.59:0/4148348468 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c0686e0 con 0x7f003c0ce7c0 2024-04-25T15:46:33.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.555+0000 7f0041d2b640 1 --2- 172.21.15.59:0/4148348468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c0ce7c0 0x7f003c0ca210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f00380097a0 tx=0x7f003802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb8d8d69a682505 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.560+0000 7f0040d29640 1 -- 172.21.15.59:0/4148348468 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0038037070 con 0x7f003c0ce7c0 2024-04-25T15:46:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.561+0000 7f0040d29640 1 -- 172.21.15.59:0/4148348468 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0038032440 con 0x7f003c0ce7c0 2024-04-25T15:46:33.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.561+0000 7f0040d29640 1 -- 172.21.15.59:0/4148348468 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0038032810 con 0x7f003c0ce7c0 2024-04-25T15:46:33.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.561+0000 7f0043f8f640 1 -- 172.21.15.59:0/4148348468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c0ce7c0 msgr2=0x7f003c0ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.561+0000 7f0043f8f640 1 --2- 172.21.15.59:0/4148348468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c0ce7c0 0x7f003c0ca210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f00380097a0 tx=0x7f003802a230 comp rx=0 tx=0).stop 2024-04-25T15:46:33.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.561+0000 7f0043f8f640 1 -- 172.21.15.59:0/4148348468 shutdown_connections 2024-04-25T15:46:33.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.561+0000 7f0043f8f640 1 --2- 172.21.15.59:0/4148348468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c0ce7c0 0x7f003c0ca210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.561+0000 7f0043f8f640 1 -- 172.21.15.59:0/4148348468 >> 172.21.15.59:0/4148348468 conn(0x7f003c0cdca0 msgr2=0x7f003c0ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:33.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.562+0000 7f0043f8f640 1 -- 172.21.15.59:0/4148348468 shutdown_connections 2024-04-25T15:46:33.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.562+0000 7f0043f8f640 1 -- 172.21.15.59:0/4148348468 wait complete. 2024-04-25T15:46:33.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.563+0000 7f0043f8f640 1 Processor -- start 2024-04-25T15:46:33.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.563+0000 7f0043f8f640 1 -- start start 2024-04-25T15:46:33.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.564+0000 7f0043f8f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f003c0ce7c0 0x7f003c15ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.565+0000 7f0043f8f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c150f50 0x7f003c1f4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.565+0000 7f0043f8f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f003c151360 0x7f003c0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.565+0000 7f0043f8f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f003c0b9bf0 con 0x7f003c150f50 2024-04-25T15:46:33.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.565+0000 7f0043f8f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f003c0b9910 con 0x7f003c151360 2024-04-25T15:46:33.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.565+0000 7f0043f8f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f003c0c9e60 con 0x7f003c0ce7c0 2024-04-25T15:46:33.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.565+0000 7f004152a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c150f50 0x7f003c1f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.565+0000 7f004252c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f003c151360 0x7f003c0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.565+0000 7f004152a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c150f50 0x7f003c1f4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60966/0 (socket says 172.21.15.59:60966) 2024-04-25T15:46:33.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.565+0000 7f004152a640 1 -- 172.21.15.59:0/3689358016 learned_addr learned my addr 172.21.15.59:0/3689358016 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:33.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.569+0000 7f0041d2b640 1 --2- 172.21.15.59:0/3689358016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f003c0ce7c0 0x7f003c15ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.570+0000 7f004152a640 1 -- 172.21.15.59:0/3689358016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f003c0ce7c0 msgr2=0x7f003c15ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.570+0000 7f004152a640 1 --2- 172.21.15.59:0/3689358016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f003c0ce7c0 0x7f003c15ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.570+0000 7f004152a640 1 -- 172.21.15.59:0/3689358016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f003c151360 msgr2=0x7f003c0ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:33.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.570+0000 7f004152a640 1 --2- 172.21.15.59:0/3689358016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f003c151360 0x7f003c0ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:33.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.570+0000 7f004152a640 1 -- 172.21.15.59:0/3689358016 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c1f0590 con 0x7f003c150f50 2024-04-25T15:46:33.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.570+0000 7f0041d2b640 1 --2- 172.21.15.59:0/3689358016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f003c0ce7c0 0x7f003c15ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:33.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.572+0000 7f004152a640 1 --2- 172.21.15.59:0/3689358016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c150f50 0x7f003c1f4640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f002c00c3f0 tx=0x7f002c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:33.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.576+0000 7f00327fc640 1 -- 172.21.15.59:0/3689358016 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c0052d0 con 0x7f003c150f50 2024-04-25T15:46:33.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.576+0000 7f00327fc640 1 -- 172.21.15.59:0/3689358016 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f002c005490 con 0x7f003c150f50 2024-04-25T15:46:33.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.576+0000 7f00327fc640 1 -- 172.21.15.59:0/3689358016 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c007260 con 0x7f003c150f50 2024-04-25T15:46:33.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.576+0000 7f0043f8f640 1 -- 172.21.15.59:0/3689358016 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003c1f3ba0 con 0x7f003c150f50 2024-04-25T15:46:33.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.576+0000 7f0043f8f640 1 -- 172.21.15.59:0/3689358016 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f003c1f3e40 con 0x7f003c150f50 2024-04-25T15:46:33.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.577+0000 7f0043f8f640 1 -- 172.21.15.59:0/3689358016 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f003c069fb0 con 0x7f003c150f50 2024-04-25T15:46:33.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.601+0000 7f00327fc640 1 -- 172.21.15.59:0/3689358016 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f002c007400 con 0x7f003c150f50 2024-04-25T15:46:33.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.601+0000 7f00327fc640 1 --2- 172.21.15.59:0/3689358016 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f0020074530 0x7f0020076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:33.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.602+0000 7f0041d2b640 1 --2- 172.21.15.59:0/3689358016 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f0020074530 0x7f0020076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:33.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.602+0000 7f0041d2b640 1 --2- 172.21.15.59:0/3689358016 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f0020074530 0x7f0020076a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0038034000 tx=0x7f003802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.611+0000 7f00327fc640 1 -- 172.21.15.59:0/3689358016 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f002c05ae70 con 0x7f003c150f50 2024-04-25T15:46:33.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:33.891+0000 7f00327fc640 1 -- 172.21.15.59:0/3689358016 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f002c05ebe0 con 0x7f003c150f50 2024-04-25T15:46:34.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.083+0000 7f0043f8f640 1 -- 172.21.15.59:0/3689358016 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f003c0c8d70 con 0x7f003c150f50 2024-04-25T15:46:34.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.255+0000 7f00327fc640 1 -- 172.21.15.59:0/3689358016 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16545 (secure 0 0 0) 0x7f002c067220 con 0x7f003c150f50 2024-04-25T15:46:34.257 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:34.258 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":22,"fsid":"9bb5d7ca-5217-467b-882c-0a18cd57f08f","created":"2024-04-25T15:46:00.198001+0000","modified":"2024-04-25T15:46:33.915756+0000","last_up_change":"2024-04-25T15:46:15.850827+0000","last_in_change":"2024-04-25T15:46:06.311980+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:46:16.936340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:30.174141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:31.372481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34cee654-11dd-4f4b-99fe-093462f8abad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6803","nonce":1314235095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6805","nonce":1314235095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6809","nonce":1314235095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6807","nonce":1314235095}]},"public_addr":"172.21.15.59:6803/1314235095","cluster_addr":"172.21.15.59:6805/1314235095","heartbeat_back_addr":"172.21.15.59:6809/1314235095","heartbeat_front_addr":"172.21.15.59:6807/1314235095","state":["exists","up"]},{"osd":1,"uuid":"3c15505b-4abd-4a24-b30c-edc2732f8ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6827","nonce":3550810151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6829","nonce":3550810151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6833","nonce":3550810151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6831","nonce":3550810151}]},"public_addr":"172.21.15.59:6827/3550810151","cluster_addr":"172.21.15.59:6829/3550810151","heartbeat_back_addr":"172.21.15.59:6833/3550810151","heartbeat_front_addr":"172.21.15.59:6831/3550810151","state":["exists","up"]},{"osd":2,"uuid":"5884bf21-e6b4-4813-b8bc-6baa92443c87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6811","nonce":1651189093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6813","nonce":1651189093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6817","nonce":1651189093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6815","nonce":1651189093}]},"public_addr":"172.21.15.59:6811/1651189093","cluster_addr":"172.21.15.59:6813/1651189093","heartbeat_back_addr":"172.21.15.59:6817/1651189093","heartbeat_front_addr":"172.21.15.59:6815/1651189093","state":["exists","up"]},{"osd":3,"uuid":"6ff71700-3b00-4350-b3c9-f6c41ec46b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6819","nonce":1300858236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6821","nonce":1300858236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6825","nonce":1300858236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6823","nonce":1300858236}]},"public_addr":"172.21.15.59:6819/1300858236","cluster_addr":"172.21.15.59:6821/1300858236","heartbeat_back_addr":"172.21.15.59:6825/1300858236","heartbeat_front_addr":"172.21.15.59:6823/1300858236","state":["exists","up"]},{"osd":4,"uuid":"d0a72143-93fd-4712-aadb-f3fade303426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6817","nonce":2206186554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6819","nonce":2206186554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6823","nonce":2206186554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6821","nonce":2206186554}]},"public_addr":"172.21.15.64:6817/2206186554","cluster_addr":"172.21.15.64:6819/2206186554","heartbeat_back_addr":"172.21.15.64:6823/2206186554","heartbeat_front_addr":"172.21.15.64:6821/2206186554","state":["exists","up"]},{"osd":5,"uuid":"9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6825","nonce":639697697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6827","nonce":639697697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6831","nonce":639697697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6829","nonce":639697697}]},"public_addr":"172.21.15.64:6825/639697697","cluster_addr":"172.21.15.64:6827/639697697","heartbeat_back_addr":"172.21.15.64:6831/639697697","heartbeat_front_addr":"172.21.15.64:6829/639697697","state":["exists","up"]},{"osd":6,"uuid":"311d9a6b-8fbc-4809-8d33-b9248a3562f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6809","nonce":2335675289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6811","nonce":2335675289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6815","nonce":2335675289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6813","nonce":2335675289}]},"public_addr":"172.21.15.64:6809/2335675289","cluster_addr":"172.21.15.64:6811/2335675289","heartbeat_back_addr":"172.21.15.64:6815/2335675289","heartbeat_front_addr":"172.21.15.64:6813/2335675289","state":["exists","up"]},{"osd":7,"uuid":"d0f7436e-882f-4aa7-b2ae-684b9894b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6801","nonce":970439753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6803","nonce":970439753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6807","nonce":970439753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6805","nonce":970439753}]},"public_addr":"172.21.15.64:6801/970439753","cluster_addr":"172.21.15.64:6803/970439753","heartbeat_back_addr":"172.21.15.64:6807/970439753","heartbeat_front_addr":"172.21.15.64:6805/970439753","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.807777+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.945589+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.926832+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.943537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.925062+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.957550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.913559+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.839159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:34.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.258+0000 7f0043f8f640 1 -- 172.21.15.59:0/3689358016 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f0020074530 msgr2=0x7f0020076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.258+0000 7f0043f8f640 1 --2- 172.21.15.59:0/3689358016 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f0020074530 0x7f0020076a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0038034000 tx=0x7f003802e000 comp rx=0 tx=0).stop 2024-04-25T15:46:34.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.258+0000 7f0043f8f640 1 -- 172.21.15.59:0/3689358016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c150f50 msgr2=0x7f003c1f4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.258+0000 7f0043f8f640 1 --2- 172.21.15.59:0/3689358016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c150f50 0x7f003c1f4640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f002c00c3f0 tx=0x7f002c00c7f0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.258+0000 7f0043f8f640 1 -- 172.21.15.59:0/3689358016 shutdown_connections 2024-04-25T15:46:34.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.258+0000 7f0043f8f640 1 --2- 172.21.15.59:0/3689358016 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f0020074530 0x7f0020076a40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.258+0000 7f0043f8f640 1 --2- 172.21.15.59:0/3689358016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f003c151360 0x7f003c0ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.258+0000 7f0043f8f640 1 --2- 172.21.15.59:0/3689358016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c150f50 0x7f003c1f4640 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.258+0000 7f0043f8f640 1 --2- 172.21.15.59:0/3689358016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f003c0ce7c0 0x7f003c15ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.258+0000 7f0043f8f640 1 -- 172.21.15.59:0/3689358016 >> 172.21.15.59:0/3689358016 conn(0x7f003c0cdca0 msgr2=0x7f003c14cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:34.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.258+0000 7f0043f8f640 1 -- 172.21.15.59:0/3689358016 shutdown_connections 2024-04-25T15:46:34.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.258+0000 7f0043f8f640 1 -- 172.21.15.59:0/3689358016 wait complete. 2024-04-25T15:46:34.270 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:34.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.387+0000 7f22f4fc5640 1 Processor -- start 2024-04-25T15:46:34.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.387+0000 7f22f4fc5640 1 -- start start 2024-04-25T15:46:34.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.388+0000 7f22f4fc5640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f22f00cec50 0x7f22f015c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.388+0000 7f22f4fc5640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22f015cd60 con 0x7f22f015c1b0 2024-04-25T15:46:34.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.388+0000 7f22f4fc5640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22f015d040 con 0x7f22f00b41c0 2024-04-25T15:46:34.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.388+0000 7f22f4fc5640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f22f015cb00 con 0x7f22f00cec50 2024-04-25T15:46:34.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.389+0000 7f22eed9d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f22f00cec50 0x7f22f015c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.389+0000 7f22ee59c640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f22f00b41c0 0x7f22f00cd140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.59:45648/0 (socket says 172.21.15.59:45648) 2024-04-25T15:46:34.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.389+0000 7f22ee59c640 1 -- 172.21.15.59:0/2141896336 learned_addr learned my addr 172.21.15.59:0/2141896336 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:34.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.391+0000 7f22edd9b640 1 -- 172.21.15.59:0/2141896336 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2845799527 0 0) 0x7f22f015d040 con 0x7f22f00b41c0 2024-04-25T15:46:34.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.392+0000 7f22edd9b640 1 -- 172.21.15.59:0/2141896336 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22dc003520 con 0x7f22f00b41c0 2024-04-25T15:46:34.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.393+0000 7f22eed9d640 1 -- 172.21.15.59:0/2141896336 >> v1:172.21.15.64:6789/0 conn(0x7f22f00b41c0 legacy=0x7f22f00cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.393+0000 7f22eed9d640 1 -- 172.21.15.59:0/2141896336 >> v1:172.21.15.59:6789/0 conn(0x7f22f015c1b0 legacy=0x7f22f00ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.393+0000 7f22eed9d640 1 -- 172.21.15.59:0/2141896336 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f015d320 con 0x7f22f00cec50 2024-04-25T15:46:34.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.397+0000 7f22eed9d640 1 --2- 172.21.15.59:0/2141896336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22f00cec50 0x7f22f015c5c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009d90 tx=0x7f22e802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31dc2d381505726 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:34.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.402+0000 7f22edd9b640 1 -- 172.21.15.59:0/2141896336 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8007740 con 0x7f22f00cec50 2024-04-25T15:46:34.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.402+0000 7f22edd9b640 1 -- 172.21.15.59:0/2141896336 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22e80078e0 con 0x7f22f00cec50 2024-04-25T15:46:34.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.402+0000 7f22edd9b640 1 -- 172.21.15.59:0/2141896336 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8007cb0 con 0x7f22f00cec50 2024-04-25T15:46:34.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.403+0000 7f22f4fc5640 1 -- 172.21.15.59:0/2141896336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22f00cec50 msgr2=0x7f22f015c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.403+0000 7f22f4fc5640 1 --2- 172.21.15.59:0/2141896336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22f00cec50 0x7f22f015c5c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009d90 tx=0x7f22e802a6f0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.403+0000 7f22f4fc5640 1 -- 172.21.15.59:0/2141896336 shutdown_connections 2024-04-25T15:46:34.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.403+0000 7f22f4fc5640 1 --2- 172.21.15.59:0/2141896336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22f00cec50 0x7f22f015c5c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.403+0000 7f22f4fc5640 1 -- 172.21.15.59:0/2141896336 >> 172.21.15.59:0/2141896336 conn(0x7f22f006ed70 msgr2=0x7f22f006f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:34.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.403+0000 7f22f4fc5640 1 -- 172.21.15.59:0/2141896336 shutdown_connections 2024-04-25T15:46:34.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.403+0000 7f22f4fc5640 1 -- 172.21.15.59:0/2141896336 wait complete. 2024-04-25T15:46:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.405+0000 7f22f4fc5640 1 Processor -- start 2024-04-25T15:46:34.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.405+0000 7f22f4fc5640 1 -- start start 2024-04-25T15:46:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.406+0000 7f22f4fc5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22f00b41c0 0x7f22f0160920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.406+0000 7f22f4fc5640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22f00cec50 0x7f22f01f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.406+0000 7f22f4fc5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22f015c1b0 0x7f22f00c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.406+0000 7f22f4fc5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f22f00b78a0 con 0x7f22f015c1b0 2024-04-25T15:46:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.406+0000 7f22f4fc5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f22f00ce020 con 0x7f22f00b41c0 2024-04-25T15:46:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.406+0000 7f22f4fc5640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f22f00c51e0 con 0x7f22f00cec50 2024-04-25T15:46:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.407+0000 7f22eed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22f015c1b0 0x7f22f00c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.407+0000 7f22ee59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22f00b41c0 0x7f22f0160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.407+0000 7f22e7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22f00cec50 0x7f22f01f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.407+0000 7f22e7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22f00cec50 0x7f22f01f2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:38316/0 (socket says 172.21.15.59:38316) 2024-04-25T15:46:34.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.407+0000 7f22e7fff640 1 -- 172.21.15.59:0/3779533866 learned_addr learned my addr 172.21.15.59:0/3779533866 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:34.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.411+0000 7f22eed9d640 1 -- 172.21.15.59:0/3779533866 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22f00cec50 msgr2=0x7f22f01f2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.411+0000 7f22eed9d640 1 --2- 172.21.15.59:0/3779533866 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22f00cec50 0x7f22f01f2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.411+0000 7f22eed9d640 1 -- 172.21.15.59:0/3779533866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22f00b41c0 msgr2=0x7f22f0160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.411+0000 7f22eed9d640 1 --2- 172.21.15.59:0/3779533866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22f00b41c0 0x7f22f0160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.411+0000 7f22eed9d640 1 -- 172.21.15.59:0/3779533866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f015e8e0 con 0x7f22f015c1b0 2024-04-25T15:46:34.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.413+0000 7f22eed9d640 1 --2- 172.21.15.59:0/3779533866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22f015c1b0 0x7f22f00c9680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f22e8031000 tx=0x7f22e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:34.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.417+0000 7f22e6ffd640 1 -- 172.21.15.59:0/3779533866 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e803f070 con 0x7f22f015c1b0 2024-04-25T15:46:34.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.417+0000 7f22e6ffd640 1 -- 172.21.15.59:0/3779533866 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22e8031ac0 con 0x7f22f015c1b0 2024-04-25T15:46:34.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.417+0000 7f22f4fc5640 1 -- 172.21.15.59:0/3779533866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f0157040 con 0x7f22f015c1b0 2024-04-25T15:46:34.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.418+0000 7f22e6ffd640 1 -- 172.21.15.59:0/3779533866 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8044460 con 0x7f22f015c1b0 2024-04-25T15:46:34.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.418+0000 7f22f4fc5640 1 -- 172.21.15.59:0/3779533866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f015de00 con 0x7f22f015c1b0 2024-04-25T15:46:34.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.418+0000 7f22f4fc5640 1 -- 172.21.15.59:0/3779533866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f0156db0 con 0x7f22f015c1b0 2024-04-25T15:46:34.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.718+0000 7f22e6ffd640 1 -- 172.21.15.59:0/3779533866 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f22e803b410 con 0x7f22f015c1b0 2024-04-25T15:46:34.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.719+0000 7f22e6ffd640 1 --2- 172.21.15.59:0/3779533866 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f22d0074530 0x7f22d0076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:34.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.719+0000 7f22ee59c640 1 --2- 172.21.15.59:0/3779533866 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f22d0074530 0x7f22d0076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:34.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.719+0000 7f22ee59c640 1 --2- 172.21.15.59:0/3779533866 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f22d0074530 0x7f22d0076a40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22e00011e0 tx=0x7f22e0007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:34.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.734+0000 7f22e6ffd640 1 -- 172.21.15.59:0/3779533866 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f22e8007840 con 0x7f22f015c1b0 2024-04-25T15:46:34.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.734+0000 7f22e6ffd640 1 -- 172.21.15.59:0/3779533866 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f22e8053080 con 0x7f22f015c1b0 2024-04-25T15:46:34.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.920+0000 7f22f4fc5640 1 -- 172.21.15.59:0/3779533866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22f0074740 con 0x7f22f015c1b0 2024-04-25T15:46:34.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.964+0000 7f22e6ffd640 1 -- 172.21.15.59:0/3779533866 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16545 (secure 0 0 0) 0x7f22f0074740 con 0x7f22f015c1b0 2024-04-25T15:46:34.966 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:34.966 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":22,"fsid":"9bb5d7ca-5217-467b-882c-0a18cd57f08f","created":"2024-04-25T15:46:00.198001+0000","modified":"2024-04-25T15:46:33.915756+0000","last_up_change":"2024-04-25T15:46:15.850827+0000","last_in_change":"2024-04-25T15:46:06.311980+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:46:16.936340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:30.174141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:31.372481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34cee654-11dd-4f4b-99fe-093462f8abad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6803","nonce":1314235095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6805","nonce":1314235095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6809","nonce":1314235095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6807","nonce":1314235095}]},"public_addr":"172.21.15.59:6803/1314235095","cluster_addr":"172.21.15.59:6805/1314235095","heartbeat_back_addr":"172.21.15.59:6809/1314235095","heartbeat_front_addr":"172.21.15.59:6807/1314235095","state":["exists","up"]},{"osd":1,"uuid":"3c15505b-4abd-4a24-b30c-edc2732f8ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6827","nonce":3550810151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6829","nonce":3550810151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6833","nonce":3550810151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6831","nonce":3550810151}]},"public_addr":"172.21.15.59:6827/3550810151","cluster_addr":"172.21.15.59:6829/3550810151","heartbeat_back_addr":"172.21.15.59:6833/3550810151","heartbeat_front_addr":"172.21.15.59:6831/3550810151","state":["exists","up"]},{"osd":2,"uuid":"5884bf21-e6b4-4813-b8bc-6baa92443c87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6811","nonce":1651189093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6813","nonce":1651189093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6817","nonce":1651189093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6815","nonce":1651189093}]},"public_addr":"172.21.15.59:6811/1651189093","cluster_addr":"172.21.15.59:6813/1651189093","heartbeat_back_addr":"172.21.15.59:6817/1651189093","heartbeat_front_addr":"172.21.15.59:6815/1651189093","state":["exists","up"]},{"osd":3,"uuid":"6ff71700-3b00-4350-b3c9-f6c41ec46b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6819","nonce":1300858236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6821","nonce":1300858236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6825","nonce":1300858236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6823","nonce":1300858236}]},"public_addr":"172.21.15.59:6819/1300858236","cluster_addr":"172.21.15.59:6821/1300858236","heartbeat_back_addr":"172.21.15.59:6825/1300858236","heartbeat_front_addr":"172.21.15.59:6823/1300858236","state":["exists","up"]},{"osd":4,"uuid":"d0a72143-93fd-4712-aadb-f3fade303426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6817","nonce":2206186554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6819","nonce":2206186554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6823","nonce":2206186554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6821","nonce":2206186554}]},"public_addr":"172.21.15.64:6817/2206186554","cluster_addr":"172.21.15.64:6819/2206186554","heartbeat_back_addr":"172.21.15.64:6823/2206186554","heartbeat_front_addr":"172.21.15.64:6821/2206186554","state":["exists","up"]},{"osd":5,"uuid":"9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6825","nonce":639697697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6827","nonce":639697697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6831","nonce":639697697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6829","nonce":639697697}]},"public_addr":"172.21.15.64:6825/639697697","cluster_addr":"172.21.15.64:6827/639697697","heartbeat_back_addr":"172.21.15.64:6831/639697697","heartbeat_front_addr":"172.21.15.64:6829/639697697","state":["exists","up"]},{"osd":6,"uuid":"311d9a6b-8fbc-4809-8d33-b9248a3562f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6809","nonce":2335675289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6811","nonce":2335675289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6815","nonce":2335675289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6813","nonce":2335675289}]},"public_addr":"172.21.15.64:6809/2335675289","cluster_addr":"172.21.15.64:6811/2335675289","heartbeat_back_addr":"172.21.15.64:6815/2335675289","heartbeat_front_addr":"172.21.15.64:6813/2335675289","state":["exists","up"]},{"osd":7,"uuid":"d0f7436e-882f-4aa7-b2ae-684b9894b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6801","nonce":970439753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6803","nonce":970439753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6807","nonce":970439753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6805","nonce":970439753}]},"public_addr":"172.21.15.64:6801/970439753","cluster_addr":"172.21.15.64:6803/970439753","heartbeat_back_addr":"172.21.15.64:6807/970439753","heartbeat_front_addr":"172.21.15.64:6805/970439753","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.807777+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.945589+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.926832+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.943537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.925062+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.957550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.913559+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.839159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:34.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.967+0000 7f22f4fc5640 1 -- 172.21.15.59:0/3779533866 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f22d0074530 msgr2=0x7f22d0076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.967+0000 7f22f4fc5640 1 --2- 172.21.15.59:0/3779533866 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f22d0074530 0x7f22d0076a40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22e00011e0 tx=0x7f22e0007d30 comp rx=0 tx=0).stop 2024-04-25T15:46:34.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.967+0000 7f22f4fc5640 1 -- 172.21.15.59:0/3779533866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22f015c1b0 msgr2=0x7f22f00c9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:34.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.967+0000 7f22f4fc5640 1 --2- 172.21.15.59:0/3779533866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22f015c1b0 0x7f22f00c9680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f22e8031000 tx=0x7f22e8004a40 comp rx=0 tx=0).stop 2024-04-25T15:46:34.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.967+0000 7f22f4fc5640 1 -- 172.21.15.59:0/3779533866 shutdown_connections 2024-04-25T15:46:34.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.967+0000 7f22f4fc5640 1 --2- 172.21.15.59:0/3779533866 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f22d0074530 0x7f22d0076a40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.967+0000 7f22f4fc5640 1 --2- 172.21.15.59:0/3779533866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22f015c1b0 0x7f22f00c9680 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.967+0000 7f22f4fc5640 1 --2- 172.21.15.59:0/3779533866 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22f00cec50 0x7f22f01f2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.967+0000 7f22f4fc5640 1 --2- 172.21.15.59:0/3779533866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22f00b41c0 0x7f22f0160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:34.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.967+0000 7f22f4fc5640 1 -- 172.21.15.59:0/3779533866 >> 172.21.15.59:0/3779533866 conn(0x7f22f006ed70 msgr2=0x7f22f00b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:34.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.967+0000 7f22f4fc5640 1 -- 172.21.15.59:0/3779533866 shutdown_connections 2024-04-25T15:46:34.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:34.967+0000 7f22f4fc5640 1 -- 172.21.15.59:0/3779533866 wait complete. 2024-04-25T15:46:34.979 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T15:46:35.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.093+0000 7f5e5bc0c640 1 Processor -- start 2024-04-25T15:46:35.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.093+0000 7f5e5bc0c640 1 -- start start 2024-04-25T15:46:35.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.094+0000 7f5e5bc0c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e54156790 0x7f5e540cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.094+0000 7f5e5bc0c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5e540c73c0 0x7f5e540c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.094+0000 7f5e5bc0c640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e5415c720 con 0x7f5e5408d410 2024-04-25T15:46:35.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.094+0000 7f5e5bc0c640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f5e5415ca00 con 0x7f5e540c73c0 2024-04-25T15:46:35.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.094+0000 7f5e5bc0c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f5e5415cce0 con 0x7f5e54156790 2024-04-25T15:46:35.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.095+0000 7f5e599a8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e54156790 0x7f5e540cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.095+0000 7f5e599a8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e54156790 0x7f5e540cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:38332/0 (socket says 172.21.15.59:38332) 2024-04-25T15:46:35.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.095+0000 7f5e599a8640 1 -- 172.21.15.59:0/3675545197 learned_addr learned my addr 172.21.15.59:0/3675545197 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:35.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.098+0000 7f5e599a8640 1 -- 172.21.15.59:0/3675545197 >> v2:172.21.15.59:3300/0 conn(0x7f5e540c73c0 msgr2=0x7f5e540c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:35.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.098+0000 7f5e599a8640 1 --2- 172.21.15.59:0/3675545197 >> v2:172.21.15.59:3300/0 conn(0x7f5e540c73c0 0x7f5e540c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.098+0000 7f5e599a8640 1 -- 172.21.15.59:0/3675545197 >> v1:172.21.15.59:6789/0 conn(0x7f5e5408d410 legacy=0x7f5e5408d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:35.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.098+0000 7f5e599a8640 1 -- 172.21.15.59:0/3675545197 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5415cfc0 con 0x7f5e54156790 2024-04-25T15:46:35.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.100+0000 7f5e599a8640 1 --2- 172.21.15.59:0/3675545197 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e54156790 0x7f5e540cc5b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009870 tx=0x7f5e4c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b121e1b38a53448 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:35.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.104+0000 7f5e589a6640 1 -- 172.21.15.59:0/3675545197 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c037070 con 0x7f5e54156790 2024-04-25T15:46:35.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.104+0000 7f5e589a6640 1 -- 172.21.15.59:0/3675545197 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e4c032440 con 0x7f5e54156790 2024-04-25T15:46:35.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.104+0000 7f5e589a6640 1 -- 172.21.15.59:0/3675545197 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c032810 con 0x7f5e54156790 2024-04-25T15:46:35.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.104+0000 7f5e5bc0c640 1 -- 172.21.15.59:0/3675545197 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e54156790 msgr2=0x7f5e540cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.104+0000 7f5e5bc0c640 1 --2- 172.21.15.59:0/3675545197 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e54156790 0x7f5e540cc5b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009870 tx=0x7f5e4c02a210 comp rx=0 tx=0).stop 2024-04-25T15:46:35.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.104+0000 7f5e5bc0c640 1 -- 172.21.15.59:0/3675545197 shutdown_connections 2024-04-25T15:46:35.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.104+0000 7f5e5bc0c640 1 --2- 172.21.15.59:0/3675545197 >> v2:172.21.15.59:3300/0 conn(0x7f5e540c73c0 0x7f5e540c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.104+0000 7f5e5bc0c640 1 --2- 172.21.15.59:0/3675545197 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e54156790 0x7f5e540cc5b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.104+0000 7f5e5bc0c640 1 -- 172.21.15.59:0/3675545197 >> 172.21.15.59:0/3675545197 conn(0x7f5e5406f400 msgr2=0x7f5e540684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:35.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.105+0000 7f5e5bc0c640 1 -- 172.21.15.59:0/3675545197 shutdown_connections 2024-04-25T15:46:35.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.105+0000 7f5e5bc0c640 1 -- 172.21.15.59:0/3675545197 wait complete. 2024-04-25T15:46:35.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.106+0000 7f5e5bc0c640 1 Processor -- start 2024-04-25T15:46:35.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.106+0000 7f5e5bc0c640 1 -- start start 2024-04-25T15:46:35.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.107+0000 7f5e5bc0c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e5408d410 0x7f5e541f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.107+0000 7f5e5bc0c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e540c73c0 0x7f5e540ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.107+0000 7f5e5bc0c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e54156790 0x7f5e541510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.107+0000 7f5e5bc0c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5e540c7d10 con 0x7f5e5408d410 2024-04-25T15:46:35.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.108+0000 7f5e5bc0c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5e540ccaf0 con 0x7f5e540c73c0 2024-04-25T15:46:35.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.108+0000 7f5e5bc0c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f5e540ccde0 con 0x7f5e54156790 2024-04-25T15:46:35.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.108+0000 7f5e5a1a9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e54156790 0x7f5e541510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.108+0000 7f5e591a7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e540c73c0 0x7f5e540ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.108+0000 7f5e5a1a9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e54156790 0x7f5e541510f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:38342/0 (socket says 172.21.15.59:38342) 2024-04-25T15:46:35.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.108+0000 7f5e5a1a9640 1 -- 172.21.15.59:0/3712607696 learned_addr learned my addr 172.21.15.59:0/3712607696 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:35.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.113+0000 7f5e5a1a9640 1 -- 172.21.15.59:0/3712607696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e540c73c0 msgr2=0x7f5e540ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.113+0000 7f5e5a1a9640 1 --2- 172.21.15.59:0/3712607696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e540c73c0 0x7f5e540ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.113+0000 7f5e5a1a9640 1 -- 172.21.15.59:0/3712607696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e5408d410 msgr2=0x7f5e541f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:35.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.113+0000 7f5e5a1a9640 1 --2- 172.21.15.59:0/3712607696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e5408d410 0x7f5e541f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:35.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.113+0000 7f5e5a1a9640 1 -- 172.21.15.59:0/3712607696 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e541f3f60 con 0x7f5e54156790 2024-04-25T15:46:35.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.115+0000 7f5e5a1a9640 1 --2- 172.21.15.59:0/3712607696 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e54156790 0x7f5e541510f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400b440 tx=0x7f5e4400b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:35.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.119+0000 7f5e527fc640 1 -- 172.21.15.59:0/3712607696 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44015020 con 0x7f5e54156790 2024-04-25T15:46:35.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.119+0000 7f5e527fc640 1 -- 172.21.15.59:0/3712607696 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e44011850 con 0x7f5e54156790 2024-04-25T15:46:35.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.119+0000 7f5e527fc640 1 -- 172.21.15.59:0/3712607696 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44011c40 con 0x7f5e54156790 2024-04-25T15:46:35.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.119+0000 7f5e5bc0c640 1 -- 172.21.15.59:0/3712607696 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e541f6f80 con 0x7f5e54156790 2024-04-25T15:46:35.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.119+0000 7f5e5bc0c640 1 -- 172.21.15.59:0/3712607696 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e541f7260 con 0x7f5e54156790 2024-04-25T15:46:35.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.120+0000 7f5e5bc0c640 1 -- 172.21.15.59:0/3712607696 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e540d0940 con 0x7f5e54156790 2024-04-25T15:46:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.428+0000 7f5e527fc640 1 -- 172.21.15.59:0/3712607696 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5e44018020 con 0x7f5e54156790 2024-04-25T15:46:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.429+0000 7f5e527fc640 1 --2- 172.21.15.59:0/3712607696 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5e40074500 0x7f5e40076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.429+0000 7f5e527fc640 1 -- 172.21.15.59:0/3712607696 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5e44095620 con 0x7f5e54156790 2024-04-25T15:46:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.429+0000 7f5e599a8640 1 --2- 172.21.15.59:0/3712607696 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5e40074500 0x7f5e40076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:35.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.429+0000 7f5e599a8640 1 --2- 172.21.15.59:0/3712607696 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5e40074500 0x7f5e40076a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c034000 tx=0x7f5e4c02c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:35.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.441+0000 7f5e527fc640 1 -- 172.21.15.59:0/3712607696 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5e540d0940 con 0x7f5e54156790 2024-04-25T15:46:35.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:35.666+0000 7f5e5bc0c640 1 -- 172.21.15.59:0/3712607696 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5e5406a240 con 0x7f5e54156790 2024-04-25T15:46:36.209 INFO:tasks.ceph.mds.d.smithi064.stderr:2024-04-25T15:46:36.203+0000 13863640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:46:36.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:36.959+0000 7f5e527fc640 1 -- 172.21.15.59:0/3712607696 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f5e5406a240 con 0x7f5e54156790 2024-04-25T15:46:36.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:36.961+0000 7f5e5bc0c640 1 -- 172.21.15.59:0/3712607696 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5e40074500 msgr2=0x7f5e40076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:36.961+0000 7f5e5bc0c640 1 --2- 172.21.15.59:0/3712607696 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5e40074500 0x7f5e40076a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c034000 tx=0x7f5e4c02c000 comp rx=0 tx=0).stop 2024-04-25T15:46:36.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:36.961+0000 7f5e5bc0c640 1 -- 172.21.15.59:0/3712607696 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e54156790 msgr2=0x7f5e541510f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:36.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:36.961+0000 7f5e5bc0c640 1 --2- 172.21.15.59:0/3712607696 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e54156790 0x7f5e541510f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400b440 tx=0x7f5e4400b900 comp rx=0 tx=0).stop 2024-04-25T15:46:36.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:36.961+0000 7f5e5bc0c640 1 -- 172.21.15.59:0/3712607696 shutdown_connections 2024-04-25T15:46:36.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:36.961+0000 7f5e5bc0c640 1 --2- 172.21.15.59:0/3712607696 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5e40074500 0x7f5e40076a10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:36.961+0000 7f5e5bc0c640 1 --2- 172.21.15.59:0/3712607696 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e54156790 0x7f5e541510f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:36.961+0000 7f5e5bc0c640 1 --2- 172.21.15.59:0/3712607696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e540c73c0 0x7f5e540ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:36.961+0000 7f5e5bc0c640 1 --2- 172.21.15.59:0/3712607696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e5408d410 0x7f5e541f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:36.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:36.961+0000 7f5e5bc0c640 1 -- 172.21.15.59:0/3712607696 >> 172.21.15.59:0/3712607696 conn(0x7f5e5406f400 msgr2=0x7f5e540684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:36.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:36.961+0000 7f5e5bc0c640 1 -- 172.21.15.59:0/3712607696 shutdown_connections 2024-04-25T15:46:36.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:36.961+0000 7f5e5bc0c640 1 -- 172.21.15.59:0/3712607696 wait complete. 2024-04-25T15:46:36.973 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300} 2024-04-25T15:46:36.973 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-04-25T15:46:37.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.086+0000 7fd94a39d640 1 Processor -- start 2024-04-25T15:46:37.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.086+0000 7fd94a39d640 1 -- start start 2024-04-25T15:46:37.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.087+0000 7fd94a39d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd9440b6a20 0x7fd94408d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.088+0000 7fd94a39d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9440b5ca0 0x7fd94415fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.088+0000 7fd94a39d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd94415c5b0 con 0x7fd94408d950 2024-04-25T15:46:37.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.088+0000 7fd94a39d640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd9440b6e30 con 0x7fd9440b5ca0 2024-04-25T15:46:37.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.088+0000 7fd94a39d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fd94415d480 con 0x7fd9440b6a20 2024-04-25T15:46:37.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.088+0000 7fd94893a640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9440b5ca0 0x7fd94415fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.088+0000 7fd943fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd9440b6a20 0x7fd94408d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.089+0000 7fd94893a640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9440b5ca0 0x7fd94415fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48256/0 (socket says 172.21.15.59:48256) 2024-04-25T15:46:37.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.089+0000 7fd94893a640 1 -- 172.21.15.59:0/3742571918 learned_addr learned my addr 172.21.15.59:0/3742571918 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:37.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.091+0000 7fd94893a640 1 -- 172.21.15.59:0/3742571918 >> v2:172.21.15.64:3300/0 conn(0x7fd9440b6a20 msgr2=0x7fd94408d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:37.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.091+0000 7fd94893a640 1 --2- 172.21.15.59:0/3742571918 >> v2:172.21.15.64:3300/0 conn(0x7fd9440b6a20 0x7fd94408d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.092+0000 7fd94893a640 1 -- 172.21.15.59:0/3742571918 >> v1:172.21.15.64:6789/0 conn(0x7fd94408d950 legacy=0x7fd9440b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.092+0000 7fd94893a640 1 -- 172.21.15.59:0/3742571918 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94415c870 con 0x7fd9440b5ca0 2024-04-25T15:46:37.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.094+0000 7fd94893a640 1 --2- 172.21.15.59:0/3742571918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9440b5ca0 0x7fd94415fce0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd9440d29d0 tx=0x7fd93c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d9c1c8571e6114 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:37.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.098+0000 7fd942ffd640 1 -- 172.21.15.59:0/3742571918 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c036070 con 0x7fd9440b5ca0 2024-04-25T15:46:37.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.098+0000 7fd942ffd640 1 -- 172.21.15.59:0/3742571918 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd93c031600 con 0x7fd9440b5ca0 2024-04-25T15:46:37.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.098+0000 7fd942ffd640 1 -- 172.21.15.59:0/3742571918 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c0319f0 con 0x7fd9440b5ca0 2024-04-25T15:46:37.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.098+0000 7fd94a39d640 1 -- 172.21.15.59:0/3742571918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9440b5ca0 msgr2=0x7fd94415fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.098+0000 7fd94a39d640 1 --2- 172.21.15.59:0/3742571918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9440b5ca0 0x7fd94415fce0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd9440d29d0 tx=0x7fd93c02a7c0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.098+0000 7fd94a39d640 1 -- 172.21.15.59:0/3742571918 shutdown_connections 2024-04-25T15:46:37.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.098+0000 7fd94a39d640 1 --2- 172.21.15.59:0/3742571918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9440b5ca0 0x7fd94415fce0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.098+0000 7fd94a39d640 1 --2- 172.21.15.59:0/3742571918 >> v2:172.21.15.64:3300/0 conn(0x7fd9440b6a20 0x7fd94408d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.098+0000 7fd94a39d640 1 -- 172.21.15.59:0/3742571918 >> 172.21.15.59:0/3742571918 conn(0x7fd9440684e0 msgr2=0x7fd9440688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:37.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.099+0000 7fd94a39d640 1 -- 172.21.15.59:0/3742571918 shutdown_connections 2024-04-25T15:46:37.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.099+0000 7fd94a39d640 1 -- 172.21.15.59:0/3742571918 wait complete. 2024-04-25T15:46:37.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.100+0000 7fd94a39d640 1 Processor -- start 2024-04-25T15:46:37.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.100+0000 7fd94a39d640 1 -- start start 2024-04-25T15:46:37.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.102+0000 7fd94a39d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd94408d950 0x7fd944154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.102+0000 7fd94a39d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9440b5ca0 0x7fd944151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.102+0000 7fd94a39d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9440b6a20 0x7fd9440d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.102+0000 7fd94a39d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd94415d110 con 0x7fd9440b6a20 2024-04-25T15:46:37.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.102+0000 7fd94a39d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd94415ce30 con 0x7fd9440b5ca0 2024-04-25T15:46:37.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.102+0000 7fd94a39d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd944160220 con 0x7fd94408d950 2024-04-25T15:46:37.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.102+0000 7fd94893a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9440b6a20 0x7fd9440d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.102+0000 7fd943fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd94408d950 0x7fd944154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.102+0000 7fd9437fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9440b5ca0 0x7fd944151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.103+0000 7fd943fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd94408d950 0x7fd944154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:38350/0 (socket says 172.21.15.59:38350) 2024-04-25T15:46:37.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.103+0000 7fd943fff640 1 -- 172.21.15.59:0/1967207093 learned_addr learned my addr 172.21.15.59:0/1967207093 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:37.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.106+0000 7fd94893a640 1 -- 172.21.15.59:0/1967207093 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd94408d950 msgr2=0x7fd944154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.106+0000 7fd94893a640 1 --2- 172.21.15.59:0/1967207093 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd94408d950 0x7fd944154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.106+0000 7fd94893a640 1 -- 172.21.15.59:0/1967207093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9440b5ca0 msgr2=0x7fd944151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:37.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.106+0000 7fd94893a640 1 --2- 172.21.15.59:0/1967207093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9440b5ca0 0x7fd944151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:37.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.106+0000 7fd94893a640 1 -- 172.21.15.59:0/1967207093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94414d1a0 con 0x7fd9440b6a20 2024-04-25T15:46:37.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.109+0000 7fd94893a640 1 --2- 172.21.15.59:0/1967207093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9440b6a20 0x7fd9440d0150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd94408e4c0 tx=0x7fd93c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:37.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.113+0000 7fd940ff9640 1 -- 172.21.15.59:0/1967207093 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c036050 con 0x7fd9440b6a20 2024-04-25T15:46:37.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.113+0000 7fd940ff9640 1 -- 172.21.15.59:0/1967207093 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd93c042070 con 0x7fd9440b6a20 2024-04-25T15:46:37.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.113+0000 7fd940ff9640 1 -- 172.21.15.59:0/1967207093 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c009510 con 0x7fd9440b6a20 2024-04-25T15:46:37.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.113+0000 7fd94a39d640 1 -- 172.21.15.59:0/1967207093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9441552f0 con 0x7fd9440b6a20 2024-04-25T15:46:37.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.113+0000 7fd94a39d640 1 -- 172.21.15.59:0/1967207093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9440d12f0 con 0x7fd9440b6a20 2024-04-25T15:46:37.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.114+0000 7fd94a39d640 1 -- 172.21.15.59:0/1967207093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9440d0d80 con 0x7fd9440b6a20 2024-04-25T15:46:37.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.137+0000 7fd940ff9640 1 -- 172.21.15.59:0/1967207093 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd93c004240 con 0x7fd9440b6a20 2024-04-25T15:46:37.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.137+0000 7fd940ff9640 1 --2- 172.21.15.59:0/1967207093 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd9300744e0 0x7fd9300769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:37.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.137+0000 7fd943fff640 1 --2- 172.21.15.59:0/1967207093 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd9300744e0 0x7fd9300769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:37.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.138+0000 7fd943fff640 1 --2- 172.21.15.59:0/1967207093 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd9300744e0 0x7fd9300769f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd934009b60 tx=0x7fd934009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:37.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.140+0000 7fd940ff9640 1 -- 172.21.15.59:0/1967207093 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd93c07cf50 con 0x7fd9440b6a20 2024-04-25T15:46:37.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.422+0000 7fd940ff9640 1 -- 172.21.15.59:0/1967207093 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd93c080cc0 con 0x7fd9440b6a20 2024-04-25T15:46:37.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:37.652+0000 7fd94a39d640 1 -- 172.21.15.59:0/1967207093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fd944069910 con 0x7fd9440b6a20 2024-04-25T15:46:38.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.081+0000 7fd940ff9640 1 -- 172.21.15.59:0/1967207093 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v8) ==== 105+0+0 (secure 0 0 0) 0x7fd93c084fc0 con 0x7fd9440b6a20 2024-04-25T15:46:38.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.083+0000 7fd94a39d640 1 -- 172.21.15.59:0/1967207093 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd9300744e0 msgr2=0x7fd9300769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.083+0000 7fd94a39d640 1 --2- 172.21.15.59:0/1967207093 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd9300744e0 0x7fd9300769f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd934009b60 tx=0x7fd934009190 comp rx=0 tx=0).stop 2024-04-25T15:46:38.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.083+0000 7fd94a39d640 1 -- 172.21.15.59:0/1967207093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9440b6a20 msgr2=0x7fd9440d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.083+0000 7fd94a39d640 1 --2- 172.21.15.59:0/1967207093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9440b6a20 0x7fd9440d0150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd94408e4c0 tx=0x7fd93c004a40 comp rx=0 tx=0).stop 2024-04-25T15:46:38.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.083+0000 7fd94a39d640 1 -- 172.21.15.59:0/1967207093 shutdown_connections 2024-04-25T15:46:38.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.083+0000 7fd94a39d640 1 --2- 172.21.15.59:0/1967207093 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd9300744e0 0x7fd9300769f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.083+0000 7fd94a39d640 1 --2- 172.21.15.59:0/1967207093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9440b6a20 0x7fd9440d0150 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.083+0000 7fd94a39d640 1 --2- 172.21.15.59:0/1967207093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9440b5ca0 0x7fd944151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.083+0000 7fd94a39d640 1 --2- 172.21.15.59:0/1967207093 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd94408d950 0x7fd944154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.083+0000 7fd94a39d640 1 -- 172.21.15.59:0/1967207093 >> 172.21.15.59:0/1967207093 conn(0x7fd9440684e0 msgr2=0x7fd9440cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:38.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.083+0000 7fd94a39d640 1 -- 172.21.15.59:0/1967207093 shutdown_connections 2024-04-25T15:46:38.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.083+0000 7fd94a39d640 1 -- 172.21.15.59:0/1967207093 wait complete. 2024-04-25T15:46:38.096 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T15:46:38.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.215+0000 7f1be2d64640 1 Processor -- start 2024-04-25T15:46:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.215+0000 7f1be2d64640 1 -- start start 2024-04-25T15:46:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.216+0000 7f1be2d64640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1bdc160810 0x7f1bdc1565d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.216+0000 7f1be2d64640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f1bdc0c70b0 0x7f1bdc0b5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.216+0000 7f1be2d64640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bdc0cf080 con 0x7f1bdc15c5a0 2024-04-25T15:46:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.216+0000 7f1be2d64640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1bdc0b58d0 con 0x7f1bdc160810 2024-04-25T15:46:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.216+0000 7f1be2d64640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f1bdc15d030 con 0x7f1bdc0c70b0 2024-04-25T15:46:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.217+0000 7f1be0b00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1bdc160810 0x7f1bdc1565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.217+0000 7f1be0b00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1bdc160810 0x7f1bdc1565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48278/0 (socket says 172.21.15.59:48278) 2024-04-25T15:46:38.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.217+0000 7f1be0b00640 1 -- 172.21.15.59:0/954247797 learned_addr learned my addr 172.21.15.59:0/954247797 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:38.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.220+0000 7f1be0b00640 1 -- 172.21.15.59:0/954247797 >> v2:172.21.15.64:3300/0 conn(0x7f1bdc0c70b0 msgr2=0x7f1bdc0b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:38.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.220+0000 7f1be0b00640 1 --2- 172.21.15.59:0/954247797 >> v2:172.21.15.64:3300/0 conn(0x7f1bdc0c70b0 0x7f1bdc0b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.220+0000 7f1be0b00640 1 -- 172.21.15.59:0/954247797 >> v1:172.21.15.59:6789/0 conn(0x7f1bdc15c5a0 legacy=0x7f1bdc0ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.220+0000 7f1be0b00640 1 -- 172.21.15.59:0/954247797 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bdc15d310 con 0x7f1bdc160810 2024-04-25T15:46:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.223+0000 7f1be0b00640 1 --2- 172.21.15.59:0/954247797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bdc160810 0x7f1bdc1565d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009870 tx=0x7f1bd002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3cdb36d1c4959b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:38.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.227+0000 7f1bdb7fe640 1 -- 172.21.15.59:0/954247797 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0037070 con 0x7f1bdc160810 2024-04-25T15:46:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.228+0000 7f1bdb7fe640 1 -- 172.21.15.59:0/954247797 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd0032440 con 0x7f1bdc160810 2024-04-25T15:46:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.228+0000 7f1bdb7fe640 1 -- 172.21.15.59:0/954247797 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0032810 con 0x7f1bdc160810 2024-04-25T15:46:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.228+0000 7f1be2d64640 1 -- 172.21.15.59:0/954247797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bdc160810 msgr2=0x7f1bdc1565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.228+0000 7f1be2d64640 1 --2- 172.21.15.59:0/954247797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bdc160810 0x7f1bdc1565d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009870 tx=0x7f1bd002a2c0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.228+0000 7f1be2d64640 1 -- 172.21.15.59:0/954247797 shutdown_connections 2024-04-25T15:46:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.228+0000 7f1be2d64640 1 --2- 172.21.15.59:0/954247797 >> v2:172.21.15.64:3300/0 conn(0x7f1bdc0c70b0 0x7f1bdc0b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.228+0000 7f1be2d64640 1 --2- 172.21.15.59:0/954247797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bdc160810 0x7f1bdc1565d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.228+0000 7f1be2d64640 1 -- 172.21.15.59:0/954247797 >> 172.21.15.59:0/954247797 conn(0x7f1bdc0684e0 msgr2=0x7f1bdc0688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.228+0000 7f1be2d64640 1 -- 172.21.15.59:0/954247797 shutdown_connections 2024-04-25T15:46:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.228+0000 7f1be2d64640 1 -- 172.21.15.59:0/954247797 wait complete. 2024-04-25T15:46:38.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.230+0000 7f1be2d64640 1 Processor -- start 2024-04-25T15:46:38.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.230+0000 7f1be2d64640 1 -- start start 2024-04-25T15:46:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.232+0000 7f1be2d64640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1bdc0c70b0 0x7f1bdc0b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.232+0000 7f1be2d64640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bdc15c5a0 0x7f1bdc1f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.232+0000 7f1be2d64640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bdc160810 0x7f1bdc0cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.232+0000 7f1be2d64640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1bdc1602f0 con 0x7f1bdc15c5a0 2024-04-25T15:46:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.232+0000 7f1be2d64640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1bdc160010 con 0x7f1bdc160810 2024-04-25T15:46:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.232+0000 7f1be2d64640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1bdc0cea60 con 0x7f1bdc0c70b0 2024-04-25T15:46:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.232+0000 7f1bdbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bdc15c5a0 0x7f1bdc1f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.233+0000 7f1bdbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bdc15c5a0 0x7f1bdc1f2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48284/0 (socket says 172.21.15.59:48284) 2024-04-25T15:46:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.233+0000 7f1bdbfff640 1 -- 172.21.15.59:0/2851985099 learned_addr learned my addr 172.21.15.59:0/2851985099 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.236+0000 7f1bdbfff640 1 -- 172.21.15.59:0/2851985099 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1bdc0c70b0 msgr2=0x7f1bdc0b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.236+0000 7f1bdbfff640 1 --2- 172.21.15.59:0/2851985099 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1bdc0c70b0 0x7f1bdc0b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.236+0000 7f1bdbfff640 1 -- 172.21.15.59:0/2851985099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bdc160810 msgr2=0x7f1bdc0cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.236+0000 7f1bdbfff640 1 --2- 172.21.15.59:0/2851985099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bdc160810 0x7f1bdc0cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.236+0000 7f1bdbfff640 1 -- 172.21.15.59:0/2851985099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bdc1f3330 con 0x7f1bdc15c5a0 2024-04-25T15:46:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.239+0000 7f1bdbfff640 1 --2- 172.21.15.59:0/2851985099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bdc15c5a0 0x7f1bdc1f2df0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800b410 tx=0x7f1bc8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:38.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.243+0000 7f1bd97fa640 1 -- 172.21.15.59:0/2851985099 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8015020 con 0x7f1bdc15c5a0 2024-04-25T15:46:38.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.243+0000 7f1bd97fa640 1 -- 172.21.15.59:0/2851985099 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc8011850 con 0x7f1bdc15c5a0 2024-04-25T15:46:38.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.243+0000 7f1bd97fa640 1 -- 172.21.15.59:0/2851985099 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8011c40 con 0x7f1bdc15c5a0 2024-04-25T15:46:38.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.243+0000 7f1be2d64640 1 -- 172.21.15.59:0/2851985099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bdc153e70 con 0x7f1bdc15c5a0 2024-04-25T15:46:38.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.243+0000 7f1be2d64640 1 -- 172.21.15.59:0/2851985099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bdc15e760 con 0x7f1bdc15c5a0 2024-04-25T15:46:38.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.244+0000 7f1be2d64640 1 -- 172.21.15.59:0/2851985099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bdc15d4e0 con 0x7f1bdc15c5a0 2024-04-25T15:46:38.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.268+0000 7f1bd97fa640 1 -- 172.21.15.59:0/2851985099 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1bc8018020 con 0x7f1bdc15c5a0 2024-04-25T15:46:38.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.268+0000 7f1bd97fa640 1 --2- 172.21.15.59:0/2851985099 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1bc0074530 0x7f1bc0076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:38.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.268+0000 7f1be0b00640 1 --2- 172.21.15.59:0/2851985099 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1bc0074530 0x7f1bc0076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:38.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.269+0000 7f1be0b00640 1 --2- 172.21.15.59:0/2851985099 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1bc0074530 0x7f1bc0076a40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0034000 tx=0x7f1bd002c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:38.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.553+0000 7f1bd97fa640 1 -- 172.21.15.59:0/2851985099 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1bc8011de0 con 0x7f1bdc15c5a0 2024-04-25T15:46:38.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.553+0000 7f1bd97fa640 1 -- 172.21.15.59:0/2851985099 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1bdc15d4e0 con 0x7f1bdc15c5a0 2024-04-25T15:46:38.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:38.807+0000 7f1be2d64640 1 -- 172.21.15.59:0/2851985099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f1bdc069910 con 0x7f1bdc15c5a0 2024-04-25T15:46:39.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.377+0000 7f1bd97fa640 1 -- 172.21.15.59:0/2851985099 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f1bc801f020 con 0x7f1bdc15c5a0 2024-04-25T15:46:39.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.380+0000 7f1be2d64640 1 -- 172.21.15.59:0/2851985099 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1bc0074530 msgr2=0x7f1bc0076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.380+0000 7f1be2d64640 1 --2- 172.21.15.59:0/2851985099 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1bc0074530 0x7f1bc0076a40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0034000 tx=0x7f1bd002c000 comp rx=0 tx=0).stop 2024-04-25T15:46:39.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.380+0000 7f1be2d64640 1 -- 172.21.15.59:0/2851985099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bdc15c5a0 msgr2=0x7f1bdc1f2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.380+0000 7f1be2d64640 1 --2- 172.21.15.59:0/2851985099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bdc15c5a0 0x7f1bdc1f2df0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800b410 tx=0x7f1bc8009f90 comp rx=0 tx=0).stop 2024-04-25T15:46:39.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.380+0000 7f1be2d64640 1 -- 172.21.15.59:0/2851985099 shutdown_connections 2024-04-25T15:46:39.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.380+0000 7f1be2d64640 1 --2- 172.21.15.59:0/2851985099 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1bc0074530 0x7f1bc0076a40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.380+0000 7f1be2d64640 1 --2- 172.21.15.59:0/2851985099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1bdc160810 0x7f1bdc0cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.380+0000 7f1be2d64640 1 --2- 172.21.15.59:0/2851985099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bdc15c5a0 0x7f1bdc1f2df0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.380+0000 7f1be2d64640 1 --2- 172.21.15.59:0/2851985099 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1bdc0c70b0 0x7f1bdc0b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.380+0000 7f1be2d64640 1 -- 172.21.15.59:0/2851985099 >> 172.21.15.59:0/2851985099 conn(0x7f1bdc0684e0 msgr2=0x7f1bdc1565d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:39.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.380+0000 7f1be2d64640 1 -- 172.21.15.59:0/2851985099 shutdown_connections 2024-04-25T15:46:39.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.380+0000 7f1be2d64640 1 -- 172.21.15.59:0/2851985099 wait complete. 2024-04-25T15:46:39.393 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-25T15:46:39.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.510+0000 7fbade984640 1 Processor -- start 2024-04-25T15:46:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.510+0000 7fbade984640 1 -- start start 2024-04-25T15:46:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.512+0000 7fbade984640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbad80c70b0 0x7fbad81565d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.512+0000 7fbade984640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbad80cf080 con 0x7fbad80b5390 2024-04-25T15:46:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.512+0000 7fbade984640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbad815d030 con 0x7fbad8160810 2024-04-25T15:46:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.512+0000 7fbade984640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fbad815d310 con 0x7fbad80c70b0 2024-04-25T15:46:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.512+0000 7fbad77fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbad80c70b0 0x7fbad81565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.512+0000 7fbad7fff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fbad8160810 0x7fbad815c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.59:45676/0 (socket says 172.21.15.59:45676) 2024-04-25T15:46:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.512+0000 7fbad7fff640 1 -- 172.21.15.59:0/616298228 learned_addr learned my addr 172.21.15.59:0/616298228 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:39.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.516+0000 7fbad6ffd640 1 -- 172.21.15.59:0/616298228 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3766199956 0 0) 0x7fbad80cf080 con 0x7fbad80b5390 2024-04-25T15:46:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.516+0000 7fbad6ffd640 1 -- 172.21.15.59:0/616298228 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbac4003520 con 0x7fbad80b5390 2024-04-25T15:46:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.516+0000 7fbad6ffd640 1 -- 172.21.15.59:0/616298228 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2141057330 0 0) 0x7fbad815d030 con 0x7fbad8160810 2024-04-25T15:46:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.516+0000 7fbad6ffd640 1 -- 172.21.15.59:0/616298228 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbad80cf080 con 0x7fbad8160810 2024-04-25T15:46:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.516+0000 7fbad77fe640 1 -- 172.21.15.59:0/616298228 >> v1:172.21.15.64:6789/0 conn(0x7fbad8160810 legacy=0x7fbad815c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.516+0000 7fbad77fe640 1 -- 172.21.15.59:0/616298228 >> v1:172.21.15.59:6789/0 conn(0x7fbad80b5390 legacy=0x7fbad80ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.516+0000 7fbad77fe640 1 -- 172.21.15.59:0/616298228 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad815fd30 con 0x7fbad80c70b0 2024-04-25T15:46:39.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.519+0000 7fbad77fe640 1 --2- 172.21.15.59:0/616298228 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbad80c70b0 0x7fbad81565d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbac80097d0 tx=0x7fbac802a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=651ee3148922d165 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:39.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.523+0000 7fbad6ffd640 1 -- 172.21.15.59:0/616298228 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac8037070 con 0x7fbad80c70b0 2024-04-25T15:46:39.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.523+0000 7fbad6ffd640 1 -- 172.21.15.59:0/616298228 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac8032440 con 0x7fbad80c70b0 2024-04-25T15:46:39.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.523+0000 7fbad6ffd640 1 -- 172.21.15.59:0/616298228 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac80327f0 con 0x7fbad80c70b0 2024-04-25T15:46:39.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.524+0000 7fbade984640 1 -- 172.21.15.59:0/616298228 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbad80c70b0 msgr2=0x7fbad81565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.524+0000 7fbade984640 1 --2- 172.21.15.59:0/616298228 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbad80c70b0 0x7fbad81565d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbac80097d0 tx=0x7fbac802a290 comp rx=0 tx=0).stop 2024-04-25T15:46:39.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.524+0000 7fbade984640 1 -- 172.21.15.59:0/616298228 shutdown_connections 2024-04-25T15:46:39.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.524+0000 7fbade984640 1 --2- 172.21.15.59:0/616298228 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbad80c70b0 0x7fbad81565d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.524+0000 7fbade984640 1 -- 172.21.15.59:0/616298228 >> 172.21.15.59:0/616298228 conn(0x7fbad80684e0 msgr2=0x7fbad80688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:39.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.525+0000 7fbade984640 1 -- 172.21.15.59:0/616298228 shutdown_connections 2024-04-25T15:46:39.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.525+0000 7fbade984640 1 -- 172.21.15.59:0/616298228 wait complete. 2024-04-25T15:46:39.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.527+0000 7fbade984640 1 Processor -- start 2024-04-25T15:46:39.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.527+0000 7fbade984640 1 -- start start 2024-04-25T15:46:39.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.529+0000 7fbade984640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbad80b5390 0x7fbad81e8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.529+0000 7fbade984640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbad80c70b0 0x7fbad8150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.529+0000 7fbade984640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbad8160810 0x7fbad8150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.529+0000 7fbade984640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbad815ccb0 con 0x7fbad80b5390 2024-04-25T15:46:39.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.529+0000 7fbade984640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbad81602f0 con 0x7fbad8160810 2024-04-25T15:46:39.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.529+0000 7fbade984640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fbad80b57a0 con 0x7fbad80c70b0 2024-04-25T15:46:39.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.529+0000 7fbad7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbad80b5390 0x7fbad81e8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.529+0000 7fbad77fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbad80c70b0 0x7fbad8150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.530+0000 7fbadcf21640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbad8160810 0x7fbad8150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.530+0000 7fbad77fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbad80c70b0 0x7fbad8150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:38374/0 (socket says 172.21.15.59:38374) 2024-04-25T15:46:39.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.530+0000 7fbad77fe640 1 -- 172.21.15.59:0/2820287835 learned_addr learned my addr 172.21.15.59:0/2820287835 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:39.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.534+0000 7fbad77fe640 1 -- 172.21.15.59:0/2820287835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbad8160810 msgr2=0x7fbad8150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.534+0000 7fbad77fe640 1 --2- 172.21.15.59:0/2820287835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbad8160810 0x7fbad8150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.534+0000 7fbad77fe640 1 -- 172.21.15.59:0/2820287835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbad80b5390 msgr2=0x7fbad81e8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:39.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.534+0000 7fbad77fe640 1 --2- 172.21.15.59:0/2820287835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbad80b5390 0x7fbad81e8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:39.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.534+0000 7fbad77fe640 1 -- 172.21.15.59:0/2820287835 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad815a1a0 con 0x7fbad80c70b0 2024-04-25T15:46:39.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.536+0000 7fbad77fe640 1 --2- 172.21.15.59:0/2820287835 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbad80c70b0 0x7fbad8150a70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbac80098f0 tx=0x7fbac80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:39.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.540+0000 7fbad4ff9640 1 -- 172.21.15.59:0/2820287835 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac8037050 con 0x7fbad80c70b0 2024-04-25T15:46:39.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.540+0000 7fbad4ff9640 1 -- 172.21.15.59:0/2820287835 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac8043070 con 0x7fbad80c70b0 2024-04-25T15:46:39.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.540+0000 7fbad4ff9640 1 -- 172.21.15.59:0/2820287835 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac803cb30 con 0x7fbad80c70b0 2024-04-25T15:46:39.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.540+0000 7fbade984640 1 -- 172.21.15.59:0/2820287835 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad815a440 con 0x7fbad80c70b0 2024-04-25T15:46:39.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.540+0000 7fbade984640 1 -- 172.21.15.59:0/2820287835 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad815a8f0 con 0x7fbad80c70b0 2024-04-25T15:46:39.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.541+0000 7fbade984640 1 -- 172.21.15.59:0/2820287835 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad81514f0 con 0x7fbad80c70b0 2024-04-25T15:46:39.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.848+0000 7fbad4ff9640 1 -- 172.21.15.59:0/2820287835 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbac803ccd0 con 0x7fbad80c70b0 2024-04-25T15:46:39.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.848+0000 7fbad4ff9640 1 --2- 172.21.15.59:0/2820287835 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbab8074580 0x7fbab8076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:39.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.849+0000 7fbad4ff9640 1 -- 172.21.15.59:0/2820287835 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbac80b68b0 con 0x7fbad80c70b0 2024-04-25T15:46:39.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.849+0000 7fbad7fff640 1 --2- 172.21.15.59:0/2820287835 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbab8074580 0x7fbab8076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:39.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.849+0000 7fbad7fff640 1 --2- 172.21.15.59:0/2820287835 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbab8074580 0x7fbab8076a90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbac0005880 tx=0x7fbac0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:39.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:39.858+0000 7fbad4ff9640 1 -- 172.21.15.59:0/2820287835 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbac8080a60 con 0x7fbad80c70b0 2024-04-25T15:46:40.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.082+0000 7fbade984640 1 -- 172.21.15.59:0/2820287835 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fbad8069910 con 0x7fbad80c70b0 2024-04-25T15:46:40.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.494+0000 7fbad4ff9640 1 -- 172.21.15.59:0/2820287835 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7fbac80890a0 con 0x7fbad80c70b0 2024-04-25T15:46:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.496+0000 7fbade984640 1 -- 172.21.15.59:0/2820287835 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbab8074580 msgr2=0x7fbab8076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.496+0000 7fbade984640 1 --2- 172.21.15.59:0/2820287835 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbab8074580 0x7fbab8076a90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbac0005880 tx=0x7fbac0009040 comp rx=0 tx=0).stop 2024-04-25T15:46:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.496+0000 7fbade984640 1 -- 172.21.15.59:0/2820287835 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbad80c70b0 msgr2=0x7fbad8150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.496+0000 7fbade984640 1 --2- 172.21.15.59:0/2820287835 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbad80c70b0 0x7fbad8150a70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbac80098f0 tx=0x7fbac80046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.496+0000 7fbade984640 1 -- 172.21.15.59:0/2820287835 shutdown_connections 2024-04-25T15:46:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.496+0000 7fbade984640 1 --2- 172.21.15.59:0/2820287835 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbab8074580 0x7fbab8076a90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.496+0000 7fbade984640 1 --2- 172.21.15.59:0/2820287835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbad8160810 0x7fbad8150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.496+0000 7fbade984640 1 --2- 172.21.15.59:0/2820287835 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbad80c70b0 0x7fbad8150a70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.496+0000 7fbade984640 1 --2- 172.21.15.59:0/2820287835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbad80b5390 0x7fbad81e8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.496+0000 7fbade984640 1 -- 172.21.15.59:0/2820287835 >> 172.21.15.59:0/2820287835 conn(0x7fbad80684e0 msgr2=0x7fbad8154460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.496+0000 7fbade984640 1 -- 172.21.15.59:0/2820287835 shutdown_connections 2024-04-25T15:46:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.496+0000 7fbade984640 1 -- 172.21.15.59:0/2820287835 wait complete. 2024-04-25T15:46:40.508 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T15:46:40.509 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:40.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.649+0000 7ffb588e0640 1 Processor -- start 2024-04-25T15:46:40.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.649+0000 7ffb588e0640 1 -- start start 2024-04-25T15:46:40.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.650+0000 7ffb588e0640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ffb5415cf80 0x7ffb5406e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.650+0000 7ffb588e0640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb540713b0 con 0x7ffb540b2fc0 2024-04-25T15:46:40.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.650+0000 7ffb588e0640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb54071690 con 0x7ffb540b3510 2024-04-25T15:46:40.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.650+0000 7ffb588e0640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7ffb5406ce50 con 0x7ffb5415cf80 2024-04-25T15:46:40.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.651+0000 7ffb52d9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ffb5415cf80 0x7ffb5406e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.651+0000 7ffb52d9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ffb5415cf80 0x7ffb5406e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:46994/0 (socket says 172.21.15.59:46994) 2024-04-25T15:46:40.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.651+0000 7ffb52d9d640 1 -- 172.21.15.59:0/109230906 learned_addr learned my addr 172.21.15.59:0/109230906 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:40.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.655+0000 7ffb52d9d640 1 -- 172.21.15.59:0/109230906 >> v1:172.21.15.64:6789/0 conn(0x7ffb540b3510 legacy=0x7ffb5415c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:40.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.655+0000 7ffb52d9d640 1 -- 172.21.15.59:0/109230906 >> v1:172.21.15.59:6789/0 conn(0x7ffb540b2fc0 legacy=0x7ffb54070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:40.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.655+0000 7ffb52d9d640 1 -- 172.21.15.59:0/109230906 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5406d130 con 0x7ffb5415cf80 2024-04-25T15:46:40.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.658+0000 7ffb52d9d640 1 --2- 172.21.15.59:0/109230906 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb5415cf80 0x7ffb5406e080 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009e50 tx=0x7ffb4c02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e555183055fd4b3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:40.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.663+0000 7ffb51d9b640 1 -- 172.21.15.59:0/109230906 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c036070 con 0x7ffb5415cf80 2024-04-25T15:46:40.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.663+0000 7ffb51d9b640 1 -- 172.21.15.59:0/109230906 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb4c031600 con 0x7ffb5415cf80 2024-04-25T15:46:40.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.663+0000 7ffb51d9b640 1 -- 172.21.15.59:0/109230906 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c02ae60 con 0x7ffb5415cf80 2024-04-25T15:46:40.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.664+0000 7ffb588e0640 1 -- 172.21.15.59:0/109230906 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb5415cf80 msgr2=0x7ffb5406e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.664+0000 7ffb588e0640 1 --2- 172.21.15.59:0/109230906 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb5415cf80 0x7ffb5406e080 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009e50 tx=0x7ffb4c02a680 comp rx=0 tx=0).stop 2024-04-25T15:46:40.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.664+0000 7ffb588e0640 1 -- 172.21.15.59:0/109230906 shutdown_connections 2024-04-25T15:46:40.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.664+0000 7ffb588e0640 1 --2- 172.21.15.59:0/109230906 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb5415cf80 0x7ffb5406e080 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.664+0000 7ffb588e0640 1 -- 172.21.15.59:0/109230906 >> 172.21.15.59:0/109230906 conn(0x7ffb54072500 msgr2=0x7ffb540cb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:40.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.664+0000 7ffb588e0640 1 -- 172.21.15.59:0/109230906 shutdown_connections 2024-04-25T15:46:40.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.664+0000 7ffb588e0640 1 -- 172.21.15.59:0/109230906 wait complete. 2024-04-25T15:46:40.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.666+0000 7ffb588e0640 1 Processor -- start 2024-04-25T15:46:40.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.666+0000 7ffb588e0640 1 -- start start 2024-04-25T15:46:40.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.667+0000 7ffb588e0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb540b2fc0 0x7ffb5415a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.667+0000 7ffb588e0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffb540b3510 0x7ffb541f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.667+0000 7ffb588e0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb5415cf80 0x7ffb541e7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.667+0000 7ffb588e0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffb54070910 con 0x7ffb540b2fc0 2024-04-25T15:46:40.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.667+0000 7ffb588e0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ffb54070790 con 0x7ffb5415cf80 2024-04-25T15:46:40.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.667+0000 7ffb588e0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ffb54156840 con 0x7ffb540b3510 2024-04-25T15:46:40.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.668+0000 7ffb4bfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffb540b3510 0x7ffb541f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.668+0000 7ffb52d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb5415cf80 0x7ffb541e7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.668+0000 7ffb4bfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffb540b3510 0x7ffb541f6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:38386/0 (socket says 172.21.15.59:38386) 2024-04-25T15:46:40.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.668+0000 7ffb4bfff640 1 -- 172.21.15.59:0/356868976 learned_addr learned my addr 172.21.15.59:0/356868976 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:40.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.673+0000 7ffb4bfff640 1 -- 172.21.15.59:0/356868976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb5415cf80 msgr2=0x7ffb541e7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.673+0000 7ffb4bfff640 1 --2- 172.21.15.59:0/356868976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb5415cf80 0x7ffb541e7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.673+0000 7ffb4bfff640 1 -- 172.21.15.59:0/356868976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb540b2fc0 msgr2=0x7ffb5415a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:40.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.673+0000 7ffb4bfff640 1 --2- 172.21.15.59:0/356868976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb540b2fc0 0x7ffb5415a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:40.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.673+0000 7ffb4bfff640 1 -- 172.21.15.59:0/356868976 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5415ad10 con 0x7ffb540b3510 2024-04-25T15:46:40.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.675+0000 7ffb4bfff640 1 --2- 172.21.15.59:0/356868976 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffb540b3510 0x7ffb541f6590 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00b3f0 tx=0x7ffb3c00b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.679+0000 7ffb4affd640 1 -- 172.21.15.59:0/356868976 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c015020 con 0x7ffb540b3510 2024-04-25T15:46:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.679+0000 7ffb4affd640 1 -- 172.21.15.59:0/356868976 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb3c011830 con 0x7ffb540b3510 2024-04-25T15:46:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.679+0000 7ffb4affd640 1 -- 172.21.15.59:0/356868976 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c011c20 con 0x7ffb540b3510 2024-04-25T15:46:40.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.679+0000 7ffb588e0640 1 -- 172.21.15.59:0/356868976 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb5414e150 con 0x7ffb540b3510 2024-04-25T15:46:40.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.679+0000 7ffb588e0640 1 -- 172.21.15.59:0/356868976 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb5414dac0 con 0x7ffb540b3510 2024-04-25T15:46:40.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.680+0000 7ffb588e0640 1 -- 172.21.15.59:0/356868976 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb5415a110 con 0x7ffb540b3510 2024-04-25T15:46:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.984+0000 7ffb4affd640 1 -- 172.21.15.59:0/356868976 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ffb3c018020 con 0x7ffb540b3510 2024-04-25T15:46:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.985+0000 7ffb4affd640 1 --2- 172.21.15.59:0/356868976 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ffb340744b0 0x7ffb340769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:40.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.985+0000 7ffb5259c640 1 --2- 172.21.15.59:0/356868976 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ffb340744b0 0x7ffb340769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:40.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.985+0000 7ffb5259c640 1 --2- 172.21.15.59:0/356868976 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ffb340744b0 0x7ffb340769c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009650 tx=0x7ffb44006ba0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:40.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:40.990+0000 7ffb4affd640 1 -- 172.21.15.59:0/356868976 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ffb3c011dc0 con 0x7ffb540b3510 2024-04-25T15:46:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.001+0000 7ffb4affd640 1 -- 172.21.15.59:0/356868976 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffb3c01f030 con 0x7ffb540b3510 2024-04-25T15:46:41.181 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:46:41.184 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:46:41.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.243+0000 7ffb588e0640 1 -- 172.21.15.59:0/356868976 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb540b3920 con 0x7ffb540b3510 2024-04-25T15:46:41.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.277+0000 7ffb4affd640 1 -- 172.21.15.59:0/356868976 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6859 (secure 0 0 0) 0x7ffb3c05fa80 con 0x7ffb540b3510 2024-04-25T15:46:41.278 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:41.278 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/783440137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":783440137},{"type":"v1","addr":"172.21.15.64:6835","nonce":783440137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2150121481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2150121481},{"type":"v1","addr":"172.21.15.59:6835","nonce":2150121481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4208,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2853549826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2853549826},{"type":"v1","addr":"172.21.15.64:6833","nonce":2853549826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:32.561262+0000","modified":"2024-04-25T15:46:40.412296+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4284,"mds_1":4281,"mds_2":4217},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4217":{"gid":4217,"name":"e","rank":2,"incarnation":12,"state":"up:creating","state_seq":1,"addr":"172.21.15.59:6837/2036351360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2036351360},{"type":"v1","addr":"172.21.15.59:6837","nonce":2036351360}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/4162601241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4162601241},{"type":"v1","addr":"172.21.15.59:6839","nonce":4162601241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6837/2368752795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2368752795},{"type":"v1","addr":"172.21.15.64:6837","nonce":2368752795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284,4281]},"id":1}]} 2024-04-25T15:46:41.278 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 12 2024-04-25T15:46:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.279+0000 7ffb588e0640 1 -- 172.21.15.59:0/356868976 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ffb340744b0 msgr2=0x7ffb340769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.279+0000 7ffb588e0640 1 --2- 172.21.15.59:0/356868976 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ffb340744b0 0x7ffb340769c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009650 tx=0x7ffb44006ba0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.279+0000 7ffb588e0640 1 -- 172.21.15.59:0/356868976 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffb540b3510 msgr2=0x7ffb541f6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.279+0000 7ffb588e0640 1 --2- 172.21.15.59:0/356868976 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffb540b3510 0x7ffb541f6590 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00b3f0 tx=0x7ffb3c00b8b0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.279+0000 7ffb588e0640 1 -- 172.21.15.59:0/356868976 shutdown_connections 2024-04-25T15:46:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.279+0000 7ffb588e0640 1 --2- 172.21.15.59:0/356868976 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ffb340744b0 0x7ffb340769c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.279+0000 7ffb588e0640 1 --2- 172.21.15.59:0/356868976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffb5415cf80 0x7ffb541e7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.279+0000 7ffb588e0640 1 --2- 172.21.15.59:0/356868976 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffb540b3510 0x7ffb541f6590 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.279+0000 7ffb588e0640 1 --2- 172.21.15.59:0/356868976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb540b2fc0 0x7ffb5415a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.279+0000 7ffb588e0640 1 -- 172.21.15.59:0/356868976 >> 172.21.15.59:0/356868976 conn(0x7ffb54072500 msgr2=0x7ffb540c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:41.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.279+0000 7ffb588e0640 1 -- 172.21.15.59:0/356868976 shutdown_connections 2024-04-25T15:46:41.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.279+0000 7ffb588e0640 1 -- 172.21.15.59:0/356868976 wait complete. 2024-04-25T15:46:41.291 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:41.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.456+0000 7f42bd00d640 1 Processor -- start 2024-04-25T15:46:41.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.456+0000 7f42bd00d640 1 -- start start 2024-04-25T15:46:41.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.458+0000 7f42bd00d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f42b80b3510 0x7f42b806e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.458+0000 7f42bd00d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f42b8156840 0x7f42b815c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.458+0000 7f42bd00d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42b80713b0 con 0x7f42b80b2fc0 2024-04-25T15:46:41.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.458+0000 7f42bd00d640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f42b8071690 con 0x7f42b8156840 2024-04-25T15:46:41.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.458+0000 7f42bd00d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f42b806ce50 con 0x7f42b80b3510 2024-04-25T15:46:41.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.458+0000 7f42b759e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f42b8156840 0x7f42b815c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.458+0000 7f42b659c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f42b80b3510 0x7f42b806e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.459+0000 7f42b759e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f42b8156840 0x7f42b815c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48316/0 (socket says 172.21.15.59:48316) 2024-04-25T15:46:41.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.459+0000 7f42b759e640 1 -- 172.21.15.59:0/967333916 learned_addr learned my addr 172.21.15.59:0/967333916 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:41.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.462+0000 7f42b759e640 1 -- 172.21.15.59:0/967333916 >> v2:172.21.15.64:3300/0 conn(0x7f42b80b3510 msgr2=0x7f42b806e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:41.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.462+0000 7f42b759e640 1 --2- 172.21.15.59:0/967333916 >> v2:172.21.15.64:3300/0 conn(0x7f42b80b3510 0x7f42b806e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.462+0000 7f42b759e640 1 -- 172.21.15.59:0/967333916 >> v1:172.21.15.64:6789/0 conn(0x7f42b80b2fc0 legacy=0x7f42b8070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.462+0000 7f42b759e640 1 -- 172.21.15.59:0/967333916 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b806d130 con 0x7f42b8156840 2024-04-25T15:46:41.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.464+0000 7f42b759e640 1 --2- 172.21.15.59:0/967333916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42b8156840 0x7f42b815c870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f42b8074cf0 tx=0x7f42b002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b106017b3f2ae5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:41.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.468+0000 7f42b5d9b640 1 -- 172.21.15.59:0/967333916 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0036070 con 0x7f42b8156840 2024-04-25T15:46:41.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.468+0000 7f42b5d9b640 1 -- 172.21.15.59:0/967333916 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b0031600 con 0x7f42b8156840 2024-04-25T15:46:41.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.468+0000 7f42b5d9b640 1 -- 172.21.15.59:0/967333916 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b00319d0 con 0x7f42b8156840 2024-04-25T15:46:41.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.469+0000 7f42bd00d640 1 -- 172.21.15.59:0/967333916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42b8156840 msgr2=0x7f42b815c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.469+0000 7f42bd00d640 1 --2- 172.21.15.59:0/967333916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42b8156840 0x7f42b815c870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f42b8074cf0 tx=0x7f42b002a6a0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.469+0000 7f42bd00d640 1 -- 172.21.15.59:0/967333916 shutdown_connections 2024-04-25T15:46:41.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.469+0000 7f42bd00d640 1 --2- 172.21.15.59:0/967333916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42b8156840 0x7f42b815c870 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.469+0000 7f42bd00d640 1 --2- 172.21.15.59:0/967333916 >> v2:172.21.15.64:3300/0 conn(0x7f42b80b3510 0x7f42b806e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.469+0000 7f42bd00d640 1 -- 172.21.15.59:0/967333916 >> 172.21.15.59:0/967333916 conn(0x7f42b8072500 msgr2=0x7f42b80cb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:41.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.469+0000 7f42bd00d640 1 -- 172.21.15.59:0/967333916 shutdown_connections 2024-04-25T15:46:41.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.469+0000 7f42bd00d640 1 -- 172.21.15.59:0/967333916 wait complete. 2024-04-25T15:46:41.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.471+0000 7f42bd00d640 1 Processor -- start 2024-04-25T15:46:41.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.471+0000 7f42bd00d640 1 -- start start 2024-04-25T15:46:41.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.473+0000 7f42bd00d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42b80b2fc0 0x7f42b81f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.473+0000 7f42bd00d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42b80b3510 0x7f42b81491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.473+0000 7f42bd00d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42b8156840 0x7f42b815bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.473+0000 7f42bd00d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f42b8070790 con 0x7f42b80b2fc0 2024-04-25T15:46:41.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.473+0000 7f42bd00d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f42b8156c50 con 0x7f42b8156840 2024-04-25T15:46:41.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.473+0000 7f42bd00d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f42b8070910 con 0x7f42b80b3510 2024-04-25T15:46:41.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.473+0000 7f42b6d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42b80b2fc0 0x7f42b81f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.473+0000 7f42b759e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42b8156840 0x7f42b815bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.474+0000 7f42b6d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42b80b2fc0 0x7f42b81f2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48330/0 (socket says 172.21.15.59:48330) 2024-04-25T15:46:41.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.474+0000 7f42b6d9d640 1 -- 172.21.15.59:0/2183735078 learned_addr learned my addr 172.21.15.59:0/2183735078 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:41.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.478+0000 7f42b759e640 1 -- 172.21.15.59:0/2183735078 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42b80b3510 msgr2=0x7f42b81491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.478+0000 7f42b759e640 1 --2- 172.21.15.59:0/2183735078 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42b80b3510 0x7f42b81491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.478+0000 7f42b759e640 1 -- 172.21.15.59:0/2183735078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42b80b2fc0 msgr2=0x7f42b81f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:41.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.478+0000 7f42b759e640 1 --2- 172.21.15.59:0/2183735078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42b80b2fc0 0x7f42b81f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:41.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.478+0000 7f42b759e640 1 -- 172.21.15.59:0/2183735078 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b81f2a50 con 0x7f42b8156840 2024-04-25T15:46:41.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.480+0000 7f42b759e640 1 --2- 172.21.15.59:0/2183735078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42b8156840 0x7f42b815bb90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f42b0030000 tx=0x7f42b0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:41.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.484+0000 7f429f7fe640 1 -- 172.21.15.59:0/2183735078 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0041030 con 0x7f42b8156840 2024-04-25T15:46:41.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.484+0000 7f429f7fe640 1 -- 172.21.15.59:0/2183735078 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b0031400 con 0x7f42b8156840 2024-04-25T15:46:41.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.484+0000 7f42bd00d640 1 -- 172.21.15.59:0/2183735078 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b814bfc0 con 0x7f42b8156840 2024-04-25T15:46:41.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.485+0000 7f429f7fe640 1 -- 172.21.15.59:0/2183735078 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0036040 con 0x7f42b8156840 2024-04-25T15:46:41.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.485+0000 7f42bd00d640 1 -- 172.21.15.59:0/2183735078 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b814ba00 con 0x7f42b8156840 2024-04-25T15:46:41.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.486+0000 7f42bd00d640 1 -- 172.21.15.59:0/2183735078 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b8069fb0 con 0x7f42b8156840 2024-04-25T15:46:41.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.789+0000 7f429f7fe640 1 -- 172.21.15.59:0/2183735078 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f42b0044070 con 0x7f42b8156840 2024-04-25T15:46:41.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.789+0000 7f429f7fe640 1 --2- 172.21.15.59:0/2183735078 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f42a40744b0 0x7f42a40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:41.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.789+0000 7f42b6d9d640 1 --2- 172.21.15.59:0/2183735078 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f42a40744b0 0x7f42a40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:41.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.790+0000 7f42b6d9d640 1 --2- 172.21.15.59:0/2183735078 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f42a40744b0 0x7f42a40769c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f42ac007fd0 tx=0x7f42ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:41.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.794+0000 7f429f7fe640 1 -- 172.21.15.59:0/2183735078 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f42b007c460 con 0x7f42b8156840 2024-04-25T15:46:41.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:41.806+0000 7f429f7fe640 1 -- 172.21.15.59:0/2183735078 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f42b004b070 con 0x7f42b8156840 2024-04-25T15:46:42.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.018+0000 7f42bd00d640 1 -- 172.21.15.59:0/2183735078 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42b806e420 con 0x7f42b8156840 2024-04-25T15:46:42.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.067+0000 7f429f7fe640 1 -- 172.21.15.59:0/2183735078 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16545 (secure 0 0 0) 0x7f42b00808d0 con 0x7f42b8156840 2024-04-25T15:46:42.069 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:42.069 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":22,"fsid":"9bb5d7ca-5217-467b-882c-0a18cd57f08f","created":"2024-04-25T15:46:00.198001+0000","modified":"2024-04-25T15:46:33.915756+0000","last_up_change":"2024-04-25T15:46:15.850827+0000","last_in_change":"2024-04-25T15:46:06.311980+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:46:16.936340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:30.174141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:31.372481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34cee654-11dd-4f4b-99fe-093462f8abad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6803","nonce":1314235095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6805","nonce":1314235095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6809","nonce":1314235095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6807","nonce":1314235095}]},"public_addr":"172.21.15.59:6803/1314235095","cluster_addr":"172.21.15.59:6805/1314235095","heartbeat_back_addr":"172.21.15.59:6809/1314235095","heartbeat_front_addr":"172.21.15.59:6807/1314235095","state":["exists","up"]},{"osd":1,"uuid":"3c15505b-4abd-4a24-b30c-edc2732f8ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6827","nonce":3550810151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6829","nonce":3550810151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6833","nonce":3550810151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6831","nonce":3550810151}]},"public_addr":"172.21.15.59:6827/3550810151","cluster_addr":"172.21.15.59:6829/3550810151","heartbeat_back_addr":"172.21.15.59:6833/3550810151","heartbeat_front_addr":"172.21.15.59:6831/3550810151","state":["exists","up"]},{"osd":2,"uuid":"5884bf21-e6b4-4813-b8bc-6baa92443c87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6811","nonce":1651189093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6813","nonce":1651189093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6817","nonce":1651189093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6815","nonce":1651189093}]},"public_addr":"172.21.15.59:6811/1651189093","cluster_addr":"172.21.15.59:6813/1651189093","heartbeat_back_addr":"172.21.15.59:6817/1651189093","heartbeat_front_addr":"172.21.15.59:6815/1651189093","state":["exists","up"]},{"osd":3,"uuid":"6ff71700-3b00-4350-b3c9-f6c41ec46b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6819","nonce":1300858236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6821","nonce":1300858236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6825","nonce":1300858236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6823","nonce":1300858236}]},"public_addr":"172.21.15.59:6819/1300858236","cluster_addr":"172.21.15.59:6821/1300858236","heartbeat_back_addr":"172.21.15.59:6825/1300858236","heartbeat_front_addr":"172.21.15.59:6823/1300858236","state":["exists","up"]},{"osd":4,"uuid":"d0a72143-93fd-4712-aadb-f3fade303426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6817","nonce":2206186554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6819","nonce":2206186554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6823","nonce":2206186554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6821","nonce":2206186554}]},"public_addr":"172.21.15.64:6817/2206186554","cluster_addr":"172.21.15.64:6819/2206186554","heartbeat_back_addr":"172.21.15.64:6823/2206186554","heartbeat_front_addr":"172.21.15.64:6821/2206186554","state":["exists","up"]},{"osd":5,"uuid":"9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6825","nonce":639697697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6827","nonce":639697697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6831","nonce":639697697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6829","nonce":639697697}]},"public_addr":"172.21.15.64:6825/639697697","cluster_addr":"172.21.15.64:6827/639697697","heartbeat_back_addr":"172.21.15.64:6831/639697697","heartbeat_front_addr":"172.21.15.64:6829/639697697","state":["exists","up"]},{"osd":6,"uuid":"311d9a6b-8fbc-4809-8d33-b9248a3562f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6809","nonce":2335675289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6811","nonce":2335675289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6815","nonce":2335675289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6813","nonce":2335675289}]},"public_addr":"172.21.15.64:6809/2335675289","cluster_addr":"172.21.15.64:6811/2335675289","heartbeat_back_addr":"172.21.15.64:6815/2335675289","heartbeat_front_addr":"172.21.15.64:6813/2335675289","state":["exists","up"]},{"osd":7,"uuid":"d0f7436e-882f-4aa7-b2ae-684b9894b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6801","nonce":970439753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6803","nonce":970439753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6807","nonce":970439753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6805","nonce":970439753}]},"public_addr":"172.21.15.64:6801/970439753","cluster_addr":"172.21.15.64:6803/970439753","heartbeat_back_addr":"172.21.15.64:6807/970439753","heartbeat_front_addr":"172.21.15.64:6805/970439753","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.807777+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.945589+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.926832+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.943537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.925062+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.957550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.913559+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.839159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:42.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.069+0000 7f42bd00d640 1 -- 172.21.15.59:0/2183735078 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f42a40744b0 msgr2=0x7f42a40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.069+0000 7f42bd00d640 1 --2- 172.21.15.59:0/2183735078 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f42a40744b0 0x7f42a40769c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f42ac007fd0 tx=0x7f42ac009040 comp rx=0 tx=0).stop 2024-04-25T15:46:42.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.069+0000 7f42bd00d640 1 -- 172.21.15.59:0/2183735078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42b8156840 msgr2=0x7f42b815bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.069+0000 7f42bd00d640 1 --2- 172.21.15.59:0/2183735078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42b8156840 0x7f42b815bb90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f42b0030000 tx=0x7f42b0004a40 comp rx=0 tx=0).stop 2024-04-25T15:46:42.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.069+0000 7f42bd00d640 1 -- 172.21.15.59:0/2183735078 shutdown_connections 2024-04-25T15:46:42.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.069+0000 7f42bd00d640 1 --2- 172.21.15.59:0/2183735078 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f42a40744b0 0x7f42a40769c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.069+0000 7f42bd00d640 1 --2- 172.21.15.59:0/2183735078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42b8156840 0x7f42b815bb90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.069+0000 7f42bd00d640 1 --2- 172.21.15.59:0/2183735078 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42b80b3510 0x7f42b81491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.069+0000 7f42bd00d640 1 --2- 172.21.15.59:0/2183735078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42b80b2fc0 0x7f42b81f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.069+0000 7f42bd00d640 1 -- 172.21.15.59:0/2183735078 >> 172.21.15.59:0/2183735078 conn(0x7f42b8072500 msgr2=0x7f42b81511d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:42.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.069+0000 7f42bd00d640 1 -- 172.21.15.59:0/2183735078 shutdown_connections 2024-04-25T15:46:42.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.069+0000 7f42bd00d640 1 -- 172.21.15.59:0/2183735078 wait complete. 2024-04-25T15:46:42.083 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T15:46:42.083 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:46:42.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.194+0000 7f94bca84640 1 Processor -- start 2024-04-25T15:46:42.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.194+0000 7f94bca84640 1 -- start start 2024-04-25T15:46:42.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.195+0000 7f94bca84640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94b80b41c0 0x7f94b80cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.195+0000 7f94bca84640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f94b80ce540 0x7f94b80ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.195+0000 7f94bca84640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94b815cd60 con 0x7f94b80cd680 2024-04-25T15:46:42.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.195+0000 7f94bca84640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f94b815d040 con 0x7f94b80b41c0 2024-04-25T15:46:42.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.195+0000 7f94bca84640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f94b815d320 con 0x7f94b80ce540 2024-04-25T15:46:42.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.196+0000 7f94b6d9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f94b80ce540 0x7f94b80ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.196+0000 7f94b659c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94b80b41c0 0x7f94b80cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.196+0000 7f94b6d9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f94b80ce540 0x7f94b80ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:38412/0 (socket says 172.21.15.59:38412) 2024-04-25T15:46:42.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.196+0000 7f94b6d9d640 1 -- 172.21.15.59:0/1052121086 learned_addr learned my addr 172.21.15.59:0/1052121086 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:42.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.199+0000 7f94b6d9d640 1 -- 172.21.15.59:0/1052121086 >> v2:172.21.15.59:3300/0 conn(0x7f94b80b41c0 msgr2=0x7f94b80cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:42.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.199+0000 7f94b6d9d640 1 --2- 172.21.15.59:0/1052121086 >> v2:172.21.15.59:3300/0 conn(0x7f94b80b41c0 0x7f94b80cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.199+0000 7f94b6d9d640 1 -- 172.21.15.59:0/1052121086 >> v1:172.21.15.59:6789/0 conn(0x7f94b80cd680 legacy=0x7f94b815c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.199+0000 7f94b6d9d640 1 -- 172.21.15.59:0/1052121086 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b815d600 con 0x7f94b80ce540 2024-04-25T15:46:42.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.201+0000 7f94b6d9d640 1 --2- 172.21.15.59:0/1052121086 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f94b80ce540 0x7f94b80ce950 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009e50 tx=0x7f94b002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce45340d09a716d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:42.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.206+0000 7f94b5d9b640 1 -- 172.21.15.59:0/1052121086 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0036070 con 0x7f94b80ce540 2024-04-25T15:46:42.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.206+0000 7f94b5d9b640 1 -- 172.21.15.59:0/1052121086 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b0031600 con 0x7f94b80ce540 2024-04-25T15:46:42.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.206+0000 7f94b5d9b640 1 -- 172.21.15.59:0/1052121086 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b00319d0 con 0x7f94b80ce540 2024-04-25T15:46:42.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.207+0000 7f94bca84640 1 -- 172.21.15.59:0/1052121086 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f94b80ce540 msgr2=0x7f94b80ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.207+0000 7f94bca84640 1 --2- 172.21.15.59:0/1052121086 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f94b80ce540 0x7f94b80ce950 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009e50 tx=0x7f94b002a710 comp rx=0 tx=0).stop 2024-04-25T15:46:42.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.207+0000 7f94bca84640 1 -- 172.21.15.59:0/1052121086 shutdown_connections 2024-04-25T15:46:42.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.207+0000 7f94bca84640 1 --2- 172.21.15.59:0/1052121086 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f94b80ce540 0x7f94b80ce950 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.207+0000 7f94bca84640 1 --2- 172.21.15.59:0/1052121086 >> v2:172.21.15.59:3300/0 conn(0x7f94b80b41c0 0x7f94b80cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.207+0000 7f94bca84640 1 -- 172.21.15.59:0/1052121086 >> 172.21.15.59:0/1052121086 conn(0x7f94b806ed70 msgr2=0x7f94b806f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:42.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.207+0000 7f94bca84640 1 -- 172.21.15.59:0/1052121086 shutdown_connections 2024-04-25T15:46:42.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.207+0000 7f94bca84640 1 -- 172.21.15.59:0/1052121086 wait complete. 2024-04-25T15:46:42.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.209+0000 7f94bca84640 1 Processor -- start 2024-04-25T15:46:42.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.209+0000 7f94bca84640 1 -- start start 2024-04-25T15:46:42.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.210+0000 7f94bca84640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94b80b41c0 0x7f94b8149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.210+0000 7f94bca84640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94b80cd680 0x7f94b80d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.210+0000 7f94bca84640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f94b80ce540 0x7f94b80d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.210+0000 7f94bca84640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94b80cee90 con 0x7f94b80b41c0 2024-04-25T15:46:42.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.210+0000 7f94bca84640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f94b80b78a0 con 0x7f94b80cd680 2024-04-25T15:46:42.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.210+0000 7f94bca84640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f94b80c51e0 con 0x7f94b80ce540 2024-04-25T15:46:42.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.211+0000 7f94b6d9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f94b80ce540 0x7f94b80d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.211+0000 7f94b659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94b80b41c0 0x7f94b8149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.211+0000 7f94b6d9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f94b80ce540 0x7f94b80d0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:38414/0 (socket says 172.21.15.59:38414) 2024-04-25T15:46:42.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.211+0000 7f94affff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94b80cd680 0x7f94b80d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.211+0000 7f94b6d9d640 1 -- 172.21.15.59:0/4098262726 learned_addr learned my addr 172.21.15.59:0/4098262726 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:42.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.215+0000 7f94b659c640 1 -- 172.21.15.59:0/4098262726 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f94b80ce540 msgr2=0x7f94b80d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.215+0000 7f94b659c640 1 --2- 172.21.15.59:0/4098262726 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f94b80ce540 0x7f94b80d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.215+0000 7f94b659c640 1 -- 172.21.15.59:0/4098262726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94b80cd680 msgr2=0x7f94b80d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.215+0000 7f94b659c640 1 --2- 172.21.15.59:0/4098262726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94b80cd680 0x7f94b80d08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.215+0000 7f94b659c640 1 -- 172.21.15.59:0/4098262726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b8149650 con 0x7f94b80b41c0 2024-04-25T15:46:42.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.215+0000 7f94b6d9d640 1 --2- 172.21.15.59:0/4098262726 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f94b80ce540 0x7f94b80d0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:46:42.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.218+0000 7f94b659c640 1 --2- 172.21.15.59:0/4098262726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94b80b41c0 0x7f94b8149110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f94a800e8a0 tx=0x7f94a800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:42.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.220+0000 7f94aeffd640 1 -- 172.21.15.59:0/4098262726 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8017070 con 0x7f94b80b41c0 2024-04-25T15:46:42.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.220+0000 7f94bca84640 1 -- 172.21.15.59:0/4098262726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b81f6e80 con 0x7f94b80b41c0 2024-04-25T15:46:42.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.220+0000 7f94bca84640 1 -- 172.21.15.59:0/4098262726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b8155e70 con 0x7f94b80b41c0 2024-04-25T15:46:42.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.221+0000 7f94bca84640 1 -- 172.21.15.59:0/4098262726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b80698a0 con 0x7f94b80b41c0 2024-04-25T15:46:42.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.222+0000 7f94aeffd640 1 -- 172.21.15.59:0/4098262726 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94a800c940 con 0x7f94b80b41c0 2024-04-25T15:46:42.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.222+0000 7f94aeffd640 1 -- 172.21.15.59:0/4098262726 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8021060 con 0x7f94b80b41c0 2024-04-25T15:46:42.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.518+0000 7f94aeffd640 1 -- 172.21.15.59:0/4098262726 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f94a801a070 con 0x7f94b80b41c0 2024-04-25T15:46:42.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.518+0000 7f94aeffd640 1 --2- 172.21.15.59:0/4098262726 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f94980744b0 0x7f94980769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.518+0000 7f94affff640 1 --2- 172.21.15.59:0/4098262726 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f94980744b0 0x7f94980769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.519+0000 7f94affff640 1 --2- 172.21.15.59:0/4098262726 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f94980744b0 0x7f94980769c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f94b8158eb0 tx=0x7f94a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:42.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.533+0000 7f94aeffd640 1 -- 172.21.15.59:0/4098262726 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f94a805bbb0 con 0x7f94b80b41c0 2024-04-25T15:46:42.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.533+0000 7f94aeffd640 1 -- 172.21.15.59:0/4098262726 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f94a8093e20 con 0x7f94b80b41c0 2024-04-25T15:46:42.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.713+0000 7f94bca84640 1 -- 172.21.15.59:0/4098262726 --> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f94b80cbab0 con 0x7f94980744b0 2024-04-25T15:46:42.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.720+0000 7f94aeffd640 1 -- 172.21.15.59:0/4098262726 <== mgr.4102 v2:172.21.15.59:6800/2368090706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251955 (secure 0 0 0) 0x7f94b80cbab0 con 0x7f94980744b0 2024-04-25T15:46:42.724 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:42.726 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T15:46:42.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.723+0000 7f94bca84640 1 -- 172.21.15.59:0/4098262726 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f94980744b0 msgr2=0x7f94980769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.723+0000 7f94bca84640 1 --2- 172.21.15.59:0/4098262726 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f94980744b0 0x7f94980769c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f94b8158eb0 tx=0x7f94a0009040 comp rx=0 tx=0).stop 2024-04-25T15:46:42.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.723+0000 7f94bca84640 1 -- 172.21.15.59:0/4098262726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94b80b41c0 msgr2=0x7f94b8149110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.723+0000 7f94bca84640 1 --2- 172.21.15.59:0/4098262726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94b80b41c0 0x7f94b8149110 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f94a800e8a0 tx=0x7f94a800ed60 comp rx=0 tx=0).stop 2024-04-25T15:46:42.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.723+0000 7f94bca84640 1 -- 172.21.15.59:0/4098262726 shutdown_connections 2024-04-25T15:46:42.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.723+0000 7f94bca84640 1 --2- 172.21.15.59:0/4098262726 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f94980744b0 0x7f94980769c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.723+0000 7f94bca84640 1 --2- 172.21.15.59:0/4098262726 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f94b80ce540 0x7f94b80d0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.723+0000 7f94bca84640 1 --2- 172.21.15.59:0/4098262726 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f94b80cd680 0x7f94b80d08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.723+0000 7f94bca84640 1 --2- 172.21.15.59:0/4098262726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94b80b41c0 0x7f94b8149110 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.723+0000 7f94bca84640 1 -- 172.21.15.59:0/4098262726 >> 172.21.15.59:0/4098262726 conn(0x7f94b806ed70 msgr2=0x7f94b80b61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:42.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.723+0000 7f94bca84640 1 -- 172.21.15.59:0/4098262726 shutdown_connections 2024-04-25T15:46:42.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.723+0000 7f94bca84640 1 -- 172.21.15.59:0/4098262726 wait complete. 2024-04-25T15:46:42.735 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-04-25T15:46:42.309283+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594918,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":204,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219140,"kb_used_data":3004,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755580,"statfs":{"total":773094113280,"available":772869713920,"internally_reserved":0,"allocated":3076096,"data_stored":1802004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4550,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.384802"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280274+0000","last_change":"2024-04-25T15:46:33.037109+0000","last_active":"2024-04-25T15:46:34.280274+0000","last_peered":"2024-04-25T15:46:34.280274+0000","last_clean":"2024-04-25T15:46:34.280274+0000","last_became_active":"2024-04-25T15:46:33.036415+0000","last_became_peered":"2024-04-25T15:46:33.036415+0000","last_unstale":"2024-04-25T15:46:34.280274+0000","last_undegraded":"2024-04-25T15:46:34.280274+0000","last_fullsized":"2024-04-25T15:46:34.280274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:33.557001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079837+0000","last_change":"2024-04-25T15:46:33.022420+0000","last_active":"2024-04-25T15:46:34.079837+0000","last_peered":"2024-04-25T15:46:34.079837+0000","last_clean":"2024-04-25T15:46:34.079837+0000","last_became_active":"2024-04-25T15:46:33.022095+0000","last_became_peered":"2024-04-25T15:46:33.022095+0000","last_unstale":"2024-04-25T15:46:34.079837+0000","last_undegraded":"2024-04-25T15:46:34.079837+0000","last_fullsized":"2024-04-25T15:46:34.079837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279160+0000","last_change":"2024-04-25T15:46:33.063451+0000","last_active":"2024-04-25T15:46:34.279160+0000","last_peered":"2024-04-25T15:46:34.279160+0000","last_clean":"2024-04-25T15:46:34.279160+0000","last_became_active":"2024-04-25T15:46:33.063038+0000","last_became_peered":"2024-04-25T15:46:33.063038+0000","last_unstale":"2024-04-25T15:46:34.279160+0000","last_undegraded":"2024-04-25T15:46:34.279160+0000","last_fullsized":"2024-04-25T15:46:34.279160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:49:29.792442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072346+0000","last_change":"2024-04-25T15:46:33.041049+0000","last_active":"2024-04-25T15:46:34.072346+0000","last_peered":"2024-04-25T15:46:34.072346+0000","last_clean":"2024-04-25T15:46:34.072346+0000","last_became_active":"2024-04-25T15:46:33.040716+0000","last_became_peered":"2024-04-25T15:46:33.040716+0000","last_unstale":"2024-04-25T15:46:34.072346+0000","last_undegraded":"2024-04-25T15:46:34.072346+0000","last_fullsized":"2024-04-25T15:46:34.072346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:12.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279724+0000","last_change":"2024-04-25T15:46:33.063350+0000","last_active":"2024-04-25T15:46:34.279724+0000","last_peered":"2024-04-25T15:46:34.279724+0000","last_clean":"2024-04-25T15:46:34.279724+0000","last_became_active":"2024-04-25T15:46:33.063110+0000","last_became_peered":"2024-04-25T15:46:33.063110+0000","last_unstale":"2024-04-25T15:46:34.279724+0000","last_undegraded":"2024-04-25T15:46:34.279724+0000","last_fullsized":"2024-04-25T15:46:34.279724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072549+0000","last_change":"2024-04-25T15:46:33.040765+0000","last_active":"2024-04-25T15:46:34.072549+0000","last_peered":"2024-04-25T15:46:34.072549+0000","last_clean":"2024-04-25T15:46:34.072549+0000","last_became_active":"2024-04-25T15:46:33.040272+0000","last_became_peered":"2024-04-25T15:46:33.040272+0000","last_unstale":"2024-04-25T15:46:34.072549+0000","last_undegraded":"2024-04-25T15:46:34.072549+0000","last_fullsized":"2024-04-25T15:46:34.072549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:20.677976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278880+0000","last_change":"2024-04-25T15:46:33.037395+0000","last_active":"2024-04-25T15:46:34.278880+0000","last_peered":"2024-04-25T15:46:34.278880+0000","last_clean":"2024-04-25T15:46:34.278880+0000","last_became_active":"2024-04-25T15:46:33.036613+0000","last_became_peered":"2024-04-25T15:46:33.036613+0000","last_unstale":"2024-04-25T15:46:34.278880+0000","last_undegraded":"2024-04-25T15:46:34.278880+0000","last_fullsized":"2024-04-25T15:46:34.278880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127454+0000","last_change":"2024-04-25T15:46:33.039941+0000","last_active":"2024-04-25T15:46:34.127454+0000","last_peered":"2024-04-25T15:46:34.127454+0000","last_clean":"2024-04-25T15:46:34.127454+0000","last_became_active":"2024-04-25T15:46:33.039696+0000","last_became_peered":"2024-04-25T15:46:33.039696+0000","last_unstale":"2024-04-25T15:46:34.127454+0000","last_undegraded":"2024-04-25T15:46:34.127454+0000","last_fullsized":"2024-04-25T15:46:34.127454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:41.663796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280450+0000","last_change":"2024-04-25T15:46:33.043405+0000","last_active":"2024-04-25T15:46:34.280450+0000","last_peered":"2024-04-25T15:46:34.280450+0000","last_clean":"2024-04-25T15:46:34.280450+0000","last_became_active":"2024-04-25T15:46:33.043094+0000","last_became_peered":"2024-04-25T15:46:33.043094+0000","last_unstale":"2024-04-25T15:46:34.280450+0000","last_undegraded":"2024-04-25T15:46:34.280450+0000","last_fullsized":"2024-04-25T15:46:34.280450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:49.811317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279156+0000","last_change":"2024-04-25T15:46:33.037180+0000","last_active":"2024-04-25T15:46:34.279156+0000","last_peered":"2024-04-25T15:46:34.279156+0000","last_clean":"2024-04-25T15:46:34.279156+0000","last_became_active":"2024-04-25T15:46:33.036822+0000","last_became_peered":"2024-04-25T15:46:33.036822+0000","last_unstale":"2024-04-25T15:46:34.279156+0000","last_undegraded":"2024-04-25T15:46:34.279156+0000","last_fullsized":"2024-04-25T15:46:34.279156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:45.123026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279431+0000","last_change":"2024-04-25T15:46:33.040594+0000","last_active":"2024-04-25T15:46:34.279431+0000","last_peered":"2024-04-25T15:46:34.279431+0000","last_clean":"2024-04-25T15:46:34.279431+0000","last_became_active":"2024-04-25T15:46:33.040296+0000","last_became_peered":"2024-04-25T15:46:33.040296+0000","last_unstale":"2024-04-25T15:46:34.279431+0000","last_undegraded":"2024-04-25T15:46:34.279431+0000","last_fullsized":"2024-04-25T15:46:34.279431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:47.844325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280119+0000","last_change":"2024-04-25T15:46:33.011129+0000","last_active":"2024-04-25T15:46:34.280119+0000","last_peered":"2024-04-25T15:46:34.280119+0000","last_clean":"2024-04-25T15:46:34.280119+0000","last_became_active":"2024-04-25T15:46:33.010754+0000","last_became_peered":"2024-04-25T15:46:33.010754+0000","last_unstale":"2024-04-25T15:46:34.280119+0000","last_undegraded":"2024-04-25T15:46:34.280119+0000","last_fullsized":"2024-04-25T15:46:34.280119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:31.093111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127704+0000","last_change":"2024-04-25T15:46:33.011388+0000","last_active":"2024-04-25T15:46:34.127704+0000","last_peered":"2024-04-25T15:46:34.127704+0000","last_clean":"2024-04-25T15:46:34.127704+0000","last_became_active":"2024-04-25T15:46:33.011083+0000","last_became_peered":"2024-04-25T15:46:33.011083+0000","last_unstale":"2024-04-25T15:46:34.127704+0000","last_undegraded":"2024-04-25T15:46:34.127704+0000","last_fullsized":"2024-04-25T15:46:34.127704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:22.959149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279003+0000","last_change":"2024-04-25T15:46:33.022531+0000","last_active":"2024-04-25T15:46:34.279003+0000","last_peered":"2024-04-25T15:46:34.279003+0000","last_clean":"2024-04-25T15:46:34.279003+0000","last_became_active":"2024-04-25T15:46:33.022214+0000","last_became_peered":"2024-04-25T15:46:33.022214+0000","last_unstale":"2024-04-25T15:46:34.279003+0000","last_undegraded":"2024-04-25T15:46:34.279003+0000","last_fullsized":"2024-04-25T15:46:34.279003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:19.052124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079530+0000","last_change":"2024-04-25T15:46:32.929715+0000","last_active":"2024-04-25T15:46:34.079530+0000","last_peered":"2024-04-25T15:46:34.079530+0000","last_clean":"2024-04-25T15:46:34.079530+0000","last_became_active":"2024-04-25T15:46:32.929386+0000","last_became_peered":"2024-04-25T15:46:32.929386+0000","last_unstale":"2024-04-25T15:46:34.079530+0000","last_undegraded":"2024-04-25T15:46:34.079530+0000","last_fullsized":"2024-04-25T15:46:34.079530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:47.844325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072189+0000","last_change":"2024-04-25T15:46:33.041583+0000","last_active":"2024-04-25T15:46:34.072189+0000","last_peered":"2024-04-25T15:46:34.072189+0000","last_clean":"2024-04-25T15:46:34.072189+0000","last_became_active":"2024-04-25T15:46:33.040240+0000","last_became_peered":"2024-04-25T15:46:33.040240+0000","last_unstale":"2024-04-25T15:46:34.072189+0000","last_undegraded":"2024-04-25T15:46:34.072189+0000","last_fullsized":"2024-04-25T15:46:34.072189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072738+0000","last_change":"2024-04-25T15:46:33.044561+0000","last_active":"2024-04-25T15:46:34.072738+0000","last_peered":"2024-04-25T15:46:34.072738+0000","last_clean":"2024-04-25T15:46:34.072738+0000","last_became_active":"2024-04-25T15:46:33.044065+0000","last_became_peered":"2024-04-25T15:46:33.044065+0000","last_unstale":"2024-04-25T15:46:34.072738+0000","last_undegraded":"2024-04-25T15:46:34.072738+0000","last_fullsized":"2024-04-25T15:46:34.072738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:33.557001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278571+0000","last_change":"2024-04-25T15:46:33.061929+0000","last_active":"2024-04-25T15:46:34.278571+0000","last_peered":"2024-04-25T15:46:34.278571+0000","last_clean":"2024-04-25T15:46:34.278571+0000","last_became_active":"2024-04-25T15:46:33.061623+0000","last_became_peered":"2024-04-25T15:46:33.061623+0000","last_unstale":"2024-04-25T15:46:34.278571+0000","last_undegraded":"2024-04-25T15:46:34.278571+0000","last_fullsized":"2024-04-25T15:46:34.278571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:28.844626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280701+0000","last_change":"2024-04-25T15:46:33.063451+0000","last_active":"2024-04-25T15:46:34.280701+0000","last_peered":"2024-04-25T15:46:34.280701+0000","last_clean":"2024-04-25T15:46:34.280701+0000","last_became_active":"2024-04-25T15:46:33.063126+0000","last_became_peered":"2024-04-25T15:46:33.063126+0000","last_unstale":"2024-04-25T15:46:34.280701+0000","last_undegraded":"2024-04-25T15:46:34.280701+0000","last_fullsized":"2024-04-25T15:46:34.280701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:49.144595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278998+0000","last_change":"2024-04-25T15:46:33.014377+0000","last_active":"2024-04-25T15:46:34.278998+0000","last_peered":"2024-04-25T15:46:34.278998+0000","last_clean":"2024-04-25T15:46:34.278998+0000","last_became_active":"2024-04-25T15:46:33.014056+0000","last_became_peered":"2024-04-25T15:46:33.014056+0000","last_unstale":"2024-04-25T15:46:34.278998+0000","last_undegraded":"2024-04-25T15:46:34.278998+0000","last_fullsized":"2024-04-25T15:46:34.278998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:49.025646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279064+0000","last_change":"2024-04-25T15:46:33.032744+0000","last_active":"2024-04-25T15:46:34.279064+0000","last_peered":"2024-04-25T15:46:34.279064+0000","last_clean":"2024-04-25T15:46:34.279064+0000","last_became_active":"2024-04-25T15:46:33.032498+0000","last_became_peered":"2024-04-25T15:46:33.032498+0000","last_unstale":"2024-04-25T15:46:34.279064+0000","last_undegraded":"2024-04-25T15:46:34.279064+0000","last_fullsized":"2024-04-25T15:46:34.279064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:04.861299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072714+0000","last_change":"2024-04-25T15:46:33.043548+0000","last_active":"2024-04-25T15:46:34.072714+0000","last_peered":"2024-04-25T15:46:34.072714+0000","last_clean":"2024-04-25T15:46:34.072714+0000","last_became_active":"2024-04-25T15:46:33.043251+0000","last_became_peered":"2024-04-25T15:46:33.043251+0000","last_unstale":"2024-04-25T15:46:34.072714+0000","last_undegraded":"2024-04-25T15:46:34.072714+0000","last_fullsized":"2024-04-25T15:46:34.072714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:04.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127585+0000","last_change":"2024-04-25T15:46:32.927532+0000","last_active":"2024-04-25T15:46:34.127585+0000","last_peered":"2024-04-25T15:46:34.127585+0000","last_clean":"2024-04-25T15:46:34.127585+0000","last_became_active":"2024-04-25T15:46:32.926836+0000","last_became_peered":"2024-04-25T15:46:32.926836+0000","last_unstale":"2024-04-25T15:46:34.127585+0000","last_undegraded":"2024-04-25T15:46:34.127585+0000","last_fullsized":"2024-04-25T15:46:34.127585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:21.339594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072201+0000","last_change":"2024-04-25T15:46:33.041900+0000","last_active":"2024-04-25T15:46:34.072201+0000","last_peered":"2024-04-25T15:46:34.072201+0000","last_clean":"2024-04-25T15:46:34.072201+0000","last_became_active":"2024-04-25T15:46:33.040821+0000","last_became_peered":"2024-04-25T15:46:33.040821+0000","last_unstale":"2024-04-25T15:46:34.072201+0000","last_undegraded":"2024-04-25T15:46:34.072201+0000","last_fullsized":"2024-04-25T15:46:34.072201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.128074+0000","last_change":"2024-04-25T15:46:32.926772+0000","last_active":"2024-04-25T15:46:34.128074+0000","last_peered":"2024-04-25T15:46:34.128074+0000","last_clean":"2024-04-25T15:46:34.128074+0000","last_became_active":"2024-04-25T15:46:32.926468+0000","last_became_peered":"2024-04-25T15:46:32.926468+0000","last_unstale":"2024-04-25T15:46:34.128074+0000","last_undegraded":"2024-04-25T15:46:34.128074+0000","last_fullsized":"2024-04-25T15:46:34.128074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:21:35.665923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279365+0000","last_change":"2024-04-25T15:46:33.031482+0000","last_active":"2024-04-25T15:46:34.279365+0000","last_peered":"2024-04-25T15:46:34.279365+0000","last_clean":"2024-04-25T15:46:34.279365+0000","last_became_active":"2024-04-25T15:46:33.031182+0000","last_became_peered":"2024-04-25T15:46:33.031182+0000","last_unstale":"2024-04-25T15:46:34.279365+0000","last_undegraded":"2024-04-25T15:46:34.279365+0000","last_fullsized":"2024-04-25T15:46:34.279365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079941+0000","last_change":"2024-04-25T15:46:32.931992+0000","last_active":"2024-04-25T15:46:34.079941+0000","last_peered":"2024-04-25T15:46:34.079941+0000","last_clean":"2024-04-25T15:46:34.079941+0000","last_became_active":"2024-04-25T15:46:32.931684+0000","last_became_peered":"2024-04-25T15:46:32.931684+0000","last_unstale":"2024-04-25T15:46:34.079941+0000","last_undegraded":"2024-04-25T15:46:34.079941+0000","last_fullsized":"2024-04-25T15:46:34.079941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:12.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127825+0000","last_change":"2024-04-25T15:46:32.926461+0000","last_active":"2024-04-25T15:46:34.127825+0000","last_peered":"2024-04-25T15:46:34.127825+0000","last_clean":"2024-04-25T15:46:34.127825+0000","last_became_active":"2024-04-25T15:46:32.926136+0000","last_became_peered":"2024-04-25T15:46:32.926136+0000","last_unstale":"2024-04-25T15:46:34.127825+0000","last_undegraded":"2024-04-25T15:46:34.127825+0000","last_fullsized":"2024-04-25T15:46:34.127825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:29.896062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279231+0000","last_change":"2024-04-25T15:46:33.022460+0000","last_active":"2024-04-25T15:46:34.279231+0000","last_peered":"2024-04-25T15:46:34.279231+0000","last_clean":"2024-04-25T15:46:34.279231+0000","last_became_active":"2024-04-25T15:46:33.022116+0000","last_became_peered":"2024-04-25T15:46:33.022116+0000","last_unstale":"2024-04-25T15:46:34.279231+0000","last_undegraded":"2024-04-25T15:46:34.279231+0000","last_fullsized":"2024-04-25T15:46:34.279231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:22.980615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072889+0000","last_change":"2024-04-25T15:46:33.040668+0000","last_active":"2024-04-25T15:46:34.072889+0000","last_peered":"2024-04-25T15:46:34.072889+0000","last_clean":"2024-04-25T15:46:34.072889+0000","last_became_active":"2024-04-25T15:46:33.040134+0000","last_became_peered":"2024-04-25T15:46:33.040134+0000","last_unstale":"2024-04-25T15:46:34.072889+0000","last_undegraded":"2024-04-25T15:46:34.072889+0000","last_fullsized":"2024-04-25T15:46:34.072889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:16.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278491+0000","last_change":"2024-04-25T15:46:33.062510+0000","last_active":"2024-04-25T15:46:34.278491+0000","last_peered":"2024-04-25T15:46:34.278491+0000","last_clean":"2024-04-25T15:46:34.278491+0000","last_became_active":"2024-04-25T15:46:33.062166+0000","last_became_peered":"2024-04-25T15:46:33.062166+0000","last_unstale":"2024-04-25T15:46:34.278491+0000","last_undegraded":"2024-04-25T15:46:34.278491+0000","last_fullsized":"2024-04-25T15:46:34.278491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:31.093111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279330+0000","last_change":"2024-04-25T15:46:33.022223+0000","last_active":"2024-04-25T15:46:34.279330+0000","last_peered":"2024-04-25T15:46:34.279330+0000","last_clean":"2024-04-25T15:46:34.279330+0000","last_became_active":"2024-04-25T15:46:33.021888+0000","last_became_peered":"2024-04-25T15:46:33.021888+0000","last_unstale":"2024-04-25T15:46:34.279330+0000","last_undegraded":"2024-04-25T15:46:34.279330+0000","last_fullsized":"2024-04-25T15:46:34.279330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:23.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279381+0000","last_change":"2024-04-25T15:46:32.929281+0000","last_active":"2024-04-25T15:46:34.279381+0000","last_peered":"2024-04-25T15:46:34.279381+0000","last_clean":"2024-04-25T15:46:34.279381+0000","last_became_active":"2024-04-25T15:46:32.929019+0000","last_became_peered":"2024-04-25T15:46:32.929019+0000","last_unstale":"2024-04-25T15:46:34.279381+0000","last_undegraded":"2024-04-25T15:46:34.279381+0000","last_fullsized":"2024-04-25T15:46:34.279381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:55.692126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.522003+0000","last_change":"2024-04-25T15:46:31.685950+0000","last_active":"2024-04-25T15:46:39.522003+0000","last_peered":"2024-04-25T15:46:39.522003+0000","last_clean":"2024-04-25T15:46:39.522003+0000","last_became_active":"2024-04-25T15:46:31.685602+0000","last_became_peered":"2024-04-25T15:46:31.685602+0000","last_unstale":"2024-04-25T15:46:39.522003+0000","last_undegraded":"2024-04-25T15:46:39.522003+0000","last_fullsized":"2024-04-25T15:46:39.522003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:29.676427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279266+0000","last_change":"2024-04-25T15:46:33.023655+0000","last_active":"2024-04-25T15:46:34.279266+0000","last_peered":"2024-04-25T15:46:34.279266+0000","last_clean":"2024-04-25T15:46:34.279266+0000","last_became_active":"2024-04-25T15:46:33.023432+0000","last_became_peered":"2024-04-25T15:46:33.023432+0000","last_unstale":"2024-04-25T15:46:34.279266+0000","last_undegraded":"2024-04-25T15:46:34.279266+0000","last_fullsized":"2024-04-25T15:46:34.279266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:21.339594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.782101+0000","last_change":"2024-04-25T15:46:31.659079+0000","last_active":"2024-04-25T15:46:41.782101+0000","last_peered":"2024-04-25T15:46:41.782101+0000","last_clean":"2024-04-25T15:46:41.782101+0000","last_became_active":"2024-04-25T15:46:31.658681+0000","last_became_peered":"2024-04-25T15:46:31.658681+0000","last_unstale":"2024-04-25T15:46:41.782101+0000","last_undegraded":"2024-04-25T15:46:41.782101+0000","last_fullsized":"2024-04-25T15:46:41.782101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127408+0000","last_change":"2024-04-25T15:46:31.684220+0000","last_active":"2024-04-25T15:46:34.127408+0000","last_peered":"2024-04-25T15:46:34.127408+0000","last_clean":"2024-04-25T15:46:34.127408+0000","last_became_active":"2024-04-25T15:46:31.682936+0000","last_became_peered":"2024-04-25T15:46:31.682936+0000","last_unstale":"2024-04-25T15:46:34.127408+0000","last_undegraded":"2024-04-25T15:46:34.127408+0000","last_fullsized":"2024-04-25T15:46:34.127408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:53.729696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127570+0000","last_change":"2024-04-25T15:46:33.019843+0000","last_active":"2024-04-25T15:46:34.127570+0000","last_peered":"2024-04-25T15:46:34.127570+0000","last_clean":"2024-04-25T15:46:34.127570+0000","last_became_active":"2024-04-25T15:46:33.019526+0000","last_became_peered":"2024-04-25T15:46:33.019526+0000","last_unstale":"2024-04-25T15:46:34.127570+0000","last_undegraded":"2024-04-25T15:46:34.127570+0000","last_fullsized":"2024-04-25T15:46:34.127570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:22.980615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072467+0000","last_change":"2024-04-25T15:46:31.689444+0000","last_active":"2024-04-25T15:46:34.072467+0000","last_peered":"2024-04-25T15:46:34.072467+0000","last_clean":"2024-04-25T15:46:34.072467+0000","last_became_active":"2024-04-25T15:46:31.689130+0000","last_became_peered":"2024-04-25T15:46:31.689130+0000","last_unstale":"2024-04-25T15:46:34.072467+0000","last_undegraded":"2024-04-25T15:46:34.072467+0000","last_fullsized":"2024-04-25T15:46:34.072467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079523+0000","last_change":"2024-04-25T15:46:32.931979+0000","last_active":"2024-04-25T15:46:34.079523+0000","last_peered":"2024-04-25T15:46:34.079523+0000","last_clean":"2024-04-25T15:46:34.079523+0000","last_became_active":"2024-04-25T15:46:32.931648+0000","last_became_peered":"2024-04-25T15:46:32.931648+0000","last_unstale":"2024-04-25T15:46:34.079523+0000","last_undegraded":"2024-04-25T15:46:34.079523+0000","last_fullsized":"2024-04-25T15:46:34.079523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:23.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.520120+0000","last_change":"2024-04-25T15:46:31.685721+0000","last_active":"2024-04-25T15:46:39.520120+0000","last_peered":"2024-04-25T15:46:39.520120+0000","last_clean":"2024-04-25T15:46:39.520120+0000","last_became_active":"2024-04-25T15:46:31.685244+0000","last_became_peered":"2024-04-25T15:46:31.685244+0000","last_unstale":"2024-04-25T15:46:39.520120+0000","last_undegraded":"2024-04-25T15:46:39.520120+0000","last_fullsized":"2024-04-25T15:46:39.520120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072360+0000","last_change":"2024-04-25T15:46:33.043533+0000","last_active":"2024-04-25T15:46:34.072360+0000","last_peered":"2024-04-25T15:46:34.072360+0000","last_clean":"2024-04-25T15:46:34.072360+0000","last_became_active":"2024-04-25T15:46:33.043228+0000","last_became_peered":"2024-04-25T15:46:33.043228+0000","last_unstale":"2024-04-25T15:46:34.072360+0000","last_undegraded":"2024-04-25T15:46:34.072360+0000","last_fullsized":"2024-04-25T15:46:34.072360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.519834+0000","last_change":"2024-04-25T15:46:31.692399+0000","last_active":"2024-04-25T15:46:39.519834+0000","last_peered":"2024-04-25T15:46:39.519834+0000","last_clean":"2024-04-25T15:46:39.519834+0000","last_became_active":"2024-04-25T15:46:31.692063+0000","last_became_peered":"2024-04-25T15:46:31.692063+0000","last_unstale":"2024-04-25T15:46:39.519834+0000","last_undegraded":"2024-04-25T15:46:39.519834+0000","last_fullsized":"2024-04-25T15:46:39.519834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279587+0000","last_change":"2024-04-25T15:46:33.043275+0000","last_active":"2024-04-25T15:46:34.279587+0000","last_peered":"2024-04-25T15:46:34.279587+0000","last_clean":"2024-04-25T15:46:34.279587+0000","last_became_active":"2024-04-25T15:46:33.042941+0000","last_became_peered":"2024-04-25T15:46:33.042941+0000","last_unstale":"2024-04-25T15:46:34.279587+0000","last_undegraded":"2024-04-25T15:46:34.279587+0000","last_fullsized":"2024-04-25T15:46:34.279587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:22.959149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.597813+0000","last_change":"2024-04-25T15:46:31.686299+0000","last_active":"2024-04-25T15:46:34.597813+0000","last_peered":"2024-04-25T15:46:34.597813+0000","last_clean":"2024-04-25T15:46:34.597813+0000","last_became_active":"2024-04-25T15:46:31.685993+0000","last_became_peered":"2024-04-25T15:46:31.685993+0000","last_unstale":"2024-04-25T15:46:34.597813+0000","last_undegraded":"2024-04-25T15:46:34.597813+0000","last_fullsized":"2024-04-25T15:46:34.597813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280313+0000","last_change":"2024-04-25T15:46:33.035207+0000","last_active":"2024-04-25T15:46:34.280313+0000","last_peered":"2024-04-25T15:46:34.280313+0000","last_clean":"2024-04-25T15:46:34.280313+0000","last_became_active":"2024-04-25T15:46:33.034926+0000","last_became_peered":"2024-04-25T15:46:33.034926+0000","last_unstale":"2024-04-25T15:46:34.280313+0000","last_undegraded":"2024-04-25T15:46:34.280313+0000","last_fullsized":"2024-04-25T15:46:34.280313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:28.844626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.518399+0000","last_change":"2024-04-25T15:46:31.683086+0000","last_active":"2024-04-25T15:46:39.518399+0000","last_peered":"2024-04-25T15:46:39.518399+0000","last_clean":"2024-04-25T15:46:39.518399+0000","last_became_active":"2024-04-25T15:46:31.682661+0000","last_became_peered":"2024-04-25T15:46:31.682661+0000","last_unstale":"2024-04-25T15:46:39.518399+0000","last_undegraded":"2024-04-25T15:46:39.518399+0000","last_fullsized":"2024-04-25T15:46:39.518399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280485+0000","last_change":"2024-04-25T15:46:33.034800+0000","last_active":"2024-04-25T15:46:34.280485+0000","last_peered":"2024-04-25T15:46:34.280485+0000","last_clean":"2024-04-25T15:46:34.280485+0000","last_became_active":"2024-04-25T15:46:33.034493+0000","last_became_peered":"2024-04-25T15:46:33.034493+0000","last_unstale":"2024-04-25T15:46:34.280485+0000","last_undegraded":"2024-04-25T15:46:34.280485+0000","last_fullsized":"2024-04-25T15:46:34.280485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:16.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.404450+0000","last_change":"2024-04-25T15:46:31.688398+0000","last_active":"2024-04-25T15:46:39.404450+0000","last_peered":"2024-04-25T15:46:39.404450+0000","last_clean":"2024-04-25T15:46:39.404450+0000","last_became_active":"2024-04-25T15:46:31.688096+0000","last_became_peered":"2024-04-25T15:46:31.688096+0000","last_unstale":"2024-04-25T15:46:39.404450+0000","last_undegraded":"2024-04-25T15:46:39.404450+0000","last_fullsized":"2024-04-25T15:46:39.404450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:53.729696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279191+0000","last_change":"2024-04-25T15:46:33.031520+0000","last_active":"2024-04-25T15:46:34.279191+0000","last_peered":"2024-04-25T15:46:34.279191+0000","last_clean":"2024-04-25T15:46:34.279191+0000","last_became_active":"2024-04-25T15:46:33.031282+0000","last_became_peered":"2024-04-25T15:46:33.031282+0000","last_unstale":"2024-04-25T15:46:34.279191+0000","last_undegraded":"2024-04-25T15:46:34.279191+0000","last_fullsized":"2024-04-25T15:46:34.279191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:41.663796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.520081+0000","last_change":"2024-04-25T15:46:31.691191+0000","last_active":"2024-04-25T15:46:39.520081+0000","last_peered":"2024-04-25T15:46:39.520081+0000","last_clean":"2024-04-25T15:46:39.520081+0000","last_became_active":"2024-04-25T15:46:31.690848+0000","last_became_peered":"2024-04-25T15:46:31.690848+0000","last_unstale":"2024-04-25T15:46:39.520081+0000","last_undegraded":"2024-04-25T15:46:39.520081+0000","last_fullsized":"2024-04-25T15:46:39.520081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279897+0000","last_change":"2024-04-25T15:46:33.040890+0000","last_active":"2024-04-25T15:46:34.279897+0000","last_peered":"2024-04-25T15:46:34.279897+0000","last_clean":"2024-04-25T15:46:34.279897+0000","last_became_active":"2024-04-25T15:46:33.040568+0000","last_became_peered":"2024-04-25T15:46:33.040568+0000","last_unstale":"2024-04-25T15:46:34.279897+0000","last_undegraded":"2024-04-25T15:46:34.279897+0000","last_fullsized":"2024-04-25T15:46:34.279897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:04.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.784901+0000","last_change":"2024-04-25T15:46:31.659031+0000","last_active":"2024-04-25T15:46:41.784901+0000","last_peered":"2024-04-25T15:46:41.784901+0000","last_clean":"2024-04-25T15:46:41.784901+0000","last_became_active":"2024-04-25T15:46:31.658670+0000","last_became_peered":"2024-04-25T15:46:31.658670+0000","last_unstale":"2024-04-25T15:46:41.784901+0000","last_undegraded":"2024-04-25T15:46:41.784901+0000","last_fullsized":"2024-04-25T15:46:41.784901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279448+0000","last_change":"2024-04-25T15:46:33.021142+0000","last_active":"2024-04-25T15:46:34.279448+0000","last_peered":"2024-04-25T15:46:34.279448+0000","last_clean":"2024-04-25T15:46:34.279448+0000","last_became_active":"2024-04-25T15:46:33.020753+0000","last_became_peered":"2024-04-25T15:46:33.020753+0000","last_unstale":"2024-04-25T15:46:34.279448+0000","last_undegraded":"2024-04-25T15:46:34.279448+0000","last_fullsized":"2024-04-25T15:46:34.279448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'15","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.910630+0000","last_change":"2024-04-25T15:46:31.703454+0000","last_active":"2024-04-25T15:46:41.910630+0000","last_peered":"2024-04-25T15:46:41.910630+0000","last_clean":"2024-04-25T15:46:41.910630+0000","last_became_active":"2024-04-25T15:46:31.703167+0000","last_became_peered":"2024-04-25T15:46:31.703167+0000","last_unstale":"2024-04-25T15:46:41.910630+0000","last_undegraded":"2024-04-25T15:46:41.910630+0000","last_fullsized":"2024-04-25T15:46:41.910630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:02.958438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279066+0000","last_change":"2024-04-25T15:46:33.039900+0000","last_active":"2024-04-25T15:46:34.279066+0000","last_peered":"2024-04-25T15:46:34.279066+0000","last_clean":"2024-04-25T15:46:34.279066+0000","last_became_active":"2024-04-25T15:46:33.039613+0000","last_became_peered":"2024-04-25T15:46:33.039613+0000","last_unstale":"2024-04-25T15:46:34.279066+0000","last_undegraded":"2024-04-25T15:46:34.279066+0000","last_fullsized":"2024-04-25T15:46:34.279066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279574+0000","last_change":"2024-04-25T15:46:31.684537+0000","last_active":"2024-04-25T15:46:34.279574+0000","last_peered":"2024-04-25T15:46:34.279574+0000","last_clean":"2024-04-25T15:46:34.279574+0000","last_became_active":"2024-04-25T15:46:31.684173+0000","last_became_peered":"2024-04-25T15:46:31.684173+0000","last_unstale":"2024-04-25T15:46:34.279574+0000","last_undegraded":"2024-04-25T15:46:34.279574+0000","last_fullsized":"2024-04-25T15:46:34.279574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:41.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279453+0000","last_change":"2024-04-25T15:46:33.037831+0000","last_active":"2024-04-25T15:46:34.279453+0000","last_peered":"2024-04-25T15:46:34.279453+0000","last_clean":"2024-04-25T15:46:34.279453+0000","last_became_active":"2024-04-25T15:46:33.037529+0000","last_became_peered":"2024-04-25T15:46:33.037529+0000","last_unstale":"2024-04-25T15:46:34.279453+0000","last_undegraded":"2024-04-25T15:46:34.279453+0000","last_fullsized":"2024-04-25T15:46:34.279453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:20.677976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.683508+0000","last_change":"2024-04-25T15:46:31.704159+0000","last_active":"2024-04-25T15:46:34.683508+0000","last_peered":"2024-04-25T15:46:34.683508+0000","last_clean":"2024-04-25T15:46:34.683508+0000","last_became_active":"2024-04-25T15:46:31.703896+0000","last_became_peered":"2024-04-25T15:46:31.703896+0000","last_unstale":"2024-04-25T15:46:34.683508+0000","last_undegraded":"2024-04-25T15:46:34.683508+0000","last_fullsized":"2024-04-25T15:46:34.683508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280621+0000","last_change":"2024-04-25T15:46:33.038719+0000","last_active":"2024-04-25T15:46:34.280621+0000","last_peered":"2024-04-25T15:46:34.280621+0000","last_clean":"2024-04-25T15:46:34.280621+0000","last_became_active":"2024-04-25T15:46:33.038380+0000","last_became_peered":"2024-04-25T15:46:33.038380+0000","last_unstale":"2024-04-25T15:46:34.280621+0000","last_undegraded":"2024-04-25T15:46:34.280621+0000","last_fullsized":"2024-04-25T15:46:34.280621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:13:33.423087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079971+0000","last_change":"2024-04-25T15:46:31.690489+0000","last_active":"2024-04-25T15:46:34.079971+0000","last_peered":"2024-04-25T15:46:34.079971+0000","last_clean":"2024-04-25T15:46:34.079971+0000","last_became_active":"2024-04-25T15:46:31.690181+0000","last_became_peered":"2024-04-25T15:46:31.690181+0000","last_unstale":"2024-04-25T15:46:34.079971+0000","last_undegraded":"2024-04-25T15:46:34.079971+0000","last_fullsized":"2024-04-25T15:46:34.079971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072683+0000","last_change":"2024-04-25T15:46:33.036460+0000","last_active":"2024-04-25T15:46:34.072683+0000","last_peered":"2024-04-25T15:46:34.072683+0000","last_clean":"2024-04-25T15:46:34.072683+0000","last_became_active":"2024-04-25T15:46:33.036033+0000","last_became_peered":"2024-04-25T15:46:33.036033+0000","last_unstale":"2024-04-25T15:46:34.072683+0000","last_undegraded":"2024-04-25T15:46:34.072683+0000","last_fullsized":"2024-04-25T15:46:34.072683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.908940+0000","last_change":"2024-04-25T15:46:31.703571+0000","last_active":"2024-04-25T15:46:41.908940+0000","last_peered":"2024-04-25T15:46:41.908940+0000","last_clean":"2024-04-25T15:46:41.908940+0000","last_became_active":"2024-04-25T15:46:31.703234+0000","last_became_peered":"2024-04-25T15:46:31.703234+0000","last_unstale":"2024-04-25T15:46:41.908940+0000","last_undegraded":"2024-04-25T15:46:41.908940+0000","last_fullsized":"2024-04-25T15:46:41.908940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280501+0000","last_change":"2024-04-25T15:46:33.043464+0000","last_active":"2024-04-25T15:46:34.280501+0000","last_peered":"2024-04-25T15:46:34.280501+0000","last_clean":"2024-04-25T15:46:34.280501+0000","last_became_active":"2024-04-25T15:46:33.043145+0000","last_became_peered":"2024-04-25T15:46:33.043145+0000","last_unstale":"2024-04-25T15:46:34.280501+0000","last_undegraded":"2024-04-25T15:46:34.280501+0000","last_fullsized":"2024-04-25T15:46:34.280501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:06.648469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278676+0000","last_change":"2024-04-25T15:46:20.235628+0000","last_active":"2024-04-25T15:46:34.278676+0000","last_peered":"2024-04-25T15:46:34.278676+0000","last_clean":"2024-04-25T15:46:34.278676+0000","last_became_active":"2024-04-25T15:46:20.234477+0000","last_became_peered":"2024-04-25T15:46:20.234477+0000","last_unstale":"2024-04-25T15:46:34.278676+0000","last_undegraded":"2024-04-25T15:46:34.278676+0000","last_fullsized":"2024-04-25T15:46:34.278676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:17.824148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:17.824148+0000","last_clean_scrub_stamp":"2024-04-25T15:46:17.824148+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:50:25.187348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.520967+0000","last_change":"2024-04-25T15:46:31.702774+0000","last_active":"2024-04-25T15:46:39.520967+0000","last_peered":"2024-04-25T15:46:39.520967+0000","last_clean":"2024-04-25T15:46:39.520967+0000","last_became_active":"2024-04-25T15:46:31.702517+0000","last_became_peered":"2024-04-25T15:46:31.702517+0000","last_unstale":"2024-04-25T15:46:39.520967+0000","last_undegraded":"2024-04-25T15:46:39.520967+0000","last_fullsized":"2024-04-25T15:46:39.520967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127685+0000","last_change":"2024-04-25T15:46:33.043034+0000","last_active":"2024-04-25T15:46:34.127685+0000","last_peered":"2024-04-25T15:46:34.127685+0000","last_clean":"2024-04-25T15:46:34.127685+0000","last_became_active":"2024-04-25T15:46:33.042522+0000","last_became_peered":"2024-04-25T15:46:33.042522+0000","last_unstale":"2024-04-25T15:46:34.127685+0000","last_undegraded":"2024-04-25T15:46:34.127685+0000","last_fullsized":"2024-04-25T15:46:34.127685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:40.746464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.784860+0000","last_change":"2024-04-25T15:46:31.689200+0000","last_active":"2024-04-25T15:46:41.784860+0000","last_peered":"2024-04-25T15:46:41.784860+0000","last_clean":"2024-04-25T15:46:41.784860+0000","last_became_active":"2024-04-25T15:46:31.687761+0000","last_became_peered":"2024-04-25T15:46:31.687761+0000","last_unstale":"2024-04-25T15:46:41.784860+0000","last_undegraded":"2024-04-25T15:46:41.784860+0000","last_fullsized":"2024-04-25T15:46:41.784860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278867+0000","last_change":"2024-04-25T15:46:33.021652+0000","last_active":"2024-04-25T15:46:34.278867+0000","last_peered":"2024-04-25T15:46:34.278867+0000","last_clean":"2024-04-25T15:46:34.278867+0000","last_became_active":"2024-04-25T15:46:33.020828+0000","last_became_peered":"2024-04-25T15:46:33.020828+0000","last_unstale":"2024-04-25T15:46:34.278867+0000","last_undegraded":"2024-04-25T15:46:34.278867+0000","last_fullsized":"2024-04-25T15:46:34.278867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:11.243833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.909249+0000","last_change":"2024-04-25T15:46:31.704698+0000","last_active":"2024-04-25T15:46:41.909249+0000","last_peered":"2024-04-25T15:46:41.909249+0000","last_clean":"2024-04-25T15:46:41.909249+0000","last_became_active":"2024-04-25T15:46:31.704412+0000","last_became_peered":"2024-04-25T15:46:31.704412+0000","last_unstale":"2024-04-25T15:46:41.909249+0000","last_undegraded":"2024-04-25T15:46:41.909249+0000","last_fullsized":"2024-04-25T15:46:41.909249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079474+0000","last_change":"2024-04-25T15:46:33.061942+0000","last_active":"2024-04-25T15:46:34.079474+0000","last_peered":"2024-04-25T15:46:34.079474+0000","last_clean":"2024-04-25T15:46:34.079474+0000","last_became_active":"2024-04-25T15:46:33.061619+0000","last_became_peered":"2024-04-25T15:46:33.061619+0000","last_unstale":"2024-04-25T15:46:34.079474+0000","last_undegraded":"2024-04-25T15:46:34.079474+0000","last_fullsized":"2024-04-25T15:46:34.079474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:45.123026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.073122+0000","last_change":"2024-04-25T15:46:31.690694+0000","last_active":"2024-04-25T15:46:34.073122+0000","last_peered":"2024-04-25T15:46:34.073122+0000","last_clean":"2024-04-25T15:46:34.073122+0000","last_became_active":"2024-04-25T15:46:31.690339+0000","last_became_peered":"2024-04-25T15:46:31.690339+0000","last_unstale":"2024-04-25T15:46:34.073122+0000","last_undegraded":"2024-04-25T15:46:34.073122+0000","last_fullsized":"2024-04-25T15:46:34.073122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280771+0000","last_change":"2024-04-25T15:46:33.022306+0000","last_active":"2024-04-25T15:46:34.280771+0000","last_peered":"2024-04-25T15:46:34.280771+0000","last_clean":"2024-04-25T15:46:34.280771+0000","last_became_active":"2024-04-25T15:46:33.021995+0000","last_became_peered":"2024-04-25T15:46:33.021995+0000","last_unstale":"2024-04-25T15:46:34.280771+0000","last_undegraded":"2024-04-25T15:46:34.280771+0000","last_fullsized":"2024-04-25T15:46:34.280771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:03.749619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079765+0000","last_change":"2024-04-25T15:46:31.684114+0000","last_active":"2024-04-25T15:46:34.079765+0000","last_peered":"2024-04-25T15:46:34.079765+0000","last_clean":"2024-04-25T15:46:34.079765+0000","last_became_active":"2024-04-25T15:46:31.683802+0000","last_became_peered":"2024-04-25T15:46:31.683802+0000","last_unstale":"2024-04-25T15:46:34.079765+0000","last_undegraded":"2024-04-25T15:46:34.079765+0000","last_fullsized":"2024-04-25T15:46:34.079765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072964+0000","last_change":"2024-04-25T15:46:33.040119+0000","last_active":"2024-04-25T15:46:34.072964+0000","last_peered":"2024-04-25T15:46:34.072964+0000","last_clean":"2024-04-25T15:46:34.072964+0000","last_became_active":"2024-04-25T15:46:33.039820+0000","last_became_peered":"2024-04-25T15:46:33.039820+0000","last_unstale":"2024-04-25T15:46:34.072964+0000","last_undegraded":"2024-04-25T15:46:34.072964+0000","last_fullsized":"2024-04-25T15:46:34.072964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:06.648469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280760+0000","last_change":"2024-04-25T15:46:31.688610+0000","last_active":"2024-04-25T15:46:34.280760+0000","last_peered":"2024-04-25T15:46:34.280760+0000","last_clean":"2024-04-25T15:46:34.280760+0000","last_became_active":"2024-04-25T15:46:31.688274+0000","last_became_peered":"2024-04-25T15:46:31.688274+0000","last_unstale":"2024-04-25T15:46:34.280760+0000","last_undegraded":"2024-04-25T15:46:34.280760+0000","last_fullsized":"2024-04-25T15:46:34.280760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:02.574106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079663+0000","last_change":"2024-04-25T15:46:33.062042+0000","last_active":"2024-04-25T15:46:34.079663+0000","last_peered":"2024-04-25T15:46:34.079663+0000","last_clean":"2024-04-25T15:46:34.079663+0000","last_became_active":"2024-04-25T15:46:33.061680+0000","last_became_peered":"2024-04-25T15:46:33.061680+0000","last_unstale":"2024-04-25T15:46:34.079663+0000","last_undegraded":"2024-04-25T15:46:34.079663+0000","last_fullsized":"2024-04-25T15:46:34.079663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079964+0000","last_change":"2024-04-25T15:46:31.687114+0000","last_active":"2024-04-25T15:46:34.079964+0000","last_peered":"2024-04-25T15:46:34.079964+0000","last_clean":"2024-04-25T15:46:34.079964+0000","last_became_active":"2024-04-25T15:46:31.686758+0000","last_became_peered":"2024-04-25T15:46:31.686758+0000","last_unstale":"2024-04-25T15:46:34.079964+0000","last_undegraded":"2024-04-25T15:46:34.079964+0000","last_fullsized":"2024-04-25T15:46:34.079964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.128107+0000","last_change":"2024-04-25T15:46:33.031231+0000","last_active":"2024-04-25T15:46:34.128107+0000","last_peered":"2024-04-25T15:46:34.128107+0000","last_clean":"2024-04-25T15:46:34.128107+0000","last_became_active":"2024-04-25T15:46:33.030894+0000","last_became_peered":"2024-04-25T15:46:33.030894+0000","last_unstale":"2024-04-25T15:46:34.128107+0000","last_undegraded":"2024-04-25T15:46:34.128107+0000","last_fullsized":"2024-04-25T15:46:34.128107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:40.210974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.518049+0000","last_change":"2024-04-25T15:46:31.688577+0000","last_active":"2024-04-25T15:46:39.518049+0000","last_peered":"2024-04-25T15:46:39.518049+0000","last_clean":"2024-04-25T15:46:39.518049+0000","last_became_active":"2024-04-25T15:46:31.687691+0000","last_became_peered":"2024-04-25T15:46:31.687691+0000","last_unstale":"2024-04-25T15:46:39.518049+0000","last_undegraded":"2024-04-25T15:46:39.518049+0000","last_fullsized":"2024-04-25T15:46:39.518049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279504+0000","last_change":"2024-04-25T15:46:33.021249+0000","last_active":"2024-04-25T15:46:34.279504+0000","last_peered":"2024-04-25T15:46:34.279504+0000","last_clean":"2024-04-25T15:46:34.279504+0000","last_became_active":"2024-04-25T15:46:33.020779+0000","last_became_peered":"2024-04-25T15:46:33.020779+0000","last_unstale":"2024-04-25T15:46:34.279504+0000","last_undegraded":"2024-04-25T15:46:34.279504+0000","last_fullsized":"2024-04-25T15:46:34.279504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:39.504513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.406934+0000","last_change":"2024-04-25T15:46:31.689494+0000","last_active":"2024-04-25T15:46:39.406934+0000","last_peered":"2024-04-25T15:46:39.406934+0000","last_clean":"2024-04-25T15:46:39.406934+0000","last_became_active":"2024-04-25T15:46:31.688192+0000","last_became_peered":"2024-04-25T15:46:31.688192+0000","last_unstale":"2024-04-25T15:46:39.406934+0000","last_undegraded":"2024-04-25T15:46:39.406934+0000","last_fullsized":"2024-04-25T15:46:39.406934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278866+0000","last_change":"2024-04-25T15:46:33.062043+0000","last_active":"2024-04-25T15:46:34.278866+0000","last_peered":"2024-04-25T15:46:34.278866+0000","last_clean":"2024-04-25T15:46:34.278866+0000","last_became_active":"2024-04-25T15:46:33.061651+0000","last_became_peered":"2024-04-25T15:46:33.061651+0000","last_unstale":"2024-04-25T15:46:34.278866+0000","last_undegraded":"2024-04-25T15:46:34.278866+0000","last_fullsized":"2024-04-25T15:46:34.278866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:21.340361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079655+0000","last_change":"2024-04-25T15:46:31.685055+0000","last_active":"2024-04-25T15:46:34.079655+0000","last_peered":"2024-04-25T15:46:34.079655+0000","last_clean":"2024-04-25T15:46:34.079655+0000","last_became_active":"2024-04-25T15:46:31.684706+0000","last_became_peered":"2024-04-25T15:46:31.684706+0000","last_unstale":"2024-04-25T15:46:34.079655+0000","last_undegraded":"2024-04-25T15:46:34.079655+0000","last_fullsized":"2024-04-25T15:46:34.079655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:29.917598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127645+0000","last_change":"2024-04-25T15:46:32.929240+0000","last_active":"2024-04-25T15:46:34.127645+0000","last_peered":"2024-04-25T15:46:34.127645+0000","last_clean":"2024-04-25T15:46:34.127645+0000","last_became_active":"2024-04-25T15:46:32.928971+0000","last_became_peered":"2024-04-25T15:46:32.928971+0000","last_unstale":"2024-04-25T15:46:34.127645+0000","last_undegraded":"2024-04-25T15:46:34.127645+0000","last_fullsized":"2024-04-25T15:46:34.127645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:39.504513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079792+0000","last_change":"2024-04-25T15:46:31.687651+0000","last_active":"2024-04-25T15:46:34.079792+0000","last_peered":"2024-04-25T15:46:34.079792+0000","last_clean":"2024-04-25T15:46:34.079792+0000","last_became_active":"2024-04-25T15:46:31.687335+0000","last_became_peered":"2024-04-25T15:46:31.687335+0000","last_unstale":"2024-04-25T15:46:34.079792+0000","last_undegraded":"2024-04-25T15:46:34.079792+0000","last_fullsized":"2024-04-25T15:46:34.079792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127741+0000","last_change":"2024-04-25T15:46:33.021215+0000","last_active":"2024-04-25T15:46:34.127741+0000","last_peered":"2024-04-25T15:46:34.127741+0000","last_clean":"2024-04-25T15:46:34.127741+0000","last_became_active":"2024-04-25T15:46:33.020855+0000","last_became_peered":"2024-04-25T15:46:33.020855+0000","last_unstale":"2024-04-25T15:46:34.127741+0000","last_undegraded":"2024-04-25T15:46:34.127741+0000","last_fullsized":"2024-04-25T15:46:34.127741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:54.058601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.407002+0000","last_change":"2024-04-25T15:46:31.693099+0000","last_active":"2024-04-25T15:46:39.407002+0000","last_peered":"2024-04-25T15:46:39.407002+0000","last_clean":"2024-04-25T15:46:39.407002+0000","last_became_active":"2024-04-25T15:46:31.692762+0000","last_became_peered":"2024-04-25T15:46:31.692762+0000","last_unstale":"2024-04-25T15:46:39.407002+0000","last_undegraded":"2024-04-25T15:46:39.407002+0000","last_fullsized":"2024-04-25T15:46:39.407002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:29.917598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278877+0000","last_change":"2024-04-25T15:46:33.014467+0000","last_active":"2024-04-25T15:46:34.278877+0000","last_peered":"2024-04-25T15:46:34.278877+0000","last_clean":"2024-04-25T15:46:34.278877+0000","last_became_active":"2024-04-25T15:46:33.014116+0000","last_became_peered":"2024-04-25T15:46:33.014116+0000","last_unstale":"2024-04-25T15:46:34.278877+0000","last_undegraded":"2024-04-25T15:46:34.278877+0000","last_fullsized":"2024-04-25T15:46:34.278877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:44.912712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072776+0000","last_change":"2024-04-25T15:46:33.040027+0000","last_active":"2024-04-25T15:46:34.072776+0000","last_peered":"2024-04-25T15:46:34.072776+0000","last_clean":"2024-04-25T15:46:34.072776+0000","last_became_active":"2024-04-25T15:46:33.039713+0000","last_became_peered":"2024-04-25T15:46:33.039713+0000","last_unstale":"2024-04-25T15:46:34.072776+0000","last_undegraded":"2024-04-25T15:46:34.072776+0000","last_fullsized":"2024-04-25T15:46:34.072776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:49.811317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.600911+0000","last_change":"2024-04-25T15:46:31.686712+0000","last_active":"2024-04-25T15:46:34.600911+0000","last_peered":"2024-04-25T15:46:34.600911+0000","last_clean":"2024-04-25T15:46:34.600911+0000","last_became_active":"2024-04-25T15:46:31.686390+0000","last_became_peered":"2024-04-25T15:46:31.686390+0000","last_unstale":"2024-04-25T15:46:34.600911+0000","last_undegraded":"2024-04-25T15:46:34.600911+0000","last_fullsized":"2024-04-25T15:46:34.600911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072515+0000","last_change":"2024-04-25T15:46:33.041233+0000","last_active":"2024-04-25T15:46:34.072515+0000","last_peered":"2024-04-25T15:46:34.072515+0000","last_clean":"2024-04-25T15:46:34.072515+0000","last_became_active":"2024-04-25T15:46:33.040941+0000","last_became_peered":"2024-04-25T15:46:33.040941+0000","last_unstale":"2024-04-25T15:46:34.072515+0000","last_undegraded":"2024-04-25T15:46:34.072515+0000","last_fullsized":"2024-04-25T15:46:34.072515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.785446+0000","last_change":"2024-04-25T15:46:31.688658+0000","last_active":"2024-04-25T15:46:41.785446+0000","last_peered":"2024-04-25T15:46:41.785446+0000","last_clean":"2024-04-25T15:46:41.785446+0000","last_became_active":"2024-04-25T15:46:31.688342+0000","last_became_peered":"2024-04-25T15:46:31.688342+0000","last_unstale":"2024-04-25T15:46:41.785446+0000","last_undegraded":"2024-04-25T15:46:41.785446+0000","last_fullsized":"2024-04-25T15:46:41.785446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279544+0000","last_change":"2024-04-25T15:46:33.043423+0000","last_active":"2024-04-25T15:46:34.279544+0000","last_peered":"2024-04-25T15:46:34.279544+0000","last_clean":"2024-04-25T15:46:34.279544+0000","last_became_active":"2024-04-25T15:46:33.043134+0000","last_became_peered":"2024-04-25T15:46:33.043134+0000","last_unstale":"2024-04-25T15:46:34.279544+0000","last_undegraded":"2024-04-25T15:46:34.279544+0000","last_fullsized":"2024-04-25T15:46:34.279544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:40.746464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.679527+0000","last_change":"2024-04-25T15:46:31.685427+0000","last_active":"2024-04-25T15:46:34.679527+0000","last_peered":"2024-04-25T15:46:34.679527+0000","last_clean":"2024-04-25T15:46:34.679527+0000","last_became_active":"2024-04-25T15:46:31.684729+0000","last_became_peered":"2024-04-25T15:46:31.684729+0000","last_unstale":"2024-04-25T15:46:34.679527+0000","last_undegraded":"2024-04-25T15:46:34.679527+0000","last_fullsized":"2024-04-25T15:46:34.679527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:06.621567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.128030+0000","last_change":"2024-04-25T15:46:33.012259+0000","last_active":"2024-04-25T15:46:34.128030+0000","last_peered":"2024-04-25T15:46:34.128030+0000","last_clean":"2024-04-25T15:46:34.128030+0000","last_became_active":"2024-04-25T15:46:33.011979+0000","last_became_peered":"2024-04-25T15:46:33.011979+0000","last_unstale":"2024-04-25T15:46:34.128030+0000","last_undegraded":"2024-04-25T15:46:34.128030+0000","last_fullsized":"2024-04-25T15:46:34.128030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:47.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.609091+0000","last_change":"2024-04-25T15:46:31.688031+0000","last_active":"2024-04-25T15:46:34.609091+0000","last_peered":"2024-04-25T15:46:34.609091+0000","last_clean":"2024-04-25T15:46:34.609091+0000","last_became_active":"2024-04-25T15:46:31.687705+0000","last_became_peered":"2024-04-25T15:46:31.687705+0000","last_unstale":"2024-04-25T15:46:34.609091+0000","last_undegraded":"2024-04-25T15:46:34.609091+0000","last_fullsized":"2024-04-25T15:46:34.609091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:28.618857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4550,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":9570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":835584,"data_stored":668322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":78340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":78016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":77352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":76638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":76798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":78872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":831488,"data_stored":667666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:46:42.740 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:46:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.889+0000 7f83a4492640 1 Processor -- start 2024-04-25T15:46:42.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.889+0000 7f83a4492640 1 -- start start 2024-04-25T15:46:42.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.890+0000 7f83a4492640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f839c15c1b0 0x7f839c15c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.890+0000 7f83a4492640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f839c0ce540 0x7f839c0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.890+0000 7f83a4492640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f839c15cd60 con 0x7f839c0b41c0 2024-04-25T15:46:42.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.890+0000 7f83a4492640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f839c15cb00 con 0x7f839c15c1b0 2024-04-25T15:46:42.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.890+0000 7f83a4492640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f839c15d040 con 0x7f839c0ce540 2024-04-25T15:46:42.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.891+0000 7f83a2a2f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f839c0ce540 0x7f839c0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.892+0000 7f83a2a2f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f839c0ce540 0x7f839c0ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:38420/0 (socket says 172.21.15.59:38420) 2024-04-25T15:46:42.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.892+0000 7f83a2a2f640 1 -- 172.21.15.59:0/3424719310 learned_addr learned my addr 172.21.15.59:0/3424719310 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.896+0000 7f83a2a2f640 1 -- 172.21.15.59:0/3424719310 >> v2:172.21.15.59:3300/0 conn(0x7f839c15c1b0 msgr2=0x7f839c15c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.896+0000 7f83a2a2f640 1 --2- 172.21.15.59:0/3424719310 >> v2:172.21.15.59:3300/0 conn(0x7f839c15c1b0 0x7f839c15c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.896+0000 7f83a2a2f640 1 -- 172.21.15.59:0/3424719310 >> v1:172.21.15.64:6789/0 conn(0x7f839c0b41c0 legacy=0x7f839c0cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.896+0000 7f83a2a2f640 1 -- 172.21.15.59:0/3424719310 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c15d320 con 0x7f839c0ce540 2024-04-25T15:46:42.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.898+0000 7f83a2a2f640 1 --2- 172.21.15.59:0/3424719310 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f839c0ce540 0x7f839c0ce950 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8394009e50 tx=0x7f839402a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af8a8aa122ff36ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:42.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.908+0000 7f83a122c640 1 -- 172.21.15.59:0/3424719310 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394036070 con 0x7f839c0ce540 2024-04-25T15:46:42.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.908+0000 7f83a122c640 1 -- 172.21.15.59:0/3424719310 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8394031600 con 0x7f839c0ce540 2024-04-25T15:46:42.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.908+0000 7f83a122c640 1 -- 172.21.15.59:0/3424719310 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83940319d0 con 0x7f839c0ce540 2024-04-25T15:46:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.909+0000 7f83a4492640 1 -- 172.21.15.59:0/3424719310 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f839c0ce540 msgr2=0x7f839c0ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.909+0000 7f83a4492640 1 --2- 172.21.15.59:0/3424719310 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f839c0ce540 0x7f839c0ce950 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8394009e50 tx=0x7f839402a6f0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.909+0000 7f83a4492640 1 -- 172.21.15.59:0/3424719310 shutdown_connections 2024-04-25T15:46:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.909+0000 7f83a4492640 1 --2- 172.21.15.59:0/3424719310 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f839c0ce540 0x7f839c0ce950 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.909+0000 7f83a4492640 1 --2- 172.21.15.59:0/3424719310 >> v2:172.21.15.59:3300/0 conn(0x7f839c15c1b0 0x7f839c15c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.909+0000 7f83a4492640 1 -- 172.21.15.59:0/3424719310 >> 172.21.15.59:0/3424719310 conn(0x7f839c06ed70 msgr2=0x7f839c06f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.909+0000 7f83a4492640 1 -- 172.21.15.59:0/3424719310 shutdown_connections 2024-04-25T15:46:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.909+0000 7f83a4492640 1 -- 172.21.15.59:0/3424719310 wait complete. 2024-04-25T15:46:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.911+0000 7f83a4492640 1 Processor -- start 2024-04-25T15:46:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.911+0000 7f83a4492640 1 -- start start 2024-04-25T15:46:42.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.912+0000 7f83a4492640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839c0b41c0 0x7f839c1e80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.912+0000 7f83a4492640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839c0ce540 0x7f839c158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.912+0000 7f83a4492640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f839c15c1b0 0x7f839c152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:42.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.912+0000 7f83a4492640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f839c0b78a0 con 0x7f839c0b41c0 2024-04-25T15:46:42.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.912+0000 7f83a4492640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f839c0ce020 con 0x7f839c0ce540 2024-04-25T15:46:42.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.912+0000 7f83a4492640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f839c0cee90 con 0x7f839c15c1b0 2024-04-25T15:46:42.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.914+0000 7f83a222e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839c0b41c0 0x7f839c1e80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.915+0000 7f83a222e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839c0b41c0 0x7f839c1e80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48354/0 (socket says 172.21.15.59:48354) 2024-04-25T15:46:42.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.915+0000 7f83a222e640 1 -- 172.21.15.59:0/844575072 learned_addr learned my addr 172.21.15.59:0/844575072 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:42.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.915+0000 7f83a1a2d640 1 --2- 172.21.15.59:0/844575072 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839c0ce540 0x7f839c158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:42.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.919+0000 7f83a222e640 1 -- 172.21.15.59:0/844575072 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f839c15c1b0 msgr2=0x7f839c152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.919+0000 7f83a222e640 1 --2- 172.21.15.59:0/844575072 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f839c15c1b0 0x7f839c152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.919+0000 7f83a222e640 1 -- 172.21.15.59:0/844575072 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839c0ce540 msgr2=0x7f839c158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:42.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.919+0000 7f83a222e640 1 --2- 172.21.15.59:0/844575072 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839c0ce540 0x7f839c158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:42.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.919+0000 7f83a222e640 1 -- 172.21.15.59:0/844575072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c1e8620 con 0x7f839c0b41c0 2024-04-25T15:46:42.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.921+0000 7f83a222e640 1 --2- 172.21.15.59:0/844575072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839c0b41c0 0x7f839c1e80e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f839800b410 tx=0x7f839800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:42.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.925+0000 7f8392ffd640 1 -- 172.21.15.59:0/844575072 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398015020 con 0x7f839c0b41c0 2024-04-25T15:46:42.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.926+0000 7f8392ffd640 1 -- 172.21.15.59:0/844575072 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8398011850 con 0x7f839c0b41c0 2024-04-25T15:46:42.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.926+0000 7f83a4492640 1 -- 172.21.15.59:0/844575072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839c1566e0 con 0x7f839c0b41c0 2024-04-25T15:46:42.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.926+0000 7f8392ffd640 1 -- 172.21.15.59:0/844575072 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398011c40 con 0x7f839c0b41c0 2024-04-25T15:46:42.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.926+0000 7f83a4492640 1 -- 172.21.15.59:0/844575072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839c0cb6b0 con 0x7f839c0b41c0 2024-04-25T15:46:42.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:42.927+0000 7f83a4492640 1 -- 172.21.15.59:0/844575072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f839c0698a0 con 0x7f839c0b41c0 2024-04-25T15:46:43.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.221+0000 7f8392ffd640 1 -- 172.21.15.59:0/844575072 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8398018020 con 0x7f839c0b41c0 2024-04-25T15:46:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.222+0000 7f8392ffd640 1 --2- 172.21.15.59:0/844575072 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f8380074530 0x7f8380076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.222+0000 7f83a1a2d640 1 --2- 172.21.15.59:0/844575072 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f8380074530 0x7f8380076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.222+0000 7f83a1a2d640 1 --2- 172.21.15.59:0/844575072 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f8380074530 0x7f8380076a40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f839c157fd0 tx=0x7f838c009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:43.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.243+0000 7f8392ffd640 1 -- 172.21.15.59:0/844575072 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8398011de0 con 0x7f839c0b41c0 2024-04-25T15:46:43.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.243+0000 7f8392ffd640 1 -- 172.21.15.59:0/844575072 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f839801f070 con 0x7f839c0b41c0 2024-04-25T15:46:43.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.439+0000 7f83a4492640 1 -- 172.21.15.59:0/844575072 --> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f839c0cbab0 con 0x7f8380074530 2024-04-25T15:46:43.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.445+0000 7f8392ffd640 1 -- 172.21.15.59:0/844575072 <== mgr.4102 v2:172.21.15.59:6800/2368090706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251955 (secure 0 0 0) 0x7f839c0cbab0 con 0x7f8380074530 2024-04-25T15:46:43.448 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:43.450 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T15:46:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.448+0000 7f83a4492640 1 -- 172.21.15.59:0/844575072 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f8380074530 msgr2=0x7f8380076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.448+0000 7f83a4492640 1 --2- 172.21.15.59:0/844575072 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f8380074530 0x7f8380076a40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f839c157fd0 tx=0x7f838c009060 comp rx=0 tx=0).stop 2024-04-25T15:46:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.448+0000 7f83a4492640 1 -- 172.21.15.59:0/844575072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839c0b41c0 msgr2=0x7f839c1e80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.448+0000 7f83a4492640 1 --2- 172.21.15.59:0/844575072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839c0b41c0 0x7f839c1e80e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f839800b410 tx=0x7f839800b8d0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.448+0000 7f83a4492640 1 -- 172.21.15.59:0/844575072 shutdown_connections 2024-04-25T15:46:43.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.448+0000 7f83a4492640 1 --2- 172.21.15.59:0/844575072 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f8380074530 0x7f8380076a40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.448+0000 7f83a4492640 1 --2- 172.21.15.59:0/844575072 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f839c15c1b0 0x7f839c152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.448+0000 7f83a4492640 1 --2- 172.21.15.59:0/844575072 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839c0ce540 0x7f839c158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.448+0000 7f83a4492640 1 --2- 172.21.15.59:0/844575072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839c0b41c0 0x7f839c1e80e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.448+0000 7f83a4492640 1 -- 172.21.15.59:0/844575072 >> 172.21.15.59:0/844575072 conn(0x7f839c06ed70 msgr2=0x7f839c0b5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:43.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.449+0000 7f83a4492640 1 -- 172.21.15.59:0/844575072 shutdown_connections 2024-04-25T15:46:43.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.449+0000 7f83a4492640 1 -- 172.21.15.59:0/844575072 wait complete. 2024-04-25T15:46:43.460 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-04-25T15:46:42.309283+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594918,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":204,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219140,"kb_used_data":3004,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755580,"statfs":{"total":773094113280,"available":772869713920,"internally_reserved":0,"allocated":3076096,"data_stored":1802004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4550,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.384802"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280274+0000","last_change":"2024-04-25T15:46:33.037109+0000","last_active":"2024-04-25T15:46:34.280274+0000","last_peered":"2024-04-25T15:46:34.280274+0000","last_clean":"2024-04-25T15:46:34.280274+0000","last_became_active":"2024-04-25T15:46:33.036415+0000","last_became_peered":"2024-04-25T15:46:33.036415+0000","last_unstale":"2024-04-25T15:46:34.280274+0000","last_undegraded":"2024-04-25T15:46:34.280274+0000","last_fullsized":"2024-04-25T15:46:34.280274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:33.557001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079837+0000","last_change":"2024-04-25T15:46:33.022420+0000","last_active":"2024-04-25T15:46:34.079837+0000","last_peered":"2024-04-25T15:46:34.079837+0000","last_clean":"2024-04-25T15:46:34.079837+0000","last_became_active":"2024-04-25T15:46:33.022095+0000","last_became_peered":"2024-04-25T15:46:33.022095+0000","last_unstale":"2024-04-25T15:46:34.079837+0000","last_undegraded":"2024-04-25T15:46:34.079837+0000","last_fullsized":"2024-04-25T15:46:34.079837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279160+0000","last_change":"2024-04-25T15:46:33.063451+0000","last_active":"2024-04-25T15:46:34.279160+0000","last_peered":"2024-04-25T15:46:34.279160+0000","last_clean":"2024-04-25T15:46:34.279160+0000","last_became_active":"2024-04-25T15:46:33.063038+0000","last_became_peered":"2024-04-25T15:46:33.063038+0000","last_unstale":"2024-04-25T15:46:34.279160+0000","last_undegraded":"2024-04-25T15:46:34.279160+0000","last_fullsized":"2024-04-25T15:46:34.279160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:49:29.792442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072346+0000","last_change":"2024-04-25T15:46:33.041049+0000","last_active":"2024-04-25T15:46:34.072346+0000","last_peered":"2024-04-25T15:46:34.072346+0000","last_clean":"2024-04-25T15:46:34.072346+0000","last_became_active":"2024-04-25T15:46:33.040716+0000","last_became_peered":"2024-04-25T15:46:33.040716+0000","last_unstale":"2024-04-25T15:46:34.072346+0000","last_undegraded":"2024-04-25T15:46:34.072346+0000","last_fullsized":"2024-04-25T15:46:34.072346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:12.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279724+0000","last_change":"2024-04-25T15:46:33.063350+0000","last_active":"2024-04-25T15:46:34.279724+0000","last_peered":"2024-04-25T15:46:34.279724+0000","last_clean":"2024-04-25T15:46:34.279724+0000","last_became_active":"2024-04-25T15:46:33.063110+0000","last_became_peered":"2024-04-25T15:46:33.063110+0000","last_unstale":"2024-04-25T15:46:34.279724+0000","last_undegraded":"2024-04-25T15:46:34.279724+0000","last_fullsized":"2024-04-25T15:46:34.279724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072549+0000","last_change":"2024-04-25T15:46:33.040765+0000","last_active":"2024-04-25T15:46:34.072549+0000","last_peered":"2024-04-25T15:46:34.072549+0000","last_clean":"2024-04-25T15:46:34.072549+0000","last_became_active":"2024-04-25T15:46:33.040272+0000","last_became_peered":"2024-04-25T15:46:33.040272+0000","last_unstale":"2024-04-25T15:46:34.072549+0000","last_undegraded":"2024-04-25T15:46:34.072549+0000","last_fullsized":"2024-04-25T15:46:34.072549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:20.677976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278880+0000","last_change":"2024-04-25T15:46:33.037395+0000","last_active":"2024-04-25T15:46:34.278880+0000","last_peered":"2024-04-25T15:46:34.278880+0000","last_clean":"2024-04-25T15:46:34.278880+0000","last_became_active":"2024-04-25T15:46:33.036613+0000","last_became_peered":"2024-04-25T15:46:33.036613+0000","last_unstale":"2024-04-25T15:46:34.278880+0000","last_undegraded":"2024-04-25T15:46:34.278880+0000","last_fullsized":"2024-04-25T15:46:34.278880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127454+0000","last_change":"2024-04-25T15:46:33.039941+0000","last_active":"2024-04-25T15:46:34.127454+0000","last_peered":"2024-04-25T15:46:34.127454+0000","last_clean":"2024-04-25T15:46:34.127454+0000","last_became_active":"2024-04-25T15:46:33.039696+0000","last_became_peered":"2024-04-25T15:46:33.039696+0000","last_unstale":"2024-04-25T15:46:34.127454+0000","last_undegraded":"2024-04-25T15:46:34.127454+0000","last_fullsized":"2024-04-25T15:46:34.127454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:41.663796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280450+0000","last_change":"2024-04-25T15:46:33.043405+0000","last_active":"2024-04-25T15:46:34.280450+0000","last_peered":"2024-04-25T15:46:34.280450+0000","last_clean":"2024-04-25T15:46:34.280450+0000","last_became_active":"2024-04-25T15:46:33.043094+0000","last_became_peered":"2024-04-25T15:46:33.043094+0000","last_unstale":"2024-04-25T15:46:34.280450+0000","last_undegraded":"2024-04-25T15:46:34.280450+0000","last_fullsized":"2024-04-25T15:46:34.280450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:49.811317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279156+0000","last_change":"2024-04-25T15:46:33.037180+0000","last_active":"2024-04-25T15:46:34.279156+0000","last_peered":"2024-04-25T15:46:34.279156+0000","last_clean":"2024-04-25T15:46:34.279156+0000","last_became_active":"2024-04-25T15:46:33.036822+0000","last_became_peered":"2024-04-25T15:46:33.036822+0000","last_unstale":"2024-04-25T15:46:34.279156+0000","last_undegraded":"2024-04-25T15:46:34.279156+0000","last_fullsized":"2024-04-25T15:46:34.279156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:45.123026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279431+0000","last_change":"2024-04-25T15:46:33.040594+0000","last_active":"2024-04-25T15:46:34.279431+0000","last_peered":"2024-04-25T15:46:34.279431+0000","last_clean":"2024-04-25T15:46:34.279431+0000","last_became_active":"2024-04-25T15:46:33.040296+0000","last_became_peered":"2024-04-25T15:46:33.040296+0000","last_unstale":"2024-04-25T15:46:34.279431+0000","last_undegraded":"2024-04-25T15:46:34.279431+0000","last_fullsized":"2024-04-25T15:46:34.279431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:47.844325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280119+0000","last_change":"2024-04-25T15:46:33.011129+0000","last_active":"2024-04-25T15:46:34.280119+0000","last_peered":"2024-04-25T15:46:34.280119+0000","last_clean":"2024-04-25T15:46:34.280119+0000","last_became_active":"2024-04-25T15:46:33.010754+0000","last_became_peered":"2024-04-25T15:46:33.010754+0000","last_unstale":"2024-04-25T15:46:34.280119+0000","last_undegraded":"2024-04-25T15:46:34.280119+0000","last_fullsized":"2024-04-25T15:46:34.280119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:31.093111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127704+0000","last_change":"2024-04-25T15:46:33.011388+0000","last_active":"2024-04-25T15:46:34.127704+0000","last_peered":"2024-04-25T15:46:34.127704+0000","last_clean":"2024-04-25T15:46:34.127704+0000","last_became_active":"2024-04-25T15:46:33.011083+0000","last_became_peered":"2024-04-25T15:46:33.011083+0000","last_unstale":"2024-04-25T15:46:34.127704+0000","last_undegraded":"2024-04-25T15:46:34.127704+0000","last_fullsized":"2024-04-25T15:46:34.127704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:22.959149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279003+0000","last_change":"2024-04-25T15:46:33.022531+0000","last_active":"2024-04-25T15:46:34.279003+0000","last_peered":"2024-04-25T15:46:34.279003+0000","last_clean":"2024-04-25T15:46:34.279003+0000","last_became_active":"2024-04-25T15:46:33.022214+0000","last_became_peered":"2024-04-25T15:46:33.022214+0000","last_unstale":"2024-04-25T15:46:34.279003+0000","last_undegraded":"2024-04-25T15:46:34.279003+0000","last_fullsized":"2024-04-25T15:46:34.279003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:19.052124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079530+0000","last_change":"2024-04-25T15:46:32.929715+0000","last_active":"2024-04-25T15:46:34.079530+0000","last_peered":"2024-04-25T15:46:34.079530+0000","last_clean":"2024-04-25T15:46:34.079530+0000","last_became_active":"2024-04-25T15:46:32.929386+0000","last_became_peered":"2024-04-25T15:46:32.929386+0000","last_unstale":"2024-04-25T15:46:34.079530+0000","last_undegraded":"2024-04-25T15:46:34.079530+0000","last_fullsized":"2024-04-25T15:46:34.079530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:47.844325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072189+0000","last_change":"2024-04-25T15:46:33.041583+0000","last_active":"2024-04-25T15:46:34.072189+0000","last_peered":"2024-04-25T15:46:34.072189+0000","last_clean":"2024-04-25T15:46:34.072189+0000","last_became_active":"2024-04-25T15:46:33.040240+0000","last_became_peered":"2024-04-25T15:46:33.040240+0000","last_unstale":"2024-04-25T15:46:34.072189+0000","last_undegraded":"2024-04-25T15:46:34.072189+0000","last_fullsized":"2024-04-25T15:46:34.072189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072738+0000","last_change":"2024-04-25T15:46:33.044561+0000","last_active":"2024-04-25T15:46:34.072738+0000","last_peered":"2024-04-25T15:46:34.072738+0000","last_clean":"2024-04-25T15:46:34.072738+0000","last_became_active":"2024-04-25T15:46:33.044065+0000","last_became_peered":"2024-04-25T15:46:33.044065+0000","last_unstale":"2024-04-25T15:46:34.072738+0000","last_undegraded":"2024-04-25T15:46:34.072738+0000","last_fullsized":"2024-04-25T15:46:34.072738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:33.557001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278571+0000","last_change":"2024-04-25T15:46:33.061929+0000","last_active":"2024-04-25T15:46:34.278571+0000","last_peered":"2024-04-25T15:46:34.278571+0000","last_clean":"2024-04-25T15:46:34.278571+0000","last_became_active":"2024-04-25T15:46:33.061623+0000","last_became_peered":"2024-04-25T15:46:33.061623+0000","last_unstale":"2024-04-25T15:46:34.278571+0000","last_undegraded":"2024-04-25T15:46:34.278571+0000","last_fullsized":"2024-04-25T15:46:34.278571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:28.844626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280701+0000","last_change":"2024-04-25T15:46:33.063451+0000","last_active":"2024-04-25T15:46:34.280701+0000","last_peered":"2024-04-25T15:46:34.280701+0000","last_clean":"2024-04-25T15:46:34.280701+0000","last_became_active":"2024-04-25T15:46:33.063126+0000","last_became_peered":"2024-04-25T15:46:33.063126+0000","last_unstale":"2024-04-25T15:46:34.280701+0000","last_undegraded":"2024-04-25T15:46:34.280701+0000","last_fullsized":"2024-04-25T15:46:34.280701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:49.144595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278998+0000","last_change":"2024-04-25T15:46:33.014377+0000","last_active":"2024-04-25T15:46:34.278998+0000","last_peered":"2024-04-25T15:46:34.278998+0000","last_clean":"2024-04-25T15:46:34.278998+0000","last_became_active":"2024-04-25T15:46:33.014056+0000","last_became_peered":"2024-04-25T15:46:33.014056+0000","last_unstale":"2024-04-25T15:46:34.278998+0000","last_undegraded":"2024-04-25T15:46:34.278998+0000","last_fullsized":"2024-04-25T15:46:34.278998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:49.025646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279064+0000","last_change":"2024-04-25T15:46:33.032744+0000","last_active":"2024-04-25T15:46:34.279064+0000","last_peered":"2024-04-25T15:46:34.279064+0000","last_clean":"2024-04-25T15:46:34.279064+0000","last_became_active":"2024-04-25T15:46:33.032498+0000","last_became_peered":"2024-04-25T15:46:33.032498+0000","last_unstale":"2024-04-25T15:46:34.279064+0000","last_undegraded":"2024-04-25T15:46:34.279064+0000","last_fullsized":"2024-04-25T15:46:34.279064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:04.861299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072714+0000","last_change":"2024-04-25T15:46:33.043548+0000","last_active":"2024-04-25T15:46:34.072714+0000","last_peered":"2024-04-25T15:46:34.072714+0000","last_clean":"2024-04-25T15:46:34.072714+0000","last_became_active":"2024-04-25T15:46:33.043251+0000","last_became_peered":"2024-04-25T15:46:33.043251+0000","last_unstale":"2024-04-25T15:46:34.072714+0000","last_undegraded":"2024-04-25T15:46:34.072714+0000","last_fullsized":"2024-04-25T15:46:34.072714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:04.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127585+0000","last_change":"2024-04-25T15:46:32.927532+0000","last_active":"2024-04-25T15:46:34.127585+0000","last_peered":"2024-04-25T15:46:34.127585+0000","last_clean":"2024-04-25T15:46:34.127585+0000","last_became_active":"2024-04-25T15:46:32.926836+0000","last_became_peered":"2024-04-25T15:46:32.926836+0000","last_unstale":"2024-04-25T15:46:34.127585+0000","last_undegraded":"2024-04-25T15:46:34.127585+0000","last_fullsized":"2024-04-25T15:46:34.127585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:21.339594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072201+0000","last_change":"2024-04-25T15:46:33.041900+0000","last_active":"2024-04-25T15:46:34.072201+0000","last_peered":"2024-04-25T15:46:34.072201+0000","last_clean":"2024-04-25T15:46:34.072201+0000","last_became_active":"2024-04-25T15:46:33.040821+0000","last_became_peered":"2024-04-25T15:46:33.040821+0000","last_unstale":"2024-04-25T15:46:34.072201+0000","last_undegraded":"2024-04-25T15:46:34.072201+0000","last_fullsized":"2024-04-25T15:46:34.072201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.128074+0000","last_change":"2024-04-25T15:46:32.926772+0000","last_active":"2024-04-25T15:46:34.128074+0000","last_peered":"2024-04-25T15:46:34.128074+0000","last_clean":"2024-04-25T15:46:34.128074+0000","last_became_active":"2024-04-25T15:46:32.926468+0000","last_became_peered":"2024-04-25T15:46:32.926468+0000","last_unstale":"2024-04-25T15:46:34.128074+0000","last_undegraded":"2024-04-25T15:46:34.128074+0000","last_fullsized":"2024-04-25T15:46:34.128074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:21:35.665923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279365+0000","last_change":"2024-04-25T15:46:33.031482+0000","last_active":"2024-04-25T15:46:34.279365+0000","last_peered":"2024-04-25T15:46:34.279365+0000","last_clean":"2024-04-25T15:46:34.279365+0000","last_became_active":"2024-04-25T15:46:33.031182+0000","last_became_peered":"2024-04-25T15:46:33.031182+0000","last_unstale":"2024-04-25T15:46:34.279365+0000","last_undegraded":"2024-04-25T15:46:34.279365+0000","last_fullsized":"2024-04-25T15:46:34.279365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079941+0000","last_change":"2024-04-25T15:46:32.931992+0000","last_active":"2024-04-25T15:46:34.079941+0000","last_peered":"2024-04-25T15:46:34.079941+0000","last_clean":"2024-04-25T15:46:34.079941+0000","last_became_active":"2024-04-25T15:46:32.931684+0000","last_became_peered":"2024-04-25T15:46:32.931684+0000","last_unstale":"2024-04-25T15:46:34.079941+0000","last_undegraded":"2024-04-25T15:46:34.079941+0000","last_fullsized":"2024-04-25T15:46:34.079941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:12.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127825+0000","last_change":"2024-04-25T15:46:32.926461+0000","last_active":"2024-04-25T15:46:34.127825+0000","last_peered":"2024-04-25T15:46:34.127825+0000","last_clean":"2024-04-25T15:46:34.127825+0000","last_became_active":"2024-04-25T15:46:32.926136+0000","last_became_peered":"2024-04-25T15:46:32.926136+0000","last_unstale":"2024-04-25T15:46:34.127825+0000","last_undegraded":"2024-04-25T15:46:34.127825+0000","last_fullsized":"2024-04-25T15:46:34.127825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:29.896062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279231+0000","last_change":"2024-04-25T15:46:33.022460+0000","last_active":"2024-04-25T15:46:34.279231+0000","last_peered":"2024-04-25T15:46:34.279231+0000","last_clean":"2024-04-25T15:46:34.279231+0000","last_became_active":"2024-04-25T15:46:33.022116+0000","last_became_peered":"2024-04-25T15:46:33.022116+0000","last_unstale":"2024-04-25T15:46:34.279231+0000","last_undegraded":"2024-04-25T15:46:34.279231+0000","last_fullsized":"2024-04-25T15:46:34.279231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:22.980615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072889+0000","last_change":"2024-04-25T15:46:33.040668+0000","last_active":"2024-04-25T15:46:34.072889+0000","last_peered":"2024-04-25T15:46:34.072889+0000","last_clean":"2024-04-25T15:46:34.072889+0000","last_became_active":"2024-04-25T15:46:33.040134+0000","last_became_peered":"2024-04-25T15:46:33.040134+0000","last_unstale":"2024-04-25T15:46:34.072889+0000","last_undegraded":"2024-04-25T15:46:34.072889+0000","last_fullsized":"2024-04-25T15:46:34.072889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:16.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278491+0000","last_change":"2024-04-25T15:46:33.062510+0000","last_active":"2024-04-25T15:46:34.278491+0000","last_peered":"2024-04-25T15:46:34.278491+0000","last_clean":"2024-04-25T15:46:34.278491+0000","last_became_active":"2024-04-25T15:46:33.062166+0000","last_became_peered":"2024-04-25T15:46:33.062166+0000","last_unstale":"2024-04-25T15:46:34.278491+0000","last_undegraded":"2024-04-25T15:46:34.278491+0000","last_fullsized":"2024-04-25T15:46:34.278491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:31.093111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279330+0000","last_change":"2024-04-25T15:46:33.022223+0000","last_active":"2024-04-25T15:46:34.279330+0000","last_peered":"2024-04-25T15:46:34.279330+0000","last_clean":"2024-04-25T15:46:34.279330+0000","last_became_active":"2024-04-25T15:46:33.021888+0000","last_became_peered":"2024-04-25T15:46:33.021888+0000","last_unstale":"2024-04-25T15:46:34.279330+0000","last_undegraded":"2024-04-25T15:46:34.279330+0000","last_fullsized":"2024-04-25T15:46:34.279330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:23.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279381+0000","last_change":"2024-04-25T15:46:32.929281+0000","last_active":"2024-04-25T15:46:34.279381+0000","last_peered":"2024-04-25T15:46:34.279381+0000","last_clean":"2024-04-25T15:46:34.279381+0000","last_became_active":"2024-04-25T15:46:32.929019+0000","last_became_peered":"2024-04-25T15:46:32.929019+0000","last_unstale":"2024-04-25T15:46:34.279381+0000","last_undegraded":"2024-04-25T15:46:34.279381+0000","last_fullsized":"2024-04-25T15:46:34.279381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:55.692126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.522003+0000","last_change":"2024-04-25T15:46:31.685950+0000","last_active":"2024-04-25T15:46:39.522003+0000","last_peered":"2024-04-25T15:46:39.522003+0000","last_clean":"2024-04-25T15:46:39.522003+0000","last_became_active":"2024-04-25T15:46:31.685602+0000","last_became_peered":"2024-04-25T15:46:31.685602+0000","last_unstale":"2024-04-25T15:46:39.522003+0000","last_undegraded":"2024-04-25T15:46:39.522003+0000","last_fullsized":"2024-04-25T15:46:39.522003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:29.676427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279266+0000","last_change":"2024-04-25T15:46:33.023655+0000","last_active":"2024-04-25T15:46:34.279266+0000","last_peered":"2024-04-25T15:46:34.279266+0000","last_clean":"2024-04-25T15:46:34.279266+0000","last_became_active":"2024-04-25T15:46:33.023432+0000","last_became_peered":"2024-04-25T15:46:33.023432+0000","last_unstale":"2024-04-25T15:46:34.279266+0000","last_undegraded":"2024-04-25T15:46:34.279266+0000","last_fullsized":"2024-04-25T15:46:34.279266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:21.339594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.782101+0000","last_change":"2024-04-25T15:46:31.659079+0000","last_active":"2024-04-25T15:46:41.782101+0000","last_peered":"2024-04-25T15:46:41.782101+0000","last_clean":"2024-04-25T15:46:41.782101+0000","last_became_active":"2024-04-25T15:46:31.658681+0000","last_became_peered":"2024-04-25T15:46:31.658681+0000","last_unstale":"2024-04-25T15:46:41.782101+0000","last_undegraded":"2024-04-25T15:46:41.782101+0000","last_fullsized":"2024-04-25T15:46:41.782101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127408+0000","last_change":"2024-04-25T15:46:31.684220+0000","last_active":"2024-04-25T15:46:34.127408+0000","last_peered":"2024-04-25T15:46:34.127408+0000","last_clean":"2024-04-25T15:46:34.127408+0000","last_became_active":"2024-04-25T15:46:31.682936+0000","last_became_peered":"2024-04-25T15:46:31.682936+0000","last_unstale":"2024-04-25T15:46:34.127408+0000","last_undegraded":"2024-04-25T15:46:34.127408+0000","last_fullsized":"2024-04-25T15:46:34.127408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:53.729696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127570+0000","last_change":"2024-04-25T15:46:33.019843+0000","last_active":"2024-04-25T15:46:34.127570+0000","last_peered":"2024-04-25T15:46:34.127570+0000","last_clean":"2024-04-25T15:46:34.127570+0000","last_became_active":"2024-04-25T15:46:33.019526+0000","last_became_peered":"2024-04-25T15:46:33.019526+0000","last_unstale":"2024-04-25T15:46:34.127570+0000","last_undegraded":"2024-04-25T15:46:34.127570+0000","last_fullsized":"2024-04-25T15:46:34.127570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:22.980615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072467+0000","last_change":"2024-04-25T15:46:31.689444+0000","last_active":"2024-04-25T15:46:34.072467+0000","last_peered":"2024-04-25T15:46:34.072467+0000","last_clean":"2024-04-25T15:46:34.072467+0000","last_became_active":"2024-04-25T15:46:31.689130+0000","last_became_peered":"2024-04-25T15:46:31.689130+0000","last_unstale":"2024-04-25T15:46:34.072467+0000","last_undegraded":"2024-04-25T15:46:34.072467+0000","last_fullsized":"2024-04-25T15:46:34.072467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079523+0000","last_change":"2024-04-25T15:46:32.931979+0000","last_active":"2024-04-25T15:46:34.079523+0000","last_peered":"2024-04-25T15:46:34.079523+0000","last_clean":"2024-04-25T15:46:34.079523+0000","last_became_active":"2024-04-25T15:46:32.931648+0000","last_became_peered":"2024-04-25T15:46:32.931648+0000","last_unstale":"2024-04-25T15:46:34.079523+0000","last_undegraded":"2024-04-25T15:46:34.079523+0000","last_fullsized":"2024-04-25T15:46:34.079523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:23.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.520120+0000","last_change":"2024-04-25T15:46:31.685721+0000","last_active":"2024-04-25T15:46:39.520120+0000","last_peered":"2024-04-25T15:46:39.520120+0000","last_clean":"2024-04-25T15:46:39.520120+0000","last_became_active":"2024-04-25T15:46:31.685244+0000","last_became_peered":"2024-04-25T15:46:31.685244+0000","last_unstale":"2024-04-25T15:46:39.520120+0000","last_undegraded":"2024-04-25T15:46:39.520120+0000","last_fullsized":"2024-04-25T15:46:39.520120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072360+0000","last_change":"2024-04-25T15:46:33.043533+0000","last_active":"2024-04-25T15:46:34.072360+0000","last_peered":"2024-04-25T15:46:34.072360+0000","last_clean":"2024-04-25T15:46:34.072360+0000","last_became_active":"2024-04-25T15:46:33.043228+0000","last_became_peered":"2024-04-25T15:46:33.043228+0000","last_unstale":"2024-04-25T15:46:34.072360+0000","last_undegraded":"2024-04-25T15:46:34.072360+0000","last_fullsized":"2024-04-25T15:46:34.072360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.519834+0000","last_change":"2024-04-25T15:46:31.692399+0000","last_active":"2024-04-25T15:46:39.519834+0000","last_peered":"2024-04-25T15:46:39.519834+0000","last_clean":"2024-04-25T15:46:39.519834+0000","last_became_active":"2024-04-25T15:46:31.692063+0000","last_became_peered":"2024-04-25T15:46:31.692063+0000","last_unstale":"2024-04-25T15:46:39.519834+0000","last_undegraded":"2024-04-25T15:46:39.519834+0000","last_fullsized":"2024-04-25T15:46:39.519834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279587+0000","last_change":"2024-04-25T15:46:33.043275+0000","last_active":"2024-04-25T15:46:34.279587+0000","last_peered":"2024-04-25T15:46:34.279587+0000","last_clean":"2024-04-25T15:46:34.279587+0000","last_became_active":"2024-04-25T15:46:33.042941+0000","last_became_peered":"2024-04-25T15:46:33.042941+0000","last_unstale":"2024-04-25T15:46:34.279587+0000","last_undegraded":"2024-04-25T15:46:34.279587+0000","last_fullsized":"2024-04-25T15:46:34.279587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:22.959149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.597813+0000","last_change":"2024-04-25T15:46:31.686299+0000","last_active":"2024-04-25T15:46:34.597813+0000","last_peered":"2024-04-25T15:46:34.597813+0000","last_clean":"2024-04-25T15:46:34.597813+0000","last_became_active":"2024-04-25T15:46:31.685993+0000","last_became_peered":"2024-04-25T15:46:31.685993+0000","last_unstale":"2024-04-25T15:46:34.597813+0000","last_undegraded":"2024-04-25T15:46:34.597813+0000","last_fullsized":"2024-04-25T15:46:34.597813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280313+0000","last_change":"2024-04-25T15:46:33.035207+0000","last_active":"2024-04-25T15:46:34.280313+0000","last_peered":"2024-04-25T15:46:34.280313+0000","last_clean":"2024-04-25T15:46:34.280313+0000","last_became_active":"2024-04-25T15:46:33.034926+0000","last_became_peered":"2024-04-25T15:46:33.034926+0000","last_unstale":"2024-04-25T15:46:34.280313+0000","last_undegraded":"2024-04-25T15:46:34.280313+0000","last_fullsized":"2024-04-25T15:46:34.280313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:28.844626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.518399+0000","last_change":"2024-04-25T15:46:31.683086+0000","last_active":"2024-04-25T15:46:39.518399+0000","last_peered":"2024-04-25T15:46:39.518399+0000","last_clean":"2024-04-25T15:46:39.518399+0000","last_became_active":"2024-04-25T15:46:31.682661+0000","last_became_peered":"2024-04-25T15:46:31.682661+0000","last_unstale":"2024-04-25T15:46:39.518399+0000","last_undegraded":"2024-04-25T15:46:39.518399+0000","last_fullsized":"2024-04-25T15:46:39.518399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280485+0000","last_change":"2024-04-25T15:46:33.034800+0000","last_active":"2024-04-25T15:46:34.280485+0000","last_peered":"2024-04-25T15:46:34.280485+0000","last_clean":"2024-04-25T15:46:34.280485+0000","last_became_active":"2024-04-25T15:46:33.034493+0000","last_became_peered":"2024-04-25T15:46:33.034493+0000","last_unstale":"2024-04-25T15:46:34.280485+0000","last_undegraded":"2024-04-25T15:46:34.280485+0000","last_fullsized":"2024-04-25T15:46:34.280485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:16.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.404450+0000","last_change":"2024-04-25T15:46:31.688398+0000","last_active":"2024-04-25T15:46:39.404450+0000","last_peered":"2024-04-25T15:46:39.404450+0000","last_clean":"2024-04-25T15:46:39.404450+0000","last_became_active":"2024-04-25T15:46:31.688096+0000","last_became_peered":"2024-04-25T15:46:31.688096+0000","last_unstale":"2024-04-25T15:46:39.404450+0000","last_undegraded":"2024-04-25T15:46:39.404450+0000","last_fullsized":"2024-04-25T15:46:39.404450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:53.729696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279191+0000","last_change":"2024-04-25T15:46:33.031520+0000","last_active":"2024-04-25T15:46:34.279191+0000","last_peered":"2024-04-25T15:46:34.279191+0000","last_clean":"2024-04-25T15:46:34.279191+0000","last_became_active":"2024-04-25T15:46:33.031282+0000","last_became_peered":"2024-04-25T15:46:33.031282+0000","last_unstale":"2024-04-25T15:46:34.279191+0000","last_undegraded":"2024-04-25T15:46:34.279191+0000","last_fullsized":"2024-04-25T15:46:34.279191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:41.663796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.520081+0000","last_change":"2024-04-25T15:46:31.691191+0000","last_active":"2024-04-25T15:46:39.520081+0000","last_peered":"2024-04-25T15:46:39.520081+0000","last_clean":"2024-04-25T15:46:39.520081+0000","last_became_active":"2024-04-25T15:46:31.690848+0000","last_became_peered":"2024-04-25T15:46:31.690848+0000","last_unstale":"2024-04-25T15:46:39.520081+0000","last_undegraded":"2024-04-25T15:46:39.520081+0000","last_fullsized":"2024-04-25T15:46:39.520081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279897+0000","last_change":"2024-04-25T15:46:33.040890+0000","last_active":"2024-04-25T15:46:34.279897+0000","last_peered":"2024-04-25T15:46:34.279897+0000","last_clean":"2024-04-25T15:46:34.279897+0000","last_became_active":"2024-04-25T15:46:33.040568+0000","last_became_peered":"2024-04-25T15:46:33.040568+0000","last_unstale":"2024-04-25T15:46:34.279897+0000","last_undegraded":"2024-04-25T15:46:34.279897+0000","last_fullsized":"2024-04-25T15:46:34.279897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:04.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.784901+0000","last_change":"2024-04-25T15:46:31.659031+0000","last_active":"2024-04-25T15:46:41.784901+0000","last_peered":"2024-04-25T15:46:41.784901+0000","last_clean":"2024-04-25T15:46:41.784901+0000","last_became_active":"2024-04-25T15:46:31.658670+0000","last_became_peered":"2024-04-25T15:46:31.658670+0000","last_unstale":"2024-04-25T15:46:41.784901+0000","last_undegraded":"2024-04-25T15:46:41.784901+0000","last_fullsized":"2024-04-25T15:46:41.784901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279448+0000","last_change":"2024-04-25T15:46:33.021142+0000","last_active":"2024-04-25T15:46:34.279448+0000","last_peered":"2024-04-25T15:46:34.279448+0000","last_clean":"2024-04-25T15:46:34.279448+0000","last_became_active":"2024-04-25T15:46:33.020753+0000","last_became_peered":"2024-04-25T15:46:33.020753+0000","last_unstale":"2024-04-25T15:46:34.279448+0000","last_undegraded":"2024-04-25T15:46:34.279448+0000","last_fullsized":"2024-04-25T15:46:34.279448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'15","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.910630+0000","last_change":"2024-04-25T15:46:31.703454+0000","last_active":"2024-04-25T15:46:41.910630+0000","last_peered":"2024-04-25T15:46:41.910630+0000","last_clean":"2024-04-25T15:46:41.910630+0000","last_became_active":"2024-04-25T15:46:31.703167+0000","last_became_peered":"2024-04-25T15:46:31.703167+0000","last_unstale":"2024-04-25T15:46:41.910630+0000","last_undegraded":"2024-04-25T15:46:41.910630+0000","last_fullsized":"2024-04-25T15:46:41.910630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:02.958438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279066+0000","last_change":"2024-04-25T15:46:33.039900+0000","last_active":"2024-04-25T15:46:34.279066+0000","last_peered":"2024-04-25T15:46:34.279066+0000","last_clean":"2024-04-25T15:46:34.279066+0000","last_became_active":"2024-04-25T15:46:33.039613+0000","last_became_peered":"2024-04-25T15:46:33.039613+0000","last_unstale":"2024-04-25T15:46:34.279066+0000","last_undegraded":"2024-04-25T15:46:34.279066+0000","last_fullsized":"2024-04-25T15:46:34.279066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279574+0000","last_change":"2024-04-25T15:46:31.684537+0000","last_active":"2024-04-25T15:46:34.279574+0000","last_peered":"2024-04-25T15:46:34.279574+0000","last_clean":"2024-04-25T15:46:34.279574+0000","last_became_active":"2024-04-25T15:46:31.684173+0000","last_became_peered":"2024-04-25T15:46:31.684173+0000","last_unstale":"2024-04-25T15:46:34.279574+0000","last_undegraded":"2024-04-25T15:46:34.279574+0000","last_fullsized":"2024-04-25T15:46:34.279574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:41.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279453+0000","last_change":"2024-04-25T15:46:33.037831+0000","last_active":"2024-04-25T15:46:34.279453+0000","last_peered":"2024-04-25T15:46:34.279453+0000","last_clean":"2024-04-25T15:46:34.279453+0000","last_became_active":"2024-04-25T15:46:33.037529+0000","last_became_peered":"2024-04-25T15:46:33.037529+0000","last_unstale":"2024-04-25T15:46:34.279453+0000","last_undegraded":"2024-04-25T15:46:34.279453+0000","last_fullsized":"2024-04-25T15:46:34.279453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:20.677976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.683508+0000","last_change":"2024-04-25T15:46:31.704159+0000","last_active":"2024-04-25T15:46:34.683508+0000","last_peered":"2024-04-25T15:46:34.683508+0000","last_clean":"2024-04-25T15:46:34.683508+0000","last_became_active":"2024-04-25T15:46:31.703896+0000","last_became_peered":"2024-04-25T15:46:31.703896+0000","last_unstale":"2024-04-25T15:46:34.683508+0000","last_undegraded":"2024-04-25T15:46:34.683508+0000","last_fullsized":"2024-04-25T15:46:34.683508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280621+0000","last_change":"2024-04-25T15:46:33.038719+0000","last_active":"2024-04-25T15:46:34.280621+0000","last_peered":"2024-04-25T15:46:34.280621+0000","last_clean":"2024-04-25T15:46:34.280621+0000","last_became_active":"2024-04-25T15:46:33.038380+0000","last_became_peered":"2024-04-25T15:46:33.038380+0000","last_unstale":"2024-04-25T15:46:34.280621+0000","last_undegraded":"2024-04-25T15:46:34.280621+0000","last_fullsized":"2024-04-25T15:46:34.280621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:13:33.423087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079971+0000","last_change":"2024-04-25T15:46:31.690489+0000","last_active":"2024-04-25T15:46:34.079971+0000","last_peered":"2024-04-25T15:46:34.079971+0000","last_clean":"2024-04-25T15:46:34.079971+0000","last_became_active":"2024-04-25T15:46:31.690181+0000","last_became_peered":"2024-04-25T15:46:31.690181+0000","last_unstale":"2024-04-25T15:46:34.079971+0000","last_undegraded":"2024-04-25T15:46:34.079971+0000","last_fullsized":"2024-04-25T15:46:34.079971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072683+0000","last_change":"2024-04-25T15:46:33.036460+0000","last_active":"2024-04-25T15:46:34.072683+0000","last_peered":"2024-04-25T15:46:34.072683+0000","last_clean":"2024-04-25T15:46:34.072683+0000","last_became_active":"2024-04-25T15:46:33.036033+0000","last_became_peered":"2024-04-25T15:46:33.036033+0000","last_unstale":"2024-04-25T15:46:34.072683+0000","last_undegraded":"2024-04-25T15:46:34.072683+0000","last_fullsized":"2024-04-25T15:46:34.072683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.908940+0000","last_change":"2024-04-25T15:46:31.703571+0000","last_active":"2024-04-25T15:46:41.908940+0000","last_peered":"2024-04-25T15:46:41.908940+0000","last_clean":"2024-04-25T15:46:41.908940+0000","last_became_active":"2024-04-25T15:46:31.703234+0000","last_became_peered":"2024-04-25T15:46:31.703234+0000","last_unstale":"2024-04-25T15:46:41.908940+0000","last_undegraded":"2024-04-25T15:46:41.908940+0000","last_fullsized":"2024-04-25T15:46:41.908940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280501+0000","last_change":"2024-04-25T15:46:33.043464+0000","last_active":"2024-04-25T15:46:34.280501+0000","last_peered":"2024-04-25T15:46:34.280501+0000","last_clean":"2024-04-25T15:46:34.280501+0000","last_became_active":"2024-04-25T15:46:33.043145+0000","last_became_peered":"2024-04-25T15:46:33.043145+0000","last_unstale":"2024-04-25T15:46:34.280501+0000","last_undegraded":"2024-04-25T15:46:34.280501+0000","last_fullsized":"2024-04-25T15:46:34.280501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:06.648469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278676+0000","last_change":"2024-04-25T15:46:20.235628+0000","last_active":"2024-04-25T15:46:34.278676+0000","last_peered":"2024-04-25T15:46:34.278676+0000","last_clean":"2024-04-25T15:46:34.278676+0000","last_became_active":"2024-04-25T15:46:20.234477+0000","last_became_peered":"2024-04-25T15:46:20.234477+0000","last_unstale":"2024-04-25T15:46:34.278676+0000","last_undegraded":"2024-04-25T15:46:34.278676+0000","last_fullsized":"2024-04-25T15:46:34.278676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:17.824148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:17.824148+0000","last_clean_scrub_stamp":"2024-04-25T15:46:17.824148+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:50:25.187348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.520967+0000","last_change":"2024-04-25T15:46:31.702774+0000","last_active":"2024-04-25T15:46:39.520967+0000","last_peered":"2024-04-25T15:46:39.520967+0000","last_clean":"2024-04-25T15:46:39.520967+0000","last_became_active":"2024-04-25T15:46:31.702517+0000","last_became_peered":"2024-04-25T15:46:31.702517+0000","last_unstale":"2024-04-25T15:46:39.520967+0000","last_undegraded":"2024-04-25T15:46:39.520967+0000","last_fullsized":"2024-04-25T15:46:39.520967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127685+0000","last_change":"2024-04-25T15:46:33.043034+0000","last_active":"2024-04-25T15:46:34.127685+0000","last_peered":"2024-04-25T15:46:34.127685+0000","last_clean":"2024-04-25T15:46:34.127685+0000","last_became_active":"2024-04-25T15:46:33.042522+0000","last_became_peered":"2024-04-25T15:46:33.042522+0000","last_unstale":"2024-04-25T15:46:34.127685+0000","last_undegraded":"2024-04-25T15:46:34.127685+0000","last_fullsized":"2024-04-25T15:46:34.127685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:40.746464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.784860+0000","last_change":"2024-04-25T15:46:31.689200+0000","last_active":"2024-04-25T15:46:41.784860+0000","last_peered":"2024-04-25T15:46:41.784860+0000","last_clean":"2024-04-25T15:46:41.784860+0000","last_became_active":"2024-04-25T15:46:31.687761+0000","last_became_peered":"2024-04-25T15:46:31.687761+0000","last_unstale":"2024-04-25T15:46:41.784860+0000","last_undegraded":"2024-04-25T15:46:41.784860+0000","last_fullsized":"2024-04-25T15:46:41.784860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278867+0000","last_change":"2024-04-25T15:46:33.021652+0000","last_active":"2024-04-25T15:46:34.278867+0000","last_peered":"2024-04-25T15:46:34.278867+0000","last_clean":"2024-04-25T15:46:34.278867+0000","last_became_active":"2024-04-25T15:46:33.020828+0000","last_became_peered":"2024-04-25T15:46:33.020828+0000","last_unstale":"2024-04-25T15:46:34.278867+0000","last_undegraded":"2024-04-25T15:46:34.278867+0000","last_fullsized":"2024-04-25T15:46:34.278867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:11.243833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.909249+0000","last_change":"2024-04-25T15:46:31.704698+0000","last_active":"2024-04-25T15:46:41.909249+0000","last_peered":"2024-04-25T15:46:41.909249+0000","last_clean":"2024-04-25T15:46:41.909249+0000","last_became_active":"2024-04-25T15:46:31.704412+0000","last_became_peered":"2024-04-25T15:46:31.704412+0000","last_unstale":"2024-04-25T15:46:41.909249+0000","last_undegraded":"2024-04-25T15:46:41.909249+0000","last_fullsized":"2024-04-25T15:46:41.909249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079474+0000","last_change":"2024-04-25T15:46:33.061942+0000","last_active":"2024-04-25T15:46:34.079474+0000","last_peered":"2024-04-25T15:46:34.079474+0000","last_clean":"2024-04-25T15:46:34.079474+0000","last_became_active":"2024-04-25T15:46:33.061619+0000","last_became_peered":"2024-04-25T15:46:33.061619+0000","last_unstale":"2024-04-25T15:46:34.079474+0000","last_undegraded":"2024-04-25T15:46:34.079474+0000","last_fullsized":"2024-04-25T15:46:34.079474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:45.123026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.073122+0000","last_change":"2024-04-25T15:46:31.690694+0000","last_active":"2024-04-25T15:46:34.073122+0000","last_peered":"2024-04-25T15:46:34.073122+0000","last_clean":"2024-04-25T15:46:34.073122+0000","last_became_active":"2024-04-25T15:46:31.690339+0000","last_became_peered":"2024-04-25T15:46:31.690339+0000","last_unstale":"2024-04-25T15:46:34.073122+0000","last_undegraded":"2024-04-25T15:46:34.073122+0000","last_fullsized":"2024-04-25T15:46:34.073122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280771+0000","last_change":"2024-04-25T15:46:33.022306+0000","last_active":"2024-04-25T15:46:34.280771+0000","last_peered":"2024-04-25T15:46:34.280771+0000","last_clean":"2024-04-25T15:46:34.280771+0000","last_became_active":"2024-04-25T15:46:33.021995+0000","last_became_peered":"2024-04-25T15:46:33.021995+0000","last_unstale":"2024-04-25T15:46:34.280771+0000","last_undegraded":"2024-04-25T15:46:34.280771+0000","last_fullsized":"2024-04-25T15:46:34.280771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:03.749619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079765+0000","last_change":"2024-04-25T15:46:31.684114+0000","last_active":"2024-04-25T15:46:34.079765+0000","last_peered":"2024-04-25T15:46:34.079765+0000","last_clean":"2024-04-25T15:46:34.079765+0000","last_became_active":"2024-04-25T15:46:31.683802+0000","last_became_peered":"2024-04-25T15:46:31.683802+0000","last_unstale":"2024-04-25T15:46:34.079765+0000","last_undegraded":"2024-04-25T15:46:34.079765+0000","last_fullsized":"2024-04-25T15:46:34.079765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072964+0000","last_change":"2024-04-25T15:46:33.040119+0000","last_active":"2024-04-25T15:46:34.072964+0000","last_peered":"2024-04-25T15:46:34.072964+0000","last_clean":"2024-04-25T15:46:34.072964+0000","last_became_active":"2024-04-25T15:46:33.039820+0000","last_became_peered":"2024-04-25T15:46:33.039820+0000","last_unstale":"2024-04-25T15:46:34.072964+0000","last_undegraded":"2024-04-25T15:46:34.072964+0000","last_fullsized":"2024-04-25T15:46:34.072964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:06.648469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280760+0000","last_change":"2024-04-25T15:46:31.688610+0000","last_active":"2024-04-25T15:46:34.280760+0000","last_peered":"2024-04-25T15:46:34.280760+0000","last_clean":"2024-04-25T15:46:34.280760+0000","last_became_active":"2024-04-25T15:46:31.688274+0000","last_became_peered":"2024-04-25T15:46:31.688274+0000","last_unstale":"2024-04-25T15:46:34.280760+0000","last_undegraded":"2024-04-25T15:46:34.280760+0000","last_fullsized":"2024-04-25T15:46:34.280760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:02.574106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079663+0000","last_change":"2024-04-25T15:46:33.062042+0000","last_active":"2024-04-25T15:46:34.079663+0000","last_peered":"2024-04-25T15:46:34.079663+0000","last_clean":"2024-04-25T15:46:34.079663+0000","last_became_active":"2024-04-25T15:46:33.061680+0000","last_became_peered":"2024-04-25T15:46:33.061680+0000","last_unstale":"2024-04-25T15:46:34.079663+0000","last_undegraded":"2024-04-25T15:46:34.079663+0000","last_fullsized":"2024-04-25T15:46:34.079663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079964+0000","last_change":"2024-04-25T15:46:31.687114+0000","last_active":"2024-04-25T15:46:34.079964+0000","last_peered":"2024-04-25T15:46:34.079964+0000","last_clean":"2024-04-25T15:46:34.079964+0000","last_became_active":"2024-04-25T15:46:31.686758+0000","last_became_peered":"2024-04-25T15:46:31.686758+0000","last_unstale":"2024-04-25T15:46:34.079964+0000","last_undegraded":"2024-04-25T15:46:34.079964+0000","last_fullsized":"2024-04-25T15:46:34.079964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.128107+0000","last_change":"2024-04-25T15:46:33.031231+0000","last_active":"2024-04-25T15:46:34.128107+0000","last_peered":"2024-04-25T15:46:34.128107+0000","last_clean":"2024-04-25T15:46:34.128107+0000","last_became_active":"2024-04-25T15:46:33.030894+0000","last_became_peered":"2024-04-25T15:46:33.030894+0000","last_unstale":"2024-04-25T15:46:34.128107+0000","last_undegraded":"2024-04-25T15:46:34.128107+0000","last_fullsized":"2024-04-25T15:46:34.128107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:40.210974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.518049+0000","last_change":"2024-04-25T15:46:31.688577+0000","last_active":"2024-04-25T15:46:39.518049+0000","last_peered":"2024-04-25T15:46:39.518049+0000","last_clean":"2024-04-25T15:46:39.518049+0000","last_became_active":"2024-04-25T15:46:31.687691+0000","last_became_peered":"2024-04-25T15:46:31.687691+0000","last_unstale":"2024-04-25T15:46:39.518049+0000","last_undegraded":"2024-04-25T15:46:39.518049+0000","last_fullsized":"2024-04-25T15:46:39.518049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279504+0000","last_change":"2024-04-25T15:46:33.021249+0000","last_active":"2024-04-25T15:46:34.279504+0000","last_peered":"2024-04-25T15:46:34.279504+0000","last_clean":"2024-04-25T15:46:34.279504+0000","last_became_active":"2024-04-25T15:46:33.020779+0000","last_became_peered":"2024-04-25T15:46:33.020779+0000","last_unstale":"2024-04-25T15:46:34.279504+0000","last_undegraded":"2024-04-25T15:46:34.279504+0000","last_fullsized":"2024-04-25T15:46:34.279504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:39.504513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.406934+0000","last_change":"2024-04-25T15:46:31.689494+0000","last_active":"2024-04-25T15:46:39.406934+0000","last_peered":"2024-04-25T15:46:39.406934+0000","last_clean":"2024-04-25T15:46:39.406934+0000","last_became_active":"2024-04-25T15:46:31.688192+0000","last_became_peered":"2024-04-25T15:46:31.688192+0000","last_unstale":"2024-04-25T15:46:39.406934+0000","last_undegraded":"2024-04-25T15:46:39.406934+0000","last_fullsized":"2024-04-25T15:46:39.406934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278866+0000","last_change":"2024-04-25T15:46:33.062043+0000","last_active":"2024-04-25T15:46:34.278866+0000","last_peered":"2024-04-25T15:46:34.278866+0000","last_clean":"2024-04-25T15:46:34.278866+0000","last_became_active":"2024-04-25T15:46:33.061651+0000","last_became_peered":"2024-04-25T15:46:33.061651+0000","last_unstale":"2024-04-25T15:46:34.278866+0000","last_undegraded":"2024-04-25T15:46:34.278866+0000","last_fullsized":"2024-04-25T15:46:34.278866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:21.340361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079655+0000","last_change":"2024-04-25T15:46:31.685055+0000","last_active":"2024-04-25T15:46:34.079655+0000","last_peered":"2024-04-25T15:46:34.079655+0000","last_clean":"2024-04-25T15:46:34.079655+0000","last_became_active":"2024-04-25T15:46:31.684706+0000","last_became_peered":"2024-04-25T15:46:31.684706+0000","last_unstale":"2024-04-25T15:46:34.079655+0000","last_undegraded":"2024-04-25T15:46:34.079655+0000","last_fullsized":"2024-04-25T15:46:34.079655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:29.917598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127645+0000","last_change":"2024-04-25T15:46:32.929240+0000","last_active":"2024-04-25T15:46:34.127645+0000","last_peered":"2024-04-25T15:46:34.127645+0000","last_clean":"2024-04-25T15:46:34.127645+0000","last_became_active":"2024-04-25T15:46:32.928971+0000","last_became_peered":"2024-04-25T15:46:32.928971+0000","last_unstale":"2024-04-25T15:46:34.127645+0000","last_undegraded":"2024-04-25T15:46:34.127645+0000","last_fullsized":"2024-04-25T15:46:34.127645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:39.504513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079792+0000","last_change":"2024-04-25T15:46:31.687651+0000","last_active":"2024-04-25T15:46:34.079792+0000","last_peered":"2024-04-25T15:46:34.079792+0000","last_clean":"2024-04-25T15:46:34.079792+0000","last_became_active":"2024-04-25T15:46:31.687335+0000","last_became_peered":"2024-04-25T15:46:31.687335+0000","last_unstale":"2024-04-25T15:46:34.079792+0000","last_undegraded":"2024-04-25T15:46:34.079792+0000","last_fullsized":"2024-04-25T15:46:34.079792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127741+0000","last_change":"2024-04-25T15:46:33.021215+0000","last_active":"2024-04-25T15:46:34.127741+0000","last_peered":"2024-04-25T15:46:34.127741+0000","last_clean":"2024-04-25T15:46:34.127741+0000","last_became_active":"2024-04-25T15:46:33.020855+0000","last_became_peered":"2024-04-25T15:46:33.020855+0000","last_unstale":"2024-04-25T15:46:34.127741+0000","last_undegraded":"2024-04-25T15:46:34.127741+0000","last_fullsized":"2024-04-25T15:46:34.127741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:54.058601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.407002+0000","last_change":"2024-04-25T15:46:31.693099+0000","last_active":"2024-04-25T15:46:39.407002+0000","last_peered":"2024-04-25T15:46:39.407002+0000","last_clean":"2024-04-25T15:46:39.407002+0000","last_became_active":"2024-04-25T15:46:31.692762+0000","last_became_peered":"2024-04-25T15:46:31.692762+0000","last_unstale":"2024-04-25T15:46:39.407002+0000","last_undegraded":"2024-04-25T15:46:39.407002+0000","last_fullsized":"2024-04-25T15:46:39.407002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:29.917598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278877+0000","last_change":"2024-04-25T15:46:33.014467+0000","last_active":"2024-04-25T15:46:34.278877+0000","last_peered":"2024-04-25T15:46:34.278877+0000","last_clean":"2024-04-25T15:46:34.278877+0000","last_became_active":"2024-04-25T15:46:33.014116+0000","last_became_peered":"2024-04-25T15:46:33.014116+0000","last_unstale":"2024-04-25T15:46:34.278877+0000","last_undegraded":"2024-04-25T15:46:34.278877+0000","last_fullsized":"2024-04-25T15:46:34.278877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:44.912712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072776+0000","last_change":"2024-04-25T15:46:33.040027+0000","last_active":"2024-04-25T15:46:34.072776+0000","last_peered":"2024-04-25T15:46:34.072776+0000","last_clean":"2024-04-25T15:46:34.072776+0000","last_became_active":"2024-04-25T15:46:33.039713+0000","last_became_peered":"2024-04-25T15:46:33.039713+0000","last_unstale":"2024-04-25T15:46:34.072776+0000","last_undegraded":"2024-04-25T15:46:34.072776+0000","last_fullsized":"2024-04-25T15:46:34.072776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:49.811317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.600911+0000","last_change":"2024-04-25T15:46:31.686712+0000","last_active":"2024-04-25T15:46:34.600911+0000","last_peered":"2024-04-25T15:46:34.600911+0000","last_clean":"2024-04-25T15:46:34.600911+0000","last_became_active":"2024-04-25T15:46:31.686390+0000","last_became_peered":"2024-04-25T15:46:31.686390+0000","last_unstale":"2024-04-25T15:46:34.600911+0000","last_undegraded":"2024-04-25T15:46:34.600911+0000","last_fullsized":"2024-04-25T15:46:34.600911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072515+0000","last_change":"2024-04-25T15:46:33.041233+0000","last_active":"2024-04-25T15:46:34.072515+0000","last_peered":"2024-04-25T15:46:34.072515+0000","last_clean":"2024-04-25T15:46:34.072515+0000","last_became_active":"2024-04-25T15:46:33.040941+0000","last_became_peered":"2024-04-25T15:46:33.040941+0000","last_unstale":"2024-04-25T15:46:34.072515+0000","last_undegraded":"2024-04-25T15:46:34.072515+0000","last_fullsized":"2024-04-25T15:46:34.072515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.785446+0000","last_change":"2024-04-25T15:46:31.688658+0000","last_active":"2024-04-25T15:46:41.785446+0000","last_peered":"2024-04-25T15:46:41.785446+0000","last_clean":"2024-04-25T15:46:41.785446+0000","last_became_active":"2024-04-25T15:46:31.688342+0000","last_became_peered":"2024-04-25T15:46:31.688342+0000","last_unstale":"2024-04-25T15:46:41.785446+0000","last_undegraded":"2024-04-25T15:46:41.785446+0000","last_fullsized":"2024-04-25T15:46:41.785446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279544+0000","last_change":"2024-04-25T15:46:33.043423+0000","last_active":"2024-04-25T15:46:34.279544+0000","last_peered":"2024-04-25T15:46:34.279544+0000","last_clean":"2024-04-25T15:46:34.279544+0000","last_became_active":"2024-04-25T15:46:33.043134+0000","last_became_peered":"2024-04-25T15:46:33.043134+0000","last_unstale":"2024-04-25T15:46:34.279544+0000","last_undegraded":"2024-04-25T15:46:34.279544+0000","last_fullsized":"2024-04-25T15:46:34.279544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:40.746464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.679527+0000","last_change":"2024-04-25T15:46:31.685427+0000","last_active":"2024-04-25T15:46:34.679527+0000","last_peered":"2024-04-25T15:46:34.679527+0000","last_clean":"2024-04-25T15:46:34.679527+0000","last_became_active":"2024-04-25T15:46:31.684729+0000","last_became_peered":"2024-04-25T15:46:31.684729+0000","last_unstale":"2024-04-25T15:46:34.679527+0000","last_undegraded":"2024-04-25T15:46:34.679527+0000","last_fullsized":"2024-04-25T15:46:34.679527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:06.621567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.128030+0000","last_change":"2024-04-25T15:46:33.012259+0000","last_active":"2024-04-25T15:46:34.128030+0000","last_peered":"2024-04-25T15:46:34.128030+0000","last_clean":"2024-04-25T15:46:34.128030+0000","last_became_active":"2024-04-25T15:46:33.011979+0000","last_became_peered":"2024-04-25T15:46:33.011979+0000","last_unstale":"2024-04-25T15:46:34.128030+0000","last_undegraded":"2024-04-25T15:46:34.128030+0000","last_fullsized":"2024-04-25T15:46:34.128030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:47.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.609091+0000","last_change":"2024-04-25T15:46:31.688031+0000","last_active":"2024-04-25T15:46:34.609091+0000","last_peered":"2024-04-25T15:46:34.609091+0000","last_clean":"2024-04-25T15:46:34.609091+0000","last_became_active":"2024-04-25T15:46:31.687705+0000","last_became_peered":"2024-04-25T15:46:31.687705+0000","last_unstale":"2024-04-25T15:46:34.609091+0000","last_undegraded":"2024-04-25T15:46:34.609091+0000","last_fullsized":"2024-04-25T15:46:34.609091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:28.618857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4550,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":9570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91,"ondisk_log_size":91,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":835584,"data_stored":668322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":78340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":78016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":77352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":76638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":76798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":78872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":831488,"data_stored":667666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:46:43.464 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T15:46:43.464 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T15:46:43.465 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T15:46:43.465 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T15:46:43.465 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T15:46:43.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.612+0000 7faacd070640 1 Processor -- start 2024-04-25T15:46:43.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.612+0000 7faacd070640 1 -- start start 2024-04-25T15:46:43.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.614+0000 7faacd070640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faac80c46d0 0x7faac8154300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.614+0000 7faacd070640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faac80cfb80 0x7faac80cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.614+0000 7faacd070640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faac80cc0a0 con 0x7faac80cbb80 2024-04-25T15:46:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.614+0000 7faacd070640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7faac815b1e0 con 0x7faac80c46d0 2024-04-25T15:46:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.614+0000 7faacd070640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7faac815af00 con 0x7faac80cfb80 2024-04-25T15:46:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.614+0000 7faac759e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faac80cfb80 0x7faac80cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.614+0000 7faac659c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faac80c46d0 0x7faac8154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.614+0000 7faac6d9d640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7faac80cbb80 0x7faac80cc880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.59:45704/0 (socket says 172.21.15.59:45704) 2024-04-25T15:46:43.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.614+0000 7faac6d9d640 1 -- 172.21.15.59:0/2360216260 learned_addr learned my addr 172.21.15.59:0/2360216260 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:43.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.617+0000 7faac659c640 1 -- 172.21.15.59:0/2360216260 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faac80cfb80 msgr2=0x7faac80cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:43.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.617+0000 7faac659c640 1 --2- 172.21.15.59:0/2360216260 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faac80cfb80 0x7faac80cff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.617+0000 7faac659c640 1 -- 172.21.15.59:0/2360216260 >> v1:172.21.15.64:6789/0 conn(0x7faac80cbb80 legacy=0x7faac80cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.617+0000 7faac659c640 1 -- 172.21.15.59:0/2360216260 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac80caf70 con 0x7faac80c46d0 2024-04-25T15:46:43.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.620+0000 7faac659c640 1 --2- 172.21.15.59:0/2360216260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac80c46d0 0x7faac8154300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faab00097a0 tx=0x7faab002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b900ecd4f38e4d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:43.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.627+0000 7faac5d9b640 1 -- 172.21.15.59:0/2360216260 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab0037070 con 0x7faac80c46d0 2024-04-25T15:46:43.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.627+0000 7faac5d9b640 1 -- 172.21.15.59:0/2360216260 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab002ae50 con 0x7faac80c46d0 2024-04-25T15:46:43.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.627+0000 7faac5d9b640 1 -- 172.21.15.59:0/2360216260 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab0032660 con 0x7faac80c46d0 2024-04-25T15:46:43.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.628+0000 7faacd070640 1 -- 172.21.15.59:0/2360216260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac80c46d0 msgr2=0x7faac8154300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.628+0000 7faacd070640 1 --2- 172.21.15.59:0/2360216260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac80c46d0 0x7faac8154300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faab00097a0 tx=0x7faab002a100 comp rx=0 tx=0).stop 2024-04-25T15:46:43.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.628+0000 7faacd070640 1 -- 172.21.15.59:0/2360216260 shutdown_connections 2024-04-25T15:46:43.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.628+0000 7faacd070640 1 --2- 172.21.15.59:0/2360216260 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faac80cfb80 0x7faac80cff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.628+0000 7faacd070640 1 --2- 172.21.15.59:0/2360216260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac80c46d0 0x7faac8154300 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.628+0000 7faacd070640 1 -- 172.21.15.59:0/2360216260 >> 172.21.15.59:0/2360216260 conn(0x7faac8073200 msgr2=0x7faac8073610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:43.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.628+0000 7faacd070640 1 -- 172.21.15.59:0/2360216260 shutdown_connections 2024-04-25T15:46:43.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.628+0000 7faacd070640 1 -- 172.21.15.59:0/2360216260 wait complete. 2024-04-25T15:46:43.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.630+0000 7faacd070640 1 Processor -- start 2024-04-25T15:46:43.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.630+0000 7faacd070640 1 -- start start 2024-04-25T15:46:43.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.631+0000 7faacd070640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faac80c46d0 0x7faac815d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.631+0000 7faacd070640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faac80cfb80 0x7faac80c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.631+0000 7faacd070640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac81536e0 0x7faac8150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.631+0000 7faacd070640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faac80b2320 con 0x7faac81536e0 2024-04-25T15:46:43.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.631+0000 7faacd070640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7faac80cc360 con 0x7faac80cfb80 2024-04-25T15:46:43.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.631+0000 7faacd070640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7faac80cb610 con 0x7faac80c46d0 2024-04-25T15:46:43.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.632+0000 7faac6d9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faac80c46d0 0x7faac815d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.632+0000 7faac659c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faac80cfb80 0x7faac80c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.632+0000 7faac6d9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faac80c46d0 0x7faac815d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:38444/0 (socket says 172.21.15.59:38444) 2024-04-25T15:46:43.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.632+0000 7faac6d9d640 1 -- 172.21.15.59:0/2310790494 learned_addr learned my addr 172.21.15.59:0/2310790494 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:43.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.632+0000 7faac759e640 1 --2- 172.21.15.59:0/2310790494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac81536e0 0x7faac8150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.636+0000 7faac6d9d640 1 -- 172.21.15.59:0/2310790494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faac80cfb80 msgr2=0x7faac80c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.636+0000 7faac6d9d640 1 --2- 172.21.15.59:0/2310790494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faac80cfb80 0x7faac80c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.636+0000 7faac6d9d640 1 -- 172.21.15.59:0/2310790494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac81536e0 msgr2=0x7faac8150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:43.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.636+0000 7faac6d9d640 1 --2- 172.21.15.59:0/2310790494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac81536e0 0x7faac8150030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:43.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.636+0000 7faac6d9d640 1 -- 172.21.15.59:0/2310790494 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac8155ef0 con 0x7faac80c46d0 2024-04-25T15:46:43.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.639+0000 7faac6d9d640 1 --2- 172.21.15.59:0/2310790494 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faac80c46d0 0x7faac815d970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faac000c3c0 tx=0x7faac000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:43.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.643+0000 7faabf7fe640 1 -- 172.21.15.59:0/2310790494 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac0017070 con 0x7faac80c46d0 2024-04-25T15:46:43.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.643+0000 7faabf7fe640 1 -- 172.21.15.59:0/2310790494 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac0005ce0 con 0x7faac80c46d0 2024-04-25T15:46:43.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.643+0000 7faacd070640 1 -- 172.21.15.59:0/2310790494 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac815deb0 con 0x7faac80c46d0 2024-04-25T15:46:43.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.643+0000 7faabf7fe640 1 -- 172.21.15.59:0/2310790494 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac00072d0 con 0x7faac80c46d0 2024-04-25T15:46:43.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.643+0000 7faacd070640 1 -- 172.21.15.59:0/2310790494 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faac815d1b0 con 0x7faac80c46d0 2024-04-25T15:46:43.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.644+0000 7faacd070640 1 -- 172.21.15.59:0/2310790494 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac81560c0 con 0x7faac80c46d0 2024-04-25T15:46:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.951+0000 7faabf7fe640 1 -- 172.21.15.59:0/2310790494 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7faac001a070 con 0x7faac80c46d0 2024-04-25T15:46:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.951+0000 7faabf7fe640 1 --2- 172.21.15.59:0/2310790494 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7faaa8074580 0x7faaa8076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.951+0000 7faabf7fe640 1 -- 172.21.15.59:0/2310790494 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7faac0094a30 con 0x7faac80c46d0 2024-04-25T15:46:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.951+0000 7faac659c640 1 --2- 172.21.15.59:0/2310790494 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7faaa8074580 0x7faaa8076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:43.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.952+0000 7faac659c640 1 --2- 172.21.15.59:0/2310790494 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7faaa8074580 0x7faaa8076a90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faab0034000 tx=0x7faab002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:43.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:43.962+0000 7faabf7fe640 1 -- 172.21.15.59:0/2310790494 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faac005eb50 con 0x7faac80c46d0 2024-04-25T15:46:44.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.202+0000 7faacd070640 1 -- 172.21.15.59:0/2310790494 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7faac815e6e0 con 0x7faac80c46d0 2024-04-25T15:46:44.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.379+0000 7faabf7fe640 1 -- 172.21.15.59:0/2310790494 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+186742 (secure 0 0 0) 0x7faac0067220 con 0x7faac80c46d0 2024-04-25T15:46:44.382 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:44.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.382+0000 7faacd070640 1 -- 172.21.15.59:0/2310790494 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7faaa8074580 msgr2=0x7faaa8076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:44.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.382+0000 7faacd070640 1 --2- 172.21.15.59:0/2310790494 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7faaa8074580 0x7faaa8076a90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faab0034000 tx=0x7faab002e000 comp rx=0 tx=0).stop 2024-04-25T15:46:44.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.382+0000 7faacd070640 1 -- 172.21.15.59:0/2310790494 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faac80c46d0 msgr2=0x7faac815d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:44.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.382+0000 7faacd070640 1 --2- 172.21.15.59:0/2310790494 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faac80c46d0 0x7faac815d970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faac000c3c0 tx=0x7faac000c880 comp rx=0 tx=0).stop 2024-04-25T15:46:44.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.382+0000 7faacd070640 1 -- 172.21.15.59:0/2310790494 shutdown_connections 2024-04-25T15:46:44.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.382+0000 7faacd070640 1 --2- 172.21.15.59:0/2310790494 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7faaa8074580 0x7faaa8076a90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.382+0000 7faacd070640 1 --2- 172.21.15.59:0/2310790494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac81536e0 0x7faac8150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.382+0000 7faacd070640 1 --2- 172.21.15.59:0/2310790494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faac80cfb80 0x7faac80c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.382+0000 7faacd070640 1 --2- 172.21.15.59:0/2310790494 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faac80c46d0 0x7faac815d970 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.382+0000 7faacd070640 1 -- 172.21.15.59:0/2310790494 >> 172.21.15.59:0/2310790494 conn(0x7faac8073200 msgr2=0x7faac815a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:44.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.382+0000 7faacd070640 1 -- 172.21.15.59:0/2310790494 shutdown_connections 2024-04-25T15:46:44.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.382+0000 7faacd070640 1 -- 172.21.15.59:0/2310790494 wait complete. 2024-04-25T15:46:44.395 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":2368090706},{"type":"v1","addr":"172.21.15.59:6801","nonce":2368090706}]},"active_addr":"172.21.15.59:6801/2368090706","active_change":"2024-04-25T15:46:05.910547+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4113,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":1843946157}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":1564059533}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":529554425}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":3695394467}]}]} 2024-04-25T15:46:44.399 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T15:46:44.399 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T15:46:44.399 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:44.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.511+0000 7f330d830640 1 Processor -- start 2024-04-25T15:46:44.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.511+0000 7f330d830640 1 -- start start 2024-04-25T15:46:44.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.512+0000 7f330d830640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33080b41c0 0x7f33080cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:44.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.512+0000 7f330d830640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f33080cd680 0x7f330815c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:44.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.512+0000 7f330d830640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f330815cd60 con 0x7f330815c6f0 2024-04-25T15:46:44.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.512+0000 7f330d830640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f330815cb00 con 0x7f33080cd680 2024-04-25T15:46:44.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.512+0000 7f330d830640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f330815d040 con 0x7f33080b41c0 2024-04-25T15:46:44.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.513+0000 7f33077fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f330815c6f0 0x7f33080ce540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39374/0 (socket says 172.21.15.59:39374) 2024-04-25T15:46:44.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.513+0000 7f33077fe640 1 -- 172.21.15.59:0/71028850 learned_addr learned my addr 172.21.15.59:0/71028850 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:44.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.513+0000 7f33067fc640 1 --2- 172.21.15.59:0/71028850 >> v2:172.21.15.64:3300/0 conn(0x7f33080cd680 0x7f330815c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:44.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.513+0000 7f3306ffd640 1 --2- 172.21.15.59:0/71028850 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33080b41c0 0x7f33080cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:44.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.516+0000 7f3305ffb640 1 -- 172.21.15.59:0/71028850 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2668015673 0 0) 0x7f330815cd60 con 0x7f330815c6f0 2024-04-25T15:46:44.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.516+0000 7f3305ffb640 1 -- 172.21.15.59:0/71028850 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32f0003520 con 0x7f330815c6f0 2024-04-25T15:46:44.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.516+0000 7f33067fc640 1 -- 172.21.15.59:0/71028850 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33080b41c0 msgr2=0x7f33080cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:44.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.516+0000 7f33067fc640 1 --2- 172.21.15.59:0/71028850 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33080b41c0 0x7f33080cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.516+0000 7f33067fc640 1 -- 172.21.15.59:0/71028850 >> v1:172.21.15.59:6789/0 conn(0x7f330815c6f0 legacy=0x7f33080ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:44.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.516+0000 7f33067fc640 1 -- 172.21.15.59:0/71028850 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330815d320 con 0x7f33080cd680 2024-04-25T15:46:44.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.518+0000 7f33067fc640 1 --2- 172.21.15.59:0/71028850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33080cd680 0x7f330815c1b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0097a0 tx=0x7f32fc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9f564c3b381e689 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:44.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.523+0000 7f3305ffb640 1 -- 172.21.15.59:0/71028850 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc037070 con 0x7f33080cd680 2024-04-25T15:46:44.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.523+0000 7f3305ffb640 1 -- 172.21.15.59:0/71028850 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32fc032440 con 0x7f33080cd680 2024-04-25T15:46:44.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.523+0000 7f3305ffb640 1 -- 172.21.15.59:0/71028850 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc032810 con 0x7f33080cd680 2024-04-25T15:46:44.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.523+0000 7f330d830640 1 -- 172.21.15.59:0/71028850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33080cd680 msgr2=0x7f330815c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:44.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.523+0000 7f330d830640 1 --2- 172.21.15.59:0/71028850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33080cd680 0x7f330815c1b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0097a0 tx=0x7f32fc02a180 comp rx=0 tx=0).stop 2024-04-25T15:46:44.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.523+0000 7f330d830640 1 -- 172.21.15.59:0/71028850 shutdown_connections 2024-04-25T15:46:44.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.523+0000 7f330d830640 1 --2- 172.21.15.59:0/71028850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33080cd680 0x7f330815c1b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.523+0000 7f330d830640 1 --2- 172.21.15.59:0/71028850 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33080b41c0 0x7f33080cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.524+0000 7f330d830640 1 -- 172.21.15.59:0/71028850 >> 172.21.15.59:0/71028850 conn(0x7f330806ed70 msgr2=0x7f330806f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:44.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.524+0000 7f330d830640 1 -- 172.21.15.59:0/71028850 shutdown_connections 2024-04-25T15:46:44.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.524+0000 7f330d830640 1 -- 172.21.15.59:0/71028850 wait complete. 2024-04-25T15:46:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.525+0000 7f330d830640 1 Processor -- start 2024-04-25T15:46:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.525+0000 7f330d830640 1 -- start start 2024-04-25T15:46:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.527+0000 7f330d830640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33080b41c0 0x7f33081f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.527+0000 7f330d830640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33080cd680 0x7f33080c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.527+0000 7f330d830640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f330815c6f0 0x7f33080ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.527+0000 7f330d830640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f33080b78a0 con 0x7f33080b41c0 2024-04-25T15:46:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.527+0000 7f330d830640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f33080ce020 con 0x7f330815c6f0 2024-04-25T15:46:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.527+0000 7f330d830640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f33080c51e0 con 0x7f33080cd680 2024-04-25T15:46:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.527+0000 7f3306ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33080b41c0 0x7f33081f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.527+0000 7f33067fc640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33080cd680 0x7f33080c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.527+0000 7f33077fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f330815c6f0 0x7f33080ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.528+0000 7f3306ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33080b41c0 0x7f33081f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59580/0 (socket says 172.21.15.59:59580) 2024-04-25T15:46:44.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.528+0000 7f3306ffd640 1 -- 172.21.15.59:0/716802920 learned_addr learned my addr 172.21.15.59:0/716802920 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:44.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.532+0000 7f3306ffd640 1 -- 172.21.15.59:0/716802920 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33080cd680 msgr2=0x7f33080c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:44.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.532+0000 7f3306ffd640 1 --2- 172.21.15.59:0/716802920 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33080cd680 0x7f33080c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.532+0000 7f3306ffd640 1 -- 172.21.15.59:0/716802920 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f330815c6f0 msgr2=0x7f33080ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:44.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.532+0000 7f3306ffd640 1 --2- 172.21.15.59:0/716802920 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f330815c6f0 0x7f33080ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:44.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.532+0000 7f3306ffd640 1 -- 172.21.15.59:0/716802920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33080c7bb0 con 0x7f33080b41c0 2024-04-25T15:46:44.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.535+0000 7f3306ffd640 1 --2- 172.21.15.59:0/716802920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33080b41c0 0x7f33081f2e20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f32f800e870 tx=0x7f32f800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:44.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.538+0000 7f32effff640 1 -- 172.21.15.59:0/716802920 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f8017070 con 0x7f33080b41c0 2024-04-25T15:46:44.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.538+0000 7f32effff640 1 -- 172.21.15.59:0/716802920 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f800ee60 con 0x7f33080b41c0 2024-04-25T15:46:44.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.538+0000 7f32effff640 1 -- 172.21.15.59:0/716802920 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f800cb00 con 0x7f33080b41c0 2024-04-25T15:46:44.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.538+0000 7f330d830640 1 -- 172.21.15.59:0/716802920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33080c6e90 con 0x7f33080b41c0 2024-04-25T15:46:44.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.538+0000 7f330d830640 1 -- 172.21.15.59:0/716802920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33081e3750 con 0x7f33080b41c0 2024-04-25T15:46:44.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.539+0000 7f330d830640 1 -- 172.21.15.59:0/716802920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33080698a0 con 0x7f33080b41c0 2024-04-25T15:46:44.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.846+0000 7f32effff640 1 -- 172.21.15.59:0/716802920 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f32f801a070 con 0x7f33080b41c0 2024-04-25T15:46:44.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.846+0000 7f32effff640 1 --2- 172.21.15.59:0/716802920 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f32f4074530 0x7f32f4076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:44.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.847+0000 7f33067fc640 1 --2- 172.21.15.59:0/716802920 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f32f4074530 0x7f32f4076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:44.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.847+0000 7f33067fc640 1 --2- 172.21.15.59:0/716802920 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f32f4074530 0x7f32f4076a40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f32fc034000 tx=0x7f32fc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:44.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.861+0000 7f32effff640 1 -- 172.21.15.59:0/716802920 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f32f805bba0 con 0x7f33080b41c0 2024-04-25T15:46:44.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:44.861+0000 7f32effff640 1 -- 172.21.15.59:0/716802920 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f32f805f910 con 0x7f33080b41c0 2024-04-25T15:46:45.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.050+0000 7f330d830640 1 -- 172.21.15.59:0/716802920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33080cbab0 con 0x7f33080b41c0 2024-04-25T15:46:45.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.092+0000 7f32effff640 1 -- 172.21.15.59:0/716802920 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16545 (secure 0 0 0) 0x7f32f8063c10 con 0x7f33080b41c0 2024-04-25T15:46:45.093 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:45.094 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":22,"fsid":"9bb5d7ca-5217-467b-882c-0a18cd57f08f","created":"2024-04-25T15:46:00.198001+0000","modified":"2024-04-25T15:46:33.915756+0000","last_up_change":"2024-04-25T15:46:15.850827+0000","last_in_change":"2024-04-25T15:46:06.311980+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:46:16.936340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:30.174141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:31.372481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34cee654-11dd-4f4b-99fe-093462f8abad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6803","nonce":1314235095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6805","nonce":1314235095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6809","nonce":1314235095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6807","nonce":1314235095}]},"public_addr":"172.21.15.59:6803/1314235095","cluster_addr":"172.21.15.59:6805/1314235095","heartbeat_back_addr":"172.21.15.59:6809/1314235095","heartbeat_front_addr":"172.21.15.59:6807/1314235095","state":["exists","up"]},{"osd":1,"uuid":"3c15505b-4abd-4a24-b30c-edc2732f8ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6827","nonce":3550810151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6829","nonce":3550810151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6833","nonce":3550810151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6831","nonce":3550810151}]},"public_addr":"172.21.15.59:6827/3550810151","cluster_addr":"172.21.15.59:6829/3550810151","heartbeat_back_addr":"172.21.15.59:6833/3550810151","heartbeat_front_addr":"172.21.15.59:6831/3550810151","state":["exists","up"]},{"osd":2,"uuid":"5884bf21-e6b4-4813-b8bc-6baa92443c87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6811","nonce":1651189093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6813","nonce":1651189093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6817","nonce":1651189093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6815","nonce":1651189093}]},"public_addr":"172.21.15.59:6811/1651189093","cluster_addr":"172.21.15.59:6813/1651189093","heartbeat_back_addr":"172.21.15.59:6817/1651189093","heartbeat_front_addr":"172.21.15.59:6815/1651189093","state":["exists","up"]},{"osd":3,"uuid":"6ff71700-3b00-4350-b3c9-f6c41ec46b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6819","nonce":1300858236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6821","nonce":1300858236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6825","nonce":1300858236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6823","nonce":1300858236}]},"public_addr":"172.21.15.59:6819/1300858236","cluster_addr":"172.21.15.59:6821/1300858236","heartbeat_back_addr":"172.21.15.59:6825/1300858236","heartbeat_front_addr":"172.21.15.59:6823/1300858236","state":["exists","up"]},{"osd":4,"uuid":"d0a72143-93fd-4712-aadb-f3fade303426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6817","nonce":2206186554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6819","nonce":2206186554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6823","nonce":2206186554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6821","nonce":2206186554}]},"public_addr":"172.21.15.64:6817/2206186554","cluster_addr":"172.21.15.64:6819/2206186554","heartbeat_back_addr":"172.21.15.64:6823/2206186554","heartbeat_front_addr":"172.21.15.64:6821/2206186554","state":["exists","up"]},{"osd":5,"uuid":"9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6825","nonce":639697697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6827","nonce":639697697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6831","nonce":639697697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6829","nonce":639697697}]},"public_addr":"172.21.15.64:6825/639697697","cluster_addr":"172.21.15.64:6827/639697697","heartbeat_back_addr":"172.21.15.64:6831/639697697","heartbeat_front_addr":"172.21.15.64:6829/639697697","state":["exists","up"]},{"osd":6,"uuid":"311d9a6b-8fbc-4809-8d33-b9248a3562f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6809","nonce":2335675289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6811","nonce":2335675289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6815","nonce":2335675289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6813","nonce":2335675289}]},"public_addr":"172.21.15.64:6809/2335675289","cluster_addr":"172.21.15.64:6811/2335675289","heartbeat_back_addr":"172.21.15.64:6815/2335675289","heartbeat_front_addr":"172.21.15.64:6813/2335675289","state":["exists","up"]},{"osd":7,"uuid":"d0f7436e-882f-4aa7-b2ae-684b9894b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6801","nonce":970439753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6803","nonce":970439753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6807","nonce":970439753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6805","nonce":970439753}]},"public_addr":"172.21.15.64:6801/970439753","cluster_addr":"172.21.15.64:6803/970439753","heartbeat_back_addr":"172.21.15.64:6807/970439753","heartbeat_front_addr":"172.21.15.64:6805/970439753","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.807777+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.945589+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.926832+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.943537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.925062+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.957550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.913559+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.839159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:45.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.095+0000 7f330d830640 1 -- 172.21.15.59:0/716802920 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f32f4074530 msgr2=0x7f32f4076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:45.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.095+0000 7f330d830640 1 --2- 172.21.15.59:0/716802920 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f32f4074530 0x7f32f4076a40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f32fc034000 tx=0x7f32fc02e000 comp rx=0 tx=0).stop 2024-04-25T15:46:45.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.095+0000 7f330d830640 1 -- 172.21.15.59:0/716802920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33080b41c0 msgr2=0x7f33081f2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:45.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.095+0000 7f330d830640 1 --2- 172.21.15.59:0/716802920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33080b41c0 0x7f33081f2e20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f32f800e870 tx=0x7f32f800ed30 comp rx=0 tx=0).stop 2024-04-25T15:46:45.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.095+0000 7f330d830640 1 -- 172.21.15.59:0/716802920 shutdown_connections 2024-04-25T15:46:45.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.095+0000 7f330d830640 1 --2- 172.21.15.59:0/716802920 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f32f4074530 0x7f32f4076a40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.095+0000 7f330d830640 1 --2- 172.21.15.59:0/716802920 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f330815c6f0 0x7f33080ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.095+0000 7f330d830640 1 --2- 172.21.15.59:0/716802920 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f33080cd680 0x7f33080c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.095+0000 7f330d830640 1 --2- 172.21.15.59:0/716802920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33080b41c0 0x7f33081f2e20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.095+0000 7f330d830640 1 -- 172.21.15.59:0/716802920 >> 172.21.15.59:0/716802920 conn(0x7f330806ed70 msgr2=0x7f33080b61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:45.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.095+0000 7f330d830640 1 -- 172.21.15.59:0/716802920 shutdown_connections 2024-04-25T15:46:45.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.095+0000 7f330d830640 1 -- 172.21.15.59:0/716802920 wait complete. 2024-04-25T15:46:45.107 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T15:46:45.108 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:45.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.218+0000 7f56d7c42640 1 Processor -- start 2024-04-25T15:46:45.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.218+0000 7f56d7c42640 1 -- start start 2024-04-25T15:46:45.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.219+0000 7f56d7c42640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f56d008df10 0x7f56d0156730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:45.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.219+0000 7f56d7c42640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56d00cc6e0 0x7f56d015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:45.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.219+0000 7f56d7c42640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d015d460 con 0x7f56d00b52f0 2024-04-25T15:46:45.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.219+0000 7f56d7c42640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f56d0160560 con 0x7f56d00cc6e0 2024-04-25T15:46:45.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.219+0000 7f56d7c42640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f56d01609f0 con 0x7f56d008df10 2024-04-25T15:46:45.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.220+0000 7f56d59de640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f56d008df10 0x7f56d0156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:45.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.220+0000 7f56d51dd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56d00cc6e0 0x7f56d015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:45.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.220+0000 7f56d59de640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f56d008df10 0x7f56d0156730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:53408/0 (socket says 172.21.15.59:53408) 2024-04-25T15:46:45.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.220+0000 7f56d59de640 1 -- 172.21.15.59:0/2153882072 learned_addr learned my addr 172.21.15.59:0/2153882072 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:45.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.223+0000 7f56d59de640 1 -- 172.21.15.59:0/2153882072 >> v2:172.21.15.59:3300/0 conn(0x7f56d00cc6e0 msgr2=0x7f56d015cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:45.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.223+0000 7f56d59de640 1 --2- 172.21.15.59:0/2153882072 >> v2:172.21.15.59:3300/0 conn(0x7f56d00cc6e0 0x7f56d015cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.223+0000 7f56d59de640 1 -- 172.21.15.59:0/2153882072 >> v1:172.21.15.59:6789/0 conn(0x7f56d00b52f0 legacy=0x7f56d008d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:45.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.223+0000 7f56d59de640 1 -- 172.21.15.59:0/2153882072 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d00ccc50 con 0x7f56d008df10 2024-04-25T15:46:45.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.225+0000 7f56d59de640 1 --2- 172.21.15.59:0/2153882072 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d008df10 0x7f56d0156730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f56d008e440 tx=0x7f56cc02a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dcb1bb9abe7a8fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:45.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.229+0000 7f56d49dc640 1 -- 172.21.15.59:0/2153882072 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc037070 con 0x7f56d008df10 2024-04-25T15:46:45.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.229+0000 7f56d49dc640 1 -- 172.21.15.59:0/2153882072 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56cc02ae50 con 0x7f56d008df10 2024-04-25T15:46:45.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.229+0000 7f56d49dc640 1 -- 172.21.15.59:0/2153882072 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc032860 con 0x7f56d008df10 2024-04-25T15:46:45.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.230+0000 7f56d7c42640 1 -- 172.21.15.59:0/2153882072 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d008df10 msgr2=0x7f56d0156730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:45.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.230+0000 7f56d7c42640 1 --2- 172.21.15.59:0/2153882072 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d008df10 0x7f56d0156730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f56d008e440 tx=0x7f56cc02a300 comp rx=0 tx=0).stop 2024-04-25T15:46:45.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.230+0000 7f56d7c42640 1 -- 172.21.15.59:0/2153882072 shutdown_connections 2024-04-25T15:46:45.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.230+0000 7f56d7c42640 1 --2- 172.21.15.59:0/2153882072 >> v2:172.21.15.59:3300/0 conn(0x7f56d00cc6e0 0x7f56d015cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.230+0000 7f56d7c42640 1 --2- 172.21.15.59:0/2153882072 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d008df10 0x7f56d0156730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.230+0000 7f56d7c42640 1 -- 172.21.15.59:0/2153882072 >> 172.21.15.59:0/2153882072 conn(0x7f56d006f3e0 msgr2=0x7f56d00684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:45.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.230+0000 7f56d7c42640 1 -- 172.21.15.59:0/2153882072 shutdown_connections 2024-04-25T15:46:45.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.231+0000 7f56d7c42640 1 -- 172.21.15.59:0/2153882072 wait complete. 2024-04-25T15:46:45.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.232+0000 7f56d7c42640 1 Processor -- start 2024-04-25T15:46:45.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.232+0000 7f56d7c42640 1 -- start start 2024-04-25T15:46:45.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.233+0000 7f56d7c42640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d008df10 0x7f56d015f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:45.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.234+0000 7f56d7c42640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f56d00b52f0 0x7f56d0147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:45.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.234+0000 7f56d7c42640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56d00cc6e0 0x7f56d01f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:45.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.234+0000 7f56d7c42640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f56d01601f0 con 0x7f56d00cc6e0 2024-04-25T15:46:45.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.234+0000 7f56d7c42640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f56d015ff10 con 0x7f56d008df10 2024-04-25T15:46:45.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.234+0000 7f56d7c42640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f56d008db20 con 0x7f56d00b52f0 2024-04-25T15:46:45.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.234+0000 7f56d59de640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d008df10 0x7f56d015f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:45.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.234+0000 7f56d61df640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56d00cc6e0 0x7f56d01f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:45.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.234+0000 7f56d51dd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f56d00b52f0 0x7f56d0147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:45.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.235+0000 7f56d59de640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d008df10 0x7f56d015f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:53422/0 (socket says 172.21.15.59:53422) 2024-04-25T15:46:45.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.235+0000 7f56d59de640 1 -- 172.21.15.59:0/1443124511 learned_addr learned my addr 172.21.15.59:0/1443124511 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:45.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.238+0000 7f56d61df640 1 -- 172.21.15.59:0/1443124511 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f56d00b52f0 msgr2=0x7f56d0147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:45.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.238+0000 7f56d61df640 1 --2- 172.21.15.59:0/1443124511 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f56d00b52f0 0x7f56d0147d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.238+0000 7f56d61df640 1 -- 172.21.15.59:0/1443124511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d008df10 msgr2=0x7f56d015f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:45.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.238+0000 7f56d61df640 1 --2- 172.21.15.59:0/1443124511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d008df10 0x7f56d015f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.238+0000 7f56d61df640 1 -- 172.21.15.59:0/1443124511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d01f3250 con 0x7f56d00cc6e0 2024-04-25T15:46:45.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.241+0000 7f56d61df640 1 --2- 172.21.15.59:0/1443124511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56d00cc6e0 0x7f56d01f2d10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f56c800c700 tx=0x7f56c800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:45.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.244+0000 7f56c67fc640 1 -- 172.21.15.59:0/1443124511 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8003b70 con 0x7f56d00cc6e0 2024-04-25T15:46:45.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.244+0000 7f56c67fc640 1 -- 172.21.15.59:0/1443124511 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c8003d10 con 0x7f56d00cc6e0 2024-04-25T15:46:45.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.245+0000 7f56d7c42640 1 -- 172.21.15.59:0/1443124511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d00ca9f0 con 0x7f56d00cc6e0 2024-04-25T15:46:45.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.245+0000 7f56c67fc640 1 -- 172.21.15.59:0/1443124511 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8005310 con 0x7f56d00cc6e0 2024-04-25T15:46:45.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.245+0000 7f56d7c42640 1 -- 172.21.15.59:0/1443124511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d00cafb0 con 0x7f56d00cc6e0 2024-04-25T15:46:45.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.245+0000 7f56d7c42640 1 -- 172.21.15.59:0/1443124511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56d00698a0 con 0x7f56d00cc6e0 2024-04-25T15:46:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.543+0000 7f56c67fc640 1 -- 172.21.15.59:0/1443124511 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f56c80054b0 con 0x7f56d00cc6e0 2024-04-25T15:46:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.544+0000 7f56c67fc640 1 --2- 172.21.15.59:0/1443124511 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f56b40744e0 0x7f56b40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.544+0000 7f56d59de640 1 --2- 172.21.15.59:0/1443124511 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f56b40744e0 0x7f56b40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.544+0000 7f56d59de640 1 --2- 172.21.15.59:0/1443124511 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f56b40744e0 0x7f56b40769f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f56cc009630 tx=0x7f56cc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:45.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.561+0000 7f56c67fc640 1 -- 172.21.15.59:0/1443124511 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f56c80057a0 con 0x7f56d00cc6e0 2024-04-25T15:46:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.561+0000 7f56c67fc640 1 -- 172.21.15.59:0/1443124511 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f56d015d460 con 0x7f56d00cc6e0 2024-04-25T15:46:45.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.748+0000 7f56d7c42640 1 -- 172.21.15.59:0/1443124511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56d014a8c0 con 0x7f56d00cc6e0 2024-04-25T15:46:45.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.790+0000 7f56c67fc640 1 -- 172.21.15.59:0/1443124511 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16545 (secure 0 0 0) 0x7f56c805fab0 con 0x7f56d00cc6e0 2024-04-25T15:46:45.791 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:45.791 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":22,"fsid":"9bb5d7ca-5217-467b-882c-0a18cd57f08f","created":"2024-04-25T15:46:00.198001+0000","modified":"2024-04-25T15:46:33.915756+0000","last_up_change":"2024-04-25T15:46:15.850827+0000","last_in_change":"2024-04-25T15:46:06.311980+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:46:16.936340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:30.174141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:31.372481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34cee654-11dd-4f4b-99fe-093462f8abad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6803","nonce":1314235095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6805","nonce":1314235095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6809","nonce":1314235095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6807","nonce":1314235095}]},"public_addr":"172.21.15.59:6803/1314235095","cluster_addr":"172.21.15.59:6805/1314235095","heartbeat_back_addr":"172.21.15.59:6809/1314235095","heartbeat_front_addr":"172.21.15.59:6807/1314235095","state":["exists","up"]},{"osd":1,"uuid":"3c15505b-4abd-4a24-b30c-edc2732f8ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6827","nonce":3550810151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6829","nonce":3550810151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6833","nonce":3550810151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6831","nonce":3550810151}]},"public_addr":"172.21.15.59:6827/3550810151","cluster_addr":"172.21.15.59:6829/3550810151","heartbeat_back_addr":"172.21.15.59:6833/3550810151","heartbeat_front_addr":"172.21.15.59:6831/3550810151","state":["exists","up"]},{"osd":2,"uuid":"5884bf21-e6b4-4813-b8bc-6baa92443c87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6811","nonce":1651189093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6813","nonce":1651189093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6817","nonce":1651189093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6815","nonce":1651189093}]},"public_addr":"172.21.15.59:6811/1651189093","cluster_addr":"172.21.15.59:6813/1651189093","heartbeat_back_addr":"172.21.15.59:6817/1651189093","heartbeat_front_addr":"172.21.15.59:6815/1651189093","state":["exists","up"]},{"osd":3,"uuid":"6ff71700-3b00-4350-b3c9-f6c41ec46b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6819","nonce":1300858236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6821","nonce":1300858236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6825","nonce":1300858236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6823","nonce":1300858236}]},"public_addr":"172.21.15.59:6819/1300858236","cluster_addr":"172.21.15.59:6821/1300858236","heartbeat_back_addr":"172.21.15.59:6825/1300858236","heartbeat_front_addr":"172.21.15.59:6823/1300858236","state":["exists","up"]},{"osd":4,"uuid":"d0a72143-93fd-4712-aadb-f3fade303426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6817","nonce":2206186554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6819","nonce":2206186554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6823","nonce":2206186554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6821","nonce":2206186554}]},"public_addr":"172.21.15.64:6817/2206186554","cluster_addr":"172.21.15.64:6819/2206186554","heartbeat_back_addr":"172.21.15.64:6823/2206186554","heartbeat_front_addr":"172.21.15.64:6821/2206186554","state":["exists","up"]},{"osd":5,"uuid":"9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6825","nonce":639697697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6827","nonce":639697697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6831","nonce":639697697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6829","nonce":639697697}]},"public_addr":"172.21.15.64:6825/639697697","cluster_addr":"172.21.15.64:6827/639697697","heartbeat_back_addr":"172.21.15.64:6831/639697697","heartbeat_front_addr":"172.21.15.64:6829/639697697","state":["exists","up"]},{"osd":6,"uuid":"311d9a6b-8fbc-4809-8d33-b9248a3562f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6809","nonce":2335675289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6811","nonce":2335675289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6815","nonce":2335675289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6813","nonce":2335675289}]},"public_addr":"172.21.15.64:6809/2335675289","cluster_addr":"172.21.15.64:6811/2335675289","heartbeat_back_addr":"172.21.15.64:6815/2335675289","heartbeat_front_addr":"172.21.15.64:6813/2335675289","state":["exists","up"]},{"osd":7,"uuid":"d0f7436e-882f-4aa7-b2ae-684b9894b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6801","nonce":970439753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6803","nonce":970439753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6807","nonce":970439753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6805","nonce":970439753}]},"public_addr":"172.21.15.64:6801/970439753","cluster_addr":"172.21.15.64:6803/970439753","heartbeat_back_addr":"172.21.15.64:6807/970439753","heartbeat_front_addr":"172.21.15.64:6805/970439753","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.807777+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.945589+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.926832+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.943537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.925062+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.957550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.913559+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.839159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.792+0000 7f56d7c42640 1 -- 172.21.15.59:0/1443124511 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f56b40744e0 msgr2=0x7f56b40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.792+0000 7f56d7c42640 1 --2- 172.21.15.59:0/1443124511 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f56b40744e0 0x7f56b40769f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f56cc009630 tx=0x7f56cc02e000 comp rx=0 tx=0).stop 2024-04-25T15:46:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.792+0000 7f56d7c42640 1 -- 172.21.15.59:0/1443124511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56d00cc6e0 msgr2=0x7f56d01f2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.792+0000 7f56d7c42640 1 --2- 172.21.15.59:0/1443124511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56d00cc6e0 0x7f56d01f2d10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f56c800c700 tx=0x7f56c800cbc0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.792+0000 7f56d7c42640 1 -- 172.21.15.59:0/1443124511 shutdown_connections 2024-04-25T15:46:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.792+0000 7f56d7c42640 1 --2- 172.21.15.59:0/1443124511 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f56b40744e0 0x7f56b40769f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.792+0000 7f56d7c42640 1 --2- 172.21.15.59:0/1443124511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56d00cc6e0 0x7f56d01f2d10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.792+0000 7f56d7c42640 1 --2- 172.21.15.59:0/1443124511 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f56d00b52f0 0x7f56d0147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.792+0000 7f56d7c42640 1 --2- 172.21.15.59:0/1443124511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56d008df10 0x7f56d015f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.792+0000 7f56d7c42640 1 -- 172.21.15.59:0/1443124511 >> 172.21.15.59:0/1443124511 conn(0x7f56d006f3e0 msgr2=0x7f56d008d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.792+0000 7f56d7c42640 1 -- 172.21.15.59:0/1443124511 shutdown_connections 2024-04-25T15:46:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:45.792+0000 7f56d7c42640 1 -- 172.21.15.59:0/1443124511 wait complete. 2024-04-25T15:46:45.804 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T15:46:45.805 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T15:46:45.805 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T15:46:45.806 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T15:46:45.806 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T15:46:45.806 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T15:46:45.807 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T15:46:45.807 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T15:46:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.010+0000 7efc79630640 1 Processor -- start 2024-04-25T15:46:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.010+0000 7efc79630640 1 -- start start 2024-04-25T15:46:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.012+0000 7efc79630640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efc6c04c8c0 0x7efc6c0f6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.012+0000 7efc79630640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efc6c1004f0 0x7efc6c100900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.012+0000 7efc79630640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc6c006540 con 0x7efc6c045350 2024-04-25T15:46:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.012+0000 7efc79630640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7efc6c033150 con 0x7efc6c1004f0 2024-04-25T15:46:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.012+0000 7efc79630640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7efc6c006e70 con 0x7efc6c04c8c0 2024-04-25T15:46:46.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.013+0000 7efc78e2f640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efc6c1004f0 0x7efc6c100900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.013+0000 7efc737fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efc6c04c8c0 0x7efc6c0f6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.013+0000 7fcc36485640 1 Processor -- start 2024-04-25T15:46:46.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.014+0000 7efc78e2f640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efc6c1004f0 0x7efc6c100900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:53426/0 (socket says 172.21.15.59:53426) 2024-04-25T15:46:46.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.014+0000 7efc78e2f640 1 -- 172.21.15.59:0/2896229190 learned_addr learned my addr 172.21.15.59:0/2896229190 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.014+0000 7f13df59e640 1 Processor -- start 2024-04-25T15:46:46.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.014+0000 7fcc36485640 1 -- start start 2024-04-25T15:46:46.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.016+0000 7fcc36485640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcc300c7e60 0x7fcc30149860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.016+0000 7fcc36485640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc300c4960 0x7fcc300c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.014+0000 7f13df59e640 1 -- start start 2024-04-25T15:46:46.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.016+0000 7fcc36485640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fcc3006ccd0 0x7fcc3006d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.016+0000 7fcc36485640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fcc301607e0 con 0x7fcc300c4960 2024-04-25T15:46:46.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.016+0000 7fcc36485640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fcc30160aa0 con 0x7fcc3006ccd0 2024-04-25T15:46:46.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.016+0000 7fcc36485640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fcc30160d80 con 0x7fcc300c7e60 2024-04-25T15:46:46.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.017+0000 7f13df59e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f13d8050ed0 0x7f13d8006ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.017+0000 7f13df59e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d8047540 con 0x7f13d8045e70 2024-04-25T15:46:46.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.017+0000 7f13df59e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d8034fe0 con 0x7f13d80334e0 2024-04-25T15:46:46.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.017+0000 7f13df59e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f13d8035840 con 0x7f13d8050ed0 2024-04-25T15:46:46.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.016+0000 7f245edce640 1 Processor -- start 2024-04-25T15:46:46.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.016+0000 7f245edce640 1 -- start start 2024-04-25T15:46:46.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.018+0000 7efc78e2f640 1 -- 172.21.15.59:0/2896229190 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efc6c04c8c0 msgr2=0x7efc6c0f6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.018+0000 7efc78e2f640 1 --2- 172.21.15.59:0/2896229190 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efc6c04c8c0 0x7efc6c0f6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.018+0000 7efc78e2f640 1 -- 172.21.15.59:0/2896229190 >> v1:172.21.15.64:6789/0 conn(0x7efc6c045350 legacy=0x7efc6c007300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.018+0000 7efc78e2f640 1 -- 172.21.15.59:0/2896229190 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6c006820 con 0x7efc6c1004f0 2024-04-25T15:46:46.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.018+0000 7f245edce640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2458152890 0x7f24580c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.018+0000 7f245edce640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2458158ce0 0x7f245806f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.019+0000 7f245edce640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2458158550 con 0x7f24581590f0 2024-04-25T15:46:46.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.019+0000 7f245edce640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f24580c9370 con 0x7f2458152890 2024-04-25T15:46:46.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.019+0000 7f245edce640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f24580c8260 con 0x7f2458158ce0 2024-04-25T15:46:46.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.020+0000 7fcc34c82640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc300c4960 0x7fcc300c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.021+0000 7f2487e61640 1 Processor -- start 2024-04-25T15:46:46.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.021+0000 7f2487e61640 1 -- start start 2024-04-25T15:46:46.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.022+0000 7fcc35483640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcc300c7e60 0x7fcc30149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.022+0000 7fe538e92640 1 Processor -- start 2024-04-25T15:46:46.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.022+0000 7f2457fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2458158ce0 0x7f245806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.023+0000 7fe538e92640 1 -- start start 2024-04-25T15:46:46.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.023+0000 7f2457fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2458158ce0 0x7f245806f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53246/0 (socket says 172.21.15.59:53246) 2024-04-25T15:46:46.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.023+0000 7f2457fff640 1 -- 172.21.15.59:0/1226155110 learned_addr learned my addr 172.21.15.59:0/1226155110 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.023+0000 7efc78e2f640 1 --2- 172.21.15.59:0/2896229190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc6c1004f0 0x7efc6c100900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efc6c006ff0 tx=0x7efc6002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c08eb34e2f04148d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.023+0000 7fcc35483640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcc300c7e60 0x7fcc30149860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53232/0 (socket says 172.21.15.59:53232) 2024-04-25T15:46:46.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.023+0000 7f2487e61640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f24800c90f0 0x7f24800caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.023+0000 7fcc35483640 1 -- 172.21.15.59:0/955402929 learned_addr learned my addr 172.21.15.59:0/955402929 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.023+0000 7f2487e61640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f248015cbd0 0x7f24800cb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.023+0000 7f2487e61640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24800c37b0 con 0x7f24800cb180 2024-04-25T15:46:46.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.023+0000 7f2487e61640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f2480071680 con 0x7f248015cbd0 2024-04-25T15:46:46.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.023+0000 7f2487e61640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f24800c3ae0 con 0x7f24800c90f0 2024-04-25T15:46:46.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.024+0000 7fe538e92640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe5340c9f60 0x7fe5340c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.024+0000 7f13ddd9b640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f13d80334e0 0x7f13d8046d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.59:46832/0 (socket says 172.21.15.59:46832) 2024-04-25T15:46:46.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.024+0000 7f13ddd9b640 1 -- 172.21.15.59:0/575778829 learned_addr learned my addr 172.21.15.59:0/575778829 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:46.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.024+0000 7fcc35c84640 1 --2- 172.21.15.59:0/955402929 >> v2:172.21.15.64:3300/0 conn(0x7fcc3006ccd0 0x7fcc3006d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.025+0000 7fe538e92640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe5340c58e0 0x7fe5340c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.025+0000 7fe538e92640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5340c9860 con 0x7fe53406f9e0 2024-04-25T15:46:46.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.025+0000 7fe538e92640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fe5340cb180 con 0x7fe5340c58e0 2024-04-25T15:46:46.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.025+0000 7fe538e92640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fe5340c9b00 con 0x7fe5340c9f60 2024-04-25T15:46:46.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.025+0000 7f245cb6a640 1 --2- 172.21.15.59:0/1226155110 >> v2:172.21.15.64:3300/0 conn(0x7f2458152890 0x7f24580c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.026+0000 7f2457fff640 1 -- 172.21.15.59:0/1226155110 >> v2:172.21.15.64:3300/0 conn(0x7f2458152890 msgr2=0x7f24580c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.026+0000 7f2457fff640 1 --2- 172.21.15.59:0/1226155110 >> v2:172.21.15.64:3300/0 conn(0x7f2458152890 0x7f24580c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.026+0000 7f2457fff640 1 -- 172.21.15.59:0/1226155110 >> v1:172.21.15.59:6789/0 conn(0x7f24581590f0 legacy=0x7f245815b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.026+0000 7f2457fff640 1 -- 172.21.15.59:0/1226155110 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24580c9610 con 0x7f2458158ce0 2024-04-25T15:46:46.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.028+0000 7f66ffc9f640 1 Processor -- start 2024-04-25T15:46:46.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.028+0000 7fcc35483640 1 -- 172.21.15.59:0/955402929 >> v2:172.21.15.64:3300/0 conn(0x7fcc3006ccd0 msgr2=0x7fcc3006d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.028+0000 7f66ffc9f640 1 -- start start 2024-04-25T15:46:46.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.028+0000 7fcc35483640 1 --2- 172.21.15.59:0/955402929 >> v2:172.21.15.64:3300/0 conn(0x7fcc3006ccd0 0x7fcc3006d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.028+0000 7fcc35483640 1 -- 172.21.15.59:0/955402929 >> v2:172.21.15.59:3300/0 conn(0x7fcc300c4960 msgr2=0x7fcc300c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.028+0000 7fcc35483640 1 --2- 172.21.15.59:0/955402929 >> v2:172.21.15.59:3300/0 conn(0x7fcc300c4960 0x7fcc300c4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.028+0000 7f13de59c640 1 --2- 172.21.15.59:0/575778829 >> v2:172.21.15.59:3300/0 conn(0x7f13d8050ed0 0x7f13d8006ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.028+0000 7fcc35483640 1 -- 172.21.15.59:0/955402929 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc30161060 con 0x7fcc300c7e60 2024-04-25T15:46:46.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.030+0000 7f66ffc9f640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f66f80c3660 0x7f66f80703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.031+0000 7f66ffc9f640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66f8153870 con 0x7f66f8153460 2024-04-25T15:46:46.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.031+0000 7f66ffc9f640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66f80c9520 con 0x7f66f80ca560 2024-04-25T15:46:46.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.031+0000 7f66ffc9f640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f66f8070900 con 0x7f66f80c3660 2024-04-25T15:46:46.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.031+0000 7fcc35483640 1 --2- 172.21.15.59:0/955402929 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcc300c7e60 0x7fcc30149860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcc30164e90 tx=0x7fcc2c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78520edfc556b06a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.032+0000 7f2457fff640 1 --2- 172.21.15.59:0/1226155110 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2458158ce0 0x7f245806f080 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2450009e50 tx=0x7f245002a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d673997924f6b470 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.033+0000 7f24853fc640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f24800cb180 0x7f248015c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.59:46848/0 (socket says 172.21.15.59:46848) 2024-04-25T15:46:46.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.033+0000 7f24853fc640 1 -- 172.21.15.59:0/2155808056 learned_addr learned my addr 172.21.15.59:0/2155808056 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:46.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.034+0000 7f13dd59a640 1 -- 172.21.15.59:0/575778829 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3916008886 0 0) 0x7f13d8047540 con 0x7f13d8045e70 2024-04-25T15:46:46.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.034+0000 7f13dd59a640 1 -- 172.21.15.59:0/575778829 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13c8003440 con 0x7f13d8045e70 2024-04-25T15:46:46.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.036+0000 7efc72ffd640 1 -- 172.21.15.59:0/2896229190 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc60037070 con 0x7efc6c1004f0 2024-04-25T15:46:46.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.036+0000 7efc72ffd640 1 -- 172.21.15.59:0/2896229190 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6002ae50 con 0x7efc6c1004f0 2024-04-25T15:46:46.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.036+0000 7efc72ffd640 1 -- 172.21.15.59:0/2896229190 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc600328a0 con 0x7efc6c1004f0 2024-04-25T15:46:46.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.037+0000 7efc79630640 1 -- 172.21.15.59:0/2896229190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc6c1004f0 msgr2=0x7efc6c100900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.037+0000 7efc79630640 1 --2- 172.21.15.59:0/2896229190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc6c1004f0 0x7efc6c100900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efc6c006ff0 tx=0x7efc6002a300 comp rx=0 tx=0).stop 2024-04-25T15:46:46.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.037+0000 7efc79630640 1 -- 172.21.15.59:0/2896229190 shutdown_connections 2024-04-25T15:46:46.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.037+0000 7efc79630640 1 --2- 172.21.15.59:0/2896229190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc6c1004f0 0x7efc6c100900 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.037+0000 7efc79630640 1 --2- 172.21.15.59:0/2896229190 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efc6c04c8c0 0x7efc6c0f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.037+0000 7efc79630640 1 -- 172.21.15.59:0/2896229190 >> 172.21.15.59:0/2896229190 conn(0x7efc6c0503b0 msgr2=0x7efc6c0507c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.037+0000 7efc79630640 1 -- 172.21.15.59:0/2896229190 shutdown_connections 2024-04-25T15:46:46.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.037+0000 7efc79630640 1 -- 172.21.15.59:0/2896229190 wait complete. 2024-04-25T15:46:46.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.038+0000 7fcc27fff640 1 -- 172.21.15.59:0/955402929 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c037070 con 0x7fcc300c7e60 2024-04-25T15:46:46.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.038+0000 7f2485bfd640 1 --2- 172.21.15.59:0/2155808056 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f24800c90f0 0x7f24800caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.039+0000 7f13dd59a640 1 -- 172.21.15.59:0/575778829 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 482737407 0 0) 0x7f13d8034fe0 con 0x7f13d80334e0 2024-04-25T15:46:46.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.039+0000 7f13dd59a640 1 -- 172.21.15.59:0/575778829 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13d8047540 con 0x7f13d80334e0 2024-04-25T15:46:46.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.039+0000 7fe532d9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe5340c58e0 0x7fe5340c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.040+0000 7efc79630640 1 Processor -- start 2024-04-25T15:46:46.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.040+0000 7efc79630640 1 -- start start 2024-04-25T15:46:46.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.040+0000 7fe532d9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe5340c58e0 0x7fe5340c7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:53466/0 (socket says 172.21.15.59:53466) 2024-04-25T15:46:46.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.040+0000 7fe532d9d640 1 -- 172.21.15.59:0/1901397783 learned_addr learned my addr 172.21.15.59:0/1901397783 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.040+0000 7f2484bfb640 1 -- 172.21.15.59:0/2155808056 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3340792928 0 0) 0x7f24800c37b0 con 0x7f24800cb180 2024-04-25T15:46:46.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.040+0000 7f2484bfb640 1 -- 172.21.15.59:0/2155808056 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f246c003520 con 0x7f24800cb180 2024-04-25T15:46:46.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.041+0000 7f24863fe640 1 --2- 172.21.15.59:0/2155808056 >> v2:172.21.15.64:3300/0 conn(0x7f248015cbd0 0x7f24800cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.042+0000 7fcc27fff640 1 -- 172.21.15.59:0/955402929 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc2c032440 con 0x7fcc300c7e60 2024-04-25T15:46:46.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.042+0000 7fcc27fff640 1 -- 172.21.15.59:0/955402929 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c032810 con 0x7fcc300c7e60 2024-04-25T15:46:46.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.042+0000 7f13de59c640 1 -- 172.21.15.59:0/575778829 >> v1:172.21.15.64:6789/0 conn(0x7f13d80334e0 legacy=0x7f13d8046d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.042+0000 7f13de59c640 1 -- 172.21.15.59:0/575778829 >> v1:172.21.15.59:6789/0 conn(0x7f13d8045e70 legacy=0x7f13d80e5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.042+0000 7f13de59c640 1 -- 172.21.15.59:0/575778829 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d8046280 con 0x7f13d8050ed0 2024-04-25T15:46:46.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.042+0000 7efc79630640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc6c045350 0x7efc6c0e7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.042+0000 7efc79630640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc6c04c8c0 0x7efc6c0e7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.042+0000 7f22ee0b6640 1 Processor -- start 2024-04-25T15:46:46.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.042+0000 7efc79630640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efc6c1004f0 0x7efc6c0ed1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.042+0000 7f22ee0b6640 1 -- start start 2024-04-25T15:46:46.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.042+0000 7efc79630640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c045c10 con 0x7efc6c045350 2024-04-25T15:46:46.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.042+0000 7efc79630640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c0f7510 con 0x7efc6c04c8c0 2024-04-25T15:46:46.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.042+0000 7efc79630640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7efc6c045d90 con 0x7efc6c1004f0 2024-04-25T15:46:46.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.043+0000 7fcc36485640 1 -- 172.21.15.59:0/955402929 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcc300c7e60 msgr2=0x7fcc30149860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.043+0000 7fcc36485640 1 --2- 172.21.15.59:0/955402929 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcc300c7e60 0x7fcc30149860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcc30164e90 tx=0x7fcc2c02a270 comp rx=0 tx=0).stop 2024-04-25T15:46:46.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.043+0000 7fcc36485640 1 -- 172.21.15.59:0/955402929 shutdown_connections 2024-04-25T15:46:46.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.043+0000 7fcc36485640 1 --2- 172.21.15.59:0/955402929 >> v2:172.21.15.64:3300/0 conn(0x7fcc3006ccd0 0x7fcc3006d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.043+0000 7fcc36485640 1 --2- 172.21.15.59:0/955402929 >> v2:172.21.15.59:3300/0 conn(0x7fcc300c4960 0x7fcc300c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.043+0000 7fcc36485640 1 --2- 172.21.15.59:0/955402929 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcc300c7e60 0x7fcc30149860 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.043+0000 7fcc36485640 1 -- 172.21.15.59:0/955402929 >> 172.21.15.59:0/955402929 conn(0x7fcc30068b10 msgr2=0x7fcc3006f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.043+0000 7fcc36485640 1 -- 172.21.15.59:0/955402929 shutdown_connections 2024-04-25T15:46:46.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.043+0000 7fcc36485640 1 -- 172.21.15.59:0/955402929 wait complete. 2024-04-25T15:46:46.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.043+0000 7f22ee0b6640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f22e8156870 0x7f22e80c3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.044+0000 7f22ee0b6640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22e80c3e70 con 0x7f22e80ca090 2024-04-25T15:46:46.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.044+0000 7f22ee0b6640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22e815cf10 con 0x7f22e80c90f0 2024-04-25T15:46:46.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.044+0000 7f22ee0b6640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f22e8070cb0 con 0x7f22e8156870 2024-04-25T15:46:46.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.044+0000 7fe53259c640 1 --2- 172.21.15.59:0/1901397783 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe5340c9f60 0x7fe5340c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.045+0000 7f24577fe640 1 -- 172.21.15.59:0/1226155110 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2450036070 con 0x7f2458158ce0 2024-04-25T15:46:46.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.045+0000 7f24577fe640 1 -- 172.21.15.59:0/1226155110 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2450031600 con 0x7f2458158ce0 2024-04-25T15:46:46.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.045+0000 7f24577fe640 1 -- 172.21.15.59:0/1226155110 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24500319d0 con 0x7f2458158ce0 2024-04-25T15:46:46.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.045+0000 7f66fd23a640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f66f8153460 0x7f66f8161930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39426/0 (socket says 172.21.15.59:39426) 2024-04-25T15:46:46.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.045+0000 7f66fd23a640 1 -- 172.21.15.59:0/3799852137 learned_addr learned my addr 172.21.15.59:0/3799852137 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:46.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.045+0000 7fcc36485640 1 Processor -- start 2024-04-25T15:46:46.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.045+0000 7fcc36485640 1 -- start start 2024-04-25T15:46:46.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.046+0000 7f245edce640 1 -- 172.21.15.59:0/1226155110 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2458158ce0 msgr2=0x7f245806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.046+0000 7f245edce640 1 --2- 172.21.15.59:0/1226155110 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2458158ce0 0x7f245806f080 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2450009e50 tx=0x7f245002a6c0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.046+0000 7f245edce640 1 -- 172.21.15.59:0/1226155110 shutdown_connections 2024-04-25T15:46:46.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.046+0000 7f245edce640 1 --2- 172.21.15.59:0/1226155110 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2458158ce0 0x7f245806f080 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.046+0000 7f245edce640 1 --2- 172.21.15.59:0/1226155110 >> v2:172.21.15.64:3300/0 conn(0x7f2458152890 0x7f24580c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.046+0000 7f245edce640 1 -- 172.21.15.59:0/1226155110 >> 172.21.15.59:0/1226155110 conn(0x7f24580cda50 msgr2=0x7f24580c9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.046+0000 7f245edce640 1 -- 172.21.15.59:0/1226155110 shutdown_connections 2024-04-25T15:46:46.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.046+0000 7f245edce640 1 -- 172.21.15.59:0/1226155110 wait complete. 2024-04-25T15:46:46.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.046+0000 7f13de59c640 1 --2- 172.21.15.59:0/575778829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13d8050ed0 0x7f13d8006ae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009790 tx=0x7f13d002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258c7fdc400b3368 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.046+0000 7fe532d9d640 1 -- 172.21.15.59:0/1901397783 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe5340c9f60 msgr2=0x7fe5340c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.046+0000 7fe532d9d640 1 --2- 172.21.15.59:0/1901397783 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe5340c9f60 0x7fe5340c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.046+0000 7fe532d9d640 1 -- 172.21.15.59:0/1901397783 >> v1:172.21.15.59:6789/0 conn(0x7fe53406f9e0 legacy=0x7fe534152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.046+0000 7fe532d9d640 1 -- 172.21.15.59:0/1901397783 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5340c53c0 con 0x7fe5340c58e0 2024-04-25T15:46:46.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.047+0000 7fcc36485640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcc3006ccd0 0x7fcc3015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.047+0000 7fcc36485640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcc300c4960 0x7fcc3015f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.047+0000 7fcc36485640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc300c7e60 0x7fcc3015fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.047+0000 7fcc36485640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcc30149da0 con 0x7fcc300c7e60 2024-04-25T15:46:46.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.047+0000 7fcc36485640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcc30161620 con 0x7fcc3006ccd0 2024-04-25T15:46:46.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.047+0000 7fcc36485640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fcc30149f20 con 0x7fcc300c4960 2024-04-25T15:46:46.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.048+0000 7f245edce640 1 Processor -- start 2024-04-25T15:46:46.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.048+0000 7f245edce640 1 -- start start 2024-04-25T15:46:46.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.048+0000 7f2485bfd640 1 -- 172.21.15.59:0/2155808056 >> v2:172.21.15.64:3300/0 conn(0x7f248015cbd0 msgr2=0x7f24800cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.048+0000 7f2485bfd640 1 --2- 172.21.15.59:0/2155808056 >> v2:172.21.15.64:3300/0 conn(0x7f248015cbd0 0x7f24800cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.048+0000 7f2485bfd640 1 -- 172.21.15.59:0/2155808056 >> v1:172.21.15.64:6789/0 conn(0x7f24800cb180 legacy=0x7f248015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.048+0000 7f2485bfd640 1 -- 172.21.15.59:0/2155808056 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24800c57e0 con 0x7f24800c90f0 2024-04-25T15:46:46.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.048+0000 7f66fe23c640 1 --2- 172.21.15.59:0/3799852137 >> v2:172.21.15.64:3300/0 conn(0x7f66f80c3660 0x7f66f80703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.049+0000 7f245edce640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2458152890 0x7f2458153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.049+0000 7f245edce640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2458158ce0 0x7f2458147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.049+0000 7f245edce640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24581590f0 0x7f24581570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.050+0000 7f245edce640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2458073110 con 0x7f2458158ce0 2024-04-25T15:46:46.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.050+0000 7f245edce640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f24581587c0 con 0x7f24581590f0 2024-04-25T15:46:46.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.050+0000 7f245edce640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f24580c9030 con 0x7f2458152890 2024-04-25T15:46:46.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.052+0000 7f13dd59a640 1 -- 172.21.15.59:0/575778829 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d0037070 con 0x7f13d8050ed0 2024-04-25T15:46:46.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.052+0000 7f13dd59a640 1 -- 172.21.15.59:0/575778829 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d0032440 con 0x7f13d8050ed0 2024-04-25T15:46:46.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.052+0000 7f13dd59a640 1 -- 172.21.15.59:0/575778829 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d0032810 con 0x7f13d8050ed0 2024-04-25T15:46:46.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.053+0000 7f13df59e640 1 -- 172.21.15.59:0/575778829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13d8050ed0 msgr2=0x7f13d8006ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.053+0000 7f13df59e640 1 --2- 172.21.15.59:0/575778829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13d8050ed0 0x7f13d8006ae0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009790 tx=0x7f13d002a210 comp rx=0 tx=0).stop 2024-04-25T15:46:46.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.053+0000 7f13df59e640 1 -- 172.21.15.59:0/575778829 shutdown_connections 2024-04-25T15:46:46.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.053+0000 7f13df59e640 1 --2- 172.21.15.59:0/575778829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13d8050ed0 0x7f13d8006ae0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.053+0000 7f13df59e640 1 -- 172.21.15.59:0/575778829 >> 172.21.15.59:0/575778829 conn(0x7f13d80503b0 msgr2=0x7f13d80507c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.053+0000 7f13df59e640 1 -- 172.21.15.59:0/575778829 shutdown_connections 2024-04-25T15:46:46.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.053+0000 7f13df59e640 1 -- 172.21.15.59:0/575778829 wait complete. 2024-04-25T15:46:46.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.054+0000 7fe532d9d640 1 --2- 172.21.15.59:0/1901397783 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5340c58e0 0x7fe5340c7570 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009e50 tx=0x7fe52c02a760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c2239d7c57fb5f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.054+0000 7f2485bfd640 1 --2- 172.21.15.59:0/2155808056 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f24800c90f0 0x7f24800caa80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f247c0097a0 tx=0x7f247c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54cb227e756011a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.054+0000 7efc78e2f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efc6c1004f0 0x7efc6c0ed1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.055+0000 7efc78e2f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efc6c1004f0 0x7efc6c0ed1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53276/0 (socket says 172.21.15.59:53276) 2024-04-25T15:46:46.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.055+0000 7efc78e2f640 1 -- 172.21.15.59:0/2037857970 learned_addr learned my addr 172.21.15.59:0/2037857970 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.055+0000 7f13df59e640 1 Processor -- start 2024-04-25T15:46:46.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.055+0000 7f13df59e640 1 -- start start 2024-04-25T15:46:46.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.056+0000 7fcc35c84640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc300c7e60 0x7fcc3015fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.057+0000 7f13df59e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13d80334e0 0x7f13d8174ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.057+0000 7f13df59e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f13d8045e70 0x7f13d8047df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.057+0000 7fcc35c84640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc300c7e60 0x7fcc3015fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59620/0 (socket says 172.21.15.59:59620) 2024-04-25T15:46:46.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.057+0000 7fcc35c84640 1 -- 172.21.15.59:0/71490553 learned_addr learned my addr 172.21.15.59:0/71490553 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.057+0000 7f13df59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13d8050ed0 0x7f13d80d7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.057+0000 7f13df59e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f13d80065c0 con 0x7f13d8050ed0 2024-04-25T15:46:46.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.057+0000 7f13df59e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f13d8035560 con 0x7f13d80334e0 2024-04-25T15:46:46.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.057+0000 7f13df59e640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f13d8045350 con 0x7f13d8045e70 2024-04-25T15:46:46.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.058+0000 7efc73fff640 1 --2- 172.21.15.59:0/2037857970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc6c045350 0x7efc6c0e7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.060+0000 7f2457fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2458158ce0 0x7f2458147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.061+0000 7efc737fe640 1 --2- 172.21.15.59:0/2037857970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc6c04c8c0 0x7efc6c0e7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.063+0000 7efc78e2f640 1 -- 172.21.15.59:0/2037857970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc6c04c8c0 msgr2=0x7efc6c0e7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.063+0000 7efc78e2f640 1 --2- 172.21.15.59:0/2037857970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efc6c04c8c0 0x7efc6c0e7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.063+0000 7efc78e2f640 1 -- 172.21.15.59:0/2037857970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc6c045350 msgr2=0x7efc6c0e7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.063+0000 7efc78e2f640 1 --2- 172.21.15.59:0/2037857970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc6c045350 0x7efc6c0e7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.063+0000 7efc78e2f640 1 -- 172.21.15.59:0/2037857970 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6c0e2130 con 0x7efc6c1004f0 2024-04-25T15:46:46.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.063+0000 7fcc35c84640 1 -- 172.21.15.59:0/71490553 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcc300c4960 msgr2=0x7fcc3015f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.063+0000 7fcc35c84640 1 --2- 172.21.15.59:0/71490553 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcc300c4960 0x7fcc3015f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.063+0000 7fcc35c84640 1 -- 172.21.15.59:0/71490553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcc3006ccd0 msgr2=0x7fcc3015ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.063+0000 7fcc35c84640 1 --2- 172.21.15.59:0/71490553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcc3006ccd0 0x7fcc3015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.063+0000 7fcc35c84640 1 -- 172.21.15.59:0/71490553 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3015b1f0 con 0x7fcc300c7e60 2024-04-25T15:46:46.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.065+0000 7f2457fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2458158ce0 0x7f2458147860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59636/0 (socket says 172.21.15.59:59636) 2024-04-25T15:46:46.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.065+0000 7f2457fff640 1 -- 172.21.15.59:0/3572122489 learned_addr learned my addr 172.21.15.59:0/3572122489 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.066+0000 7f22e77fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f22e8156870 0x7f22e80c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.066+0000 7f2484bfb640 1 -- 172.21.15.59:0/2155808056 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c037070 con 0x7f24800c90f0 2024-04-25T15:46:46.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.066+0000 7f2484bfb640 1 -- 172.21.15.59:0/2155808056 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f247c032440 con 0x7f24800c90f0 2024-04-25T15:46:46.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.066+0000 7f2484bfb640 1 -- 172.21.15.59:0/2155808056 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c032810 con 0x7f24800c90f0 2024-04-25T15:46:46.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.067+0000 7f2487e61640 1 -- 172.21.15.59:0/2155808056 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f24800c90f0 msgr2=0x7f24800caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.067+0000 7f2487e61640 1 --2- 172.21.15.59:0/2155808056 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f24800c90f0 0x7f24800caa80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f247c0097a0 tx=0x7f247c02a210 comp rx=0 tx=0).stop 2024-04-25T15:46:46.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.067+0000 7f13ddd9b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f13d8045e70 0x7f13d8047df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.067+0000 7f2487e61640 1 -- 172.21.15.59:0/2155808056 shutdown_connections 2024-04-25T15:46:46.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.067+0000 7f2487e61640 1 --2- 172.21.15.59:0/2155808056 >> v2:172.21.15.64:3300/0 conn(0x7f248015cbd0 0x7f24800cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.067+0000 7f2487e61640 1 --2- 172.21.15.59:0/2155808056 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f24800c90f0 0x7f24800caa80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.067+0000 7f2487e61640 1 -- 172.21.15.59:0/2155808056 >> 172.21.15.59:0/2155808056 conn(0x7f2480071f40 msgr2=0x7f2480072350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.067+0000 7f2487e61640 1 -- 172.21.15.59:0/2155808056 shutdown_connections 2024-04-25T15:46:46.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.067+0000 7f2487e61640 1 -- 172.21.15.59:0/2155808056 wait complete. 2024-04-25T15:46:46.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.067+0000 7f66fca39640 1 -- 172.21.15.59:0/3799852137 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1749985856 0 0) 0x7f66f8153870 con 0x7f66f8153460 2024-04-25T15:46:46.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.067+0000 7f66fca39640 1 -- 172.21.15.59:0/3799852137 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66e4003520 con 0x7f66f8153460 2024-04-25T15:46:46.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.067+0000 7fe53159a640 1 -- 172.21.15.59:0/1901397783 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c036070 con 0x7fe5340c58e0 2024-04-25T15:46:46.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.067+0000 7fe53159a640 1 -- 172.21.15.59:0/1901397783 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe52c031600 con 0x7fe5340c58e0 2024-04-25T15:46:46.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.067+0000 7fe53159a640 1 -- 172.21.15.59:0/1901397783 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c0319d0 con 0x7fe5340c58e0 2024-04-25T15:46:46.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.068+0000 7f13ddd9b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f13d8045e70 0x7f13d8047df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53312/0 (socket says 172.21.15.59:53312) 2024-04-25T15:46:46.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.068+0000 7f13ddd9b640 1 -- 172.21.15.59:0/93567421 learned_addr learned my addr 172.21.15.59:0/93567421 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.068+0000 7f245d36b640 1 --2- 172.21.15.59:0/3572122489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24581590f0 0x7f24581570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.068+0000 7fcc35c84640 1 --2- 172.21.15.59:0/71490553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc300c7e60 0x7fcc3015fdc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcc28007d40 tx=0x7fcc2800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.068+0000 7fe538e92640 1 -- 172.21.15.59:0/1901397783 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5340c58e0 msgr2=0x7fe5340c7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.068+0000 7fe538e92640 1 --2- 172.21.15.59:0/1901397783 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5340c58e0 0x7fe5340c7570 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009e50 tx=0x7fe52c02a760 comp rx=0 tx=0).stop 2024-04-25T15:46:46.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.068+0000 7f22e77fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f22e8156870 0x7f22e80c3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:53482/0 (socket says 172.21.15.59:53482) 2024-04-25T15:46:46.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.068+0000 7fe538e92640 1 -- 172.21.15.59:0/1901397783 shutdown_connections 2024-04-25T15:46:46.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.068+0000 7fe538e92640 1 --2- 172.21.15.59:0/1901397783 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5340c58e0 0x7fe5340c7570 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.068+0000 7fe538e92640 1 --2- 172.21.15.59:0/1901397783 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe5340c9f60 0x7fe5340c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.068+0000 7fe538e92640 1 -- 172.21.15.59:0/1901397783 >> 172.21.15.59:0/1901397783 conn(0x7fe53406c9a0 msgr2=0x7fe53406cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.068+0000 7f22e77fe640 1 -- 172.21.15.59:0/613517068 learned_addr learned my addr 172.21.15.59:0/613517068 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.069+0000 7fe538e92640 1 -- 172.21.15.59:0/1901397783 shutdown_connections 2024-04-25T15:46:46.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.069+0000 7fe538e92640 1 -- 172.21.15.59:0/1901397783 wait complete. 2024-04-25T15:46:46.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.069+0000 7f2487e61640 1 Processor -- start 2024-04-25T15:46:46.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.069+0000 7f2487e61640 1 -- start start 2024-04-25T15:46:46.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.069+0000 7efc78e2f640 1 --2- 172.21.15.59:0/2037857970 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efc6c1004f0 0x7efc6c0ed1e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efc6002a340 tx=0x7efc600046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.070+0000 7f2487e61640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f24800c90f0 0x7f248014a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.070+0000 7f2487e61640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24800cb180 0x7f24800c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.070+0000 7f2487e61640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f248015cbd0 0x7f24800c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.070+0000 7f2487e61640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2480071240 con 0x7f248015cbd0 2024-04-25T15:46:46.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.070+0000 7f2487e61640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2480070f60 con 0x7f24800cb180 2024-04-25T15:46:46.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.070+0000 7f2487e61640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f24800c53c0 con 0x7f24800c90f0 2024-04-25T15:46:46.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.070+0000 7fe538e92640 1 Processor -- start 2024-04-25T15:46:46.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.071+0000 7f66fe23c640 1 -- 172.21.15.59:0/3799852137 >> v1:172.21.15.64:6789/0 conn(0x7f66f80ca560 legacy=0x7f66f80c3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.071+0000 7f66fe23c640 1 -- 172.21.15.59:0/3799852137 >> v1:172.21.15.59:6789/0 conn(0x7f66f8153460 legacy=0x7f66f8161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.071+0000 7f66fe23c640 1 -- 172.21.15.59:0/3799852137 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f80c9800 con 0x7f66f80c3660 2024-04-25T15:46:46.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.071+0000 7fe538e92640 1 -- start start 2024-04-25T15:46:46.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.072+0000 7fe538e92640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe53406f9e0 0x7fe53414b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.072+0000 7fe538e92640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5340c58e0 0x7fe53414a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.072+0000 7fe538e92640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5340c9f60 0x7fe53414ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.072+0000 7fe538e92640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe534158740 con 0x7fe5340c58e0 2024-04-25T15:46:46.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.072+0000 7fe538e92640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe5341585c0 con 0x7fe5340c9f60 2024-04-25T15:46:46.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.072+0000 7fe538e92640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fe534069910 con 0x7fe53406f9e0 2024-04-25T15:46:46.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.073+0000 7f13ddd9b640 1 -- 172.21.15.59:0/93567421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13d80334e0 msgr2=0x7f13d8174ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.073+0000 7f13ddd9b640 1 --2- 172.21.15.59:0/93567421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13d80334e0 0x7f13d8174ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.073+0000 7f13ddd9b640 1 -- 172.21.15.59:0/93567421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13d8050ed0 msgr2=0x7f13d80d7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.073+0000 7f13ddd9b640 1 --2- 172.21.15.59:0/93567421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13d8050ed0 0x7f13d80d7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.073+0000 7f13ddd9b640 1 -- 172.21.15.59:0/93567421 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d8048330 con 0x7f13d8045e70 2024-04-25T15:46:46.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.075+0000 7f22e77fe640 1 -- 172.21.15.59:0/613517068 >> v1:172.21.15.64:6789/0 conn(0x7f22e80c90f0 legacy=0x7f22e806cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.075+0000 7f22e77fe640 1 -- 172.21.15.59:0/613517068 >> v1:172.21.15.59:6789/0 conn(0x7f22e80ca090 legacy=0x7f22e806c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.076+0000 7f22e77fe640 1 -- 172.21.15.59:0/613517068 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e815d1f0 con 0x7f22e8156870 2024-04-25T15:46:46.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.079+0000 7f13ddd9b640 1 --2- 172.21.15.59:0/93567421 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f13d8045e70 0x7f13d8047df0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13e0000b60 tx=0x7f13e006e970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.080+0000 7f24863fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f248015cbd0 0x7f24800c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.080+0000 7f24863fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f248015cbd0 0x7f24800c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59662/0 (socket says 172.21.15.59:59662) 2024-04-25T15:46:46.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.080+0000 7f24863fe640 1 -- 172.21.15.59:0/977729942 learned_addr learned my addr 172.21.15.59:0/977729942 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.082+0000 7f245cb6a640 1 --2- 172.21.15.59:0/3572122489 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2458152890 0x7f2458153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.085+0000 7f245d36b640 1 -- 172.21.15.59:0/3572122489 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2458152890 msgr2=0x7f2458153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.085+0000 7f245d36b640 1 --2- 172.21.15.59:0/3572122489 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2458152890 0x7f2458153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.085+0000 7f245d36b640 1 -- 172.21.15.59:0/3572122489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2458158ce0 msgr2=0x7f2458147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.085+0000 7f245d36b640 1 --2- 172.21.15.59:0/3572122489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2458158ce0 0x7f2458147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.085+0000 7f245d36b640 1 -- 172.21.15.59:0/3572122489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2458154360 con 0x7f24581590f0 2024-04-25T15:46:46.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.085+0000 7f22e77fe640 1 --2- 172.21.15.59:0/613517068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22e8156870 0x7f22e80c3930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f22d8009870 tx=0x7f22d802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ca8d4298d60ec52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.088+0000 7f2485bfd640 1 --2- 172.21.15.59:0/977729942 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f24800c90f0 0x7f248014a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.088+0000 7fcc25ffb640 1 -- 172.21.15.59:0/71490553 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28014420 con 0x7fcc300c7e60 2024-04-25T15:46:46.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.088+0000 7fcc25ffb640 1 -- 172.21.15.59:0/71490553 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc28019070 con 0x7fcc300c7e60 2024-04-25T15:46:46.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.088+0000 7fcc25ffb640 1 -- 172.21.15.59:0/71490553 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28014800 con 0x7fcc300c7e60 2024-04-25T15:46:46.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.088+0000 7fcc36485640 1 -- 172.21.15.59:0/71490553 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc30071b80 con 0x7fcc300c7e60 2024-04-25T15:46:46.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.088+0000 7fcc36485640 1 -- 172.21.15.59:0/71490553 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc300ccd80 con 0x7fcc300c7e60 2024-04-25T15:46:46.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.089+0000 7fcc36485640 1 -- 172.21.15.59:0/71490553 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcc300698a0 con 0x7fcc300c7e60 2024-04-25T15:46:46.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.090+0000 7f13ceffd640 1 -- 172.21.15.59:0/93567421 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e006e320 con 0x7f13d8045e70 2024-04-25T15:46:46.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.090+0000 7f13ceffd640 1 -- 172.21.15.59:0/93567421 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e006c580 con 0x7f13d8045e70 2024-04-25T15:46:46.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.090+0000 7f13ceffd640 1 -- 172.21.15.59:0/93567421 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e006c930 con 0x7f13d8045e70 2024-04-25T15:46:46.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.090+0000 7f13df59e640 1 -- 172.21.15.59:0/93567421 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d8049680 con 0x7f13d8045e70 2024-04-25T15:46:46.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.090+0000 7f13df59e640 1 -- 172.21.15.59:0/93567421 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d8049c40 con 0x7f13d8045e70 2024-04-25T15:46:46.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.091+0000 7f13df59e640 1 -- 172.21.15.59:0/93567421 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f13d80054a0 con 0x7f13d8045e70 2024-04-25T15:46:46.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.092+0000 7f24863fe640 1 -- 172.21.15.59:0/977729942 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f24800c90f0 msgr2=0x7f248014a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.092+0000 7f24863fe640 1 --2- 172.21.15.59:0/977729942 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f24800c90f0 0x7f248014a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.092+0000 7f24863fe640 1 -- 172.21.15.59:0/977729942 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24800cb180 msgr2=0x7f24800c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.092+0000 7f24863fe640 1 --2- 172.21.15.59:0/977729942 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24800cb180 0x7f24800c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.092+0000 7f24863fe640 1 -- 172.21.15.59:0/977729942 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24801f3670 con 0x7f248015cbd0 2024-04-25T15:46:46.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.092+0000 7fe53259c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe53406f9e0 0x7fe53414b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.093+0000 7efc70ff9640 1 -- 172.21.15.59:0/2037857970 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc60041070 con 0x7efc6c1004f0 2024-04-25T15:46:46.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.093+0000 7efc70ff9640 1 -- 172.21.15.59:0/2037857970 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6003c680 con 0x7efc6c1004f0 2024-04-25T15:46:46.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.093+0000 7fe53259c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe53406f9e0 0x7fe53414b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53330/0 (socket says 172.21.15.59:53330) 2024-04-25T15:46:46.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.093+0000 7fe53259c640 1 -- 172.21.15.59:0/732641001 learned_addr learned my addr 172.21.15.59:0/732641001 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.093+0000 7efc70ff9640 1 -- 172.21.15.59:0/2037857970 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc60037040 con 0x7efc6c1004f0 2024-04-25T15:46:46.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.093+0000 7efc79630640 1 -- 172.21.15.59:0/2037857970 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6c0ecae0 con 0x7efc6c1004f0 2024-04-25T15:46:46.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.093+0000 7efc79630640 1 -- 172.21.15.59:0/2037857970 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efc6c0eb1d0 con 0x7efc6c1004f0 2024-04-25T15:46:46.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.094+0000 7efc79630640 1 -- 172.21.15.59:0/2037857970 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efc6c0054a0 con 0x7efc6c1004f0 2024-04-25T15:46:46.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.094+0000 7f245d36b640 1 --2- 172.21.15.59:0/3572122489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24581590f0 0x7f24581570d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f244400b3e0 tx=0x7f244400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.096+0000 7f24863fe640 1 --2- 172.21.15.59:0/977729942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f248015cbd0 0x7f24800c7d00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2478007d40 tx=0x7f247800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.098+0000 7fe532d9d640 1 --2- 172.21.15.59:0/732641001 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5340c9f60 0x7fe53414ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.104+0000 7f66fe23c640 1 --2- 172.21.15.59:0/3799852137 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66f80c3660 0x7f66f80703c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009d90 tx=0x7f66f002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e42f2b5118d0b49c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.105+0000 7f22e67fc640 1 -- 172.21.15.59:0/613517068 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8037070 con 0x7f22e8156870 2024-04-25T15:46:46.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.105+0000 7f22e67fc640 1 -- 172.21.15.59:0/613517068 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d8032440 con 0x7f22e8156870 2024-04-25T15:46:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.105+0000 7f22e67fc640 1 -- 172.21.15.59:0/613517068 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8037070 con 0x7f22e8156870 2024-04-25T15:46:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.106+0000 7f22ee0b6640 1 -- 172.21.15.59:0/613517068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22e8156870 msgr2=0x7f22e80c3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.106+0000 7f22ee0b6640 1 --2- 172.21.15.59:0/613517068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22e8156870 0x7f22e80c3930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f22d8009870 tx=0x7f22d802a1c0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.106+0000 7f22ee0b6640 1 -- 172.21.15.59:0/613517068 shutdown_connections 2024-04-25T15:46:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.106+0000 7f22ee0b6640 1 --2- 172.21.15.59:0/613517068 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22e8156870 0x7f22e80c3930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.106+0000 7f22ee0b6640 1 -- 172.21.15.59:0/613517068 >> 172.21.15.59:0/613517068 conn(0x7f22e8071f40 msgr2=0x7f22e8072350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.106+0000 7f22ee0b6640 1 -- 172.21.15.59:0/613517068 shutdown_connections 2024-04-25T15:46:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.106+0000 7f22ee0b6640 1 -- 172.21.15.59:0/613517068 wait complete. 2024-04-25T15:46:46.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.108+0000 7fe53259c640 1 -- 172.21.15.59:0/732641001 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5340c9f60 msgr2=0x7fe53414ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.108+0000 7fe53259c640 1 --2- 172.21.15.59:0/732641001 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5340c9f60 0x7fe53414ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.108+0000 7fe53259c640 1 -- 172.21.15.59:0/732641001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5340c58e0 msgr2=0x7fe53414a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.108+0000 7fe53259c640 1 --2- 172.21.15.59:0/732641001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5340c58e0 0x7fe53414a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.108+0000 7fe53259c640 1 -- 172.21.15.59:0/732641001 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53414bd50 con 0x7fe53406f9e0 2024-04-25T15:46:46.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.108+0000 7f22ee0b6640 1 Processor -- start 2024-04-25T15:46:46.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.108+0000 7f22ee0b6640 1 -- start start 2024-04-25T15:46:46.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.109+0000 7f22ee0b6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22e80c90f0 0x7f22e80c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.109+0000 7f22ee0b6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22e80ca090 0x7f22e81f2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.109+0000 7f22ee0b6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22e8156870 0x7f22e81592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.109+0000 7f22ee0b6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f22e8071570 con 0x7f22e8156870 2024-04-25T15:46:46.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.109+0000 7f22ee0b6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f22e80711e0 con 0x7f22e80c90f0 2024-04-25T15:46:46.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.109+0000 7f22ee0b6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f22e80c5850 con 0x7f22e80ca090 2024-04-25T15:46:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.120+0000 7f22e77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22e80c90f0 0x7f22e80c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.121+0000 7f66fca39640 1 -- 172.21.15.59:0/3799852137 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0007740 con 0x7f66f80c3660 2024-04-25T15:46:46.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.121+0000 7f66fca39640 1 -- 172.21.15.59:0/3799852137 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f00078e0 con 0x7f66f80c3660 2024-04-25T15:46:46.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.121+0000 7f66fca39640 1 -- 172.21.15.59:0/3799852137 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0007cb0 con 0x7f66f80c3660 2024-04-25T15:46:46.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.121+0000 7f22e77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22e80c90f0 0x7f22e80c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:53524/0 (socket says 172.21.15.59:53524) 2024-04-25T15:46:46.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.121+0000 7f22e77fe640 1 -- 172.21.15.59:0/177568525 learned_addr learned my addr 172.21.15.59:0/177568525 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.122+0000 7f66ffc9f640 1 -- 172.21.15.59:0/3799852137 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66f80c3660 msgr2=0x7f66f80703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.122+0000 7f66ffc9f640 1 --2- 172.21.15.59:0/3799852137 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66f80c3660 0x7f66f80703c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009d90 tx=0x7f66f002a6f0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.122+0000 7f66ffc9f640 1 -- 172.21.15.59:0/3799852137 shutdown_connections 2024-04-25T15:46:46.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.122+0000 7f66ffc9f640 1 --2- 172.21.15.59:0/3799852137 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66f80c3660 0x7f66f80703c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.122+0000 7fcc25ffb640 1 -- 172.21.15.59:0/71490553 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcc280149a0 con 0x7fcc300c7e60 2024-04-25T15:46:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.122+0000 7f66ffc9f640 1 -- 172.21.15.59:0/3799852137 >> 172.21.15.59:0/3799852137 conn(0x7f66f806e060 msgr2=0x7f66f8071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.122+0000 7f66ffc9f640 1 -- 172.21.15.59:0/3799852137 shutdown_connections 2024-04-25T15:46:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.122+0000 7f66ffc9f640 1 -- 172.21.15.59:0/3799852137 wait complete. 2024-04-25T15:46:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.122+0000 7fcc25ffb640 1 --2- 172.21.15.59:0/71490553 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fcc14074500 0x7fcc14076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.122+0000 7fcc35483640 1 --2- 172.21.15.59:0/71490553 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fcc14074500 0x7fcc14076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.123+0000 7fcc35483640 1 --2- 172.21.15.59:0/71490553 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fcc14074500 0x7fcc14076a10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c034000 tx=0x7fcc2c02c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.123+0000 7f24557fa640 1 -- 172.21.15.59:0/3572122489 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2444015020 con 0x7f24581590f0 2024-04-25T15:46:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.123+0000 7f24557fa640 1 -- 172.21.15.59:0/3572122489 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2444011830 con 0x7f24581590f0 2024-04-25T15:46:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.123+0000 7f24557fa640 1 -- 172.21.15.59:0/3572122489 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2444011c60 con 0x7f24581590f0 2024-04-25T15:46:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.123+0000 7f245edce640 1 -- 172.21.15.59:0/3572122489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24580c1ec0 con 0x7f24581590f0 2024-04-25T15:46:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.123+0000 7f245edce640 1 -- 172.21.15.59:0/3572122489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24580c2480 con 0x7f24581590f0 2024-04-25T15:46:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.124+0000 7f245edce640 1 -- 172.21.15.59:0/3572122489 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f24580698a0 con 0x7f24581590f0 2024-04-25T15:46:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.124+0000 7f66ffc9f640 1 Processor -- start 2024-04-25T15:46:46.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.124+0000 7f66ffc9f640 1 -- start start 2024-04-25T15:46:46.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.126+0000 7f66ffc9f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66f80c3660 0x7f66f80b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.126+0000 7f66ffc9f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66f80ca560 0x7f66f81583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.126+0000 7f66ffc9f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f66f8153460 0x7f66f8158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.126+0000 7f66ffc9f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f66f806f970 con 0x7f66f80c3660 2024-04-25T15:46:46.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.126+0000 7f66ffc9f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f66f80c92d0 con 0x7f66f80ca560 2024-04-25T15:46:46.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.126+0000 7f66ffc9f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f66f806ff30 con 0x7f66f8153460 2024-04-25T15:46:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.128+0000 7fcc25ffb640 1 -- 172.21.15.59:0/71490553 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcc2805c740 con 0x7fcc300c7e60 2024-04-25T15:46:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.128+0000 7fcc25ffb640 1 --2- 172.21.15.59:0/71490553 >> [v2:172.21.15.59:6818/1300858236,v1:172.21.15.59:6819/1300858236] conn(0x7fcc1407c750 0x7fcc1407eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.128+0000 7fcc25ffb640 1 -- 172.21.15.59:0/71490553 --> [v2:172.21.15.59:6818/1300858236,v1:172.21.15.59:6819/1300858236] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc28006b90 con 0x7fcc1407c750 2024-04-25T15:46:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.128+0000 7fcc25ffb640 1 -- 172.21.15.59:0/71490553 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fcc2805cb00 con 0x7fcc300c7e60 2024-04-25T15:46:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.129+0000 7fcc34c82640 1 --2- 172.21.15.59:0/71490553 >> [v2:172.21.15.59:6818/1300858236,v1:172.21.15.59:6819/1300858236] conn(0x7fcc1407c750 0x7fcc1407eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.129+0000 7fcc34c82640 1 --2- 172.21.15.59:0/71490553 >> [v2:172.21.15.59:6818/1300858236,v1:172.21.15.59:6819/1300858236] conn(0x7fcc1407c750 0x7fcc1407eba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.130+0000 7fcc25ffb640 1 -- 172.21.15.59:0/71490553 <== osd.3 v2:172.21.15.59:6818/1300858236 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcc28006b90 con 0x7fcc1407c750 2024-04-25T15:46:46.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.133+0000 7f24767fc640 1 -- 172.21.15.59:0/977729942 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478014420 con 0x7f248015cbd0 2024-04-25T15:46:46.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.133+0000 7f24767fc640 1 -- 172.21.15.59:0/977729942 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2478019070 con 0x7f248015cbd0 2024-04-25T15:46:46.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.133+0000 7f24767fc640 1 -- 172.21.15.59:0/977729942 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478014820 con 0x7f248015cbd0 2024-04-25T15:46:46.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.133+0000 7f2487e61640 1 -- 172.21.15.59:0/977729942 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24800cca70 con 0x7f248015cbd0 2024-04-25T15:46:46.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.133+0000 7f66fda3b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66f80c3660 0x7f66f80b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.134+0000 7f2487e61640 1 -- 172.21.15.59:0/977729942 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24801577a0 con 0x7f248015cbd0 2024-04-25T15:46:46.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.134+0000 7f2487e61640 1 -- 172.21.15.59:0/977729942 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2480069fb0 con 0x7f248015cbd0 2024-04-25T15:46:46.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.136+0000 7f66fda3b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66f80c3660 0x7f66f80b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59674/0 (socket says 172.21.15.59:59674) 2024-04-25T15:46:46.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.136+0000 7f66fda3b640 1 -- 172.21.15.59:0/4208449474 learned_addr learned my addr 172.21.15.59:0/4208449474 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.136+0000 7f22e7fff640 1 --2- 172.21.15.59:0/177568525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22e8156870 0x7f22e81592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.136+0000 7f66fd23a640 1 --2- 172.21.15.59:0/4208449474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66f80ca560 0x7f66f81583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.138+0000 7f13ceffd640 1 -- 172.21.15.59:0/93567421 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f13e006cad0 con 0x7f13d8045e70 2024-04-25T15:46:46.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.138+0000 7f13ceffd640 1 --2- 172.21.15.59:0/93567421 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f13c0074500 0x7f13c0076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.138+0000 7f13de59c640 1 --2- 172.21.15.59:0/93567421 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f13c0074500 0x7f13c0076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.139+0000 7f13de59c640 1 --2- 172.21.15.59:0/93567421 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f13c0074500 0x7f13c0076a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f13d0034000 tx=0x7f13d002c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.142+0000 7f22e77fe640 1 -- 172.21.15.59:0/177568525 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22e80ca090 msgr2=0x7f22e81f2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.142+0000 7f22e77fe640 1 --2- 172.21.15.59:0/177568525 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22e80ca090 0x7f22e81f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.142+0000 7f22e77fe640 1 -- 172.21.15.59:0/177568525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22e8156870 msgr2=0x7f22e81592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.142+0000 7f22e77fe640 1 --2- 172.21.15.59:0/177568525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22e8156870 0x7f22e81592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.142+0000 7f22e77fe640 1 -- 172.21.15.59:0/177568525 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e81f2d90 con 0x7f22e80c90f0 2024-04-25T15:46:46.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.142+0000 7f13ceffd640 1 -- 172.21.15.59:0/93567421 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f13e006cdc0 con 0x7f13d8045e70 2024-04-25T15:46:46.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.142+0000 7f13ceffd640 1 --2- 172.21.15.59:0/93567421 >> [v2:172.21.15.59:6826/3550810151,v1:172.21.15.59:6827/3550810151] conn(0x7f13c007c6f0 0x7f13c007eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.142+0000 7f13ceffd640 1 -- 172.21.15.59:0/93567421 --> [v2:172.21.15.59:6826/3550810151,v1:172.21.15.59:6827/3550810151] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13c007f210 con 0x7f13c007c6f0 2024-04-25T15:46:46.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.142+0000 7f13ded9d640 1 --2- 172.21.15.59:0/93567421 >> [v2:172.21.15.59:6826/3550810151,v1:172.21.15.59:6827/3550810151] conn(0x7f13c007c6f0 0x7f13c007eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.142+0000 7f13ceffd640 1 -- 172.21.15.59:0/93567421 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f13e00d8b20 con 0x7f13d8045e70 2024-04-25T15:46:46.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.143+0000 7f13ded9d640 1 --2- 172.21.15.59:0/93567421 >> [v2:172.21.15.59:6826/3550810151,v1:172.21.15.59:6827/3550810151] conn(0x7f13c007c6f0 0x7f13c007eb40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.143+0000 7f66fda3b640 1 -- 172.21.15.59:0/4208449474 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f66f8153460 msgr2=0x7f66f8158910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.143+0000 7f66fda3b640 1 --2- 172.21.15.59:0/4208449474 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f66f8153460 0x7f66f8158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.143+0000 7f66fda3b640 1 -- 172.21.15.59:0/4208449474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66f80ca560 msgr2=0x7f66f81583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.143+0000 7f66fda3b640 1 --2- 172.21.15.59:0/4208449474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f66f80ca560 0x7f66f81583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.143+0000 7f66fda3b640 1 -- 172.21.15.59:0/4208449474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f81ef090 con 0x7f66f80c3660 2024-04-25T15:46:46.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.143+0000 7f13ceffd640 1 -- 172.21.15.59:0/93567421 <== osd.1 v2:172.21.15.59:6826/3550810151 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f13c007f210 con 0x7f13c007c6f0 2024-04-25T15:46:46.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.145+0000 7fcc36485640 1 -- 172.21.15.59:0/71490553 --> [v2:172.21.15.59:6818/1300858236,v1:172.21.15.59:6819/1300858236] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcc301f7390 con 0x7fcc1407c750 2024-04-25T15:46:46.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.145+0000 7fcc25ffb640 1 -- 172.21.15.59:0/71490553 <== osd.3 v2:172.21.15.59:6818/1300858236 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcc301f7390 con 0x7fcc1407c750 2024-04-25T15:46:46.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.146+0000 7fcc36485640 1 -- 172.21.15.59:0/71490553 >> [v2:172.21.15.59:6818/1300858236,v1:172.21.15.59:6819/1300858236] conn(0x7fcc1407c750 msgr2=0x7fcc1407eba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.146+0000 7fcc36485640 1 --2- 172.21.15.59:0/71490553 >> [v2:172.21.15.59:6818/1300858236,v1:172.21.15.59:6819/1300858236] conn(0x7fcc1407c750 0x7fcc1407eba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.146+0000 7fcc36485640 1 -- 172.21.15.59:0/71490553 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fcc14074500 msgr2=0x7fcc14076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.146+0000 7fcc36485640 1 --2- 172.21.15.59:0/71490553 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fcc14074500 0x7fcc14076a10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c034000 tx=0x7fcc2c02c000 comp rx=0 tx=0).stop 2024-04-25T15:46:46.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.146+0000 7fcc36485640 1 -- 172.21.15.59:0/71490553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc300c7e60 msgr2=0x7fcc3015fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.146+0000 7fcc36485640 1 --2- 172.21.15.59:0/71490553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc300c7e60 0x7fcc3015fdc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcc28007d40 tx=0x7fcc2800e4b0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.146+0000 7fcc35c84640 1 -- 172.21.15.59:0/71490553 reap_dead start 2024-04-25T15:46:46.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.146+0000 7fcc36485640 1 -- 172.21.15.59:0/71490553 shutdown_connections 2024-04-25T15:46:46.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.146+0000 7fcc36485640 1 -- 172.21.15.59:0/71490553 >> 172.21.15.59:0/71490553 conn(0x7fcc30068b10 msgr2=0x7fcc301ecc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.146+0000 7fcc36485640 1 -- 172.21.15.59:0/71490553 shutdown_connections 2024-04-25T15:46:46.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.146+0000 7fcc36485640 1 -- 172.21.15.59:0/71490553 wait complete. 2024-04-25T15:46:46.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.152+0000 7f66fda3b640 1 --2- 172.21.15.59:0/4208449474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66f80c3660 0x7f66f80b2140 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f66f400c460 tx=0x7f66f400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.159 INFO:teuthology.orchestra.run.smithi059.stdout:60129542154 2024-04-25T15:46:46.159 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T15:46:46.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.158+0000 7efc70ff9640 1 -- 172.21.15.59:0/2037857970 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7efc60044070 con 0x7efc6c1004f0 2024-04-25T15:46:46.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.158+0000 7efc70ff9640 1 --2- 172.21.15.59:0/2037857970 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7efc58074500 0x7efc58076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.158+0000 7efc73fff640 1 --2- 172.21.15.59:0/2037857970 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7efc58074500 0x7efc58076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.159+0000 7efc73fff640 1 --2- 172.21.15.59:0/2037857970 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7efc58074500 0x7efc58076a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efc680014f0 tx=0x7efc68009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.160+0000 7f13df59e640 1 -- 172.21.15.59:0/93567421 --> [v2:172.21.15.59:6826/3550810151,v1:172.21.15.59:6827/3550810151] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f13d8049410 con 0x7f13c007c6f0 2024-04-25T15:46:46.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.160+0000 7f13ceffd640 1 -- 172.21.15.59:0/93567421 <== osd.1 v2:172.21.15.59:6826/3550810151 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f13d8049410 con 0x7f13c007c6f0 2024-04-25T15:46:46.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.161+0000 7f13df59e640 1 -- 172.21.15.59:0/93567421 >> [v2:172.21.15.59:6826/3550810151,v1:172.21.15.59:6827/3550810151] conn(0x7f13c007c6f0 msgr2=0x7f13c007eb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.161+0000 7f13df59e640 1 --2- 172.21.15.59:0/93567421 >> [v2:172.21.15.59:6826/3550810151,v1:172.21.15.59:6827/3550810151] conn(0x7f13c007c6f0 0x7f13c007eb40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.161+0000 7f13df59e640 1 -- 172.21.15.59:0/93567421 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f13c0074500 msgr2=0x7f13c0076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.161+0000 7f13df59e640 1 --2- 172.21.15.59:0/93567421 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f13c0074500 0x7f13c0076a10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f13d0034000 tx=0x7f13d002c000 comp rx=0 tx=0).stop 2024-04-25T15:46:46.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.161+0000 7f13df59e640 1 -- 172.21.15.59:0/93567421 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f13d8045e70 msgr2=0x7f13d8047df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.161+0000 7f13df59e640 1 --2- 172.21.15.59:0/93567421 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f13d8045e70 0x7f13d8047df0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13e0000b60 tx=0x7f13e006e970 comp rx=0 tx=0).stop 2024-04-25T15:46:46.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.161+0000 7f13ded9d640 1 -- 172.21.15.59:0/93567421 reap_dead start 2024-04-25T15:46:46.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.161+0000 7f13df59e640 1 -- 172.21.15.59:0/93567421 shutdown_connections 2024-04-25T15:46:46.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.161+0000 7f13df59e640 1 -- 172.21.15.59:0/93567421 >> 172.21.15.59:0/93567421 conn(0x7f13d80503b0 msgr2=0x7f13d8035c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.161+0000 7f13df59e640 1 -- 172.21.15.59:0/93567421 shutdown_connections 2024-04-25T15:46:46.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.161+0000 7f13df59e640 1 -- 172.21.15.59:0/93567421 wait complete. 2024-04-25T15:46:46.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.162+0000 7efc70ff9640 1 -- 172.21.15.59:0/2037857970 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7efc6007c3f0 con 0x7efc6c1004f0 2024-04-25T15:46:46.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.162+0000 7efc70ff9640 1 --2- 172.21.15.59:0/2037857970 >> [v2:172.21.15.64:6816/2206186554,v1:172.21.15.64:6817/2206186554] conn(0x7efc5807c750 0x7efc5807eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.162+0000 7efc70ff9640 1 -- 172.21.15.59:0/2037857970 --> [v2:172.21.15.64:6816/2206186554,v1:172.21.15.64:6817/2206186554] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc60008f00 con 0x7efc5807c750 2024-04-25T15:46:46.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.162+0000 7efc70ff9640 1 -- 172.21.15.59:0/2037857970 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7efc6007c7b0 con 0x7efc6c1004f0 2024-04-25T15:46:46.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.163+0000 7efc737fe640 1 --2- 172.21.15.59:0/2037857970 >> [v2:172.21.15.64:6816/2206186554,v1:172.21.15.64:6817/2206186554] conn(0x7efc5807c750 0x7efc5807eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.163+0000 7efc737fe640 1 --2- 172.21.15.59:0/2037857970 >> [v2:172.21.15.64:6816/2206186554,v1:172.21.15.64:6817/2206186554] conn(0x7efc5807c750 0x7efc5807eba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.164+0000 7efc70ff9640 1 -- 172.21.15.59:0/2037857970 <== osd.4 v2:172.21.15.64:6816/2206186554 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efc60008f00 con 0x7efc5807c750 2024-04-25T15:46:46.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.169+0000 7fe53259c640 1 --2- 172.21.15.59:0/732641001 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe53406f9e0 0x7fe53414b600 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe52400d5f0 tx=0x7fe52400dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.170+0000 7f24557fa640 1 -- 172.21.15.59:0/3572122489 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2444018020 con 0x7f24581590f0 2024-04-25T15:46:46.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.170+0000 7f66ee7fc640 1 -- 172.21.15.59:0/4208449474 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f40052d0 con 0x7f66f80c3660 2024-04-25T15:46:46.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.170+0000 7f66ee7fc640 1 -- 172.21.15.59:0/4208449474 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f4005490 con 0x7f66f80c3660 2024-04-25T15:46:46.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.170+0000 7f66ee7fc640 1 -- 172.21.15.59:0/4208449474 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f4012870 con 0x7f66f80c3660 2024-04-25T15:46:46.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.170+0000 7f66ffc9f640 1 -- 172.21.15.59:0/4208449474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f814d930 con 0x7f66f80c3660 2024-04-25T15:46:46.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.171+0000 7f66ffc9f640 1 -- 172.21.15.59:0/4208449474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f8158e50 con 0x7f66f80c3660 2024-04-25T15:46:46.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.171+0000 7f22e77fe640 1 --2- 172.21.15.59:0/177568525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22e80c90f0 0x7f22e80c8050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f22d8000c00 tx=0x7f22d80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.171+0000 7f24557fa640 1 --2- 172.21.15.59:0/3572122489 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f243c0744b0 0x7f243c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.171+0000 7f24557fa640 1 -- 172.21.15.59:0/3572122489 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f24440950d0 con 0x7f24581590f0 2024-04-25T15:46:46.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.171+0000 7f24557fa640 1 --2- 172.21.15.59:0/3572122489 >> [v2:172.21.15.64:6800/970439753,v1:172.21.15.64:6801/970439753] conn(0x7f243c07c700 0x7f243c07eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.171+0000 7f24557fa640 1 -- 172.21.15.59:0/3572122489 --> [v2:172.21.15.64:6800/970439753,v1:172.21.15.64:6801/970439753] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f243c07f220 con 0x7f243c07c700 2024-04-25T15:46:46.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.171+0000 7f24557fa640 1 -- 172.21.15.59:0/3572122489 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f2444095560 con 0x7f24581590f0 2024-04-25T15:46:46.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.171+0000 7f2457fff640 1 --2- 172.21.15.59:0/3572122489 >> [v2:172.21.15.64:6800/970439753,v1:172.21.15.64:6801/970439753] conn(0x7f243c07c700 0x7f243c07eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.172+0000 7f66dbfff640 1 -- 172.21.15.59:0/4208449474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f66d4001030 con 0x7f66f80c3660 2024-04-25T15:46:46.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.172+0000 7f2457fff640 1 --2- 172.21.15.59:0/3572122489 >> [v2:172.21.15.64:6800/970439753,v1:172.21.15.64:6801/970439753] conn(0x7f243c07c700 0x7f243c07eb50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.172+0000 7f245cb6a640 1 --2- 172.21.15.59:0/3572122489 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f243c0744b0 0x7f243c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.173+0000 7f245cb6a640 1 --2- 172.21.15.59:0/3572122489 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f243c0744b0 0x7f243c0769c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f244c00b7c0 tx=0x7f244c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.173+0000 7f24557fa640 1 -- 172.21.15.59:0/3572122489 <== osd.7 v2:172.21.15.64:6800/970439753 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f243c07f220 con 0x7f243c07c700 2024-04-25T15:46:46.175 INFO:teuthology.orchestra.run.smithi059.stdout:64424509451 2024-04-25T15:46:46.176 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T15:46:46.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.178+0000 7f22cffff640 1 -- 172.21.15.59:0/177568525 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8042070 con 0x7f22e80c90f0 2024-04-25T15:46:46.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.178+0000 7fe522ffd640 1 -- 172.21.15.59:0/732641001 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5240125f0 con 0x7fe53406f9e0 2024-04-25T15:46:46.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.178+0000 7f22ee0b6640 1 -- 172.21.15.59:0/177568525 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e81f5db0 con 0x7f22e80c90f0 2024-04-25T15:46:46.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.178+0000 7fe522ffd640 1 -- 172.21.15.59:0/732641001 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe524019070 con 0x7fe53406f9e0 2024-04-25T15:46:46.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.178+0000 7f22ee0b6640 1 -- 172.21.15.59:0/177568525 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e81f6370 con 0x7f22e80c90f0 2024-04-25T15:46:46.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.178+0000 7fe538e92640 1 -- 172.21.15.59:0/732641001 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe53414bb40 con 0x7fe53406f9e0 2024-04-25T15:46:46.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.178+0000 7fe538e92640 1 -- 172.21.15.59:0/732641001 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5341f14a0 con 0x7fe53406f9e0 2024-04-25T15:46:46.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.178+0000 7fe522ffd640 1 -- 172.21.15.59:0/732641001 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5240129d0 con 0x7fe53406f9e0 2024-04-25T15:46:46.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.179+0000 7f22cdffb640 1 -- 172.21.15.59:0/177568525 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f22c8001030 con 0x7f22e80c90f0 2024-04-25T15:46:46.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.180+0000 7fe538e92640 1 -- 172.21.15.59:0/732641001 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe534069fb0 con 0x7fe53406f9e0 2024-04-25T15:46:46.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.183+0000 7efc79630640 1 -- 172.21.15.59:0/2037857970 --> [v2:172.21.15.64:6816/2206186554,v1:172.21.15.64:6817/2206186554] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efc6c0f4a40 con 0x7efc5807c750 2024-04-25T15:46:46.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.183+0000 7efc70ff9640 1 -- 172.21.15.59:0/2037857970 <== osd.4 v2:172.21.15.64:6816/2206186554 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efc6c0f4a40 con 0x7efc5807c750 2024-04-25T15:46:46.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.184+0000 7efc79630640 1 -- 172.21.15.59:0/2037857970 >> [v2:172.21.15.64:6816/2206186554,v1:172.21.15.64:6817/2206186554] conn(0x7efc5807c750 msgr2=0x7efc5807eba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.184+0000 7efc79630640 1 --2- 172.21.15.59:0/2037857970 >> [v2:172.21.15.64:6816/2206186554,v1:172.21.15.64:6817/2206186554] conn(0x7efc5807c750 0x7efc5807eba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.184+0000 7efc79630640 1 -- 172.21.15.59:0/2037857970 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7efc58074500 msgr2=0x7efc58076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.184+0000 7efc79630640 1 --2- 172.21.15.59:0/2037857970 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7efc58074500 0x7efc58076a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efc680014f0 tx=0x7efc68009040 comp rx=0 tx=0).stop 2024-04-25T15:46:46.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.184+0000 7efc79630640 1 -- 172.21.15.59:0/2037857970 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efc6c1004f0 msgr2=0x7efc6c0ed1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.184+0000 7efc79630640 1 --2- 172.21.15.59:0/2037857970 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efc6c1004f0 0x7efc6c0ed1e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efc6002a340 tx=0x7efc600046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.184+0000 7efc78e2f640 1 -- 172.21.15.59:0/2037857970 reap_dead start 2024-04-25T15:46:46.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.184+0000 7efc79630640 1 -- 172.21.15.59:0/2037857970 shutdown_connections 2024-04-25T15:46:46.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.184+0000 7efc79630640 1 -- 172.21.15.59:0/2037857970 >> 172.21.15.59:0/2037857970 conn(0x7efc6c0503b0 msgr2=0x7efc6c0f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.184+0000 7efc79630640 1 -- 172.21.15.59:0/2037857970 shutdown_connections 2024-04-25T15:46:46.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.185+0000 7efc79630640 1 -- 172.21.15.59:0/2037857970 wait complete. 2024-04-25T15:46:46.197 INFO:teuthology.orchestra.run.smithi059.stdout:64424509449 2024-04-25T15:46:46.197 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T15:46:46.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.199+0000 7f24767fc640 1 -- 172.21.15.59:0/977729942 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f24780149c0 con 0x7f248015cbd0 2024-04-25T15:46:46.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.200+0000 7f24767fc640 1 --2- 172.21.15.59:0/977729942 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2464074500 0x7f2464076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.200+0000 7f2485bfd640 1 --2- 172.21.15.59:0/977729942 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2464074500 0x7f2464076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.201+0000 7f245edce640 1 -- 172.21.15.59:0/3572122489 --> [v2:172.21.15.64:6800/970439753,v1:172.21.15.64:6801/970439753] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2458155e60 con 0x7f243c07c700 2024-04-25T15:46:46.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.201+0000 7f2485bfd640 1 --2- 172.21.15.59:0/977729942 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2464074500 0x7f2464076a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f247c034000 tx=0x7f247c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.201+0000 7f24557fa640 1 -- 172.21.15.59:0/3572122489 <== osd.7 v2:172.21.15.64:6800/970439753 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2458155e60 con 0x7f243c07c700 2024-04-25T15:46:46.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.202+0000 7f245edce640 1 -- 172.21.15.59:0/3572122489 >> [v2:172.21.15.64:6800/970439753,v1:172.21.15.64:6801/970439753] conn(0x7f243c07c700 msgr2=0x7f243c07eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.202+0000 7f245edce640 1 --2- 172.21.15.59:0/3572122489 >> [v2:172.21.15.64:6800/970439753,v1:172.21.15.64:6801/970439753] conn(0x7f243c07c700 0x7f243c07eb50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.202+0000 7f245edce640 1 -- 172.21.15.59:0/3572122489 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f243c0744b0 msgr2=0x7f243c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.202+0000 7f245edce640 1 --2- 172.21.15.59:0/3572122489 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f243c0744b0 0x7f243c0769c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f244c00b7c0 tx=0x7f244c008040 comp rx=0 tx=0).stop 2024-04-25T15:46:46.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.202+0000 7f245edce640 1 -- 172.21.15.59:0/3572122489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24581590f0 msgr2=0x7f24581570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.202+0000 7f245edce640 1 --2- 172.21.15.59:0/3572122489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24581590f0 0x7f24581570d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f244400b3e0 tx=0x7f244400b8a0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.202+0000 7f245d36b640 1 -- 172.21.15.59:0/3572122489 reap_dead start 2024-04-25T15:46:46.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.202+0000 7f245edce640 1 -- 172.21.15.59:0/3572122489 shutdown_connections 2024-04-25T15:46:46.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.202+0000 7f245edce640 1 -- 172.21.15.59:0/3572122489 >> 172.21.15.59:0/3572122489 conn(0x7f24580cda50 msgr2=0x7f2458151630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.202+0000 7f245edce640 1 -- 172.21.15.59:0/3572122489 shutdown_connections 2024-04-25T15:46:46.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.202+0000 7f245edce640 1 -- 172.21.15.59:0/3572122489 wait complete. 2024-04-25T15:46:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.204+0000 7f24767fc640 1 -- 172.21.15.59:0/977729942 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f247805cb80 con 0x7f248015cbd0 2024-04-25T15:46:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.204+0000 7f24767fc640 1 --2- 172.21.15.59:0/977729942 >> [v2:172.21.15.64:6808/2335675289,v1:172.21.15.64:6809/2335675289] conn(0x7f246407c750 0x7f246407eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.204+0000 7f24767fc640 1 -- 172.21.15.59:0/977729942 --> [v2:172.21.15.64:6808/2335675289,v1:172.21.15.64:6809/2335675289] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2478012e50 con 0x7f246407c750 2024-04-25T15:46:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.204+0000 7f24767fc640 1 -- 172.21.15.59:0/977729942 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f247805cf40 con 0x7f248015cbd0 2024-04-25T15:46:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.205+0000 7f24853fc640 1 --2- 172.21.15.59:0/977729942 >> [v2:172.21.15.64:6808/2335675289,v1:172.21.15.64:6809/2335675289] conn(0x7f246407c750 0x7f246407eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.205+0000 7f24853fc640 1 --2- 172.21.15.59:0/977729942 >> [v2:172.21.15.64:6808/2335675289,v1:172.21.15.64:6809/2335675289] conn(0x7f246407c750 0x7f246407eba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.206+0000 7f24767fc640 1 -- 172.21.15.59:0/977729942 <== osd.6 v2:172.21.15.64:6808/2335675289 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2478012e50 con 0x7f246407c750 2024-04-25T15:46:46.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.206+0000 7f22cffff640 1 -- 172.21.15.59:0/177568525 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d8032440 con 0x7f22e80c90f0 2024-04-25T15:46:46.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.206+0000 7f22cffff640 1 -- 172.21.15.59:0/177568525 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d804c060 con 0x7f22e80c90f0 2024-04-25T15:46:46.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.208+0000 7f22cffff640 1 -- 172.21.15.59:0/177568525 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f22d8045070 con 0x7f22e80c90f0 2024-04-25T15:46:46.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.208+0000 7f22cffff640 1 --2- 172.21.15.59:0/177568525 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f22d40744e0 0x7f22d40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.209+0000 7f22e6ffd640 1 --2- 172.21.15.59:0/177568525 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f22d40744e0 0x7f22d40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.210+0000 7f22e6ffd640 1 --2- 172.21.15.59:0/177568525 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f22d40744e0 0x7f22d40769f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f22e8160a10 tx=0x7f22dc006ba0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.212+0000 7f22cffff640 1 -- 172.21.15.59:0/177568525 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f22d80b4130 con 0x7f22e80c90f0 2024-04-25T15:46:46.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.212+0000 7f22cffff640 1 --2- 172.21.15.59:0/177568525 >> [v2:172.21.15.59:6810/1651189093,v1:172.21.15.59:6811/1651189093] conn(0x7f22d407c730 0x7f22d407eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.212+0000 7f22cffff640 1 -- 172.21.15.59:0/177568525 --> [v2:172.21.15.59:6810/1651189093,v1:172.21.15.59:6811/1651189093] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22d8008f00 con 0x7f22d407c730 2024-04-25T15:46:46.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.213+0000 7f22e7fff640 1 --2- 172.21.15.59:0/177568525 >> [v2:172.21.15.59:6810/1651189093,v1:172.21.15.59:6811/1651189093] conn(0x7f22d407c730 0x7f22d407eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.213+0000 7f22cffff640 1 -- 172.21.15.59:0/177568525 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f22d807c430 con 0x7f22e80c90f0 2024-04-25T15:46:46.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.213+0000 7f22e7fff640 1 --2- 172.21.15.59:0/177568525 >> [v2:172.21.15.59:6810/1651189093,v1:172.21.15.59:6811/1651189093] conn(0x7f22d407c730 0x7f22d407eb80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.215+0000 7f22cffff640 1 -- 172.21.15.59:0/177568525 <== osd.2 v2:172.21.15.59:6810/1651189093 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f22d8008f00 con 0x7f22d407c730 2024-04-25T15:46:46.222 INFO:teuthology.orchestra.run.smithi059.stdout:64424509449 2024-04-25T15:46:46.222 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T15:46:46.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.231+0000 7fe522ffd640 1 -- 172.21.15.59:0/732641001 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe524012b70 con 0x7fe53406f9e0 2024-04-25T15:46:46.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.232+0000 7fe522ffd640 1 --2- 172.21.15.59:0/732641001 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fe514074580 0x7fe514076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.232+0000 7fe531d9b640 1 --2- 172.21.15.59:0/732641001 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fe514074580 0x7fe514076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.233+0000 7fe531d9b640 1 --2- 172.21.15.59:0/732641001 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fe514074580 0x7fe514076a90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe53414acd0 tx=0x7fe528006ba0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.233+0000 7fe522ffd640 1 -- 172.21.15.59:0/732641001 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe524095f50 con 0x7fe53406f9e0 2024-04-25T15:46:46.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.233+0000 7fe522ffd640 1 --2- 172.21.15.59:0/732641001 >> [v2:172.21.15.59:6802/1314235095,v1:172.21.15.59:6803/1314235095] conn(0x7fe51407c7d0 0x7fe51407ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.234+0000 7fe532d9d640 1 --2- 172.21.15.59:0/732641001 >> [v2:172.21.15.59:6802/1314235095,v1:172.21.15.59:6803/1314235095] conn(0x7fe51407c7d0 0x7fe51407ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.235+0000 7fe532d9d640 1 --2- 172.21.15.59:0/732641001 >> [v2:172.21.15.59:6802/1314235095,v1:172.21.15.59:6803/1314235095] conn(0x7fe51407c7d0 0x7fe51407ec20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.235+0000 7fe522ffd640 1 -- 172.21.15.59:0/732641001 --> [v2:172.21.15.59:6802/1314235095,v1:172.21.15.59:6803/1314235095] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe52401de50 con 0x7fe51407c7d0 2024-04-25T15:46:46.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.236+0000 7fe522ffd640 1 -- 172.21.15.59:0/732641001 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe524096340 con 0x7fe53406f9e0 2024-04-25T15:46:46.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.236+0000 7fe522ffd640 1 -- 172.21.15.59:0/732641001 <== osd.0 v2:172.21.15.59:6802/1314235095 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe52401de50 con 0x7fe51407c7d0 2024-04-25T15:46:46.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.237+0000 7f2487e61640 1 -- 172.21.15.59:0/977729942 --> [v2:172.21.15.64:6808/2335675289,v1:172.21.15.64:6809/2335675289] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2480159de0 con 0x7f246407c750 2024-04-25T15:46:46.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.238+0000 7f24767fc640 1 -- 172.21.15.59:0/977729942 <== osd.6 v2:172.21.15.64:6808/2335675289 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2480159de0 con 0x7f246407c750 2024-04-25T15:46:46.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.238+0000 7f2463fff640 1 -- 172.21.15.59:0/977729942 >> [v2:172.21.15.64:6808/2335675289,v1:172.21.15.64:6809/2335675289] conn(0x7f246407c750 msgr2=0x7f246407eba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.238+0000 7f2463fff640 1 --2- 172.21.15.59:0/977729942 >> [v2:172.21.15.64:6808/2335675289,v1:172.21.15.64:6809/2335675289] conn(0x7f246407c750 0x7f246407eba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.239+0000 7f2463fff640 1 -- 172.21.15.59:0/977729942 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2464074500 msgr2=0x7f2464076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.239+0000 7f2463fff640 1 --2- 172.21.15.59:0/977729942 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2464074500 0x7f2464076a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f247c034000 tx=0x7f247c02e000 comp rx=0 tx=0).stop 2024-04-25T15:46:46.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.239+0000 7f2463fff640 1 -- 172.21.15.59:0/977729942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f248015cbd0 msgr2=0x7f24800c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.239+0000 7f2463fff640 1 --2- 172.21.15.59:0/977729942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f248015cbd0 0x7f24800c7d00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2478007d40 tx=0x7f247800e4b0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.239+0000 7f24863fe640 1 -- 172.21.15.59:0/977729942 reap_dead start 2024-04-25T15:46:46.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.239+0000 7f2463fff640 1 -- 172.21.15.59:0/977729942 shutdown_connections 2024-04-25T15:46:46.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.239+0000 7f2463fff640 1 -- 172.21.15.59:0/977729942 >> 172.21.15.59:0/977729942 conn(0x7f2480071f40 msgr2=0x7f24801519b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.239+0000 7f2463fff640 1 -- 172.21.15.59:0/977729942 shutdown_connections 2024-04-25T15:46:46.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.239+0000 7f2463fff640 1 -- 172.21.15.59:0/977729942 wait complete. 2024-04-25T15:46:46.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.247+0000 7f22cdffb640 1 -- 172.21.15.59:0/177568525 --> [v2:172.21.15.59:6810/1651189093,v1:172.21.15.59:6811/1651189093] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f22c8002d50 con 0x7f22d407c730 2024-04-25T15:46:46.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.248+0000 7f22cffff640 1 -- 172.21.15.59:0/177568525 <== osd.2 v2:172.21.15.59:6810/1651189093 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f22c8002d50 con 0x7f22d407c730 2024-04-25T15:46:46.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.249+0000 7f22cdffb640 1 -- 172.21.15.59:0/177568525 >> [v2:172.21.15.59:6810/1651189093,v1:172.21.15.59:6811/1651189093] conn(0x7f22d407c730 msgr2=0x7f22d407eb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.249+0000 7f22cdffb640 1 --2- 172.21.15.59:0/177568525 >> [v2:172.21.15.59:6810/1651189093,v1:172.21.15.59:6811/1651189093] conn(0x7f22d407c730 0x7f22d407eb80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.249+0000 7f22cdffb640 1 -- 172.21.15.59:0/177568525 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f22d40744e0 msgr2=0x7f22d40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.249+0000 7f22cdffb640 1 --2- 172.21.15.59:0/177568525 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f22d40744e0 0x7f22d40769f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f22e8160a10 tx=0x7f22dc006ba0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.249+0000 7f22cdffb640 1 -- 172.21.15.59:0/177568525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22e80c90f0 msgr2=0x7f22e80c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.249+0000 7f22cdffb640 1 --2- 172.21.15.59:0/177568525 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22e80c90f0 0x7f22e80c8050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f22d8000c00 tx=0x7f22d80046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.250+0000 7f22e7fff640 1 -- 172.21.15.59:0/177568525 reap_dead start 2024-04-25T15:46:46.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.250+0000 7f22cdffb640 1 -- 172.21.15.59:0/177568525 shutdown_connections 2024-04-25T15:46:46.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.250+0000 7f22cdffb640 1 -- 172.21.15.59:0/177568525 >> 172.21.15.59:0/177568525 conn(0x7f22e8071f40 msgr2=0x7f22e80ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.250+0000 7f22cdffb640 1 -- 172.21.15.59:0/177568525 shutdown_connections 2024-04-25T15:46:46.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.250+0000 7f22cdffb640 1 -- 172.21.15.59:0/177568525 wait complete. 2024-04-25T15:46:46.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.250+0000 7f66ee7fc640 1 -- 172.21.15.59:0/4208449474 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f66f4012a10 con 0x7f66f80c3660 2024-04-25T15:46:46.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.250+0000 7f66ee7fc640 1 --2- 172.21.15.59:0/4208449474 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f66dc0744e0 0x7f66dc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.253+0000 7f66fd23a640 1 --2- 172.21.15.59:0/4208449474 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f66dc0744e0 0x7f66dc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.254+0000 7f66fd23a640 1 --2- 172.21.15.59:0/4208449474 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f66dc0744e0 0x7f66dc0769f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f66e80011e0 tx=0x7f66e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.260 INFO:teuthology.orchestra.run.smithi059.stdout:64424509449 2024-04-25T15:46:46.261 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T15:46:46.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.265+0000 7f66ee7fc640 1 -- 172.21.15.59:0/4208449474 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f66f4093dd0 con 0x7f66f80c3660 2024-04-25T15:46:46.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.265+0000 7f66ee7fc640 1 --2- 172.21.15.59:0/4208449474 >> [v2:172.21.15.64:6824/639697697,v1:172.21.15.64:6825/639697697] conn(0x7f66dc07c730 0x7f66dc07eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.265+0000 7f66ee7fc640 1 -- 172.21.15.59:0/4208449474 --> [v2:172.21.15.64:6824/639697697,v1:172.21.15.64:6825/639697697] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66dc07f250 con 0x7f66dc07c730 2024-04-25T15:46:46.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.265+0000 7f66ee7fc640 1 -- 172.21.15.59:0/4208449474 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f66f405be70 con 0x7f66f80c3660 2024-04-25T15:46:46.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.265+0000 7f66fe23c640 1 --2- 172.21.15.59:0/4208449474 >> [v2:172.21.15.64:6824/639697697,v1:172.21.15.64:6825/639697697] conn(0x7f66dc07c730 0x7f66dc07eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.266+0000 7f66fe23c640 1 --2- 172.21.15.59:0/4208449474 >> [v2:172.21.15.64:6824/639697697,v1:172.21.15.64:6825/639697697] conn(0x7f66dc07c730 0x7f66dc07eb80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.267+0000 7f66ee7fc640 1 -- 172.21.15.59:0/4208449474 <== osd.5 v2:172.21.15.64:6824/639697697 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f66dc07f250 con 0x7f66dc07c730 2024-04-25T15:46:46.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.270+0000 7fe538e92640 1 -- 172.21.15.59:0/732641001 --> [v2:172.21.15.59:6802/1314235095,v1:172.21.15.59:6803/1314235095] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe5340cd3f0 con 0x7fe51407c7d0 2024-04-25T15:46:46.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.271+0000 7fe522ffd640 1 -- 172.21.15.59:0/732641001 <== osd.0 v2:172.21.15.59:6802/1314235095 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe5340cd3f0 con 0x7fe51407c7d0 2024-04-25T15:46:46.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.272+0000 7fe520ff9640 1 -- 172.21.15.59:0/732641001 >> [v2:172.21.15.59:6802/1314235095,v1:172.21.15.59:6803/1314235095] conn(0x7fe51407c7d0 msgr2=0x7fe51407ec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.273+0000 7fe520ff9640 1 --2- 172.21.15.59:0/732641001 >> [v2:172.21.15.59:6802/1314235095,v1:172.21.15.59:6803/1314235095] conn(0x7fe51407c7d0 0x7fe51407ec20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.273+0000 7fe520ff9640 1 -- 172.21.15.59:0/732641001 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fe514074580 msgr2=0x7fe514076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.273+0000 7fe520ff9640 1 --2- 172.21.15.59:0/732641001 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fe514074580 0x7fe514076a90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe53414acd0 tx=0x7fe528006ba0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.273+0000 7fe520ff9640 1 -- 172.21.15.59:0/732641001 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe53406f9e0 msgr2=0x7fe53414b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.273+0000 7fe520ff9640 1 --2- 172.21.15.59:0/732641001 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe53406f9e0 0x7fe53414b600 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe52400d5f0 tx=0x7fe52400dab0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.278 INFO:teuthology.orchestra.run.smithi059.stdout:64424509450 2024-04-25T15:46:46.278 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T15:46:46.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.274+0000 7fe532d9d640 1 -- 172.21.15.59:0/732641001 reap_dead start 2024-04-25T15:46:46.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.274+0000 7fe520ff9640 1 -- 172.21.15.59:0/732641001 shutdown_connections 2024-04-25T15:46:46.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.274+0000 7fe520ff9640 1 -- 172.21.15.59:0/732641001 >> 172.21.15.59:0/732641001 conn(0x7fe53406c9a0 msgr2=0x7fe534151800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.274+0000 7fe520ff9640 1 -- 172.21.15.59:0/732641001 shutdown_connections 2024-04-25T15:46:46.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.274+0000 7fe520ff9640 1 -- 172.21.15.59:0/732641001 wait complete. 2024-04-25T15:46:46.294 INFO:teuthology.orchestra.run.smithi059.stdout:60129542155 2024-04-25T15:46:46.295 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T15:46:46.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.298+0000 7f66dbfff640 1 -- 172.21.15.59:0/4208449474 --> [v2:172.21.15.64:6824/639697697,v1:172.21.15.64:6825/639697697] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f66d4002dd0 con 0x7f66dc07c730 2024-04-25T15:46:46.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.299+0000 7f66ee7fc640 1 -- 172.21.15.59:0/4208449474 <== osd.5 v2:172.21.15.64:6824/639697697 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f66d4002dd0 con 0x7f66dc07c730 2024-04-25T15:46:46.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.299+0000 7f66dbfff640 1 -- 172.21.15.59:0/4208449474 >> [v2:172.21.15.64:6824/639697697,v1:172.21.15.64:6825/639697697] conn(0x7f66dc07c730 msgr2=0x7f66dc07eb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.299+0000 7f66dbfff640 1 --2- 172.21.15.59:0/4208449474 >> [v2:172.21.15.64:6824/639697697,v1:172.21.15.64:6825/639697697] conn(0x7f66dc07c730 0x7f66dc07eb80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.300+0000 7f66dbfff640 1 -- 172.21.15.59:0/4208449474 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f66dc0744e0 msgr2=0x7f66dc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.300+0000 7f66dbfff640 1 --2- 172.21.15.59:0/4208449474 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f66dc0744e0 0x7f66dc0769f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f66e80011e0 tx=0x7f66e8009040 comp rx=0 tx=0).stop 2024-04-25T15:46:46.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.300+0000 7f66dbfff640 1 -- 172.21.15.59:0/4208449474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66f80c3660 msgr2=0x7f66f80b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.300+0000 7f66dbfff640 1 --2- 172.21.15.59:0/4208449474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66f80c3660 0x7f66f80b2140 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f66f400c460 tx=0x7f66f400c920 comp rx=0 tx=0).stop 2024-04-25T15:46:46.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.300+0000 7f66fe23c640 1 -- 172.21.15.59:0/4208449474 reap_dead start 2024-04-25T15:46:46.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.300+0000 7f66dbfff640 1 -- 172.21.15.59:0/4208449474 shutdown_connections 2024-04-25T15:46:46.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.301+0000 7f66dbfff640 1 -- 172.21.15.59:0/4208449474 >> 172.21.15.59:0/4208449474 conn(0x7f66f806e060 msgr2=0x7f66f806cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.302+0000 7f66dbfff640 1 -- 172.21.15.59:0/4208449474 shutdown_connections 2024-04-25T15:46:46.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.302+0000 7f66dbfff640 1 -- 172.21.15.59:0/4208449474 wait complete. 2024-04-25T15:46:46.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.322+0000 7f19ddf3f640 1 Processor -- start 2024-04-25T15:46:46.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.322+0000 7f19ddf3f640 1 -- start start 2024-04-25T15:46:46.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.325+0000 7f19ddf3f640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f19d80c8040 0x7f19d814f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.325+0000 7f19ddf3f640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19d80705d0 0x7f19d80ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.325+0000 7f19ddf3f640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19d80c8cd0 con 0x7f19d81586b0 2024-04-25T15:46:46.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.325+0000 7f19ddf3f640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f19d8152e00 con 0x7f19d80705d0 2024-04-25T15:46:46.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.325+0000 7f19ddf3f640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f19d80c5450 con 0x7f19d80c8040 2024-04-25T15:46:46.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.326+0000 7f19d6ffd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f19d80c8040 0x7f19d814f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.331+0000 7f19d6ffd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f19d80c8040 0x7f19d814f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:53546/0 (socket says 172.21.15.59:53546) 2024-04-25T15:46:46.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.331+0000 7f19d6ffd640 1 -- 172.21.15.59:0/3499285433 learned_addr learned my addr 172.21.15.59:0/3499285433 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.334+0000 7f19d6ffd640 1 -- 172.21.15.59:0/3499285433 >> v2:172.21.15.59:3300/0 conn(0x7f19d80705d0 msgr2=0x7f19d80ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.334+0000 7f19d6ffd640 1 --2- 172.21.15.59:0/3499285433 >> v2:172.21.15.59:3300/0 conn(0x7f19d80705d0 0x7f19d80ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.334+0000 7f19d6ffd640 1 -- 172.21.15.59:0/3499285433 >> v1:172.21.15.64:6789/0 conn(0x7f19d81586b0 legacy=0x7f19d80c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.334+0000 7f19d6ffd640 1 -- 172.21.15.59:0/3499285433 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d80709e0 con 0x7f19d80c8040 2024-04-25T15:46:46.338 INFO:teuthology.orchestra.run.smithi059.stdout:64424509451 2024-04-25T15:46:46.338 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T15:46:46.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.337+0000 7f19d6ffd640 1 --2- 172.21.15.59:0/3499285433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19d80c8040 0x7f19d814f170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f19d8073170 tx=0x7f19c802a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39701b2af84f99a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.342+0000 7f19d67fc640 1 -- 172.21.15.59:0/3499285433 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8037070 con 0x7f19d80c8040 2024-04-25T15:46:46.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.343+0000 7f19d67fc640 1 -- 172.21.15.59:0/3499285433 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c8032640 con 0x7f19d80c8040 2024-04-25T15:46:46.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.343+0000 7f19d67fc640 1 -- 172.21.15.59:0/3499285433 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8032a50 con 0x7f19d80c8040 2024-04-25T15:46:46.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.344+0000 7f19ddf3f640 1 -- 172.21.15.59:0/3499285433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19d80c8040 msgr2=0x7f19d814f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.344+0000 7f19ddf3f640 1 --2- 172.21.15.59:0/3499285433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19d80c8040 0x7f19d814f170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f19d8073170 tx=0x7f19c802a2c0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.347+0000 7f19ddf3f640 1 -- 172.21.15.59:0/3499285433 shutdown_connections 2024-04-25T15:46:46.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.347+0000 7f19ddf3f640 1 --2- 172.21.15.59:0/3499285433 >> v2:172.21.15.59:3300/0 conn(0x7f19d80705d0 0x7f19d80ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.347+0000 7f19ddf3f640 1 --2- 172.21.15.59:0/3499285433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19d80c8040 0x7f19d814f170 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.347+0000 7f19ddf3f640 1 -- 172.21.15.59:0/3499285433 >> 172.21.15.59:0/3499285433 conn(0x7f19d8071320 msgr2=0x7f19d8071730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.353+0000 7f19ddf3f640 1 -- 172.21.15.59:0/3499285433 shutdown_connections 2024-04-25T15:46:46.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.354+0000 7f19ddf3f640 1 -- 172.21.15.59:0/3499285433 wait complete. 2024-04-25T15:46:46.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.356+0000 7f19ddf3f640 1 Processor -- start 2024-04-25T15:46:46.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.357+0000 7f19ddf3f640 1 -- start start 2024-04-25T15:46:46.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.359+0000 7f19ddf3f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f19d80705d0 0x7f19d814ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.360+0000 7f19ddf3f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19d80c8040 0x7f19d80cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.360+0000 7f19ddf3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19d81586b0 0x7f19d814a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.362+0000 7f31e17f3640 1 Processor -- start 2024-04-25T15:46:46.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.361+0000 7f19d77fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f19d80705d0 0x7f19d814ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.362+0000 7f31e17f3640 1 -- start start 2024-04-25T15:46:46.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.361+0000 7f19d77fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f19d80705d0 0x7f19d814ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53366/0 (socket says 172.21.15.59:53366) 2024-04-25T15:46:46.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.364+0000 7f31e17f3640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f31dc1586b0 0x7f31dc0705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.364+0000 7f31e17f3640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f31dc0c8040 0x7f31dc0c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.364+0000 7f31e17f3640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31dc0c8f50 con 0x7f31dc0cd640 2024-04-25T15:46:46.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.364+0000 7f31e17f3640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f31dc152e00 con 0x7f31dc1586b0 2024-04-25T15:46:46.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.364+0000 7f31e17f3640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f31dc0c5450 con 0x7f31dc0c8040 2024-04-25T15:46:46.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.362+0000 7f19ddf3f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f19d80c5980 con 0x7f19d81586b0 2024-04-25T15:46:46.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.363+0000 7f19d77fe640 1 -- 172.21.15.59:0/3570942167 learned_addr learned my addr 172.21.15.59:0/3570942167 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.363+0000 7f19d7fff640 1 --2- 172.21.15.59:0/3570942167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19d81586b0 0x7f19d814a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.363+0000 7f19ddf3f640 1 -- 172.21.15.59:0/3570942167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f19d80c56a0 con 0x7f19d80c8040 2024-04-25T15:46:46.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.363+0000 7f19ddf3f640 1 -- 172.21.15.59:0/3570942167 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f19d80c4b40 con 0x7f19d80705d0 2024-04-25T15:46:46.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.364+0000 7f19d6ffd640 1 --2- 172.21.15.59:0/3570942167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19d80c8040 0x7f19d80cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.365+0000 7f31daffd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f31dc1586b0 0x7f31dc0705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.365+0000 7f31db7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f31dc0c8040 0x7f31dc0c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.366+0000 7f31da7fc640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f31dc0cd640 0x7f31dc14ef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.59:46884/0 (socket says 172.21.15.59:46884) 2024-04-25T15:46:46.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.366+0000 7f31da7fc640 1 -- 172.21.15.59:0/1166284131 learned_addr learned my addr 172.21.15.59:0/1166284131 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:46.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.370+0000 7f19d6ffd640 1 -- 172.21.15.59:0/3570942167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f19d80705d0 msgr2=0x7f19d814ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.370+0000 7f19d6ffd640 1 --2- 172.21.15.59:0/3570942167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f19d80705d0 0x7f19d814ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.370+0000 7f19d6ffd640 1 -- 172.21.15.59:0/3570942167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19d81586b0 msgr2=0x7f19d814a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.370+0000 7f19d6ffd640 1 --2- 172.21.15.59:0/3570942167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19d81586b0 0x7f19d814a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.370+0000 7f19d6ffd640 1 -- 172.21.15.59:0/3570942167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d814d3b0 con 0x7f19d80c8040 2024-04-25T15:46:46.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.371+0000 7f31daffd640 1 -- 172.21.15.59:0/1166284131 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f31dc0c8040 msgr2=0x7f31dc0c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.371+0000 7f31daffd640 1 --2- 172.21.15.59:0/1166284131 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f31dc0c8040 0x7f31dc0c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.371+0000 7f31daffd640 1 -- 172.21.15.59:0/1166284131 >> v1:172.21.15.64:6789/0 conn(0x7f31dc0cd640 legacy=0x7f31dc14ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.371+0000 7f31daffd640 1 -- 172.21.15.59:0/1166284131 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31dc0c56a0 con 0x7f31dc1586b0 2024-04-25T15:46:46.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.377+0000 7f19d6ffd640 1 --2- 172.21.15.59:0/3570942167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19d80c8040 0x7f19d80cc7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f19c8031000 tx=0x7f19c80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.382+0000 7fcaf1ad2640 1 Processor -- start 2024-04-25T15:46:46.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.382+0000 7f31daffd640 1 --2- 172.21.15.59:0/1166284131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31dc1586b0 0x7f31dc0705d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0097a0 tx=0x7f31cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c46d8034d06554c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.382+0000 7fcaf1ad2640 1 -- start start 2024-04-25T15:46:46.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.384+0000 7fcaf1ad2640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcaec0c3ef0 0x7fcaec0c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.384+0000 7fcaf1ad2640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcaec142340 0x7fcaec15a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.385+0000 7fcaf1ad2640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaec06e270 con 0x7fcaec0ce460 2024-04-25T15:46:46.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.385+0000 7fcaf1ad2640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fcaec159ab0 con 0x7fcaec142340 2024-04-25T15:46:46.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.385+0000 7fcaf1ad2640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fcaec06d7b0 con 0x7fcaec0c3ef0 2024-04-25T15:46:46.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.385+0000 7f19bffff640 1 -- 172.21.15.59:0/3570942167 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8041070 con 0x7f19d80c8040 2024-04-25T15:46:46.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.385+0000 7f19ddf3f640 1 -- 172.21.15.59:0/3570942167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d81ff4d0 con 0x7f19d80c8040 2024-04-25T15:46:46.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.385+0000 7f19ddf3f640 1 -- 172.21.15.59:0/3570942167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d814bdd0 con 0x7f19d80c8040 2024-04-25T15:46:46.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.385+0000 7fcaf0ad0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcaec0c3ef0 0x7fcaec0c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.386+0000 7fcaf0ad0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcaec0c3ef0 0x7fcaec0c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53388/0 (socket says 172.21.15.59:53388) 2024-04-25T15:46:46.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.386+0000 7fcaf0ad0640 1 -- 172.21.15.59:0/784944190 learned_addr learned my addr 172.21.15.59:0/784944190 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.386+0000 7f19bffff640 1 -- 172.21.15.59:0/3570942167 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c80325c0 con 0x7f19d80c8040 2024-04-25T15:46:46.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.386+0000 7f19bffff640 1 -- 172.21.15.59:0/3570942167 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8041070 con 0x7f19d80c8040 2024-04-25T15:46:46.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.388+0000 7f19ddf3f640 1 -- 172.21.15.59:0/3570942167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19b8005290 con 0x7f19d80c8040 2024-04-25T15:46:46.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.388+0000 7fcaf0ad0640 1 -- 172.21.15.59:0/784944190 >> v2:172.21.15.59:3300/0 conn(0x7fcaec142340 msgr2=0x7fcaec15a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.388+0000 7fcaf0ad0640 1 --2- 172.21.15.59:0/784944190 >> v2:172.21.15.59:3300/0 conn(0x7fcaec142340 0x7fcaec15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.388+0000 7fcaf0ad0640 1 -- 172.21.15.59:0/784944190 >> v1:172.21.15.59:6789/0 conn(0x7fcaec0ce460 legacy=0x7fcaec15c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.388+0000 7fcaf0ad0640 1 -- 172.21.15.59:0/784944190 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaec159180 con 0x7fcaec0c3ef0 2024-04-25T15:46:46.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.390+0000 7fcaf0ad0640 1 --2- 172.21.15.59:0/784944190 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcaec0c3ef0 0x7fcaec0c8f10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcad8009870 tx=0x7fcad802c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44499b6d67d1848 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.394+0000 7fcaeb7fe640 1 -- 172.21.15.59:0/784944190 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8038070 con 0x7fcaec0c3ef0 2024-04-25T15:46:46.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.394+0000 7fcaeb7fe640 1 -- 172.21.15.59:0/784944190 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad8031710 con 0x7fcaec0c3ef0 2024-04-25T15:46:46.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.394+0000 7fcaeb7fe640 1 -- 172.21.15.59:0/784944190 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8031ae0 con 0x7fcaec0c3ef0 2024-04-25T15:46:46.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.396+0000 7fcaf1ad2640 1 -- 172.21.15.59:0/784944190 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcaec0c3ef0 msgr2=0x7fcaec0c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.396+0000 7fcaf1ad2640 1 --2- 172.21.15.59:0/784944190 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcaec0c3ef0 0x7fcaec0c8f10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcad8009870 tx=0x7fcad802c4a0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.396+0000 7fcaf1ad2640 1 -- 172.21.15.59:0/784944190 shutdown_connections 2024-04-25T15:46:46.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.396+0000 7fcaf1ad2640 1 --2- 172.21.15.59:0/784944190 >> v2:172.21.15.59:3300/0 conn(0x7fcaec142340 0x7fcaec15a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.396+0000 7fcaf1ad2640 1 --2- 172.21.15.59:0/784944190 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcaec0c3ef0 0x7fcaec0c8f10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.396+0000 7fcaf1ad2640 1 -- 172.21.15.59:0/784944190 >> 172.21.15.59:0/784944190 conn(0x7fcaec074880 msgr2=0x7fcaec0700a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.396+0000 7fcaf1ad2640 1 -- 172.21.15.59:0/784944190 shutdown_connections 2024-04-25T15:46:46.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.396+0000 7fcaf1ad2640 1 -- 172.21.15.59:0/784944190 wait complete. 2024-04-25T15:46:46.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.399+0000 7fcaf1ad2640 1 Processor -- start 2024-04-25T15:46:46.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.399+0000 7fcaf1ad2640 1 -- start start 2024-04-25T15:46:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.402+0000 7fcaf1ad2640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcaec0c3ef0 0x7fcaec1e2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.402+0000 7fcaf1ad2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaec0ce460 0x7fcaec1e3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.402+0000 7fcaf1ad2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcaec142340 0x7fcaec0cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.402+0000 7fcaf1ad2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcaec0c9450 con 0x7fcaec0ce460 2024-04-25T15:46:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.402+0000 7fcaf1ad2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fcaec159740 con 0x7fcaec142340 2024-04-25T15:46:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.402+0000 7fcaf1ad2640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fcaec159f40 con 0x7fcaec0c3ef0 2024-04-25T15:46:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.403+0000 7fcaf0ad0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcaec0c3ef0 0x7fcaec1e2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.403+0000 7fcaf0ad0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcaec0c3ef0 0x7fcaec1e2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53392/0 (socket says 172.21.15.59:53392) 2024-04-25T15:46:46.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.403+0000 7fcaf0ad0640 1 -- 172.21.15.59:0/1791997925 learned_addr learned my addr 172.21.15.59:0/1791997925 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.404+0000 7f76fc096640 1 Processor -- start 2024-04-25T15:46:46.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.404+0000 7f31d9ffb640 1 -- 172.21.15.59:0/1166284131 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc037070 con 0x7f31dc1586b0 2024-04-25T15:46:46.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.404+0000 7f31d9ffb640 1 -- 172.21.15.59:0/1166284131 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31cc032440 con 0x7f31dc1586b0 2024-04-25T15:46:46.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.404+0000 7f31d9ffb640 1 -- 172.21.15.59:0/1166284131 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc032810 con 0x7f31dc1586b0 2024-04-25T15:46:46.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.404+0000 7f76fc096640 1 -- start start 2024-04-25T15:46:46.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.405+0000 7fcaebfff640 1 --2- 172.21.15.59:0/1791997925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaec0ce460 0x7fcaec1e3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.406+0000 7f31e17f3640 1 -- 172.21.15.59:0/1166284131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31dc1586b0 msgr2=0x7f31dc0705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.406+0000 7f31e17f3640 1 --2- 172.21.15.59:0/1166284131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31dc1586b0 0x7f31dc0705d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0097a0 tx=0x7f31cc02a270 comp rx=0 tx=0).stop 2024-04-25T15:46:46.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.406+0000 7f31e17f3640 1 -- 172.21.15.59:0/1166284131 shutdown_connections 2024-04-25T15:46:46.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.406+0000 7f31e17f3640 1 --2- 172.21.15.59:0/1166284131 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f31dc0c8040 0x7f31dc0c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.406+0000 7f31e17f3640 1 --2- 172.21.15.59:0/1166284131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31dc1586b0 0x7f31dc0705d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.406+0000 7f31e17f3640 1 -- 172.21.15.59:0/1166284131 >> 172.21.15.59:0/1166284131 conn(0x7f31dc071320 msgr2=0x7f31dc071730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.406+0000 7f31e17f3640 1 -- 172.21.15.59:0/1166284131 shutdown_connections 2024-04-25T15:46:46.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.407+0000 7f76fc096640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f76f4152bc0 0x7f76f415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.407+0000 7f76fc096640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f40c5290 con 0x7f76f40c7b50 2024-04-25T15:46:46.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.407+0000 7f76fc096640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f40c8170 con 0x7f76f415cc20 2024-04-25T15:46:46.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.407+0000 7f76fc096640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f76f415bf70 con 0x7f76f4152bc0 2024-04-25T15:46:46.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.406+0000 7f31e17f3640 1 -- 172.21.15.59:0/1166284131 wait complete. 2024-04-25T15:46:46.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.407+0000 7fcaf0ad0640 1 -- 172.21.15.59:0/1791997925 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcaec142340 msgr2=0x7fcaec0cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.407+0000 7fcaf0ad0640 1 --2- 172.21.15.59:0/1791997925 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcaec142340 0x7fcaec0cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.407+0000 7fcaf0ad0640 1 -- 172.21.15.59:0/1791997925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaec0ce460 msgr2=0x7fcaec1e3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.407+0000 7fcaf0ad0640 1 --2- 172.21.15.59:0/1791997925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaec0ce460 0x7fcaec1e3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.407+0000 7fcaf0ad0640 1 -- 172.21.15.59:0/1791997925 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaec1e2c80 con 0x7fcaec0c3ef0 2024-04-25T15:46:46.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.409+0000 7f31e17f3640 1 Processor -- start 2024-04-25T15:46:46.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.409+0000 7f31e17f3640 1 -- start start 2024-04-25T15:46:46.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.410+0000 7f76f9631640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f76f4152bc0 0x7f76f415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.410+0000 7f76f9631640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f76f4152bc0 0x7f76f415c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53394/0 (socket says 172.21.15.59:53394) 2024-04-25T15:46:46.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.410+0000 7f76f9631640 1 -- 172.21.15.59:0/259129963 learned_addr learned my addr 172.21.15.59:0/259129963 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.411+0000 7f31e17f3640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f31dc0c8040 0x7f31dc1f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.411+0000 7f31e17f3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0cd640 0x7f31dc15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.411+0000 7f31e17f3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31dc1586b0 0x7f31dc149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.411+0000 7f31e17f3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc0c4b40 con 0x7f31dc1586b0 2024-04-25T15:46:46.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.411+0000 7f31e17f3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc0c9df0 con 0x7f31dc0cd640 2024-04-25T15:46:46.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.411+0000 7f31e17f3640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f31dc0c4cc0 con 0x7f31dc0c8040 2024-04-25T15:46:46.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.412+0000 7fcaf0ad0640 1 --2- 172.21.15.59:0/1791997925 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcaec0c3ef0 0x7fcaec1e2740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcad8009990 tx=0x7fcad80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.414+0000 7f31db7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31dc1586b0 0x7f31dc149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.414+0000 7f76f9631640 1 -- 172.21.15.59:0/259129963 >> v1:172.21.15.64:6789/0 conn(0x7f76f415cc20 legacy=0x7f76f40715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.414+0000 7f76f9631640 1 -- 172.21.15.59:0/259129963 >> v1:172.21.15.59:6789/0 conn(0x7f76f40c7b50 legacy=0x7f76f40c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.414+0000 7f76f9631640 1 -- 172.21.15.59:0/259129963 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f40c5510 con 0x7f76f4152bc0 2024-04-25T15:46:46.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.415+0000 7f31db7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31dc1586b0 0x7f31dc149630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59744/0 (socket says 172.21.15.59:59744) 2024-04-25T15:46:46.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.415+0000 7f31db7fe640 1 -- 172.21.15.59:0/1867224803 learned_addr learned my addr 172.21.15.59:0/1867224803 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.420+0000 7f76f9631640 1 --2- 172.21.15.59:0/259129963 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f76f4152bc0 0x7f76f415c6e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f76e400bb00 tx=0x7f76e402c6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f4ecabb9e859295 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.420+0000 7f31daffd640 1 --2- 172.21.15.59:0/1867224803 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f31dc0c8040 0x7f31dc1f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.421+0000 7fcae97fa640 1 -- 172.21.15.59:0/1791997925 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8045070 con 0x7fcaec0c3ef0 2024-04-25T15:46:46.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.421+0000 7fcae97fa640 1 -- 172.21.15.59:0/1791997925 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad803eae0 con 0x7fcaec0c3ef0 2024-04-25T15:46:46.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.421+0000 7fcae97fa640 1 -- 172.21.15.59:0/1791997925 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8038040 con 0x7fcaec0c3ef0 2024-04-25T15:46:46.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.421+0000 7fcaf1ad2640 1 -- 172.21.15.59:0/1791997925 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaec1ee510 con 0x7fcaec0c3ef0 2024-04-25T15:46:46.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.422+0000 7fcaf1ad2640 1 -- 172.21.15.59:0/1791997925 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaec1eead0 con 0x7fcaec0c3ef0 2024-04-25T15:46:46.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.423+0000 7fcaf1ad2640 1 -- 172.21.15.59:0/1791997925 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaec050820 con 0x7fcaec0c3ef0 2024-04-25T15:46:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.429+0000 7f31daffd640 1 -- 172.21.15.59:0/1867224803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0cd640 msgr2=0x7f31dc15a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.429+0000 7f31daffd640 1 --2- 172.21.15.59:0/1867224803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0cd640 0x7f31dc15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.429+0000 7f31daffd640 1 -- 172.21.15.59:0/1867224803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31dc1586b0 msgr2=0x7f31dc149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.429+0000 7f31daffd640 1 --2- 172.21.15.59:0/1867224803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31dc1586b0 0x7f31dc149630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.429+0000 7f31daffd640 1 -- 172.21.15.59:0/1867224803 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31dc15ae20 con 0x7f31dc0c8040 2024-04-25T15:46:46.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.448+0000 7fc827938640 1 Processor -- start 2024-04-25T15:46:46.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.448+0000 7fc827938640 1 -- start start 2024-04-25T15:46:46.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.450+0000 7fc827938640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc820159d10 0x7fc8200b1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.450+0000 7fc827938640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc820156a30 0x7fc820070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.450+0000 7fc827938640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8200c96c0 con 0x7fc8200cade0 2024-04-25T15:46:46.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.450+0000 7fc827938640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fc82015a270 con 0x7fc820156a30 2024-04-25T15:46:46.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.450+0000 7fc827938640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fc820070750 con 0x7fc820159d10 2024-04-25T15:46:46.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.451+0000 7fc824ed3640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc820156a30 0x7fc820070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.452+0000 7fc824ed3640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc820156a30 0x7fc820070be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59750/0 (socket says 172.21.15.59:59750) 2024-04-25T15:46:46.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.452+0000 7fc824ed3640 1 -- 172.21.15.59:0/3750844492 learned_addr learned my addr 172.21.15.59:0/3750844492 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.456+0000 7fc824ed3640 1 -- 172.21.15.59:0/3750844492 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc820159d10 msgr2=0x7fc8200b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.456+0000 7fc824ed3640 1 --2- 172.21.15.59:0/3750844492 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc820159d10 0x7fc8200b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.456+0000 7fc824ed3640 1 -- 172.21.15.59:0/3750844492 >> v1:172.21.15.64:6789/0 conn(0x7fc8200cade0 legacy=0x7fc8200cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.456+0000 7fc824ed3640 1 -- 172.21.15.59:0/3750844492 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8200c9960 con 0x7fc820156a30 2024-04-25T15:46:46.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.456+0000 7f76f8e30640 1 -- 172.21.15.59:0/259129963 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e403a070 con 0x7f76f4152bc0 2024-04-25T15:46:46.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.456+0000 7f76f8e30640 1 -- 172.21.15.59:0/259129963 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e4032480 con 0x7f76f4152bc0 2024-04-25T15:46:46.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.456+0000 7f76f8e30640 1 -- 172.21.15.59:0/259129963 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e4032850 con 0x7f76f4152bc0 2024-04-25T15:46:46.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.457+0000 7f76fc096640 1 -- 172.21.15.59:0/259129963 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f76f4152bc0 msgr2=0x7f76f415c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.457+0000 7f76fc096640 1 --2- 172.21.15.59:0/259129963 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f76f4152bc0 0x7f76f415c6e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f76e400bb00 tx=0x7f76e402c6b0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.457+0000 7f76fc096640 1 -- 172.21.15.59:0/259129963 shutdown_connections 2024-04-25T15:46:46.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.457+0000 7f76fc096640 1 --2- 172.21.15.59:0/259129963 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f76f4152bc0 0x7f76f415c6e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.457+0000 7f76fc096640 1 -- 172.21.15.59:0/259129963 >> 172.21.15.59:0/259129963 conn(0x7f76f40cdfb0 msgr2=0x7f76f40ce3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.457+0000 7f76fc096640 1 -- 172.21.15.59:0/259129963 shutdown_connections 2024-04-25T15:46:46.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.457+0000 7f76fc096640 1 -- 172.21.15.59:0/259129963 wait complete. 2024-04-25T15:46:46.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.459+0000 7fc824ed3640 1 --2- 172.21.15.59:0/3750844492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc820156a30 0x7fc820070be0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc81000bb10 tx=0x7fc81002c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6134322bcefbd32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.460+0000 7f76fc096640 1 Processor -- start 2024-04-25T15:46:46.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.460+0000 7f76fc096640 1 -- start start 2024-04-25T15:46:46.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.462+0000 7f76fc096640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76f40c7b50 0x7f76f4157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.462+0000 7f76fc096640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76f4152bc0 0x7f76f414c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.463+0000 7f76fc096640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f76f415cc20 0x7f76f41edcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.463+0000 7f76fc096640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f76f40c76c0 con 0x7f76f40c7b50 2024-04-25T15:46:46.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.463+0000 7f76fc096640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f76f415c1c0 con 0x7f76f4152bc0 2024-04-25T15:46:46.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.463+0000 7f76fc096640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f76f4152fd0 con 0x7f76f415cc20 2024-04-25T15:46:46.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.464+0000 7fc817fff640 1 -- 172.21.15.59:0/3750844492 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810032780 con 0x7fc820156a30 2024-04-25T15:46:46.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.465+0000 7fc817fff640 1 -- 172.21.15.59:0/3750844492 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc810038070 con 0x7fc820156a30 2024-04-25T15:46:46.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.465+0000 7fc817fff640 1 -- 172.21.15.59:0/3750844492 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810032b40 con 0x7fc820156a30 2024-04-25T15:46:46.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.465+0000 7f76f9e32640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76f40c7b50 0x7f76f4157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.466+0000 7f76f9e32640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76f40c7b50 0x7f76f4157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59754/0 (socket says 172.21.15.59:59754) 2024-04-25T15:46:46.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.466+0000 7f76f9e32640 1 -- 172.21.15.59:0/2956529423 learned_addr learned my addr 172.21.15.59:0/2956529423 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.466+0000 7fc827938640 1 -- 172.21.15.59:0/3750844492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc820156a30 msgr2=0x7fc820070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.466+0000 7fc827938640 1 --2- 172.21.15.59:0/3750844492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc820156a30 0x7fc820070be0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc81000bb10 tx=0x7fc81002c8c0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.466+0000 7fc827938640 1 -- 172.21.15.59:0/3750844492 shutdown_connections 2024-04-25T15:46:46.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.466+0000 7fc827938640 1 --2- 172.21.15.59:0/3750844492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc820156a30 0x7fc820070be0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.466+0000 7fc827938640 1 --2- 172.21.15.59:0/3750844492 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc820159d10 0x7fc8200b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.466+0000 7fc827938640 1 -- 172.21.15.59:0/3750844492 >> 172.21.15.59:0/3750844492 conn(0x7fc820072170 msgr2=0x7fc820072580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.466+0000 7fc827938640 1 -- 172.21.15.59:0/3750844492 shutdown_connections 2024-04-25T15:46:46.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.466+0000 7fc827938640 1 -- 172.21.15.59:0/3750844492 wait complete. 2024-04-25T15:46:46.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.467+0000 7f9b63de0640 1 Processor -- start 2024-04-25T15:46:46.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.467+0000 7f9b63de0640 1 -- start start 2024-04-25T15:46:46.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.468+0000 7f729cb1f640 1 Processor -- start 2024-04-25T15:46:46.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.468+0000 7f729cb1f640 1 -- start start 2024-04-25T15:46:46.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.468+0000 7fc827938640 1 Processor -- start 2024-04-25T15:46:46.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.468+0000 7fc827938640 1 -- start start 2024-04-25T15:46:46.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.469+0000 7f9b63de0640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b5c0cc710 0x7f9b5c0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.469+0000 7f9b63de0640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b5c15dad0 con 0x7f9b5c0b51b0 2024-04-25T15:46:46.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.469+0000 7f9b63de0640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b5c15ddb0 con 0x7f9b5c154630 2024-04-25T15:46:46.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.469+0000 7f9b63de0640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f9b5c0cb130 con 0x7f9b5c0cc710 2024-04-25T15:46:46.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.470+0000 7fc827938640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8200cade0 0x7fc82014fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.470+0000 7fc827938640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc820156a30 0x7fc8201589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.470+0000 7fc827938640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc820159d10 0x7fc8200cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.470+0000 7fc827938640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc8200c3740 con 0x7fc820156a30 2024-04-25T15:46:46.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.470+0000 7fc827938640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc8200cab70 con 0x7fc8200cade0 2024-04-25T15:46:46.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.470+0000 7fc827938640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fc8200c38c0 con 0x7fc820159d10 2024-04-25T15:46:46.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.470+0000 7f729cb1f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72981607d0 0x7f72980cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.470+0000 7f729cb1f640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f729806efd0 con 0x7f72980caa10 2024-04-25T15:46:46.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.470+0000 7f729cb1f640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f729806f270 con 0x7f72981456b0 2024-04-25T15:46:46.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.470+0000 7f729cb1f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f729815fc30 con 0x7f72981607d0 2024-04-25T15:46:46.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.471+0000 7f76f9e32640 1 -- 172.21.15.59:0/2956529423 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f76f415cc20 msgr2=0x7f76f41edcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.472+0000 7f76f9e32640 1 --2- 172.21.15.59:0/2956529423 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f76f415cc20 0x7f76f41edcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.472+0000 7f76f9e32640 1 -- 172.21.15.59:0/2956529423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76f4152bc0 msgr2=0x7f76f414c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.472+0000 7f76f9e32640 1 --2- 172.21.15.59:0/2956529423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76f4152bc0 0x7f76f414c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.472+0000 7f76f9e32640 1 -- 172.21.15.59:0/2956529423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f41eea80 con 0x7f76f40c7b50 2024-04-25T15:46:46.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.476+0000 7f9b6237d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b5c0cc710 0x7f9b5c0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.476+0000 7f76f9e32640 1 --2- 172.21.15.59:0/2956529423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76f40c7b50 0x7f76f4157520 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f76f000b420 tx=0x7f76f000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.477+0000 7fc824ed3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc820156a30 0x7fc8201589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.477+0000 7f9b6237d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b5c0cc710 0x7f9b5c0cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59764/0 (socket says 172.21.15.59:59764) 2024-04-25T15:46:46.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.477+0000 7f9b6237d640 1 -- 172.21.15.59:0/2804908535 learned_addr learned my addr 172.21.15.59:0/2804908535 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.480+0000 7fc824ed3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc820156a30 0x7fc8201589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59770/0 (socket says 172.21.15.59:59770) 2024-04-25T15:46:46.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.480+0000 7fc824ed3640 1 -- 172.21.15.59:0/2941870246 learned_addr learned my addr 172.21.15.59:0/2941870246 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.480+0000 7f7295d9b640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f72980caa10 0x7f72981600c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39470/0 (socket says 172.21.15.59:39470) 2024-04-25T15:46:46.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.480+0000 7f7295d9b640 1 -- 172.21.15.59:0/1151825995 learned_addr learned my addr 172.21.15.59:0/1151825995 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:46.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.485+0000 7f9b6237d640 1 -- 172.21.15.59:0/2804908535 >> v1:172.21.15.64:6789/0 conn(0x7f9b5c154630 legacy=0x7f9b5c0cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.485+0000 7f9b6237d640 1 -- 172.21.15.59:0/2804908535 >> v1:172.21.15.59:6789/0 conn(0x7f9b5c0b51b0 legacy=0x7f9b5c0cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.485+0000 7f9b6237d640 1 -- 172.21.15.59:0/2804908535 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b5c15e090 con 0x7f9b5c0cc710 2024-04-25T15:46:46.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.490+0000 7fc824ed3640 1 -- 172.21.15.59:0/2941870246 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc820159d10 msgr2=0x7fc8200cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.490+0000 7fc824ed3640 1 --2- 172.21.15.59:0/2941870246 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc820159d10 0x7fc8200cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.490+0000 7fc824ed3640 1 -- 172.21.15.59:0/2941870246 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8200cade0 msgr2=0x7fc82014fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.490+0000 7fc824ed3640 1 --2- 172.21.15.59:0/2941870246 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8200cade0 0x7fc82014fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.490+0000 7fc824ed3640 1 -- 172.21.15.59:0/2941870246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8201502a0 con 0x7fc820156a30 2024-04-25T15:46:46.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.496+0000 7f9b6237d640 1 --2- 172.21.15.59:0/2804908535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b5c0cc710 0x7f9b5c0cabf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009e50 tx=0x7f9b5402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd563320572fd69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.496+0000 7fc824ed3640 1 --2- 172.21.15.59:0/2941870246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc820156a30 0x7fc8201589b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc810000c00 tx=0x7fc8100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.498+0000 7f76ea7fc640 1 -- 172.21.15.59:0/2956529423 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0011830 con 0x7f76f40c7b50 2024-04-25T15:46:46.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.498+0000 7f76ea7fc640 1 -- 172.21.15.59:0/2956529423 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76f0016070 con 0x7f76f40c7b50 2024-04-25T15:46:46.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.498+0000 7f76ea7fc640 1 -- 172.21.15.59:0/2956529423 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0011830 con 0x7f76f40c7b50 2024-04-25T15:46:46.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.498+0000 7f76fc096640 1 -- 172.21.15.59:0/2956529423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f4156a40 con 0x7f76f40c7b50 2024-04-25T15:46:46.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.498+0000 7f76fc096640 1 -- 172.21.15.59:0/2956529423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f4157000 con 0x7f76f40c7b50 2024-04-25T15:46:46.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.499+0000 7fcae97fa640 1 -- 172.21.15.59:0/1791997925 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcad8048070 con 0x7fcaec0c3ef0 2024-04-25T15:46:46.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.499+0000 7fcae97fa640 1 --2- 172.21.15.59:0/1791997925 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fcad0074530 0x7fcad0076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.499+0000 7f76fc096640 1 -- 172.21.15.59:0/2956529423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76f4069fb0 con 0x7f76f40c7b50 2024-04-25T15:46:46.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.500+0000 7fcaebfff640 1 --2- 172.21.15.59:0/1791997925 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fcad0074530 0x7fcad0076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.500+0000 7fcaebfff640 1 --2- 172.21.15.59:0/1791997925 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fcad0074530 0x7fcad0076a40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcaec0b3be0 tx=0x7fcae0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.505+0000 7f254717a640 1 Processor -- start 2024-04-25T15:46:46.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.505+0000 7f254717a640 1 -- start start 2024-04-25T15:46:46.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.506+0000 7f254717a640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2540159d10 0x7f25400b1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.506+0000 7f254717a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2540156a30 0x7f2540070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.506+0000 7f254717a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f25400cade0 0x7f25400cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.506+0000 7f254717a640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f254015a270 con 0x7f2540159d10 2024-04-25T15:46:46.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.506+0000 7f254717a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f2540070750 con 0x7f2540156a30 2024-04-25T15:46:46.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.506+0000 7f254717a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f25400c96c0 con 0x7f25400cade0 2024-04-25T15:46:46.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.727+0000 7f19bffff640 1 -- 172.21.15.59:0/3570942167 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f19c8044070 con 0x7f19d80c8040 2024-04-25T15:46:46.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.728+0000 7f19bffff640 1 --2- 172.21.15.59:0/3570942167 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f19c40746b0 0x7f19c4076bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.728+0000 7f19bffff640 1 -- 172.21.15.59:0/3570942167 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f19c80b5cb0 con 0x7f19d80c8040 2024-04-25T15:46:46.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.728+0000 7f19d77fe640 1 --2- 172.21.15.59:0/3570942167 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f19c40746b0 0x7f19c4076bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.728+0000 7f19d77fe640 1 --2- 172.21.15.59:0/3570942167 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f19c40746b0 0x7f19c4076bc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19d0001ea0 tx=0x7f19d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.737+0000 7f19bffff640 1 -- 172.21.15.59:0/3570942167 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f19c804b030 con 0x7f19d80c8040 2024-04-25T15:46:46.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.743+0000 7f253ffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2540156a30 0x7f2540070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.743+0000 7f253ffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2540156a30 0x7f2540070be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:53612/0 (socket says 172.21.15.59:53612) 2024-04-25T15:46:46.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.743+0000 7f253ffff640 1 -- 172.21.15.59:0/2049793293 learned_addr learned my addr 172.21.15.59:0/2049793293 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.747+0000 7f253ffff640 1 -- 172.21.15.59:0/2049793293 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f25400cade0 msgr2=0x7f25400cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.747+0000 7f253ffff640 1 --2- 172.21.15.59:0/2049793293 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f25400cade0 0x7f25400cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.747+0000 7f253ffff640 1 -- 172.21.15.59:0/2049793293 >> v2:172.21.15.59:3300/0 conn(0x7f2540159d10 msgr2=0x7f25400b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.747+0000 7f253ffff640 1 --2- 172.21.15.59:0/2049793293 >> v2:172.21.15.59:3300/0 conn(0x7f2540159d10 0x7f25400b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.747+0000 7f253ffff640 1 -- 172.21.15.59:0/2049793293 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25400c9960 con 0x7f2540156a30 2024-04-25T15:46:46.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.751+0000 7f253ffff640 1 --2- 172.21.15.59:0/2049793293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2540156a30 0x7f2540070be0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f25400718b0 tx=0x7f253402a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bba181e3e22a058f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.756+0000 7fcae97fa640 1 -- 172.21.15.59:0/1791997925 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcad807fe70 con 0x7fcaec0c3ef0 2024-04-25T15:46:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.759+0000 7f729559a640 1 -- 172.21.15.59:0/1151825995 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2867963785 0 0) 0x7f729806f270 con 0x7f72981456b0 2024-04-25T15:46:46.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.759+0000 7f729559a640 1 -- 172.21.15.59:0/1151825995 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7280003520 con 0x7f72981456b0 2024-04-25T15:46:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.761+0000 7f253f7fe640 1 -- 172.21.15.59:0/2049793293 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534037070 con 0x7f2540156a30 2024-04-25T15:46:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.761+0000 7f253f7fe640 1 -- 172.21.15.59:0/2049793293 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2534032440 con 0x7f2540156a30 2024-04-25T15:46:46.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.761+0000 7f253f7fe640 1 -- 172.21.15.59:0/2049793293 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534032810 con 0x7f2540156a30 2024-04-25T15:46:46.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.762+0000 7f254717a640 1 -- 172.21.15.59:0/2049793293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2540156a30 msgr2=0x7f2540070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.762+0000 7f254717a640 1 --2- 172.21.15.59:0/2049793293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2540156a30 0x7f2540070be0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f25400718b0 tx=0x7f253402a1e0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.762+0000 7f254717a640 1 -- 172.21.15.59:0/2049793293 shutdown_connections 2024-04-25T15:46:46.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.762+0000 7f254717a640 1 --2- 172.21.15.59:0/2049793293 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f25400cade0 0x7f25400cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.762+0000 7f254717a640 1 --2- 172.21.15.59:0/2049793293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2540156a30 0x7f2540070be0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.762+0000 7f254717a640 1 --2- 172.21.15.59:0/2049793293 >> v2:172.21.15.59:3300/0 conn(0x7f2540159d10 0x7f25400b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.762+0000 7f254717a640 1 -- 172.21.15.59:0/2049793293 >> 172.21.15.59:0/2049793293 conn(0x7f2540072170 msgr2=0x7f2540072580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.762+0000 7f254717a640 1 -- 172.21.15.59:0/2049793293 shutdown_connections 2024-04-25T15:46:46.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.762+0000 7f254717a640 1 -- 172.21.15.59:0/2049793293 wait complete. 2024-04-25T15:46:46.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.764+0000 7f254717a640 1 Processor -- start 2024-04-25T15:46:46.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.764+0000 7f254717a640 1 -- start start 2024-04-25T15:46:46.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.765+0000 7f254717a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25400cade0 0x7f25401f2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.765+0000 7f254717a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2540156a30 0x7f254014d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.765+0000 7f254717a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2540159d10 0x7f2540152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.765+0000 7f254717a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f25400c3740 con 0x7f2540156a30 2024-04-25T15:46:46.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.765+0000 7f254717a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f25400cab70 con 0x7f25400cade0 2024-04-25T15:46:46.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.765+0000 7f254717a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f25400c38c0 con 0x7f2540159d10 2024-04-25T15:46:46.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.768+0000 7f2544f16640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25400cade0 0x7f25401f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.768+0000 7f729559a640 1 -- 172.21.15.59:0/1151825995 <== mon.1 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2747289332 0 0) 0x7f7280003520 con 0x7f72981456b0 2024-04-25T15:46:46.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.768+0000 7f729559a640 1 -- 172.21.15.59:0/1151825995 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72981607d0 msgr2=0x7f72980cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.768+0000 7f729559a640 1 --2- 172.21.15.59:0/1151825995 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72981607d0 0x7f72980cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.768+0000 7f729559a640 1 -- 172.21.15.59:0/1151825995 >> v1:172.21.15.59:6789/0 conn(0x7f72980caa10 legacy=0x7f72981600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.768+0000 7f729559a640 1 -- 172.21.15.59:0/1151825995 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729806f550 con 0x7f72981456b0 2024-04-25T15:46:46.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.768+0000 7f729559a640 1 -- 172.21.15.59:0/1151825995 <== mon.1 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 763030806 0 0) 0x7f7288001670 con 0x7f72981456b0 2024-04-25T15:46:46.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.768+0000 7f729559a640 1 -- 172.21.15.59:0/1151825995 >> v1:172.21.15.64:6789/0 conn(0x7f72981456b0 legacy=0x7f7298071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.768+0000 7f729559a640 1 --2- 172.21.15.59:0/1151825995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72800039b0 0x7f7280003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.768+0000 7f729559a640 1 --2- 172.21.15.59:0/1151825995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7280004800 0x7f7280004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.768+0000 7f729559a640 1 --2- 172.21.15.59:0/1151825995 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72981607d0 0x7f728000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.768+0000 7f729559a640 1 -- 172.21.15.59:0/1151825995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f729815fc30 con 0x7f7280004800 2024-04-25T15:46:46.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.768+0000 7f729559a640 1 -- 172.21.15.59:0/1151825995 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7280005670 con 0x7f72800039b0 2024-04-25T15:46:46.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.768+0000 7f729559a640 1 -- 172.21.15.59:0/1151825995 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f728000bf80 con 0x7f72981607d0 2024-04-25T15:46:46.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.768+0000 7f2544f16640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25400cade0 0x7f25401f2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:53624/0 (socket says 172.21.15.59:53624) 2024-04-25T15:46:46.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.768+0000 7f2544f16640 1 -- 172.21.15.59:0/2173272008 learned_addr learned my addr 172.21.15.59:0/2173272008 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:46.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.769+0000 7fcae97fa640 1 -- 172.21.15.59:0/1791997925 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcad80842e0 con 0x7fcaec0c3ef0 2024-04-25T15:46:46.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.770+0000 7f31daffd640 1 --2- 172.21.15.59:0/1867224803 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f31dc0c8040 0x7f31dc1f2af0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0ce400 tx=0x7f31cc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.774+0000 7f2544f16640 1 -- 172.21.15.59:0/2173272008 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2540159d10 msgr2=0x7f2540152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.774+0000 7f2544f16640 1 --2- 172.21.15.59:0/2173272008 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2540159d10 0x7f2540152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.774+0000 7f2544f16640 1 -- 172.21.15.59:0/2173272008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2540156a30 msgr2=0x7f254014d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.774+0000 7f2544f16640 1 --2- 172.21.15.59:0/2173272008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2540156a30 0x7f254014d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.774+0000 7f2544f16640 1 -- 172.21.15.59:0/2173272008 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25401f2e60 con 0x7f25400cade0 2024-04-25T15:46:46.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.777+0000 7f2544f16640 1 --2- 172.21.15.59:0/2173272008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25400cade0 0x7f25401f2920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f253800ba50 tx=0x7f253800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.779+0000 7f31c37fe640 1 -- 172.21.15.59:0/1867224803 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc040020 con 0x7f31dc0c8040 2024-04-25T15:46:46.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.779+0000 7f31c37fe640 1 -- 172.21.15.59:0/1867224803 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31cc038040 con 0x7f31dc0c8040 2024-04-25T15:46:46.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.779+0000 7f31c37fe640 1 -- 172.21.15.59:0/1867224803 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc037070 con 0x7f31dc0c8040 2024-04-25T15:46:46.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.779+0000 7f31e17f3640 1 -- 172.21.15.59:0/1867224803 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31dc147430 con 0x7f31dc0c8040 2024-04-25T15:46:46.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.779+0000 7f31e17f3640 1 -- 172.21.15.59:0/1867224803 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f31dc1479f0 con 0x7f31dc0c8040 2024-04-25T15:46:46.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.781+0000 7f31e17f3640 1 -- 172.21.15.59:0/1867224803 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31dc074230 con 0x7f31dc0c8040 2024-04-25T15:46:46.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.782+0000 7f729659c640 1 --2- 172.21.15.59:0/1151825995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72800039b0 0x7f7280003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.783+0000 7f253d7fa640 1 -- 172.21.15.59:0/2173272008 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2538019070 con 0x7f25400cade0 2024-04-25T15:46:46.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.783+0000 7f253d7fa640 1 -- 172.21.15.59:0/2173272008 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253800cc00 con 0x7f25400cade0 2024-04-25T15:46:46.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.783+0000 7f253d7fa640 1 -- 172.21.15.59:0/2173272008 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2538014440 con 0x7f25400cade0 2024-04-25T15:46:46.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.783+0000 7f254717a640 1 -- 172.21.15.59:0/2173272008 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25400b0130 con 0x7f25400cade0 2024-04-25T15:46:46.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.784+0000 7f254717a640 1 -- 172.21.15.59:0/2173272008 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25400b06f0 con 0x7f25400cade0 2024-04-25T15:46:46.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.785+0000 7f254717a640 1 -- 172.21.15.59:0/2173272008 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2540069fb0 con 0x7f25400cade0 2024-04-25T15:46:46.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.786+0000 7f729659c640 1 -- 172.21.15.59:0/1151825995 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72981607d0 msgr2=0x7f728000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.786+0000 7f729659c640 1 --2- 172.21.15.59:0/1151825995 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72981607d0 0x7f728000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.786+0000 7f729659c640 1 -- 172.21.15.59:0/1151825995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7280004800 msgr2=0x7f7280004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:46.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.786+0000 7f729659c640 1 --2- 172.21.15.59:0/1151825995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7280004800 0x7f7280004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.786+0000 7f729659c640 1 -- 172.21.15.59:0/1151825995 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7280003520 con 0x7f72800039b0 2024-04-25T15:46:46.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.799+0000 7fc815ffb640 1 -- 172.21.15.59:0/2941870246 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810033820 con 0x7fc820156a30 2024-04-25T15:46:46.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.799+0000 7fc815ffb640 1 -- 172.21.15.59:0/2941870246 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8100339e0 con 0x7fc820156a30 2024-04-25T15:46:46.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.799+0000 7fc827938640 1 -- 172.21.15.59:0/2941870246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82015a8e0 con 0x7fc820156a30 2024-04-25T15:46:46.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.799+0000 7fc815ffb640 1 -- 172.21.15.59:0/2941870246 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810033dd0 con 0x7fc820156a30 2024-04-25T15:46:46.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.799+0000 7fc827938640 1 -- 172.21.15.59:0/2941870246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc82014f560 con 0x7fc820156a30 2024-04-25T15:46:46.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.800+0000 7fc827938640 1 -- 172.21.15.59:0/2941870246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc82015a630 con 0x7fc820156a30 2024-04-25T15:46:46.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.830+0000 7f76ea7fc640 1 -- 172.21.15.59:0/2956529423 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f76f0004020 con 0x7f76f40c7b50 2024-04-25T15:46:46.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.830+0000 7f76ea7fc640 1 --2- 172.21.15.59:0/2956529423 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f76d80748b0 0x7f76d8076dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.831+0000 7f76f9631640 1 --2- 172.21.15.59:0/2956529423 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f76d80748b0 0x7f76d8076dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:46.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.831+0000 7f76f9631640 1 --2- 172.21.15.59:0/2956529423 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f76d80748b0 0x7f76d8076dc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f76e4037000 tx=0x7f76e4032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:46.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.851+0000 7f76ea7fc640 1 -- 172.21.15.59:0/2956529423 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f76f0011630 con 0x7f76f40c7b50 2024-04-25T15:46:46.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.851+0000 7f76ea7fc640 1 -- 172.21.15.59:0/2956529423 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f76f0020020 con 0x7f76f40c7b50 2024-04-25T15:46:46.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.855+0000 7f9b60b7a640 1 -- 172.21.15.59:0/2804908535 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b54036070 con 0x7f9b5c0cc710 2024-04-25T15:46:46.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.855+0000 7f9b60b7a640 1 -- 172.21.15.59:0/2804908535 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b54031600 con 0x7f9b5c0cc710 2024-04-25T15:46:46.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.855+0000 7f9b60b7a640 1 -- 172.21.15.59:0/2804908535 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b540319d0 con 0x7f9b5c0cc710 2024-04-25T15:46:46.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.856+0000 7f9b63de0640 1 -- 172.21.15.59:0/2804908535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b5c0cc710 msgr2=0x7f9b5c0cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:46.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.856+0000 7f9b63de0640 1 --2- 172.21.15.59:0/2804908535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b5c0cc710 0x7f9b5c0cabf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009e50 tx=0x7f9b5402a710 comp rx=0 tx=0).stop 2024-04-25T15:46:46.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.856+0000 7f9b63de0640 1 -- 172.21.15.59:0/2804908535 shutdown_connections 2024-04-25T15:46:46.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.856+0000 7f9b63de0640 1 --2- 172.21.15.59:0/2804908535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b5c0cc710 0x7f9b5c0cabf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:46.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.856+0000 7f9b63de0640 1 -- 172.21.15.59:0/2804908535 >> 172.21.15.59:0/2804908535 conn(0x7f9b5c06c760 msgr2=0x7f9b5c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:46.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.856+0000 7f9b63de0640 1 -- 172.21.15.59:0/2804908535 shutdown_connections 2024-04-25T15:46:46.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.856+0000 7f9b63de0640 1 -- 172.21.15.59:0/2804908535 wait complete. 2024-04-25T15:46:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.859+0000 7f9b63de0640 1 Processor -- start 2024-04-25T15:46:46.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.859+0000 7f9b63de0640 1 -- start start 2024-04-25T15:46:46.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.860+0000 7f9b63de0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0b51b0 0x7f9b5c06e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.860+0000 7f9b63de0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b5c0cc710 0x7f9b5c0c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.860+0000 7f9b63de0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9b5c154630 0x7f9b5c1499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:46.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.860+0000 7f9b63de0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5c154a40 con 0x7f9b5c0cc710 2024-04-25T15:46:46.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.860+0000 7f9b63de0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5c15e650 con 0x7f9b5c0b51b0 2024-04-25T15:46:46.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.860+0000 7f9b63de0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f9b5c0d0190 con 0x7f9b5c154630 2024-04-25T15:46:46.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.949+0000 7f19ddf3f640 1 -- 172.21.15.59:0/3570942167 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f19b8005850 con 0x7f19d80c8040 2024-04-25T15:46:46.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:46.960+0000 7fcaf1ad2640 1 -- 172.21.15.59:0/1791997925 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fcaec1e4360 con 0x7fcaec0c3ef0 2024-04-25T15:46:47.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.041+0000 7f76fc096640 1 -- 172.21.15.59:0/2956529423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f76f40c98b0 con 0x7f76f40c7b50 2024-04-25T15:46:47.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.098+0000 7f729659c640 1 --2- 172.21.15.59:0/1151825995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72800039b0 0x7f7280003e20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7288007f20 tx=0x7f7280005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16177851e55b1604 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:47.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.099+0000 7f253d7fa640 1 -- 172.21.15.59:0/2173272008 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f253801c070 con 0x7f25400cade0 2024-04-25T15:46:47.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.099+0000 7f253d7fa640 1 --2- 172.21.15.59:0/2173272008 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f252c074500 0x7f252c076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.099+0000 7f253ffff640 1 --2- 172.21.15.59:0/2173272008 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f252c074500 0x7f252c076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.099+0000 7f253d7fa640 1 -- 172.21.15.59:0/2173272008 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f253805b790 con 0x7f25400cade0 2024-04-25T15:46:47.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.100+0000 7f253ffff640 1 --2- 172.21.15.59:0/2173272008 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f252c074500 0x7f252c076a10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2534034000 tx=0x7f253402c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:47.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.113+0000 7f253d7fa640 1 -- 172.21.15.59:0/2173272008 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2538023020 con 0x7f25400cade0 2024-04-25T15:46:47.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.118+0000 7f9b61b7c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0b51b0 0x7f9b5c06e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.121+0000 7f31c37fe640 1 -- 172.21.15.59:0/1867224803 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f31cc043020 con 0x7f31dc0c8040 2024-04-25T15:46:47.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.121+0000 7f31c37fe640 1 --2- 172.21.15.59:0/1867224803 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f31c80744e0 0x7f31c80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.121+0000 7f31c37fe640 1 -- 172.21.15.59:0/1867224803 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f31cc0b5a40 con 0x7f31dc0c8040 2024-04-25T15:46:47.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.122+0000 7f31da7fc640 1 --2- 172.21.15.59:0/1867224803 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f31c80744e0 0x7f31c80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.122+0000 7f31da7fc640 1 --2- 172.21.15.59:0/1867224803 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f31c80744e0 0x7f31c80769f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f31d0000f60 tx=0x7f31d0007a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:47.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.127+0000 7f729559a640 1 -- 172.21.15.59:0/1151825995 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288036070 con 0x7f72800039b0 2024-04-25T15:46:47.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.127+0000 7f729559a640 1 -- 172.21.15.59:0/1151825995 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7288031600 con 0x7f72800039b0 2024-04-25T15:46:47.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.127+0000 7f729559a640 1 -- 172.21.15.59:0/1151825995 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288007b70 con 0x7f72800039b0 2024-04-25T15:46:47.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.127+0000 7f9b61b7c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0b51b0 0x7f9b5c06e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:53638/0 (socket says 172.21.15.59:53638) 2024-04-25T15:46:47.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.127+0000 7f9b61b7c640 1 -- 172.21.15.59:0/2109245136 learned_addr learned my addr 172.21.15.59:0/2109245136 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:47.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.128+0000 7f729cb1f640 1 -- 172.21.15.59:0/1151825995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72800039b0 msgr2=0x7f7280003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.128+0000 7f729cb1f640 1 --2- 172.21.15.59:0/1151825995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72800039b0 0x7f7280003e20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7288007f20 tx=0x7f7280005830 comp rx=0 tx=0).stop 2024-04-25T15:46:47.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.128+0000 7f7296d9d640 1 -- 172.21.15.59:0/1151825995 reap_dead start 2024-04-25T15:46:47.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.128+0000 7f729cb1f640 1 -- 172.21.15.59:0/1151825995 shutdown_connections 2024-04-25T15:46:47.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.128+0000 7f729cb1f640 1 -- 172.21.15.59:0/1151825995 >> 172.21.15.59:0/1151825995 conn(0x7f729806c9a0 msgr2=0x7f729806cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:47.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.128+0000 7f729cb1f640 1 -- 172.21.15.59:0/1151825995 shutdown_connections 2024-04-25T15:46:47.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.128+0000 7f729cb1f640 1 -- 172.21.15.59:0/1151825995 wait complete. 2024-04-25T15:46:47.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.130+0000 7f729cb1f640 1 Processor -- start 2024-04-25T15:46:47.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.130+0000 7f729cb1f640 1 -- start start 2024-04-25T15:46:47.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.131+0000 7f9b61b7c640 1 -- 172.21.15.59:0/2109245136 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9b5c154630 msgr2=0x7f9b5c1499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.131+0000 7f9b61b7c640 1 --2- 172.21.15.59:0/2109245136 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9b5c154630 0x7f9b5c1499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.131+0000 7f9b61b7c640 1 -- 172.21.15.59:0/2109245136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b5c0cc710 msgr2=0x7f9b5c0c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.131+0000 7f9b61b7c640 1 --2- 172.21.15.59:0/2109245136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b5c0cc710 0x7f9b5c0c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.131+0000 7f9b61b7c640 1 -- 172.21.15.59:0/2109245136 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b5c06e8c0 con 0x7f9b5c0b51b0 2024-04-25T15:46:47.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.132+0000 7f729cb1f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72800039b0 0x7f72981f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.132+0000 7f729cb1f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7298159bc0 0x7f72980c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.132+0000 7f729cb1f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7298159700 0x7f7298140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.132+0000 7f729cb1f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f729806fdf0 con 0x7f7298159700 2024-04-25T15:46:47.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.132+0000 7f729cb1f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f729806fb10 con 0x7f72800039b0 2024-04-25T15:46:47.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.132+0000 7f729cb1f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f7298145ac0 con 0x7f7298159bc0 2024-04-25T15:46:47.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.136+0000 7f9b61b7c640 1 --2- 172.21.15.59:0/2109245136 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0b51b0 0x7f9b5c06e380 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9b5800b3e0 tx=0x7f9b5800b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:47.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.136+0000 7f729659c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72800039b0 0x7f72981f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.137+0000 7f729659c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72800039b0 0x7f72981f2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:53646/0 (socket says 172.21.15.59:53646) 2024-04-25T15:46:47.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.137+0000 7f729659c640 1 -- 172.21.15.59:0/1161290239 learned_addr learned my addr 172.21.15.59:0/1161290239 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:47.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.137+0000 7f31c37fe640 1 -- 172.21.15.59:0/1867224803 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f31dc074230 con 0x7f31dc0c8040 2024-04-25T15:46:47.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.141+0000 7f19bffff640 1 -- 172.21.15.59:0/3570942167 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f19c807fef0 con 0x7f19d80c8040 2024-04-25T15:46:47.141 INFO:teuthology.orchestra.run.smithi059.stdout:60129542152 2024-04-25T15:46:47.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.142+0000 7f9b527fc640 1 -- 172.21.15.59:0/2109245136 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b58015020 con 0x7f9b5c0b51b0 2024-04-25T15:46:47.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.142+0000 7f9b527fc640 1 -- 172.21.15.59:0/2109245136 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b58011850 con 0x7f9b5c0b51b0 2024-04-25T15:46:47.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.142+0000 7f9b63de0640 1 -- 172.21.15.59:0/2109245136 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b5c06da10 con 0x7f9b5c0b51b0 2024-04-25T15:46:47.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.142+0000 7f9b527fc640 1 -- 172.21.15.59:0/2109245136 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b58011c40 con 0x7f9b5c0b51b0 2024-04-25T15:46:47.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.143+0000 7f9b63de0640 1 -- 172.21.15.59:0/2109245136 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b5c1579b0 con 0x7f9b5c0b51b0 2024-04-25T15:46:47.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.143+0000 7f19ddf3f640 1 -- 172.21.15.59:0/3570942167 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f19c40746b0 msgr2=0x7f19c4076bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.143+0000 7f19ddf3f640 1 --2- 172.21.15.59:0/3570942167 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f19c40746b0 0x7f19c4076bc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19d0001ea0 tx=0x7f19d0009040 comp rx=0 tx=0).stop 2024-04-25T15:46:47.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.143+0000 7f19ddf3f640 1 -- 172.21.15.59:0/3570942167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19d80c8040 msgr2=0x7f19d80cc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.143+0000 7f19ddf3f640 1 --2- 172.21.15.59:0/3570942167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19d80c8040 0x7f19d80cc7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f19c8031000 tx=0x7f19c80046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.144+0000 7f19ddf3f640 1 -- 172.21.15.59:0/3570942167 shutdown_connections 2024-04-25T15:46:47.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.144+0000 7f19ddf3f640 1 --2- 172.21.15.59:0/3570942167 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f19c40746b0 0x7f19c4076bc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.144+0000 7f19ddf3f640 1 --2- 172.21.15.59:0/3570942167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19d81586b0 0x7f19d814a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.144+0000 7f19ddf3f640 1 --2- 172.21.15.59:0/3570942167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19d80c8040 0x7f19d80cc7a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.144+0000 7f19ddf3f640 1 --2- 172.21.15.59:0/3570942167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f19d80705d0 0x7f19d814ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.144+0000 7f19ddf3f640 1 -- 172.21.15.59:0/3570942167 >> 172.21.15.59:0/3570942167 conn(0x7f19d8071320 msgr2=0x7f19d8071730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:47.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.144+0000 7f19ddf3f640 1 -- 172.21.15.59:0/3570942167 shutdown_connections 2024-04-25T15:46:47.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.144+0000 7f19ddf3f640 1 -- 172.21.15.59:0/3570942167 wait complete. 2024-04-25T15:46:47.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.145+0000 7f9b63de0640 1 -- 172.21.15.59:0/2109245136 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b5c069fb0 con 0x7f9b5c0b51b0 2024-04-25T15:46:47.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.147+0000 7f729659c640 1 -- 172.21.15.59:0/1161290239 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7298159bc0 msgr2=0x7f72980c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.147+0000 7f729659c640 1 --2- 172.21.15.59:0/1161290239 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7298159bc0 0x7f72980c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.147+0000 7f729659c640 1 -- 172.21.15.59:0/1161290239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7298159700 msgr2=0x7f7298140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.147+0000 7f729659c640 1 --2- 172.21.15.59:0/1161290239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7298159700 0x7f7298140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.147+0000 7f729659c640 1 -- 172.21.15.59:0/1161290239 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72981f3020 con 0x7f72800039b0 2024-04-25T15:46:47.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.158+0000 7fcae97fa640 1 -- 172.21.15.59:0/1791997925 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcad8083be0 con 0x7fcaec0c3ef0 2024-04-25T15:46:47.159 INFO:teuthology.orchestra.run.smithi059.stdout:64424509448 2024-04-25T15:46:47.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.159+0000 7f729659c640 1 --2- 172.21.15.59:0/1161290239 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72800039b0 0x7f72981f2ae0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f728802ac40 tx=0x7f729815c5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:47.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.3 2024-04-25T15:46:47.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.161+0000 7fcaf1ad2640 1 -- 172.21.15.59:0/1791997925 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fcad0074530 msgr2=0x7fcad0076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.161+0000 7fcaf1ad2640 1 --2- 172.21.15.59:0/1791997925 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fcad0074530 0x7fcad0076a40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcaec0b3be0 tx=0x7fcae0008040 comp rx=0 tx=0).stop 2024-04-25T15:46:47.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.161+0000 7fcaf1ad2640 1 -- 172.21.15.59:0/1791997925 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcaec0c3ef0 msgr2=0x7fcaec1e2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.161+0000 7fcaf1ad2640 1 --2- 172.21.15.59:0/1791997925 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcaec0c3ef0 0x7fcaec1e2740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcad8009990 tx=0x7fcad80046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.161+0000 7fcaf1ad2640 1 -- 172.21.15.59:0/1791997925 shutdown_connections 2024-04-25T15:46:47.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.161+0000 7fcaf1ad2640 1 --2- 172.21.15.59:0/1791997925 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fcad0074530 0x7fcad0076a40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.161+0000 7fcaf1ad2640 1 --2- 172.21.15.59:0/1791997925 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcaec142340 0x7fcaec0cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.161+0000 7fcaf1ad2640 1 --2- 172.21.15.59:0/1791997925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaec0ce460 0x7fcaec1e3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.161+0000 7fcaf1ad2640 1 --2- 172.21.15.59:0/1791997925 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcaec0c3ef0 0x7fcaec1e2740 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.161+0000 7fcaf1ad2640 1 -- 172.21.15.59:0/1791997925 >> 172.21.15.59:0/1791997925 conn(0x7fcaec074880 msgr2=0x7fcaec13cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:47.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.162+0000 7fcaf1ad2640 1 -- 172.21.15.59:0/1791997925 shutdown_connections 2024-04-25T15:46:47.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.162+0000 7fcaf1ad2640 1 -- 172.21.15.59:0/1791997925 wait complete. 2024-04-25T15:46:47.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.4 2024-04-25T15:46:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.195+0000 7fc815ffb640 1 -- 172.21.15.59:0/2941870246 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc81004d060 con 0x7fc820156a30 2024-04-25T15:46:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.196+0000 7fc815ffb640 1 --2- 172.21.15.59:0/2941870246 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc8040744b0 0x7fc8040769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.196+0000 7fc8256d4640 1 --2- 172.21.15.59:0/2941870246 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc8040744b0 0x7fc8040769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.197+0000 7fc8256d4640 1 --2- 172.21.15.59:0/2941870246 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc8040744b0 0x7fc8040769c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009670 tx=0x7fc81c006bf0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:47.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.213+0000 7fc815ffb640 1 -- 172.21.15.59:0/2941870246 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc81007e7e0 con 0x7fc820156a30 2024-04-25T15:46:47.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.213+0000 7fc815ffb640 1 -- 172.21.15.59:0/2941870246 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc810041070 con 0x7fc820156a30 2024-04-25T15:46:47.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.213+0000 7f76ea7fc640 1 -- 172.21.15.59:0/2956529423 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f76f005f4f0 con 0x7f76f40c7b50 2024-04-25T15:46:47.214 INFO:teuthology.orchestra.run.smithi059.stdout:64424509448 2024-04-25T15:46:47.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.216+0000 7f76fc096640 1 -- 172.21.15.59:0/2956529423 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f76d80748b0 msgr2=0x7f76d8076dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.216+0000 7f76fc096640 1 --2- 172.21.15.59:0/2956529423 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f76d80748b0 0x7f76d8076dc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f76e4037000 tx=0x7f76e4032000 comp rx=0 tx=0).stop 2024-04-25T15:46:47.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.216+0000 7f76fc096640 1 -- 172.21.15.59:0/2956529423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76f40c7b50 msgr2=0x7f76f4157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.216+0000 7f76fc096640 1 --2- 172.21.15.59:0/2956529423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76f40c7b50 0x7f76f4157520 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f76f000b420 tx=0x7f76f000b8e0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.216+0000 7f76fc096640 1 -- 172.21.15.59:0/2956529423 shutdown_connections 2024-04-25T15:46:47.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.216+0000 7f76fc096640 1 --2- 172.21.15.59:0/2956529423 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f76d80748b0 0x7f76d8076dc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.216+0000 7f76fc096640 1 --2- 172.21.15.59:0/2956529423 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f76f415cc20 0x7f76f41edcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.216+0000 7f76fc096640 1 --2- 172.21.15.59:0/2956529423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76f4152bc0 0x7f76f414c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.216+0000 7f76fc096640 1 --2- 172.21.15.59:0/2956529423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76f40c7b50 0x7f76f4157520 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.216+0000 7f76fc096640 1 -- 172.21.15.59:0/2956529423 >> 172.21.15.59:0/2956529423 conn(0x7f76f40cdfb0 msgr2=0x7f76f4150c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:47.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.216+0000 7f76fc096640 1 -- 172.21.15.59:0/2956529423 shutdown_connections 2024-04-25T15:46:47.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.216+0000 7f76fc096640 1 -- 172.21.15.59:0/2956529423 wait complete. 2024-04-25T15:46:47.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.7 2024-04-25T15:46:47.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.338+0000 7f31e17f3640 1 -- 172.21.15.59:0/1867224803 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f31dc15aff0 con 0x7f31dc0c8040 2024-04-25T15:46:47.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.340+0000 7f254717a640 1 -- 172.21.15.59:0/2173272008 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f25400b46b0 con 0x7f25400cade0 2024-04-25T15:46:47.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.342+0000 7f31c37fe640 1 -- 172.21.15.59:0/1867224803 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f31cc04a030 con 0x7f31dc0c8040 2024-04-25T15:46:47.343 INFO:teuthology.orchestra.run.smithi059.stdout:64424509450 2024-04-25T15:46:47.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.345+0000 7f31e17f3640 1 -- 172.21.15.59:0/1867224803 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f31c80744e0 msgr2=0x7f31c80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.345+0000 7f31e17f3640 1 --2- 172.21.15.59:0/1867224803 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f31c80744e0 0x7f31c80769f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f31d0000f60 tx=0x7f31d0007a80 comp rx=0 tx=0).stop 2024-04-25T15:46:47.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.345+0000 7f31e17f3640 1 -- 172.21.15.59:0/1867224803 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f31dc0c8040 msgr2=0x7f31dc1f2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.345+0000 7f31e17f3640 1 --2- 172.21.15.59:0/1867224803 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f31dc0c8040 0x7f31dc1f2af0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0ce400 tx=0x7f31cc0046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.346+0000 7f31e17f3640 1 -- 172.21.15.59:0/1867224803 shutdown_connections 2024-04-25T15:46:47.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.346+0000 7f31e17f3640 1 --2- 172.21.15.59:0/1867224803 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f31c80744e0 0x7f31c80769f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.346+0000 7f31e17f3640 1 --2- 172.21.15.59:0/1867224803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31dc1586b0 0x7f31dc149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.346+0000 7f31e17f3640 1 --2- 172.21.15.59:0/1867224803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f31dc0cd640 0x7f31dc15a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.346+0000 7f31e17f3640 1 --2- 172.21.15.59:0/1867224803 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f31dc0c8040 0x7f31dc1f2af0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.346+0000 7f31e17f3640 1 -- 172.21.15.59:0/1867224803 >> 172.21.15.59:0/1867224803 conn(0x7f31dc071320 msgr2=0x7f31dc0703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:47.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.346+0000 7f31e17f3640 1 -- 172.21.15.59:0/1867224803 shutdown_connections 2024-04-25T15:46:47.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.346+0000 7f31e17f3640 1 -- 172.21.15.59:0/1867224803 wait complete. 2024-04-25T15:46:47.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.1 2024-04-25T15:46:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.435+0000 7fc827938640 1 -- 172.21.15.59:0/2941870246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc820069fb0 con 0x7fc820156a30 2024-04-25T15:46:47.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.440+0000 7fc815ffb640 1 -- 172.21.15.59:0/2941870246 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc810030050 con 0x7fc820156a30 2024-04-25T15:46:47.441 INFO:teuthology.orchestra.run.smithi059.stdout:64424509448 2024-04-25T15:46:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.442+0000 7fc827938640 1 -- 172.21.15.59:0/2941870246 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc8040744b0 msgr2=0x7fc8040769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.442+0000 7fc827938640 1 --2- 172.21.15.59:0/2941870246 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc8040744b0 0x7fc8040769c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009670 tx=0x7fc81c006bf0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.442+0000 7fc827938640 1 -- 172.21.15.59:0/2941870246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc820156a30 msgr2=0x7fc8201589b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.442+0000 7fc827938640 1 --2- 172.21.15.59:0/2941870246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc820156a30 0x7fc8201589b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc810000c00 tx=0x7fc8100046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.442+0000 7fc827938640 1 -- 172.21.15.59:0/2941870246 shutdown_connections 2024-04-25T15:46:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.442+0000 7fc827938640 1 --2- 172.21.15.59:0/2941870246 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc8040744b0 0x7fc8040769c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.442+0000 7fc827938640 1 --2- 172.21.15.59:0/2941870246 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc820159d10 0x7fc8200cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.442+0000 7fc827938640 1 --2- 172.21.15.59:0/2941870246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc820156a30 0x7fc8201589b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.442+0000 7fc827938640 1 --2- 172.21.15.59:0/2941870246 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8200cade0 0x7fc82014fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.442+0000 7fc827938640 1 -- 172.21.15.59:0/2941870246 >> 172.21.15.59:0/2941870246 conn(0x7fc820072170 msgr2=0x7fc820153ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:47.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.442+0000 7fc827938640 1 -- 172.21.15.59:0/2941870246 shutdown_connections 2024-04-25T15:46:47.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.442+0000 7fc827938640 1 -- 172.21.15.59:0/2941870246 wait complete. 2024-04-25T15:46:47.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.6 2024-04-25T15:46:47.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.455+0000 7f9b527fc640 1 -- 172.21.15.59:0/2109245136 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9b58018020 con 0x7f9b5c0b51b0 2024-04-25T15:46:47.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.455+0000 7f9b527fc640 1 --2- 172.21.15.59:0/2109245136 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f9b400744b0 0x7f9b400769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.456+0000 7f9b6137b640 1 --2- 172.21.15.59:0/2109245136 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f9b400744b0 0x7f9b400769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.456+0000 7f9b6137b640 1 --2- 172.21.15.59:0/2109245136 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f9b400744b0 0x7f9b400769c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c152170 tx=0x7f9b4c006ba0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:47.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.463+0000 7f9b527fc640 1 -- 172.21.15.59:0/2109245136 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9b58011de0 con 0x7f9b5c0b51b0 2024-04-25T15:46:47.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.479+0000 7f9b527fc640 1 -- 172.21.15.59:0/2109245136 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9b5801f020 con 0x7f9b5c0b51b0 2024-04-25T15:46:47.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.485+0000 7f7286ffd640 1 -- 172.21.15.59:0/1161290239 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288036040 con 0x7f72800039b0 2024-04-25T15:46:47.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.485+0000 7f729cb1f640 1 -- 172.21.15.59:0/1161290239 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7298142910 con 0x7f72800039b0 2024-04-25T15:46:47.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.485+0000 7f729cb1f640 1 -- 172.21.15.59:0/1161290239 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7298142e90 con 0x7f72800039b0 2024-04-25T15:46:47.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.486+0000 7f729cb1f640 1 -- 172.21.15.59:0/1161290239 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7298070cd0 con 0x7f72800039b0 2024-04-25T15:46:47.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.675+0000 7f9b63de0640 1 -- 172.21.15.59:0/2109245136 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9b5c0ca6a0 con 0x7f9b5c0b51b0 2024-04-25T15:46:47.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.846+0000 7f253d7fa640 1 -- 172.21.15.59:0/2173272008 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f253805fc00 con 0x7f25400cade0 2024-04-25T15:46:47.847 INFO:teuthology.orchestra.run.smithi059.stdout:64424509450 2024-04-25T15:46:47.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.848+0000 7f254717a640 1 -- 172.21.15.59:0/2173272008 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f252c074500 msgr2=0x7f252c076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.848+0000 7f254717a640 1 --2- 172.21.15.59:0/2173272008 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f252c074500 0x7f252c076a10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2534034000 tx=0x7f253402c000 comp rx=0 tx=0).stop 2024-04-25T15:46:47.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.848+0000 7f254717a640 1 -- 172.21.15.59:0/2173272008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25400cade0 msgr2=0x7f25401f2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.848+0000 7f254717a640 1 --2- 172.21.15.59:0/2173272008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25400cade0 0x7f25401f2920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f253800ba50 tx=0x7f253800bf10 comp rx=0 tx=0).stop 2024-04-25T15:46:47.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.848+0000 7f254717a640 1 -- 172.21.15.59:0/2173272008 shutdown_connections 2024-04-25T15:46:47.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.848+0000 7f254717a640 1 --2- 172.21.15.59:0/2173272008 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f252c074500 0x7f252c076a10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.848+0000 7f254717a640 1 --2- 172.21.15.59:0/2173272008 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2540159d10 0x7f2540152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.848+0000 7f254717a640 1 --2- 172.21.15.59:0/2173272008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2540156a30 0x7f254014d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.848+0000 7f254717a640 1 --2- 172.21.15.59:0/2173272008 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25400cade0 0x7f25401f2920 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.848+0000 7f254717a640 1 -- 172.21.15.59:0/2173272008 >> 172.21.15.59:0/2173272008 conn(0x7f2540072170 msgr2=0x7f2540154e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:47.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.848+0000 7f254717a640 1 -- 172.21.15.59:0/2173272008 shutdown_connections 2024-04-25T15:46:47.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.848+0000 7f254717a640 1 -- 172.21.15.59:0/2173272008 wait complete. 2024-04-25T15:46:47.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.5 2024-04-25T15:46:47.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.865+0000 7f7286ffd640 1 -- 172.21.15.59:0/1161290239 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7288031600 con 0x7f72800039b0 2024-04-25T15:46:47.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.865+0000 7f7286ffd640 1 -- 172.21.15.59:0/1161290239 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288005290 con 0x7f72800039b0 2024-04-25T15:46:47.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.869+0000 7f7286ffd640 1 -- 172.21.15.59:0/1161290239 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f72880035f0 con 0x7f72800039b0 2024-04-25T15:46:47.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.870+0000 7f7286ffd640 1 --2- 172.21.15.59:0/1161290239 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f72780744b0 0x7f72780769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:47.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.870+0000 7f7295d9b640 1 --2- 172.21.15.59:0/1161290239 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f72780744b0 0x7f72780769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:47.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.871+0000 7f7295d9b640 1 --2- 172.21.15.59:0/1161290239 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f72780744b0 0x7f72780769c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7298145370 tx=0x7f728c007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:47.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.876+0000 7f7286ffd640 1 -- 172.21.15.59:0/1161290239 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7288005430 con 0x7f72800039b0 2024-04-25T15:46:47.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.887+0000 7f7286ffd640 1 -- 172.21.15.59:0/1161290239 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7298070cd0 con 0x7f72800039b0 2024-04-25T15:46:47.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.909+0000 7f9b527fc640 1 -- 172.21.15.59:0/2109245136 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9b5805ff80 con 0x7f9b5c0b51b0 2024-04-25T15:46:47.910 INFO:teuthology.orchestra.run.smithi059.stdout:60129542153 2024-04-25T15:46:47.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.911+0000 7f9b63de0640 1 -- 172.21.15.59:0/2109245136 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f9b400744b0 msgr2=0x7f9b400769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.911+0000 7f9b63de0640 1 --2- 172.21.15.59:0/2109245136 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f9b400744b0 0x7f9b400769c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c152170 tx=0x7f9b4c006ba0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.911+0000 7f9b63de0640 1 -- 172.21.15.59:0/2109245136 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0b51b0 msgr2=0x7f9b5c06e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:47.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.911+0000 7f9b63de0640 1 --2- 172.21.15.59:0/2109245136 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0b51b0 0x7f9b5c06e380 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9b5800b3e0 tx=0x7f9b5800b8a0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.911+0000 7f9b63de0640 1 -- 172.21.15.59:0/2109245136 shutdown_connections 2024-04-25T15:46:47.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.911+0000 7f9b63de0640 1 --2- 172.21.15.59:0/2109245136 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f9b400744b0 0x7f9b400769c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.911+0000 7f9b63de0640 1 --2- 172.21.15.59:0/2109245136 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9b5c154630 0x7f9b5c1499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.911+0000 7f9b63de0640 1 --2- 172.21.15.59:0/2109245136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b5c0cc710 0x7f9b5c0c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.911+0000 7f9b63de0640 1 --2- 172.21.15.59:0/2109245136 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9b5c0b51b0 0x7f9b5c06e380 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:47.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.911+0000 7f9b63de0640 1 -- 172.21.15.59:0/2109245136 >> 172.21.15.59:0/2109245136 conn(0x7f9b5c06c760 msgr2=0x7f9b5c153760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:47.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.911+0000 7f9b63de0640 1 -- 172.21.15.59:0/2109245136 shutdown_connections 2024-04-25T15:46:47.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:47.911+0000 7f9b63de0640 1 -- 172.21.15.59:0/2109245136 wait complete. 2024-04-25T15:46:47.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.0 2024-04-25T15:46:48.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.074+0000 7f729cb1f640 1 -- 172.21.15.59:0/1161290239 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7298068650 con 0x7f72800039b0 2024-04-25T15:46:48.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.079+0000 7f7286ffd640 1 -- 172.21.15.59:0/1161290239 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7298068650 con 0x7f72800039b0 2024-04-25T15:46:48.079 INFO:teuthology.orchestra.run.smithi059.stdout:64424509450 2024-04-25T15:46:48.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.081+0000 7f729cb1f640 1 -- 172.21.15.59:0/1161290239 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f72780744b0 msgr2=0x7f72780769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.081+0000 7f729cb1f640 1 --2- 172.21.15.59:0/1161290239 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f72780744b0 0x7f72780769c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7298145370 tx=0x7f728c007a40 comp rx=0 tx=0).stop 2024-04-25T15:46:48.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.081+0000 7f729cb1f640 1 -- 172.21.15.59:0/1161290239 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72800039b0 msgr2=0x7f72981f2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.081+0000 7f729cb1f640 1 --2- 172.21.15.59:0/1161290239 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72800039b0 0x7f72981f2ae0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f728802ac40 tx=0x7f729815c5b0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.081+0000 7f729cb1f640 1 -- 172.21.15.59:0/1161290239 shutdown_connections 2024-04-25T15:46:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.081+0000 7f729cb1f640 1 --2- 172.21.15.59:0/1161290239 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f72780744b0 0x7f72780769c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.081+0000 7f729cb1f640 1 --2- 172.21.15.59:0/1161290239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7298159700 0x7f7298140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.081+0000 7f729cb1f640 1 --2- 172.21.15.59:0/1161290239 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7298159bc0 0x7f72980c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.081+0000 7f729cb1f640 1 --2- 172.21.15.59:0/1161290239 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72800039b0 0x7f72981f2ae0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.081+0000 7f729cb1f640 1 -- 172.21.15.59:0/1161290239 >> 172.21.15.59:0/1161290239 conn(0x7f729806c9a0 msgr2=0x7f729806cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.081+0000 7f729cb1f640 1 -- 172.21.15.59:0/1161290239 shutdown_connections 2024-04-25T15:46:48.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.081+0000 7f729cb1f640 1 -- 172.21.15.59:0/1161290239 wait complete. 2024-04-25T15:46:48.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.2 2024-04-25T15:46:48.093 DEBUG:teuthology.parallel:result is None 2024-04-25T15:46:48.161 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T15:46:48.179 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T15:46:48.229 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T15:46:48.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.277+0000 7f54f8384640 1 Processor -- start 2024-04-25T15:46:48.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.277+0000 7f54f8384640 1 -- start start 2024-04-25T15:46:48.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.279+0000 7f54f8384640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54f00cac90 0x7f54f0156a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.279+0000 7f54f8384640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54f015d0e0 0x7f54f00cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.279+0000 7f54f8384640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54f00cbed0 con 0x7f54f00c2da0 2024-04-25T15:46:48.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.279+0000 7f54f8384640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f54f00ccf50 con 0x7f54f00cac90 2024-04-25T15:46:48.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.279+0000 7f54f8384640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f54f00cb140 con 0x7f54f015d0e0 2024-04-25T15:46:48.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.317+0000 7f54f6921640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54f015d0e0 0x7f54f00cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.318+0000 7f54f6921640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54f015d0e0 0x7f54f00cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53492/0 (socket says 172.21.15.59:53492) 2024-04-25T15:46:48.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.318+0000 7f54f6921640 1 -- 172.21.15.59:0/2503543073 learned_addr learned my addr 172.21.15.59:0/2503543073 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:48.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.319+0000 7f54f6120640 1 --2- 172.21.15.59:0/2503543073 >> v2:172.21.15.59:3300/0 conn(0x7f54f00cac90 0x7f54f0156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.322+0000 7f54f6921640 1 -- 172.21.15.59:0/2503543073 >> v2:172.21.15.59:3300/0 conn(0x7f54f00cac90 msgr2=0x7f54f0156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:48.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.322+0000 7f54f6921640 1 --2- 172.21.15.59:0/2503543073 >> v2:172.21.15.59:3300/0 conn(0x7f54f00cac90 0x7f54f0156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.322+0000 7f54f6921640 1 -- 172.21.15.59:0/2503543073 >> v1:172.21.15.59:6789/0 conn(0x7f54f00c2da0 legacy=0x7f54f00c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:48.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.322+0000 7f54f6921640 1 -- 172.21.15.59:0/2503543073 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f00cc190 con 0x7f54f015d0e0 2024-04-25T15:46:48.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.322+0000 7fea9561a640 1 Processor -- start 2024-04-25T15:46:48.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.322+0000 7fea9561a640 1 -- start start 2024-04-25T15:46:48.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.324+0000 7fea9561a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea900c9200 0x7fea900c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.324+0000 7fea9561a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fea9015cef0 0x7fea90156700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.324+0000 7fea9561a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea900c38e0 con 0x7fea900ca150 2024-04-25T15:46:48.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.324+0000 7fea9561a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fea90156c40 con 0x7fea9015cef0 2024-04-25T15:46:48.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.324+0000 7fea9561a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fea900c3bc0 con 0x7fea900c9200 2024-04-25T15:46:48.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.325+0000 7f54f6921640 1 --2- 172.21.15.59:0/2503543073 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54f015d0e0 0x7f54f00cf9f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f54e8009e50 tx=0x7f54e802a750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=572173624db821f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.328+0000 7fea8f7fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fea9015cef0 0x7fea90156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.329+0000 7fea8effd640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fea900ca150 0x7fea90160400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.59:46940/0 (socket says 172.21.15.59:46940) 2024-04-25T15:46:48.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.329+0000 7fea8effd640 1 -- 172.21.15.59:0/329756684 learned_addr learned my addr 172.21.15.59:0/329756684 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:48.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.329+0000 7fea8e7fc640 1 --2- 172.21.15.59:0/329756684 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea900c9200 0x7fea900c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.333+0000 7f54f511e640 1 -- 172.21.15.59:0/2503543073 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e8036070 con 0x7f54f015d0e0 2024-04-25T15:46:48.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.333+0000 7f54f511e640 1 -- 172.21.15.59:0/2503543073 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e8031600 con 0x7f54f015d0e0 2024-04-25T15:46:48.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.333+0000 7f54f511e640 1 -- 172.21.15.59:0/2503543073 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e80319d0 con 0x7f54f015d0e0 2024-04-25T15:46:48.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.333+0000 7fea8f7fe640 1 -- 172.21.15.59:0/329756684 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea900c9200 msgr2=0x7fea900c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:48.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.333+0000 7fea8f7fe640 1 --2- 172.21.15.59:0/329756684 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea900c9200 0x7fea900c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.333+0000 7fea8f7fe640 1 -- 172.21.15.59:0/329756684 >> v1:172.21.15.64:6789/0 conn(0x7fea900ca150 legacy=0x7fea90160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.333+0000 7fea8f7fe640 1 -- 172.21.15.59:0/329756684 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea900c3ea0 con 0x7fea9015cef0 2024-04-25T15:46:48.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.334+0000 7f54f8384640 1 -- 172.21.15.59:0/2503543073 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54f015d0e0 msgr2=0x7f54f00cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.334+0000 7f54f8384640 1 --2- 172.21.15.59:0/2503543073 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54f015d0e0 0x7f54f00cf9f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f54e8009e50 tx=0x7f54e802a750 comp rx=0 tx=0).stop 2024-04-25T15:46:48.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.334+0000 7f54f8384640 1 -- 172.21.15.59:0/2503543073 shutdown_connections 2024-04-25T15:46:48.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.334+0000 7f54f8384640 1 --2- 172.21.15.59:0/2503543073 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54f015d0e0 0x7f54f00cf9f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.334+0000 7f54f8384640 1 --2- 172.21.15.59:0/2503543073 >> v2:172.21.15.59:3300/0 conn(0x7f54f00cac90 0x7f54f0156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.334+0000 7f54f8384640 1 -- 172.21.15.59:0/2503543073 >> 172.21.15.59:0/2503543073 conn(0x7f54f006c760 msgr2=0x7f54f006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:48.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.334+0000 7f54f8384640 1 -- 172.21.15.59:0/2503543073 shutdown_connections 2024-04-25T15:46:48.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.334+0000 7f54f8384640 1 -- 172.21.15.59:0/2503543073 wait complete. 2024-04-25T15:46:48.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.336+0000 7f54f8384640 1 Processor -- start 2024-04-25T15:46:48.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.336+0000 7f54f8384640 1 -- start start 2024-04-25T15:46:48.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.337+0000 7f54f8384640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54f00c2da0 0x7f54f014ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.337+0000 7f54f8384640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54f00cac90 0x7f54f00cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.337+0000 7f54f8384640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54f015d0e0 0x7f54f014c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.337+0000 7f54f8384640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f54f00cca30 con 0x7f54f00cac90 2024-04-25T15:46:48.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.337+0000 7f54f8384640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f54f00cc750 con 0x7f54f015d0e0 2024-04-25T15:46:48.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.337+0000 7f54f8384640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f54f00c86e0 con 0x7f54f00c2da0 2024-04-25T15:46:48.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.337+0000 7f54f6120640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54f00c2da0 0x7f54f014ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.338+0000 7f54f6120640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54f00c2da0 0x7f54f014ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53514/0 (socket says 172.21.15.59:53514) 2024-04-25T15:46:48.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.338+0000 7f54f6120640 1 -- 172.21.15.59:0/3800351691 learned_addr learned my addr 172.21.15.59:0/3800351691 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:48.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.338+0000 7fea8f7fe640 1 --2- 172.21.15.59:0/329756684 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea9015cef0 0x7fea90156700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fea88009d90 tx=0x7fea8802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aab800de81a4d81f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.339+0000 7f54f6921640 1 --2- 172.21.15.59:0/3800351691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54f015d0e0 0x7f54f014c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.342+0000 7f54f6120640 1 -- 172.21.15.59:0/3800351691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54f015d0e0 msgr2=0x7f54f014c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.342+0000 7f54f6120640 1 --2- 172.21.15.59:0/3800351691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54f015d0e0 0x7f54f014c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.342+0000 7f54f6120640 1 -- 172.21.15.59:0/3800351691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54f00cac90 msgr2=0x7f54f00cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.342+0000 7f54f6120640 1 --2- 172.21.15.59:0/3800351691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54f00cac90 0x7f54f00cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.342+0000 7f54f6120640 1 -- 172.21.15.59:0/3800351691 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f01504d0 con 0x7f54f00c2da0 2024-04-25T15:46:48.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.343+0000 7fea8dffb640 1 -- 172.21.15.59:0/329756684 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea88007740 con 0x7fea9015cef0 2024-04-25T15:46:48.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.343+0000 7fea8dffb640 1 -- 172.21.15.59:0/329756684 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea880078e0 con 0x7fea9015cef0 2024-04-25T15:46:48.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.343+0000 7fea8dffb640 1 -- 172.21.15.59:0/329756684 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea88007cb0 con 0x7fea9015cef0 2024-04-25T15:46:48.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.344+0000 7fea9561a640 1 -- 172.21.15.59:0/329756684 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea9015cef0 msgr2=0x7fea90156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.344+0000 7fea9561a640 1 --2- 172.21.15.59:0/329756684 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea9015cef0 0x7fea90156700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fea88009d90 tx=0x7fea8802a6f0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.344+0000 7f54f6120640 1 --2- 172.21.15.59:0/3800351691 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54f00c2da0 0x7f54f014ff90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00e870 tx=0x7f54ec00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.344+0000 7fea9561a640 1 -- 172.21.15.59:0/329756684 shutdown_connections 2024-04-25T15:46:48.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.344+0000 7fea9561a640 1 --2- 172.21.15.59:0/329756684 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea9015cef0 0x7fea90156700 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.344+0000 7fea9561a640 1 --2- 172.21.15.59:0/329756684 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea900c9200 0x7fea900c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.344+0000 7fea9561a640 1 -- 172.21.15.59:0/329756684 >> 172.21.15.59:0/329756684 conn(0x7fea90072170 msgr2=0x7fea90072580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:48.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.344+0000 7fea9561a640 1 -- 172.21.15.59:0/329756684 shutdown_connections 2024-04-25T15:46:48.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.344+0000 7fea9561a640 1 -- 172.21.15.59:0/329756684 wait complete. 2024-04-25T15:46:48.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.347+0000 7fea9561a640 1 Processor -- start 2024-04-25T15:46:48.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.347+0000 7fea9561a640 1 -- start start 2024-04-25T15:46:48.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.348+0000 7f54e6ffd640 1 -- 172.21.15.59:0/3800351691 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ec017070 con 0x7f54f00c2da0 2024-04-25T15:46:48.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.348+0000 7f54e6ffd640 1 -- 172.21.15.59:0/3800351691 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ec00c940 con 0x7f54f00c2da0 2024-04-25T15:46:48.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.348+0000 7f54e6ffd640 1 -- 172.21.15.59:0/3800351691 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ec00cd30 con 0x7f54f00c2da0 2024-04-25T15:46:48.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.348+0000 7f54f8384640 1 -- 172.21.15.59:0/3800351691 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f015a5e0 con 0x7f54f00c2da0 2024-04-25T15:46:48.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.348+0000 7f54f8384640 1 -- 172.21.15.59:0/3800351691 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f015aba0 con 0x7f54f00c2da0 2024-04-25T15:46:48.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.349+0000 7fea9561a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea900c9200 0x7fea90150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.349+0000 7fea9561a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea900ca150 0x7fea90151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.349+0000 7fea9561a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea9015cef0 0x7fea90151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.349+0000 7fea9561a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fea90070fb0 con 0x7fea900ca150 2024-04-25T15:46:48.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.349+0000 7fea9561a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fea9015fee0 con 0x7fea900c9200 2024-04-25T15:46:48.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.349+0000 7fea9561a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fea90071130 con 0x7fea9015cef0 2024-04-25T15:46:48.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.350+0000 7f54f8384640 1 -- 172.21.15.59:0/3800351691 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f00cb840 con 0x7f54f00c2da0 2024-04-25T15:46:48.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.350+0000 7fea8effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea900c9200 0x7fea90150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.350+0000 7fea8effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea900c9200 0x7fea90150410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:53678/0 (socket says 172.21.15.59:53678) 2024-04-25T15:46:48.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.350+0000 7fea8effd640 1 -- 172.21.15.59:0/3563400923 learned_addr learned my addr 172.21.15.59:0/3563400923 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:48.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.354+0000 7fea8effd640 1 -- 172.21.15.59:0/3563400923 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea9015cef0 msgr2=0x7fea90151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.354+0000 7fea8effd640 1 --2- 172.21.15.59:0/3563400923 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea9015cef0 0x7fea90151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.354+0000 7fea8effd640 1 -- 172.21.15.59:0/3563400923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea900ca150 msgr2=0x7fea90151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.354+0000 7fea8effd640 1 --2- 172.21.15.59:0/3563400923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea900ca150 0x7fea90151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.354+0000 7fea8effd640 1 -- 172.21.15.59:0/3563400923 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea901570d0 con 0x7fea900c9200 2024-04-25T15:46:48.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.359+0000 7fea8effd640 1 --2- 172.21.15.59:0/3563400923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea900c9200 0x7fea90150410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fea8000c440 tx=0x7fea8000c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.363 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T15:46:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.364+0000 7fea777fe640 1 -- 172.21.15.59:0/3563400923 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea80017070 con 0x7fea900c9200 2024-04-25T15:46:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.364+0000 7fea777fe640 1 -- 172.21.15.59:0/3563400923 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea80005ce0 con 0x7fea900c9200 2024-04-25T15:46:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.364+0000 7fea9561a640 1 -- 172.21.15.59:0/3563400923 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea901573b0 con 0x7fea900c9200 2024-04-25T15:46:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.364+0000 7fea777fe640 1 -- 172.21.15.59:0/3563400923 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea800072f0 con 0x7fea900c9200 2024-04-25T15:46:48.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.364+0000 7fea9561a640 1 -- 172.21.15.59:0/3563400923 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea9015eb70 con 0x7fea900c9200 2024-04-25T15:46:48.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.365+0000 7fea757fa640 1 -- 172.21.15.59:0/3563400923 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea900cf600 con 0x7fea900c9200 2024-04-25T15:46:48.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.369+0000 7f2a0ea61640 1 Processor -- start 2024-04-25T15:46:48.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.369+0000 7f2a0ea61640 1 -- start start 2024-04-25T15:46:48.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.370+0000 7f2a0ea61640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a0806c940 0x7f2a08154570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.371+0000 7f2a0ea61640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2a0815b000 0x7f2a080ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.371+0000 7f2a0ea61640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a0806d020 con 0x7f2a080ce590 2024-04-25T15:46:48.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.371+0000 7f2a0ea61640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f2a08154ab0 con 0x7f2a0815b000 2024-04-25T15:46:48.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.371+0000 7f2a0ea61640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0815a410 con 0x7f2a0806c940 2024-04-25T15:46:48.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.372+0000 7f2a0cffe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2a0815b000 0x7f2a080ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.372+0000 7f2a0cffe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2a0815b000 0x7f2a080ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59870/0 (socket says 172.21.15.59:59870) 2024-04-25T15:46:48.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.372+0000 7f2a0cffe640 1 -- 172.21.15.59:0/1803937016 learned_addr learned my addr 172.21.15.59:0/1803937016 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:48.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.375+0000 7f2a0cffe640 1 -- 172.21.15.59:0/1803937016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a0806c940 msgr2=0x7f2a08154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:48.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.375+0000 7f2a0cffe640 1 --2- 172.21.15.59:0/1803937016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a0806c940 0x7f2a08154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.375+0000 7f2a0cffe640 1 -- 172.21.15.59:0/1803937016 >> v1:172.21.15.64:6789/0 conn(0x7f2a080ce590 legacy=0x7f2a0815a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:48.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.375+0000 7f2a0cffe640 1 -- 172.21.15.59:0/1803937016 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0806d2c0 con 0x7f2a0815b000 2024-04-25T15:46:48.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.377+0000 7f2a0cffe640 1 --2- 172.21.15.59:0/1803937016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a0815b000 0x7f2a080ce9a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2a0806d1f0 tx=0x7f2a0002a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e10d439cd910c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.380+0000 7f54e6ffd640 1 -- 172.21.15.59:0/3800351691 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f54ec01a070 con 0x7f54f00c2da0 2024-04-25T15:46:48.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.381+0000 7f54e6ffd640 1 --2- 172.21.15.59:0/3800351691 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f54d40744e0 0x7f54d40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.381+0000 7f54e6ffd640 1 -- 172.21.15.59:0/3800351691 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f54ec05bf50 con 0x7f54f00c2da0 2024-04-25T15:46:48.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.381+0000 7f54f591f640 1 --2- 172.21.15.59:0/3800351691 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f54d40744e0 0x7f54d40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.381+0000 7f54f591f640 1 --2- 172.21.15.59:0/3800351691 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f54d40744e0 0x7f54d40769f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f54f006e680 tx=0x7f54e0006ba0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.382+0000 7f2a06ffd640 1 -- 172.21.15.59:0/1803937016 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00036070 con 0x7f2a0815b000 2024-04-25T15:46:48.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.382+0000 7f2a06ffd640 1 -- 172.21.15.59:0/1803937016 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a00031600 con 0x7f2a0815b000 2024-04-25T15:46:48.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.382+0000 7f2a06ffd640 1 -- 172.21.15.59:0/1803937016 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a000319d0 con 0x7f2a0815b000 2024-04-25T15:46:48.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.383+0000 7f2a0ea61640 1 -- 172.21.15.59:0/1803937016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a0815b000 msgr2=0x7f2a080ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.383+0000 7f2a0ea61640 1 --2- 172.21.15.59:0/1803937016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a0815b000 0x7f2a080ce9a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2a0806d1f0 tx=0x7f2a0002a750 comp rx=0 tx=0).stop 2024-04-25T15:46:48.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.383+0000 7f2a0ea61640 1 -- 172.21.15.59:0/1803937016 shutdown_connections 2024-04-25T15:46:48.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.383+0000 7f2a0ea61640 1 --2- 172.21.15.59:0/1803937016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a0815b000 0x7f2a080ce9a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.383+0000 7f2a0ea61640 1 --2- 172.21.15.59:0/1803937016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a0806c940 0x7f2a08154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.383+0000 7f2a0ea61640 1 -- 172.21.15.59:0/1803937016 >> 172.21.15.59:0/1803937016 conn(0x7f2a08068b10 msgr2=0x7f2a08070280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:48.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.383+0000 7f2a0ea61640 1 -- 172.21.15.59:0/1803937016 shutdown_connections 2024-04-25T15:46:48.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.383+0000 7f2a0ea61640 1 -- 172.21.15.59:0/1803937016 wait complete. 2024-04-25T15:46:48.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.385+0000 7f2a0ea61640 1 Processor -- start 2024-04-25T15:46:48.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.385+0000 7f2a0ea61640 1 -- start start 2024-04-25T15:46:48.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.387+0000 7f2a0ea61640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a0806c940 0x7f2a0814fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.387+0000 7f2a0ea61640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a080ce590 0x7f2a0815d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.387+0000 7f2a0ea61640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a0815b000 0x7f2a08151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.387+0000 7f2a0ea61640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0806db60 con 0x7f2a0815b000 2024-04-25T15:46:48.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.387+0000 7f2a0ea61640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0806d880 con 0x7f2a080ce590 2024-04-25T15:46:48.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.387+0000 7f2a0ea61640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0806de40 con 0x7f2a0806c940 2024-04-25T15:46:48.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.387+0000 7f2a0cffe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a0815b000 0x7f2a08151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.388+0000 7f2a0cffe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a0815b000 0x7f2a08151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59872/0 (socket says 172.21.15.59:59872) 2024-04-25T15:46:48.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.388+0000 7f2a0cffe640 1 -- 172.21.15.59:0/3994635229 learned_addr learned my addr 172.21.15.59:0/3994635229 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:48.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.392+0000 7f2a0cffe640 1 -- 172.21.15.59:0/3994635229 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a0806c940 msgr2=0x7f2a0814fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.392+0000 7f2a0cffe640 1 --2- 172.21.15.59:0/3994635229 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a0806c940 0x7f2a0814fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.392+0000 7f2a0cffe640 1 -- 172.21.15.59:0/3994635229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a080ce590 msgr2=0x7f2a0815d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.392+0000 7f2a0cffe640 1 --2- 172.21.15.59:0/3994635229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a080ce590 0x7f2a0815d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.392+0000 7f2a0cffe640 1 -- 172.21.15.59:0/3994635229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0815d9e0 con 0x7f2a0815b000 2024-04-25T15:46:48.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.395+0000 7f2a0cffe640 1 --2- 172.21.15.59:0/3994635229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a0815b000 0x7f2a08151fe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2a000093e0 tx=0x7f2a00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.399+0000 7f2a04ff9640 1 -- 172.21.15.59:0/3994635229 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00041020 con 0x7f2a0815b000 2024-04-25T15:46:48.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.399+0000 7f2a04ff9640 1 -- 172.21.15.59:0/3994635229 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a00037040 con 0x7f2a0815b000 2024-04-25T15:46:48.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.399+0000 7f2a0ea61640 1 -- 172.21.15.59:0/3994635229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a081f2330 con 0x7f2a0815b000 2024-04-25T15:46:48.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.399+0000 7f2a04ff9640 1 -- 172.21.15.59:0/3994635229 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00036070 con 0x7f2a0815b000 2024-04-25T15:46:48.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.399+0000 7f2a0ea61640 1 -- 172.21.15.59:0/3994635229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0815c9c0 con 0x7f2a0815b000 2024-04-25T15:46:48.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.400+0000 7f2a0ea61640 1 -- 172.21.15.59:0/3994635229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a0806e420 con 0x7f2a0815b000 2024-04-25T15:46:48.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.424+0000 7f2a04ff9640 1 -- 172.21.15.59:0/3994635229 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2a00044020 con 0x7f2a0815b000 2024-04-25T15:46:48.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.425+0000 7f2a04ff9640 1 --2- 172.21.15.59:0/3994635229 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f29e80744b0 0x7f29e80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.425+0000 7f2a07fff640 1 --2- 172.21.15.59:0/3994635229 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f29e80744b0 0x7f29e80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.426+0000 7f2a07fff640 1 --2- 172.21.15.59:0/3994635229 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f29e80744b0 0x7f29e80769c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009670 tx=0x7f29f8006bf0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.454 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T15:46:48.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.479+0000 7f25cf315640 1 Processor -- start 2024-04-25T15:46:48.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.479+0000 7f25cf315640 1 -- start start 2024-04-25T15:46:48.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.481+0000 7f25cf315640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25c80b47a0 0x7f25c8160730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.481+0000 7f25cf315640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f25c80cc960 0x7f25c80ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.481+0000 7f25cf315640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25c815c8c0 con 0x7f25c80ccd70 2024-04-25T15:46:48.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.481+0000 7f25cf315640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f25c80b4bb0 con 0x7f25c80b47a0 2024-04-25T15:46:48.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.481+0000 7f25cf315640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f25c8160c70 con 0x7f25c80cc960 2024-04-25T15:46:48.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.538+0000 7f2a04ff9640 1 -- 172.21.15.59:0/3994635229 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2a0007c7c0 con 0x7f2a0815b000 2024-04-25T15:46:48.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.567+0000 7f6f9657d640 1 Processor -- start 2024-04-25T15:46:48.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.567+0000 7f6f9657d640 1 -- start start 2024-04-25T15:46:48.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.568+0000 7f6f9657d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6f900c9200 0x7f6f900c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.568+0000 7f6f9657d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6f9015cef0 0x7f6f90156700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.568+0000 7f6f9657d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f900c38e0 con 0x7f6f900ca150 2024-04-25T15:46:48.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.568+0000 7f6f9657d640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f6f90156c40 con 0x7f6f900c9200 2024-04-25T15:46:48.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.568+0000 7f6f9657d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f6f900c3bc0 con 0x7f6f9015cef0 2024-04-25T15:46:48.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.667+0000 7fea777fe640 1 -- 172.21.15.59:0/3563400923 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fea8001a070 con 0x7fea900c9200 2024-04-25T15:46:48.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.668+0000 7fea777fe640 1 --2- 172.21.15.59:0/3563400923 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fea7c0744e0 0x7fea7c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.668+0000 7fea777fe640 1 -- 172.21.15.59:0/3563400923 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fea80094800 con 0x7fea900c9200 2024-04-25T15:46:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.668+0000 7fea8e7fc640 1 --2- 172.21.15.59:0/3563400923 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fea7c0744e0 0x7fea7c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.668+0000 7fea8e7fc640 1 --2- 172.21.15.59:0/3563400923 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fea7c0744e0 0x7fea7c0769f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fea901f0460 tx=0x7fea84008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.677+0000 7f54e6ffd640 1 -- 172.21.15.59:0/3800351691 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f54ec060060 con 0x7f54f00c2da0 2024-04-25T15:46:48.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.678+0000 7fea777fe640 1 -- 172.21.15.59:0/3563400923 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fea900cf600 con 0x7fea900c9200 2024-04-25T15:46:48.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.683+0000 7f25cc8b0640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f25c80cc960 0x7f25c80ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.684+0000 7f6f94b1a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6f9015cef0 0x7f6f90156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.685+0000 7f25cc8b0640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f25c80cc960 0x7f25c80ce3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:53698/0 (socket says 172.21.15.59:53698) 2024-04-25T15:46:48.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.685+0000 7f25cc8b0640 1 -- 172.21.15.59:0/2802452769 learned_addr learned my addr 172.21.15.59:0/2802452769 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:48.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.685+0000 7f6f94b1a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6f9015cef0 0x7f6f90156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53550/0 (socket says 172.21.15.59:53550) 2024-04-25T15:46:48.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.685+0000 7f6f94b1a640 1 -- 172.21.15.59:0/582239496 learned_addr learned my addr 172.21.15.59:0/582239496 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:48.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.689+0000 7f6f94b1a640 1 -- 172.21.15.59:0/582239496 >> v2:172.21.15.59:3300/0 conn(0x7f6f900c9200 msgr2=0x7f6f900c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:48.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.689+0000 7f6f94b1a640 1 --2- 172.21.15.59:0/582239496 >> v2:172.21.15.59:3300/0 conn(0x7f6f900c9200 0x7f6f900c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.689+0000 7f6f94b1a640 1 -- 172.21.15.59:0/582239496 >> v1:172.21.15.64:6789/0 conn(0x7f6f900ca150 legacy=0x7f6f90160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:48.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.689+0000 7f6f94b1a640 1 -- 172.21.15.59:0/582239496 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f900c3ea0 con 0x7f6f9015cef0 2024-04-25T15:46:48.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.691+0000 7f6f94b1a640 1 --2- 172.21.15.59:0/582239496 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6f9015cef0 0x7f6f90156700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009e50 tx=0x7f6f8802a750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d323437213ce4bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.692+0000 7f25cc8b0640 1 -- 172.21.15.59:0/2802452769 >> v2:172.21.15.59:3300/0 conn(0x7f25c80b47a0 msgr2=0x7f25c8160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:48.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.692+0000 7f25cc8b0640 1 --2- 172.21.15.59:0/2802452769 >> v2:172.21.15.59:3300/0 conn(0x7f25c80b47a0 0x7f25c8160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.692+0000 7f25cc8b0640 1 -- 172.21.15.59:0/2802452769 >> v1:172.21.15.64:6789/0 conn(0x7f25c80ccd70 legacy=0x7f25c80b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.692+0000 7f25cc8b0640 1 -- 172.21.15.59:0/2802452769 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c815cba0 con 0x7f25c80cc960 2024-04-25T15:46:48.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.696+0000 7f6f8effd640 1 -- 172.21.15.59:0/582239496 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88036070 con 0x7f6f9015cef0 2024-04-25T15:46:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.696+0000 7f6f8effd640 1 -- 172.21.15.59:0/582239496 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f88031600 con 0x7f6f9015cef0 2024-04-25T15:46:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.696+0000 7f6f8effd640 1 -- 172.21.15.59:0/582239496 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f880319d0 con 0x7f6f9015cef0 2024-04-25T15:46:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.696+0000 7f6f9657d640 1 -- 172.21.15.59:0/582239496 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6f9015cef0 msgr2=0x7f6f90156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.696+0000 7f6f9657d640 1 --2- 172.21.15.59:0/582239496 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6f9015cef0 0x7f6f90156700 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009e50 tx=0x7f6f8802a750 comp rx=0 tx=0).stop 2024-04-25T15:46:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.697+0000 7f6f9657d640 1 -- 172.21.15.59:0/582239496 shutdown_connections 2024-04-25T15:46:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.697+0000 7f6f9657d640 1 --2- 172.21.15.59:0/582239496 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6f9015cef0 0x7f6f90156700 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.697+0000 7f6f9657d640 1 --2- 172.21.15.59:0/582239496 >> v2:172.21.15.59:3300/0 conn(0x7f6f900c9200 0x7f6f900c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.697+0000 7f6f9657d640 1 -- 172.21.15.59:0/582239496 >> 172.21.15.59:0/582239496 conn(0x7f6f90072170 msgr2=0x7f6f90072580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.697+0000 7f6f9657d640 1 -- 172.21.15.59:0/582239496 shutdown_connections 2024-04-25T15:46:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.697+0000 7f6f9657d640 1 -- 172.21.15.59:0/582239496 wait complete. 2024-04-25T15:46:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.698+0000 7f25cc8b0640 1 --2- 172.21.15.59:0/2802452769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25c80cc960 0x7f25c80ce3a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f25c815c7b0 tx=0x7f25b802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ac47cb2489cc6cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.698+0000 7f6f9657d640 1 Processor -- start 2024-04-25T15:46:48.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.699+0000 7f6f9657d640 1 -- start start 2024-04-25T15:46:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.700+0000 7f6f9657d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6f900c9200 0x7f6f90156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.700+0000 7f6f9657d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f900ca150 0x7f6f9015ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.700+0000 7f6f9657d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f9015cef0 0x7f6f90150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.700+0000 7f6f9657d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6f90070fb0 con 0x7f6f9015cef0 2024-04-25T15:46:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.700+0000 7f6f9657d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9015fee0 con 0x7f6f900ca150 2024-04-25T15:46:48.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.700+0000 7f6f9657d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f6f90071130 con 0x7f6f900c9200 2024-04-25T15:46:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.701+0000 7f6f8ffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6f900c9200 0x7f6f90156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.701+0000 7f6f8ffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6f900c9200 0x7f6f90156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53556/0 (socket says 172.21.15.59:53556) 2024-04-25T15:46:48.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.701+0000 7f6f8ffff640 1 -- 172.21.15.59:0/984713856 learned_addr learned my addr 172.21.15.59:0/984713856 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:48.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.705+0000 7f25bffff640 1 -- 172.21.15.59:0/2802452769 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b8037070 con 0x7f25c80cc960 2024-04-25T15:46:48.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.705+0000 7f25bffff640 1 -- 172.21.15.59:0/2802452769 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b8032440 con 0x7f25c80cc960 2024-04-25T15:46:48.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.705+0000 7f25bffff640 1 -- 172.21.15.59:0/2802452769 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b8032810 con 0x7f25c80cc960 2024-04-25T15:46:48.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.706+0000 7f6f8f7fe640 1 --2- 172.21.15.59:0/984713856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f900ca150 0x7f6f9015ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.706+0000 7f25cf315640 1 -- 172.21.15.59:0/2802452769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25c80cc960 msgr2=0x7f25c80ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.706+0000 7f25cf315640 1 --2- 172.21.15.59:0/2802452769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25c80cc960 0x7f25c80ce3a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f25c815c7b0 tx=0x7f25b802a1e0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.706+0000 7f25cf315640 1 -- 172.21.15.59:0/2802452769 shutdown_connections 2024-04-25T15:46:48.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.706+0000 7f25cf315640 1 --2- 172.21.15.59:0/2802452769 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25c80cc960 0x7f25c80ce3a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.706+0000 7f25cf315640 1 --2- 172.21.15.59:0/2802452769 >> v2:172.21.15.59:3300/0 conn(0x7f25c80b47a0 0x7f25c8160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.706+0000 7f25cf315640 1 -- 172.21.15.59:0/2802452769 >> 172.21.15.59:0/2802452769 conn(0x7f25c80684e0 msgr2=0x7f25c80688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:48.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.706+0000 7f25cf315640 1 -- 172.21.15.59:0/2802452769 shutdown_connections 2024-04-25T15:46:48.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.706+0000 7f25cf315640 1 -- 172.21.15.59:0/2802452769 wait complete. 2024-04-25T15:46:48.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.707+0000 7f6f8ffff640 1 -- 172.21.15.59:0/984713856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f900ca150 msgr2=0x7f6f9015ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.707+0000 7f6f8ffff640 1 --2- 172.21.15.59:0/984713856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f900ca150 0x7f6f9015ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.707+0000 7f6f8ffff640 1 -- 172.21.15.59:0/984713856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f9015cef0 msgr2=0x7f6f90150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.707+0000 7f6f8ffff640 1 --2- 172.21.15.59:0/984713856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f9015cef0 0x7f6f90150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.707+0000 7f6f8ffff640 1 -- 172.21.15.59:0/984713856 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f90070820 con 0x7f6f900c9200 2024-04-25T15:46:48.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.708+0000 7f25cf315640 1 Processor -- start 2024-04-25T15:46:48.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.708+0000 7f25cf315640 1 -- start start 2024-04-25T15:46:48.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.709+0000 7f25cf315640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25c80b47a0 0x7f25c81f3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.709+0000 7f25cf315640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f25c80cc960 0x7f25c81f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.709+0000 7f25cf315640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25c80ccd70 0x7f25c81e9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.709+0000 7f25cf315640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f25c815d440 con 0x7f25c80ccd70 2024-04-25T15:46:48.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.709+0000 7f25cf315640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f25c815d160 con 0x7f25c80b47a0 2024-04-25T15:46:48.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.709+0000 7f25cf315640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f25c80b5f90 con 0x7f25c80cc960 2024-04-25T15:46:48.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.711+0000 7f25cc8b0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f25c80cc960 0x7f25c81f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.712+0000 7f6f8ffff640 1 --2- 172.21.15.59:0/984713856 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6f900c9200 0x7f6f90156dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000b3c0 tx=0x7f6f8000b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.714+0000 7f25cd0b1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25c80b47a0 0x7f25c81f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.714+0000 7f25cc8b0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f25c80cc960 0x7f25c81f6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53560/0 (socket says 172.21.15.59:53560) 2024-04-25T15:46:48.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.714+0000 7f25cc8b0640 1 -- 172.21.15.59:0/263127292 learned_addr learned my addr 172.21.15.59:0/263127292 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:48.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.718+0000 7f6f8cff9640 1 -- 172.21.15.59:0/984713856 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f80015020 con 0x7f6f900c9200 2024-04-25T15:46:48.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.718+0000 7f6f8cff9640 1 -- 172.21.15.59:0/984713856 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f80011850 con 0x7f6f900c9200 2024-04-25T15:46:48.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.718+0000 7f6f9657d640 1 -- 172.21.15.59:0/984713856 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f9015f6d0 con 0x7f6f900c9200 2024-04-25T15:46:48.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.718+0000 7f6f8cff9640 1 -- 172.21.15.59:0/984713856 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f80011c40 con 0x7f6f900c9200 2024-04-25T15:46:48.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.718+0000 7f6f9657d640 1 -- 172.21.15.59:0/984713856 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f9015e450 con 0x7f6f900c9200 2024-04-25T15:46:48.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.719+0000 7f6f9657d640 1 -- 172.21.15.59:0/984713856 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f90071d80 con 0x7f6f900c9200 2024-04-25T15:46:48.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.719+0000 7f25cd0b1640 1 -- 172.21.15.59:0/263127292 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f25c80cc960 msgr2=0x7f25c81f6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.719+0000 7f25cd0b1640 1 --2- 172.21.15.59:0/263127292 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f25c80cc960 0x7f25c81f6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.719+0000 7f25cd0b1640 1 -- 172.21.15.59:0/263127292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25c80ccd70 msgr2=0x7f25c81e9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.719+0000 7f25cd0b1640 1 --2- 172.21.15.59:0/263127292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25c80ccd70 0x7f25c81e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.719+0000 7f25cd0b1640 1 -- 172.21.15.59:0/263127292 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c815e3a0 con 0x7f25c80b47a0 2024-04-25T15:46:48.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.722+0000 7f25cd0b1640 1 --2- 172.21.15.59:0/263127292 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25c80b47a0 0x7f25c81f3650 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f25c400b440 tx=0x7f25c400b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.727+0000 7f25bdffb640 1 -- 172.21.15.59:0/263127292 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c4011830 con 0x7f25c80b47a0 2024-04-25T15:46:48.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.727+0000 7f25bdffb640 1 -- 172.21.15.59:0/263127292 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c4016070 con 0x7f25c80b47a0 2024-04-25T15:46:48.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.727+0000 7f25bdffb640 1 -- 172.21.15.59:0/263127292 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c4011c10 con 0x7f25c80b47a0 2024-04-25T15:46:48.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.729+0000 7f25cf315640 1 -- 172.21.15.59:0/263127292 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c81f6fe0 con 0x7f25c80b47a0 2024-04-25T15:46:48.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.729+0000 7f25cf315640 1 -- 172.21.15.59:0/263127292 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c815c070 con 0x7f25c80b47a0 2024-04-25T15:46:48.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.730+0000 7f25cf315640 1 -- 172.21.15.59:0/263127292 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c815e570 con 0x7f25c80b47a0 2024-04-25T15:46:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.737+0000 7f2a04ff9640 1 -- 172.21.15.59:0/3994635229 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2a0806e420 con 0x7f2a0815b000 2024-04-25T15:46:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.758+0000 7f25bdffb640 1 -- 172.21.15.59:0/263127292 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f25c4025430 con 0x7f25c80b47a0 2024-04-25T15:46:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.759+0000 7f25bdffb640 1 --2- 172.21.15.59:0/263127292 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f25ac074500 0x7f25ac076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.759+0000 7f25cc8b0640 1 --2- 172.21.15.59:0/263127292 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f25ac074500 0x7f25ac076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.759+0000 7f25cc8b0640 1 --2- 172.21.15.59:0/263127292 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f25ac074500 0x7f25ac076a10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f25b802a220 tx=0x7f25b802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.862 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T15:46:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.896+0000 7f54f8384640 1 -- 172.21.15.59:0/3800351691 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f54f006cb70 con 0x7f54f00c2da0 2024-04-25T15:46:48.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.906+0000 7fea757fa640 1 -- 172.21.15.59:0/3563400923 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fea900c9990 con 0x7fea900c9200 2024-04-25T15:46:48.925 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T15:46:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.961+0000 7f2a0ea61640 1 -- 172.21.15.59:0/3994635229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2a08069910 con 0x7f2a0815b000 2024-04-25T15:46:48.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.966+0000 7f2a04ff9640 1 -- 172.21.15.59:0/3994635229 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2a0004b030 con 0x7f2a0815b000 2024-04-25T15:46:48.967 INFO:teuthology.orchestra.run.smithi059.stdout:64424509449 2024-04-25T15:46:48.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.969+0000 7f2a0ea61640 1 -- 172.21.15.59:0/3994635229 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f29e80744b0 msgr2=0x7f29e80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.969+0000 7f2a0ea61640 1 --2- 172.21.15.59:0/3994635229 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f29e80744b0 0x7f29e80769c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009670 tx=0x7f29f8006bf0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.969+0000 7f2a0ea61640 1 -- 172.21.15.59:0/3994635229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a0815b000 msgr2=0x7f2a08151fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.969+0000 7f2a0ea61640 1 --2- 172.21.15.59:0/3994635229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a0815b000 0x7f2a08151fe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2a000093e0 tx=0x7f2a00004a40 comp rx=0 tx=0).stop 2024-04-25T15:46:48.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.969+0000 7f2a0ea61640 1 -- 172.21.15.59:0/3994635229 shutdown_connections 2024-04-25T15:46:48.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.969+0000 7f2a0ea61640 1 --2- 172.21.15.59:0/3994635229 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f29e80744b0 0x7f29e80769c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.969+0000 7f2a0ea61640 1 --2- 172.21.15.59:0/3994635229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a0815b000 0x7f2a08151fe0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.969+0000 7f2a0ea61640 1 --2- 172.21.15.59:0/3994635229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a080ce590 0x7f2a0815d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.969+0000 7f2a0ea61640 1 --2- 172.21.15.59:0/3994635229 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a0806c940 0x7f2a0814fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.969+0000 7f2a0ea61640 1 -- 172.21.15.59:0/3994635229 >> 172.21.15.59:0/3994635229 conn(0x7f2a08068b10 msgr2=0x7f2a080ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.969+0000 7f2a0ea61640 1 -- 172.21.15.59:0/3994635229 shutdown_connections 2024-04-25T15:46:48.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.969+0000 7f2a0ea61640 1 -- 172.21.15.59:0/3994635229 wait complete. 2024-04-25T15:46:48.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.979+0000 7f1f57c34640 1 Processor -- start 2024-04-25T15:46:48.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.979+0000 7f1f57c34640 1 -- start start 2024-04-25T15:46:48.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.981+0000 7f1f57c34640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1f500b47a0 0x7f1f50160730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.981+0000 7f1f57c34640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1f500cc960 0x7f1f500ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:48.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.981+0000 7f1f57c34640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f5015c8c0 con 0x7f1f500ccd70 2024-04-25T15:46:48.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.981+0000 7f1f57c34640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1f500b4bb0 con 0x7f1f500b47a0 2024-04-25T15:46:48.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.981+0000 7f1f57c34640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1f50160c70 con 0x7f1f500cc960 2024-04-25T15:46:48.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.7 2024-04-25T15:46:48.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.982+0000 7f1f559d0640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1f500b47a0 0x7f1f50160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:48.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.982+0000 7f1f561d1640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1f500ccd70 0x7f1f500b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39492/0 (socket says 172.21.15.59:39492) 2024-04-25T15:46:48.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.982+0000 7f1f561d1640 1 -- 172.21.15.59:0/3492813491 learned_addr learned my addr 172.21.15.59:0/3492813491 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:48.984 DEBUG:teuthology.parallel:result is None 2024-04-25T15:46:48.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.985+0000 7f1f559d0640 1 -- 172.21.15.59:0/3492813491 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1f500cc960 msgr2=0x7f1f500ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:48.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.985+0000 7f1f559d0640 1 --2- 172.21.15.59:0/3492813491 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1f500cc960 0x7f1f500ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.985+0000 7f1f559d0640 1 -- 172.21.15.59:0/3492813491 >> v1:172.21.15.59:6789/0 conn(0x7f1f500ccd70 legacy=0x7f1f500b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.985+0000 7f1f559d0640 1 -- 172.21.15.59:0/3492813491 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5015cba0 con 0x7f1f500b47a0 2024-04-25T15:46:48.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.988+0000 7f1f559d0640 1 --2- 172.21.15.59:0/3492813491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f500b47a0 0x7f1f50160730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0097a0 tx=0x7f1f4c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2408dd86f413c0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:48.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.995+0000 7f1f549ce640 1 -- 172.21.15.59:0/3492813491 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c037070 con 0x7f1f500b47a0 2024-04-25T15:46:48.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.995+0000 7f1f549ce640 1 -- 172.21.15.59:0/3492813491 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f4c02ae50 con 0x7f1f500b47a0 2024-04-25T15:46:48.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.995+0000 7f1f549ce640 1 -- 172.21.15.59:0/3492813491 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c032660 con 0x7f1f500b47a0 2024-04-25T15:46:48.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.996+0000 7f1f57c34640 1 -- 172.21.15.59:0/3492813491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f500b47a0 msgr2=0x7f1f50160730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:48.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.996+0000 7f1f57c34640 1 --2- 172.21.15.59:0/3492813491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f500b47a0 0x7f1f50160730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0097a0 tx=0x7f1f4c02a100 comp rx=0 tx=0).stop 2024-04-25T15:46:48.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.996+0000 7f1f57c34640 1 -- 172.21.15.59:0/3492813491 shutdown_connections 2024-04-25T15:46:48.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.996+0000 7f1f57c34640 1 --2- 172.21.15.59:0/3492813491 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1f500cc960 0x7f1f500ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.996+0000 7f1f57c34640 1 --2- 172.21.15.59:0/3492813491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f500b47a0 0x7f1f50160730 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:48.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.996+0000 7f1f57c34640 1 -- 172.21.15.59:0/3492813491 >> 172.21.15.59:0/3492813491 conn(0x7f1f500684e0 msgr2=0x7f1f500688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:48.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.996+0000 7f1f57c34640 1 -- 172.21.15.59:0/3492813491 shutdown_connections 2024-04-25T15:46:48.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.996+0000 7f1f57c34640 1 -- 172.21.15.59:0/3492813491 wait complete. 2024-04-25T15:46:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.999+0000 7f1f57c34640 1 Processor -- start 2024-04-25T15:46:48.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:48.999+0000 7f1f57c34640 1 -- start start 2024-04-25T15:46:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.001+0000 7f1f57c34640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1f500b47a0 0x7f1f50159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.001+0000 7f1f57c34640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f500cc960 0x7f1f500ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.001+0000 7f1f57c34640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f500ccd70 0x7f1f501550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.001+0000 7f1f57c34640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5015d440 con 0x7f1f500ccd70 2024-04-25T15:46:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.001+0000 7f1f57c34640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5015d160 con 0x7f1f500cc960 2024-04-25T15:46:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.001+0000 7f1f57c34640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1f500b5f90 con 0x7f1f500b47a0 2024-04-25T15:46:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.002+0000 7f1f561d1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f500ccd70 0x7f1f501550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.002+0000 7f1f561d1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f500ccd70 0x7f1f501550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59906/0 (socket says 172.21.15.59:59906) 2024-04-25T15:46:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.002+0000 7f1f561d1640 1 -- 172.21.15.59:0/2602304584 learned_addr learned my addr 172.21.15.59:0/2602304584 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.007+0000 7f1f561d1640 1 -- 172.21.15.59:0/2602304584 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1f500b47a0 msgr2=0x7f1f50159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.007+0000 7f1f561d1640 1 --2- 172.21.15.59:0/2602304584 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1f500b47a0 0x7f1f50159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.007+0000 7f1f561d1640 1 -- 172.21.15.59:0/2602304584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f500cc960 msgr2=0x7f1f500ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.007+0000 7f1f561d1640 1 --2- 172.21.15.59:0/2602304584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f500cc960 0x7f1f500ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.007+0000 7f1f561d1640 1 -- 172.21.15.59:0/2602304584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f500cabf0 con 0x7f1f500ccd70 2024-04-25T15:46:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.010+0000 7f1f561d1640 1 --2- 172.21.15.59:0/2602304584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f500ccd70 0x7f1f501550f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800c9f0 tx=0x7f1f4800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:49.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.013+0000 7f1f467fc640 1 -- 172.21.15.59:0/2602304584 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48017070 con 0x7f1f500ccd70 2024-04-25T15:46:49.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.013+0000 7f1f467fc640 1 -- 172.21.15.59:0/2602304584 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f4800ab70 con 0x7f1f500ccd70 2024-04-25T15:46:49.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.013+0000 7f1f57c34640 1 -- 172.21.15.59:0/2602304584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f50159030 con 0x7f1f500ccd70 2024-04-25T15:46:49.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.013+0000 7f1f467fc640 1 -- 172.21.15.59:0/2602304584 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48012400 con 0x7f1f500ccd70 2024-04-25T15:46:49.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.014+0000 7f1f57c34640 1 -- 172.21.15.59:0/2602304584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f500c9eb0 con 0x7f1f500ccd70 2024-04-25T15:46:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.015+0000 7f1f57c34640 1 -- 172.21.15.59:0/2602304584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f500b6960 con 0x7f1f500ccd70 2024-04-25T15:46:49.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.032+0000 7f6f8cff9640 1 -- 172.21.15.59:0/984713856 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6f80018020 con 0x7f6f900c9200 2024-04-25T15:46:49.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.032+0000 7f6f8cff9640 1 --2- 172.21.15.59:0/984713856 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f6f7c074500 0x7f6f7c076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.032+0000 7f6f8f7fe640 1 --2- 172.21.15.59:0/984713856 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f6f7c074500 0x7f6f7c076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.033+0000 7f6f8cff9640 1 -- 172.21.15.59:0/984713856 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6f80011de0 con 0x7f6f900c9200 2024-04-25T15:46:49.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.033+0000 7f6f8f7fe640 1 --2- 172.21.15.59:0/984713856 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f6f7c074500 0x7f6f7c076a10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6f90155f30 tx=0x7f6f84009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:49.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.043+0000 7ff85b0a1640 1 Processor -- start 2024-04-25T15:46:49.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.043+0000 7ff85b0a1640 1 -- start start 2024-04-25T15:46:49.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.044+0000 7ff85b0a1640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff8540b51b0 0x7ff854154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.045+0000 7ff85b0a1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff8540cabf0 0x7ff8540cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.045+0000 7ff85b0a1640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff85415dad0 con 0x7ff8540cffc0 2024-04-25T15:46:49.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.045+0000 7ff85b0a1640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7ff85415ddb0 con 0x7ff8540b51b0 2024-04-25T15:46:49.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.045+0000 7ff85b0a1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ff85415e090 con 0x7ff8540cabf0 2024-04-25T15:46:49.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.047+0000 7f25bdffb640 1 -- 172.21.15.59:0/263127292 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f25c405bc10 con 0x7f25c80b47a0 2024-04-25T15:46:49.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.050+0000 7f6f8cff9640 1 -- 172.21.15.59:0/984713856 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6f90071d80 con 0x7f6f900c9200 2024-04-25T15:46:49.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.050+0000 7f54e6ffd640 1 -- 172.21.15.59:0/3800351691 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f54ec05f960 con 0x7f54f00c2da0 2024-04-25T15:46:49.051 INFO:teuthology.orchestra.run.smithi059.stdout:60129542154 2024-04-25T15:46:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.052+0000 7f54f8384640 1 -- 172.21.15.59:0/3800351691 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f54d40744e0 msgr2=0x7f54d40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.052+0000 7f54f8384640 1 --2- 172.21.15.59:0/3800351691 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f54d40744e0 0x7f54d40769f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f54f006e680 tx=0x7f54e0006ba0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.052+0000 7f54f8384640 1 -- 172.21.15.59:0/3800351691 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54f00c2da0 msgr2=0x7f54f014ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.052+0000 7f54f8384640 1 --2- 172.21.15.59:0/3800351691 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54f00c2da0 0x7f54f014ff90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00e870 tx=0x7f54ec00ed30 comp rx=0 tx=0).stop 2024-04-25T15:46:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.052+0000 7f54f8384640 1 -- 172.21.15.59:0/3800351691 shutdown_connections 2024-04-25T15:46:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.052+0000 7f54f8384640 1 --2- 172.21.15.59:0/3800351691 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f54d40744e0 0x7f54d40769f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.052+0000 7f54f8384640 1 --2- 172.21.15.59:0/3800351691 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54f015d0e0 0x7f54f014c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.052+0000 7f54f8384640 1 --2- 172.21.15.59:0/3800351691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54f00cac90 0x7f54f00cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.052+0000 7f54f8384640 1 --2- 172.21.15.59:0/3800351691 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54f00c2da0 0x7f54f014ff90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.052+0000 7f54f8384640 1 -- 172.21.15.59:0/3800351691 >> 172.21.15.59:0/3800351691 conn(0x7f54f006c760 msgr2=0x7f54f01e8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:49.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.052+0000 7f54f8384640 1 -- 172.21.15.59:0/3800351691 shutdown_connections 2024-04-25T15:46:49.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.052+0000 7f54f8384640 1 -- 172.21.15.59:0/3800351691 wait complete. 2024-04-25T15:46:49.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.057+0000 7ff853fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff8540cabf0 0x7ff8540cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.058+0000 7ff853fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff8540cabf0 0x7ff8540cfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53580/0 (socket says 172.21.15.59:53580) 2024-04-25T15:46:49.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.058+0000 7ff853fff640 1 -- 172.21.15.59:0/2439071617 learned_addr learned my addr 172.21.15.59:0/2439071617 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:49.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.059+0000 7f25bdffb640 1 -- 172.21.15.59:0/263127292 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f25c4060080 con 0x7f25c80b47a0 2024-04-25T15:46:49.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.062+0000 7ff853fff640 1 -- 172.21.15.59:0/2439071617 >> v2:172.21.15.64:3300/0 conn(0x7ff8540b51b0 msgr2=0x7ff854154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:49.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.062+0000 7ff853fff640 1 --2- 172.21.15.59:0/2439071617 >> v2:172.21.15.64:3300/0 conn(0x7ff8540b51b0 0x7ff854154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.062+0000 7ff853fff640 1 -- 172.21.15.59:0/2439071617 >> v1:172.21.15.59:6789/0 conn(0x7ff8540cffc0 legacy=0x7ff8540cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.062+0000 7ff853fff640 1 -- 172.21.15.59:0/2439071617 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff85415e370 con 0x7ff8540cabf0 2024-04-25T15:46:49.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.3 2024-04-25T15:46:49.064 DEBUG:teuthology.parallel:result is None 2024-04-25T15:46:49.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.064+0000 7ff853fff640 1 --2- 172.21.15.59:0/2439071617 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff8540cabf0 0x7ff8540cfa80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff840009870 tx=0x7ff84002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd5b3372e7b387aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.068+0000 7ff8537fe640 1 -- 172.21.15.59:0/2439071617 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840037070 con 0x7ff8540cabf0 2024-04-25T15:46:49.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.069+0000 7fea777fe640 1 -- 172.21.15.59:0/3563400923 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fea900c9990 con 0x7fea900c9200 2024-04-25T15:46:49.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.069+0000 7ff8537fe640 1 -- 172.21.15.59:0/2439071617 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff840032440 con 0x7ff8540cabf0 2024-04-25T15:46:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.069+0000 7ff8537fe640 1 -- 172.21.15.59:0/2439071617 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840032810 con 0x7ff8540cabf0 2024-04-25T15:46:49.070 INFO:teuthology.orchestra.run.smithi059.stdout:64424509449 2024-04-25T15:46:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.070+0000 7ff85b0a1640 1 -- 172.21.15.59:0/2439071617 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff8540cabf0 msgr2=0x7ff8540cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.070+0000 7ff85b0a1640 1 --2- 172.21.15.59:0/2439071617 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff8540cabf0 0x7ff8540cfa80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff840009870 tx=0x7ff84002a210 comp rx=0 tx=0).stop 2024-04-25T15:46:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.070+0000 7ff85b0a1640 1 -- 172.21.15.59:0/2439071617 shutdown_connections 2024-04-25T15:46:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.070+0000 7ff85b0a1640 1 --2- 172.21.15.59:0/2439071617 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff8540cabf0 0x7ff8540cfa80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.070+0000 7ff85b0a1640 1 --2- 172.21.15.59:0/2439071617 >> v2:172.21.15.64:3300/0 conn(0x7ff8540b51b0 0x7ff854154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.070+0000 7ff85b0a1640 1 -- 172.21.15.59:0/2439071617 >> 172.21.15.59:0/2439071617 conn(0x7ff85406c760 msgr2=0x7ff85406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:49.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.070+0000 7ff85b0a1640 1 -- 172.21.15.59:0/2439071617 shutdown_connections 2024-04-25T15:46:49.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.070+0000 7ff85b0a1640 1 -- 172.21.15.59:0/2439071617 wait complete. 2024-04-25T15:46:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.072+0000 7fea757fa640 1 -- 172.21.15.59:0/3563400923 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fea7c0744e0 msgr2=0x7fea7c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.072+0000 7fea757fa640 1 --2- 172.21.15.59:0/3563400923 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fea7c0744e0 0x7fea7c0769f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fea901f0460 tx=0x7fea84008040 comp rx=0 tx=0).stop 2024-04-25T15:46:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.072+0000 7fea757fa640 1 -- 172.21.15.59:0/3563400923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea900c9200 msgr2=0x7fea90150410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.072+0000 7fea757fa640 1 --2- 172.21.15.59:0/3563400923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea900c9200 0x7fea90150410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fea8000c440 tx=0x7fea8000c900 comp rx=0 tx=0).stop 2024-04-25T15:46:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.072+0000 7fea757fa640 1 -- 172.21.15.59:0/3563400923 shutdown_connections 2024-04-25T15:46:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.072+0000 7fea757fa640 1 --2- 172.21.15.59:0/3563400923 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fea7c0744e0 0x7fea7c0769f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.072+0000 7fea757fa640 1 --2- 172.21.15.59:0/3563400923 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea9015cef0 0x7fea90151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.072+0000 7fea757fa640 1 --2- 172.21.15.59:0/3563400923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea900ca150 0x7fea90151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.072+0000 7fea757fa640 1 --2- 172.21.15.59:0/3563400923 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea900c9200 0x7fea90150410 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.072+0000 7fea757fa640 1 -- 172.21.15.59:0/3563400923 >> 172.21.15.59:0/3563400923 conn(0x7fea90072170 msgr2=0x7fea900cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.072+0000 7ff85b0a1640 1 Processor -- start 2024-04-25T15:46:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.072+0000 7ff85b0a1640 1 -- start start 2024-04-25T15:46:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.072+0000 7fea757fa640 1 -- 172.21.15.59:0/3563400923 shutdown_connections 2024-04-25T15:46:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.072+0000 7fea757fa640 1 -- 172.21.15.59:0/3563400923 wait complete. 2024-04-25T15:46:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.073+0000 7ff85b0a1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8540b51b0 0x7ff85406ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.073+0000 7ff85b0a1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8540cabf0 0x7ff8540ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.073+0000 7ff85b0a1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff8540cffc0 0x7ff85415ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.073+0000 7ff85b0a1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff8540ca070 con 0x7ff8540cabf0 2024-04-25T15:46:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.073+0000 7ff85b0a1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff8540cb000 con 0x7ff8540b51b0 2024-04-25T15:46:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.073+0000 7ff85b0a1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ff8540ca1f0 con 0x7ff8540cffc0 2024-04-25T15:46:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.074+0000 7ff85963e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff8540cffc0 0x7ff85415ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.074+0000 7ff85963e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff8540cffc0 0x7ff85415ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53586/0 (socket says 172.21.15.59:53586) 2024-04-25T15:46:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.074+0000 7ff85963e640 1 -- 172.21.15.59:0/3716882801 learned_addr learned my addr 172.21.15.59:0/3716882801 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.075+0000 7ff858e3d640 1 --2- 172.21.15.59:0/3716882801 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8540b51b0 0x7ff85406ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.081+0000 7ff858e3d640 1 -- 172.21.15.59:0/3716882801 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff8540cffc0 msgr2=0x7ff85415ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.081+0000 7ff858e3d640 1 --2- 172.21.15.59:0/3716882801 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff8540cffc0 0x7ff85415ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.081+0000 7ff858e3d640 1 -- 172.21.15.59:0/3716882801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8540cabf0 msgr2=0x7ff8540ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.081+0000 7ff858e3d640 1 --2- 172.21.15.59:0/3716882801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8540cabf0 0x7ff8540ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.081+0000 7ff858e3d640 1 -- 172.21.15.59:0/3716882801 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff85406f1d0 con 0x7ff8540b51b0 2024-04-25T15:46:49.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.084+0000 7ff858e3d640 1 --2- 172.21.15.59:0/3716882801 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8540b51b0 0x7ff85406ec90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff84800b410 tx=0x7ff84800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:49.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.4 2024-04-25T15:46:49.088 DEBUG:teuthology.parallel:result is None 2024-04-25T15:46:49.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.091+0000 7ff8517fa640 1 -- 172.21.15.59:0/3716882801 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848015020 con 0x7ff8540b51b0 2024-04-25T15:46:49.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.091+0000 7ff8517fa640 1 -- 172.21.15.59:0/3716882801 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff848011850 con 0x7ff8540b51b0 2024-04-25T15:46:49.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.091+0000 7ff8517fa640 1 -- 172.21.15.59:0/3716882801 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848011c40 con 0x7ff8540b51b0 2024-04-25T15:46:49.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.091+0000 7ff85b0a1640 1 -- 172.21.15.59:0/3716882801 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff85406f6a0 con 0x7ff8540b51b0 2024-04-25T15:46:49.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.091+0000 7ff85b0a1640 1 -- 172.21.15.59:0/3716882801 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff85415a580 con 0x7ff8540b51b0 2024-04-25T15:46:49.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.092+0000 7ff85b0a1640 1 -- 172.21.15.59:0/3716882801 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff854069fb0 con 0x7ff8540b51b0 2024-04-25T15:46:49.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.301+0000 7f6f9657d640 1 -- 172.21.15.59:0/984713856 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6f90069fb0 con 0x7f6f900c9200 2024-04-25T15:46:49.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.308+0000 7f6f8cff9640 1 -- 172.21.15.59:0/984713856 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6f8001f020 con 0x7f6f900c9200 2024-04-25T15:46:49.309 INFO:teuthology.orchestra.run.smithi059.stdout:64424509449 2024-04-25T15:46:49.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.309+0000 7f25cf315640 1 -- 172.21.15.59:0/263127292 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f25c80cf840 con 0x7f25c80b47a0 2024-04-25T15:46:49.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.310+0000 7f6f9657d640 1 -- 172.21.15.59:0/984713856 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f6f7c074500 msgr2=0x7f6f7c076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.310+0000 7f6f9657d640 1 --2- 172.21.15.59:0/984713856 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f6f7c074500 0x7f6f7c076a10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6f90155f30 tx=0x7f6f84009060 comp rx=0 tx=0).stop 2024-04-25T15:46:49.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.310+0000 7f6f9657d640 1 -- 172.21.15.59:0/984713856 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6f900c9200 msgr2=0x7f6f90156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.310+0000 7f6f9657d640 1 --2- 172.21.15.59:0/984713856 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6f900c9200 0x7f6f90156dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000b3c0 tx=0x7f6f8000b880 comp rx=0 tx=0).stop 2024-04-25T15:46:49.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.310+0000 7f6f9657d640 1 -- 172.21.15.59:0/984713856 shutdown_connections 2024-04-25T15:46:49.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.310+0000 7f6f9657d640 1 --2- 172.21.15.59:0/984713856 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f6f7c074500 0x7f6f7c076a10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.310+0000 7f6f9657d640 1 --2- 172.21.15.59:0/984713856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f9015cef0 0x7f6f90150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.310+0000 7f6f9657d640 1 --2- 172.21.15.59:0/984713856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f900ca150 0x7f6f9015ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.310+0000 7f6f9657d640 1 --2- 172.21.15.59:0/984713856 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6f900c9200 0x7f6f90156dc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.310+0000 7f6f9657d640 1 -- 172.21.15.59:0/984713856 >> 172.21.15.59:0/984713856 conn(0x7f6f90072170 msgr2=0x7f6f900c88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:49.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.310+0000 7f6f9657d640 1 -- 172.21.15.59:0/984713856 shutdown_connections 2024-04-25T15:46:49.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.310+0000 7f6f9657d640 1 -- 172.21.15.59:0/984713856 wait complete. 2024-04-25T15:46:49.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.321+0000 7f1f467fc640 1 -- 172.21.15.59:0/2602304584 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1f4801a070 con 0x7f1f500ccd70 2024-04-25T15:46:49.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.321+0000 7f1f467fc640 1 --2- 172.21.15.59:0/2602304584 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1f34074500 0x7f1f34076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.6 2024-04-25T15:46:49.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.321+0000 7f1f559d0640 1 --2- 172.21.15.59:0/2602304584 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1f34074500 0x7f1f34076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.322+0000 7f1f559d0640 1 --2- 172.21.15.59:0/2602304584 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1f34074500 0x7f1f34076a10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c034000 tx=0x7f1f4c02c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:49.323 DEBUG:teuthology.parallel:result is None 2024-04-25T15:46:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.340+0000 7f1f467fc640 1 -- 172.21.15.59:0/2602304584 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1f4805b700 con 0x7f1f500ccd70 2024-04-25T15:46:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.340+0000 7f1f467fc640 1 -- 172.21.15.59:0/2602304584 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1f500b6960 con 0x7f1f500ccd70 2024-04-25T15:46:49.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.392+0000 7ff8517fa640 1 -- 172.21.15.59:0/3716882801 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff848018020 con 0x7ff8540b51b0 2024-04-25T15:46:49.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.392+0000 7ff8517fa640 1 --2- 172.21.15.59:0/3716882801 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ff8380744b0 0x7ff8380769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.392+0000 7ff8517fa640 1 -- 172.21.15.59:0/3716882801 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff8480954e0 con 0x7ff8540b51b0 2024-04-25T15:46:49.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.392+0000 7ff853fff640 1 --2- 172.21.15.59:0/3716882801 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ff8380744b0 0x7ff8380769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.393+0000 7ff853fff640 1 --2- 172.21.15.59:0/3716882801 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ff8380744b0 0x7ff8380769c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff840034000 tx=0x7ff84002c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:49.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.403+0000 7ff8517fa640 1 -- 172.21.15.59:0/3716882801 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff84801f020 con 0x7ff8540b51b0 2024-04-25T15:46:49.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.411+0000 7f25bdffb640 1 -- 172.21.15.59:0/263127292 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f25c80cf840 con 0x7f25c80b47a0 2024-04-25T15:46:49.412 INFO:teuthology.orchestra.run.smithi059.stdout:64424509451 2024-04-25T15:46:49.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.414+0000 7f25cf315640 1 -- 172.21.15.59:0/263127292 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f25ac074500 msgr2=0x7f25ac076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.414+0000 7f25cf315640 1 --2- 172.21.15.59:0/263127292 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f25ac074500 0x7f25ac076a10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f25b802a220 tx=0x7f25b802e000 comp rx=0 tx=0).stop 2024-04-25T15:46:49.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.414+0000 7f25cf315640 1 -- 172.21.15.59:0/263127292 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25c80b47a0 msgr2=0x7f25c81f3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.414+0000 7f25cf315640 1 --2- 172.21.15.59:0/263127292 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25c80b47a0 0x7f25c81f3650 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f25c400b440 tx=0x7f25c400b900 comp rx=0 tx=0).stop 2024-04-25T15:46:49.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.415+0000 7f25cf315640 1 -- 172.21.15.59:0/263127292 shutdown_connections 2024-04-25T15:46:49.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.415+0000 7f25cf315640 1 --2- 172.21.15.59:0/263127292 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f25ac074500 0x7f25ac076a10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.415+0000 7f25cf315640 1 --2- 172.21.15.59:0/263127292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25c80ccd70 0x7f25c81e9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.415+0000 7f25cf315640 1 --2- 172.21.15.59:0/263127292 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f25c80cc960 0x7f25c81f6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.415+0000 7f25cf315640 1 --2- 172.21.15.59:0/263127292 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f25c80b47a0 0x7f25c81f3650 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.415+0000 7f25cf315640 1 -- 172.21.15.59:0/263127292 >> 172.21.15.59:0/263127292 conn(0x7f25c80684e0 msgr2=0x7f25c8155b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:49.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.415+0000 7f25cf315640 1 -- 172.21.15.59:0/263127292 shutdown_connections 2024-04-25T15:46:49.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.415+0000 7f25cf315640 1 -- 172.21.15.59:0/263127292 wait complete. 2024-04-25T15:46:49.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.1 2024-04-25T15:46:49.432 DEBUG:teuthology.parallel:result is None 2024-04-25T15:46:49.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.539+0000 7f1f57c34640 1 -- 172.21.15.59:0/2602304584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1f50069910 con 0x7f1f500ccd70 2024-04-25T15:46:49.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.543+0000 7f1f467fc640 1 -- 172.21.15.59:0/2602304584 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1f4805f470 con 0x7f1f500ccd70 2024-04-25T15:46:49.544 INFO:teuthology.orchestra.run.smithi059.stdout:64424509452 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.546+0000 7f1f57c34640 1 -- 172.21.15.59:0/2602304584 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1f34074500 msgr2=0x7f1f34076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.546+0000 7f1f57c34640 1 --2- 172.21.15.59:0/2602304584 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1f34074500 0x7f1f34076a10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c034000 tx=0x7f1f4c02c000 comp rx=0 tx=0).stop 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.546+0000 7f1f57c34640 1 -- 172.21.15.59:0/2602304584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f500ccd70 msgr2=0x7f1f501550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.546+0000 7f1f57c34640 1 --2- 172.21.15.59:0/2602304584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f500ccd70 0x7f1f501550f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800c9f0 tx=0x7f1f4800ceb0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.546+0000 7f1f57c34640 1 -- 172.21.15.59:0/2602304584 shutdown_connections 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.546+0000 7f1f57c34640 1 --2- 172.21.15.59:0/2602304584 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1f34074500 0x7f1f34076a10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.546+0000 7f1f57c34640 1 --2- 172.21.15.59:0/2602304584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f500ccd70 0x7f1f501550f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.546+0000 7f1f57c34640 1 --2- 172.21.15.59:0/2602304584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f500cc960 0x7f1f500ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.546+0000 7f1f57c34640 1 --2- 172.21.15.59:0/2602304584 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1f500b47a0 0x7f1f50159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.546+0000 7f1f57c34640 1 -- 172.21.15.59:0/2602304584 >> 172.21.15.59:0/2602304584 conn(0x7f1f500684e0 msgr2=0x7f1f501567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:49.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.546+0000 7f1f57c34640 1 -- 172.21.15.59:0/2602304584 shutdown_connections 2024-04-25T15:46:49.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.546+0000 7f1f57c34640 1 -- 172.21.15.59:0/2602304584 wait complete. 2024-04-25T15:46:49.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.5 2024-04-25T15:46:49.562 DEBUG:teuthology.parallel:result is None 2024-04-25T15:46:49.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.603+0000 7ff85b0a1640 1 -- 172.21.15.59:0/3716882801 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff85415d750 con 0x7ff8540b51b0 2024-04-25T15:46:49.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.665+0000 7ff8517fa640 1 -- 172.21.15.59:0/3716882801 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff84805fe70 con 0x7ff8540b51b0 2024-04-25T15:46:49.666 INFO:teuthology.orchestra.run.smithi059.stdout:60129542155 2024-04-25T15:46:49.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.667+0000 7ff85b0a1640 1 -- 172.21.15.59:0/3716882801 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ff8380744b0 msgr2=0x7ff8380769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.667+0000 7ff85b0a1640 1 --2- 172.21.15.59:0/3716882801 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ff8380744b0 0x7ff8380769c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff840034000 tx=0x7ff84002c000 comp rx=0 tx=0).stop 2024-04-25T15:46:49.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.667+0000 7ff85b0a1640 1 -- 172.21.15.59:0/3716882801 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8540b51b0 msgr2=0x7ff85406ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.667+0000 7ff85b0a1640 1 --2- 172.21.15.59:0/3716882801 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8540b51b0 0x7ff85406ec90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff84800b410 tx=0x7ff84800b8d0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.667+0000 7ff85b0a1640 1 -- 172.21.15.59:0/3716882801 shutdown_connections 2024-04-25T15:46:49.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.668+0000 7ff85b0a1640 1 --2- 172.21.15.59:0/3716882801 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ff8380744b0 0x7ff8380769c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.668+0000 7ff85b0a1640 1 --2- 172.21.15.59:0/3716882801 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff8540cffc0 0x7ff85415ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.668+0000 7ff85b0a1640 1 --2- 172.21.15.59:0/3716882801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8540cabf0 0x7ff8540ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.668+0000 7ff85b0a1640 1 --2- 172.21.15.59:0/3716882801 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff8540b51b0 0x7ff85406ec90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.668+0000 7ff85b0a1640 1 -- 172.21.15.59:0/3716882801 >> 172.21.15.59:0/3716882801 conn(0x7ff85406c760 msgr2=0x7ff85414f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:49.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.668+0000 7ff85b0a1640 1 -- 172.21.15.59:0/3716882801 shutdown_connections 2024-04-25T15:46:49.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.668+0000 7ff85b0a1640 1 -- 172.21.15.59:0/3716882801 wait complete. 2024-04-25T15:46:49.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.0 2024-04-25T15:46:49.680 DEBUG:teuthology.parallel:result is None 2024-04-25T15:46:49.680 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T15:46:49.680 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:46:49.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.791+0000 7f1fefda8640 1 Processor -- start 2024-04-25T15:46:49.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.791+0000 7f1fefda8640 1 -- start start 2024-04-25T15:46:49.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.792+0000 7f1fefda8640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1fe806cd40 0x7f1fe80c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.792+0000 7f1fefda8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fe815a840 0x7f1fe815ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.792+0000 7f1fefda8640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe80cc910 con 0x7f1fe80c74a0 2024-04-25T15:46:49.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.792+0000 7f1fefda8640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1fe80ba020 con 0x7f1fe806cd40 2024-04-25T15:46:49.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.792+0000 7f1fefda8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1fe80cc6e0 con 0x7f1fe815a840 2024-04-25T15:46:49.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.793+0000 7f1fed343640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1fe806cd40 0x7f1fe80c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.793+0000 7f1fee345640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fe815a840 0x7f1fe815ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.793+0000 7f1fee345640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fe815a840 0x7f1fe815ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53592/0 (socket says 172.21.15.59:53592) 2024-04-25T15:46:49.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.793+0000 7f1fee345640 1 -- 172.21.15.59:0/2689695422 learned_addr learned my addr 172.21.15.59:0/2689695422 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.796+0000 7f1fee345640 1 -- 172.21.15.59:0/2689695422 >> v2:172.21.15.59:3300/0 conn(0x7f1fe806cd40 msgr2=0x7f1fe80c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.796+0000 7f1fee345640 1 --2- 172.21.15.59:0/2689695422 >> v2:172.21.15.59:3300/0 conn(0x7f1fe806cd40 0x7f1fe80c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.796+0000 7f1fee345640 1 -- 172.21.15.59:0/2689695422 >> v1:172.21.15.59:6789/0 conn(0x7f1fe80c74a0 legacy=0x7f1fe806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.796+0000 7f1fee345640 1 -- 172.21.15.59:0/2689695422 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe80ccbb0 con 0x7f1fe815a840 2024-04-25T15:46:49.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.798+0000 7f1fee345640 1 --2- 172.21.15.59:0/2689695422 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fe815a840 0x7f1fe815ac50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80ccae0 tx=0x7f1fe002a750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2eb7b38381f6e1bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.803+0000 7f1fecb42640 1 -- 172.21.15.59:0/2689695422 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0036070 con 0x7f1fe815a840 2024-04-25T15:46:49.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.803+0000 7f1fecb42640 1 -- 172.21.15.59:0/2689695422 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe0031600 con 0x7f1fe815a840 2024-04-25T15:46:49.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.803+0000 7f1fecb42640 1 -- 172.21.15.59:0/2689695422 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe00319d0 con 0x7f1fe815a840 2024-04-25T15:46:49.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.804+0000 7f1fefda8640 1 -- 172.21.15.59:0/2689695422 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fe815a840 msgr2=0x7f1fe815ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.804+0000 7f1fefda8640 1 --2- 172.21.15.59:0/2689695422 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fe815a840 0x7f1fe815ac50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80ccae0 tx=0x7f1fe002a750 comp rx=0 tx=0).stop 2024-04-25T15:46:49.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.804+0000 7f1fefda8640 1 -- 172.21.15.59:0/2689695422 shutdown_connections 2024-04-25T15:46:49.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.804+0000 7f1fefda8640 1 --2- 172.21.15.59:0/2689695422 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fe815a840 0x7f1fe815ac50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.804+0000 7f1fefda8640 1 --2- 172.21.15.59:0/2689695422 >> v2:172.21.15.59:3300/0 conn(0x7f1fe806cd40 0x7f1fe80c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.804+0000 7f1fefda8640 1 -- 172.21.15.59:0/2689695422 >> 172.21.15.59:0/2689695422 conn(0x7f1fe80cde10 msgr2=0x7f1fe80ce220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:49.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.804+0000 7f1fefda8640 1 -- 172.21.15.59:0/2689695422 shutdown_connections 2024-04-25T15:46:49.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.804+0000 7f1fefda8640 1 -- 172.21.15.59:0/2689695422 wait complete. 2024-04-25T15:46:49.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.806+0000 7f1fefda8640 1 Processor -- start 2024-04-25T15:46:49.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.806+0000 7f1fefda8640 1 -- start start 2024-04-25T15:46:49.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.807+0000 7f1fefda8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fe806cd40 0x7f1fe8156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.807+0000 7f1fefda8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fe80c74a0 0x7f1fe8149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.807+0000 7f1fefda8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fe815a840 0x7f1fe814af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:49.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.807+0000 7f1fefda8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe80cd450 con 0x7f1fe815a840 2024-04-25T15:46:49.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.807+0000 7f1fefda8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe80cd170 con 0x7f1fe806cd40 2024-04-25T15:46:49.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.807+0000 7f1fefda8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1fe806ddc0 con 0x7f1fe80c74a0 2024-04-25T15:46:49.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.807+0000 7f1fee345640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fe815a840 0x7f1fe814af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.808+0000 7f1fed343640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fe80c74a0 0x7f1fe8149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.808+0000 7f1fedb44640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fe806cd40 0x7f1fe8156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:49.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.808+0000 7f1fee345640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fe815a840 0x7f1fe814af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59930/0 (socket says 172.21.15.59:59930) 2024-04-25T15:46:49.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.808+0000 7f1fee345640 1 -- 172.21.15.59:0/887305744 learned_addr learned my addr 172.21.15.59:0/887305744 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:49.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.812+0000 7f1fee345640 1 -- 172.21.15.59:0/887305744 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fe80c74a0 msgr2=0x7f1fe8149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.812+0000 7f1fee345640 1 --2- 172.21.15.59:0/887305744 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fe80c74a0 0x7f1fe8149f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.812+0000 7f1fee345640 1 -- 172.21.15.59:0/887305744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fe806cd40 msgr2=0x7f1fe8156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:49.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.812+0000 7f1fee345640 1 --2- 172.21.15.59:0/887305744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fe806cd40 0x7f1fe8156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:49.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.812+0000 7f1fee345640 1 -- 172.21.15.59:0/887305744 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe8157360 con 0x7f1fe815a840 2024-04-25T15:46:49.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.814+0000 7f1fee345640 1 --2- 172.21.15.59:0/887305744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fe815a840 0x7f1fe814af30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009f10 tx=0x7f1fe0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:49.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.816+0000 7f1fde7fc640 1 -- 172.21.15.59:0/887305744 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0041020 con 0x7f1fe815a840 2024-04-25T15:46:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.816+0000 7f1fefda8640 1 -- 172.21.15.59:0/887305744 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe814b850 con 0x7f1fe815a840 2024-04-25T15:46:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.816+0000 7f1fefda8640 1 -- 172.21.15.59:0/887305744 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe814be10 con 0x7f1fe815a840 2024-04-25T15:46:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:49.818+0000 7f1fefda8640 1 -- 172.21.15.59:0/887305744 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fe80698a0 con 0x7f1fe815a840 2024-04-25T15:46:50.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.033+0000 7f1fde7fc640 1 -- 172.21.15.59:0/887305744 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe0031600 con 0x7f1fe815a840 2024-04-25T15:46:50.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.109+0000 7f1fde7fc640 1 -- 172.21.15.59:0/887305744 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0036040 con 0x7f1fe815a840 2024-04-25T15:46:50.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.110+0000 7f1fde7fc640 1 -- 172.21.15.59:0/887305744 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1fe0044020 con 0x7f1fe815a840 2024-04-25T15:46:50.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.110+0000 7f1fde7fc640 1 --2- 172.21.15.59:0/887305744 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1fcc0744b0 0x7f1fcc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:50.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.111+0000 7f1fedb44640 1 --2- 172.21.15.59:0/887305744 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1fcc0744b0 0x7f1fcc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:50.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.111+0000 7f1fedb44640 1 --2- 172.21.15.59:0/887305744 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1fcc0744b0 0x7f1fcc0769c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4006fd0 tx=0x7f1fe4009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.126+0000 7f1fde7fc640 1 -- 172.21.15.59:0/887305744 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1fe00b4870 con 0x7f1fe815a840 2024-04-25T15:46:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.126+0000 7f1fde7fc640 1 -- 172.21.15.59:0/887305744 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1fe004b030 con 0x7f1fe815a840 2024-04-25T15:46:50.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.330+0000 7f1fefda8640 1 -- 172.21.15.59:0/887305744 --> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1fe81f3910 con 0x7f1fcc0744b0 2024-04-25T15:46:50.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.337+0000 7f1fde7fc640 1 -- 172.21.15.59:0/887305744 <== mgr.4102 v2:172.21.15.59:6800/2368090706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251880 (secure 0 0 0) 0x7f1fe81f3910 con 0x7f1fcc0744b0 2024-04-25T15:46:50.341 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:50.342 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T15:46:50.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.339+0000 7f1fefda8640 1 -- 172.21.15.59:0/887305744 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1fcc0744b0 msgr2=0x7f1fcc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:50.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.339+0000 7f1fefda8640 1 --2- 172.21.15.59:0/887305744 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1fcc0744b0 0x7f1fcc0769c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4006fd0 tx=0x7f1fe4009060 comp rx=0 tx=0).stop 2024-04-25T15:46:50.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.339+0000 7f1fefda8640 1 -- 172.21.15.59:0/887305744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fe815a840 msgr2=0x7f1fe814af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:50.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.339+0000 7f1fefda8640 1 --2- 172.21.15.59:0/887305744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fe815a840 0x7f1fe814af30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009f10 tx=0x7f1fe0004a40 comp rx=0 tx=0).stop 2024-04-25T15:46:50.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.340+0000 7f1fefda8640 1 -- 172.21.15.59:0/887305744 shutdown_connections 2024-04-25T15:46:50.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.340+0000 7f1fefda8640 1 --2- 172.21.15.59:0/887305744 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1fcc0744b0 0x7f1fcc0769c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:50.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.340+0000 7f1fefda8640 1 --2- 172.21.15.59:0/887305744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fe815a840 0x7f1fe814af30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:50.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.340+0000 7f1fefda8640 1 --2- 172.21.15.59:0/887305744 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fe80c74a0 0x7f1fe8149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:50.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.340+0000 7f1fefda8640 1 --2- 172.21.15.59:0/887305744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fe806cd40 0x7f1fe8156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:50.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.340+0000 7f1fefda8640 1 -- 172.21.15.59:0/887305744 >> 172.21.15.59:0/887305744 conn(0x7f1fe80cde10 msgr2=0x7f1fe8152d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:50.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.340+0000 7f1fefda8640 1 -- 172.21.15.59:0/887305744 shutdown_connections 2024-04-25T15:46:50.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.340+0000 7f1fefda8640 1 -- 172.21.15.59:0/887305744 wait complete. 2024-04-25T15:46:50.352 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-25T15:46:50.311349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595590,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":226,"num_write_kb":1666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219176,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755544,"statfs":{"total":773094113280,"available":772869677056,"internally_reserved":0,"allocated":3121152,"data_stored":1804284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2812,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003076"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280274+0000","last_change":"2024-04-25T15:46:33.037109+0000","last_active":"2024-04-25T15:46:34.280274+0000","last_peered":"2024-04-25T15:46:34.280274+0000","last_clean":"2024-04-25T15:46:34.280274+0000","last_became_active":"2024-04-25T15:46:33.036415+0000","last_became_peered":"2024-04-25T15:46:33.036415+0000","last_unstale":"2024-04-25T15:46:34.280274+0000","last_undegraded":"2024-04-25T15:46:34.280274+0000","last_fullsized":"2024-04-25T15:46:34.280274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:33.557001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079837+0000","last_change":"2024-04-25T15:46:33.022420+0000","last_active":"2024-04-25T15:46:34.079837+0000","last_peered":"2024-04-25T15:46:34.079837+0000","last_clean":"2024-04-25T15:46:34.079837+0000","last_became_active":"2024-04-25T15:46:33.022095+0000","last_became_peered":"2024-04-25T15:46:33.022095+0000","last_unstale":"2024-04-25T15:46:34.079837+0000","last_undegraded":"2024-04-25T15:46:34.079837+0000","last_fullsized":"2024-04-25T15:46:34.079837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279160+0000","last_change":"2024-04-25T15:46:33.063451+0000","last_active":"2024-04-25T15:46:34.279160+0000","last_peered":"2024-04-25T15:46:34.279160+0000","last_clean":"2024-04-25T15:46:34.279160+0000","last_became_active":"2024-04-25T15:46:33.063038+0000","last_became_peered":"2024-04-25T15:46:33.063038+0000","last_unstale":"2024-04-25T15:46:34.279160+0000","last_undegraded":"2024-04-25T15:46:34.279160+0000","last_fullsized":"2024-04-25T15:46:34.279160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:49:29.792442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072346+0000","last_change":"2024-04-25T15:46:33.041049+0000","last_active":"2024-04-25T15:46:34.072346+0000","last_peered":"2024-04-25T15:46:34.072346+0000","last_clean":"2024-04-25T15:46:34.072346+0000","last_became_active":"2024-04-25T15:46:33.040716+0000","last_became_peered":"2024-04-25T15:46:33.040716+0000","last_unstale":"2024-04-25T15:46:34.072346+0000","last_undegraded":"2024-04-25T15:46:34.072346+0000","last_fullsized":"2024-04-25T15:46:34.072346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:12.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279724+0000","last_change":"2024-04-25T15:46:33.063350+0000","last_active":"2024-04-25T15:46:34.279724+0000","last_peered":"2024-04-25T15:46:34.279724+0000","last_clean":"2024-04-25T15:46:34.279724+0000","last_became_active":"2024-04-25T15:46:33.063110+0000","last_became_peered":"2024-04-25T15:46:33.063110+0000","last_unstale":"2024-04-25T15:46:34.279724+0000","last_undegraded":"2024-04-25T15:46:34.279724+0000","last_fullsized":"2024-04-25T15:46:34.279724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072549+0000","last_change":"2024-04-25T15:46:33.040765+0000","last_active":"2024-04-25T15:46:34.072549+0000","last_peered":"2024-04-25T15:46:34.072549+0000","last_clean":"2024-04-25T15:46:34.072549+0000","last_became_active":"2024-04-25T15:46:33.040272+0000","last_became_peered":"2024-04-25T15:46:33.040272+0000","last_unstale":"2024-04-25T15:46:34.072549+0000","last_undegraded":"2024-04-25T15:46:34.072549+0000","last_fullsized":"2024-04-25T15:46:34.072549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:20.677976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278880+0000","last_change":"2024-04-25T15:46:33.037395+0000","last_active":"2024-04-25T15:46:34.278880+0000","last_peered":"2024-04-25T15:46:34.278880+0000","last_clean":"2024-04-25T15:46:34.278880+0000","last_became_active":"2024-04-25T15:46:33.036613+0000","last_became_peered":"2024-04-25T15:46:33.036613+0000","last_unstale":"2024-04-25T15:46:34.278880+0000","last_undegraded":"2024-04-25T15:46:34.278880+0000","last_fullsized":"2024-04-25T15:46:34.278880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127454+0000","last_change":"2024-04-25T15:46:33.039941+0000","last_active":"2024-04-25T15:46:34.127454+0000","last_peered":"2024-04-25T15:46:34.127454+0000","last_clean":"2024-04-25T15:46:34.127454+0000","last_became_active":"2024-04-25T15:46:33.039696+0000","last_became_peered":"2024-04-25T15:46:33.039696+0000","last_unstale":"2024-04-25T15:46:34.127454+0000","last_undegraded":"2024-04-25T15:46:34.127454+0000","last_fullsized":"2024-04-25T15:46:34.127454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:41.663796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280450+0000","last_change":"2024-04-25T15:46:33.043405+0000","last_active":"2024-04-25T15:46:34.280450+0000","last_peered":"2024-04-25T15:46:34.280450+0000","last_clean":"2024-04-25T15:46:34.280450+0000","last_became_active":"2024-04-25T15:46:33.043094+0000","last_became_peered":"2024-04-25T15:46:33.043094+0000","last_unstale":"2024-04-25T15:46:34.280450+0000","last_undegraded":"2024-04-25T15:46:34.280450+0000","last_fullsized":"2024-04-25T15:46:34.280450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:49.811317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279156+0000","last_change":"2024-04-25T15:46:33.037180+0000","last_active":"2024-04-25T15:46:34.279156+0000","last_peered":"2024-04-25T15:46:34.279156+0000","last_clean":"2024-04-25T15:46:34.279156+0000","last_became_active":"2024-04-25T15:46:33.036822+0000","last_became_peered":"2024-04-25T15:46:33.036822+0000","last_unstale":"2024-04-25T15:46:34.279156+0000","last_undegraded":"2024-04-25T15:46:34.279156+0000","last_fullsized":"2024-04-25T15:46:34.279156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:45.123026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279431+0000","last_change":"2024-04-25T15:46:33.040594+0000","last_active":"2024-04-25T15:46:34.279431+0000","last_peered":"2024-04-25T15:46:34.279431+0000","last_clean":"2024-04-25T15:46:34.279431+0000","last_became_active":"2024-04-25T15:46:33.040296+0000","last_became_peered":"2024-04-25T15:46:33.040296+0000","last_unstale":"2024-04-25T15:46:34.279431+0000","last_undegraded":"2024-04-25T15:46:34.279431+0000","last_fullsized":"2024-04-25T15:46:34.279431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:47.844325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280119+0000","last_change":"2024-04-25T15:46:33.011129+0000","last_active":"2024-04-25T15:46:34.280119+0000","last_peered":"2024-04-25T15:46:34.280119+0000","last_clean":"2024-04-25T15:46:34.280119+0000","last_became_active":"2024-04-25T15:46:33.010754+0000","last_became_peered":"2024-04-25T15:46:33.010754+0000","last_unstale":"2024-04-25T15:46:34.280119+0000","last_undegraded":"2024-04-25T15:46:34.280119+0000","last_fullsized":"2024-04-25T15:46:34.280119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:31.093111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127704+0000","last_change":"2024-04-25T15:46:33.011388+0000","last_active":"2024-04-25T15:46:34.127704+0000","last_peered":"2024-04-25T15:46:34.127704+0000","last_clean":"2024-04-25T15:46:34.127704+0000","last_became_active":"2024-04-25T15:46:33.011083+0000","last_became_peered":"2024-04-25T15:46:33.011083+0000","last_unstale":"2024-04-25T15:46:34.127704+0000","last_undegraded":"2024-04-25T15:46:34.127704+0000","last_fullsized":"2024-04-25T15:46:34.127704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:22.959149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279003+0000","last_change":"2024-04-25T15:46:33.022531+0000","last_active":"2024-04-25T15:46:34.279003+0000","last_peered":"2024-04-25T15:46:34.279003+0000","last_clean":"2024-04-25T15:46:34.279003+0000","last_became_active":"2024-04-25T15:46:33.022214+0000","last_became_peered":"2024-04-25T15:46:33.022214+0000","last_unstale":"2024-04-25T15:46:34.279003+0000","last_undegraded":"2024-04-25T15:46:34.279003+0000","last_fullsized":"2024-04-25T15:46:34.279003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:19.052124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079530+0000","last_change":"2024-04-25T15:46:32.929715+0000","last_active":"2024-04-25T15:46:34.079530+0000","last_peered":"2024-04-25T15:46:34.079530+0000","last_clean":"2024-04-25T15:46:34.079530+0000","last_became_active":"2024-04-25T15:46:32.929386+0000","last_became_peered":"2024-04-25T15:46:32.929386+0000","last_unstale":"2024-04-25T15:46:34.079530+0000","last_undegraded":"2024-04-25T15:46:34.079530+0000","last_fullsized":"2024-04-25T15:46:34.079530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:47.844325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072189+0000","last_change":"2024-04-25T15:46:33.041583+0000","last_active":"2024-04-25T15:46:34.072189+0000","last_peered":"2024-04-25T15:46:34.072189+0000","last_clean":"2024-04-25T15:46:34.072189+0000","last_became_active":"2024-04-25T15:46:33.040240+0000","last_became_peered":"2024-04-25T15:46:33.040240+0000","last_unstale":"2024-04-25T15:46:34.072189+0000","last_undegraded":"2024-04-25T15:46:34.072189+0000","last_fullsized":"2024-04-25T15:46:34.072189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072738+0000","last_change":"2024-04-25T15:46:33.044561+0000","last_active":"2024-04-25T15:46:34.072738+0000","last_peered":"2024-04-25T15:46:34.072738+0000","last_clean":"2024-04-25T15:46:34.072738+0000","last_became_active":"2024-04-25T15:46:33.044065+0000","last_became_peered":"2024-04-25T15:46:33.044065+0000","last_unstale":"2024-04-25T15:46:34.072738+0000","last_undegraded":"2024-04-25T15:46:34.072738+0000","last_fullsized":"2024-04-25T15:46:34.072738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:33.557001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278571+0000","last_change":"2024-04-25T15:46:33.061929+0000","last_active":"2024-04-25T15:46:34.278571+0000","last_peered":"2024-04-25T15:46:34.278571+0000","last_clean":"2024-04-25T15:46:34.278571+0000","last_became_active":"2024-04-25T15:46:33.061623+0000","last_became_peered":"2024-04-25T15:46:33.061623+0000","last_unstale":"2024-04-25T15:46:34.278571+0000","last_undegraded":"2024-04-25T15:46:34.278571+0000","last_fullsized":"2024-04-25T15:46:34.278571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:28.844626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280701+0000","last_change":"2024-04-25T15:46:33.063451+0000","last_active":"2024-04-25T15:46:34.280701+0000","last_peered":"2024-04-25T15:46:34.280701+0000","last_clean":"2024-04-25T15:46:34.280701+0000","last_became_active":"2024-04-25T15:46:33.063126+0000","last_became_peered":"2024-04-25T15:46:33.063126+0000","last_unstale":"2024-04-25T15:46:34.280701+0000","last_undegraded":"2024-04-25T15:46:34.280701+0000","last_fullsized":"2024-04-25T15:46:34.280701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:49.144595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278998+0000","last_change":"2024-04-25T15:46:33.014377+0000","last_active":"2024-04-25T15:46:34.278998+0000","last_peered":"2024-04-25T15:46:34.278998+0000","last_clean":"2024-04-25T15:46:34.278998+0000","last_became_active":"2024-04-25T15:46:33.014056+0000","last_became_peered":"2024-04-25T15:46:33.014056+0000","last_unstale":"2024-04-25T15:46:34.278998+0000","last_undegraded":"2024-04-25T15:46:34.278998+0000","last_fullsized":"2024-04-25T15:46:34.278998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:49.025646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279064+0000","last_change":"2024-04-25T15:46:33.032744+0000","last_active":"2024-04-25T15:46:34.279064+0000","last_peered":"2024-04-25T15:46:34.279064+0000","last_clean":"2024-04-25T15:46:34.279064+0000","last_became_active":"2024-04-25T15:46:33.032498+0000","last_became_peered":"2024-04-25T15:46:33.032498+0000","last_unstale":"2024-04-25T15:46:34.279064+0000","last_undegraded":"2024-04-25T15:46:34.279064+0000","last_fullsized":"2024-04-25T15:46:34.279064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:04.861299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072714+0000","last_change":"2024-04-25T15:46:33.043548+0000","last_active":"2024-04-25T15:46:34.072714+0000","last_peered":"2024-04-25T15:46:34.072714+0000","last_clean":"2024-04-25T15:46:34.072714+0000","last_became_active":"2024-04-25T15:46:33.043251+0000","last_became_peered":"2024-04-25T15:46:33.043251+0000","last_unstale":"2024-04-25T15:46:34.072714+0000","last_undegraded":"2024-04-25T15:46:34.072714+0000","last_fullsized":"2024-04-25T15:46:34.072714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:04.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127585+0000","last_change":"2024-04-25T15:46:32.927532+0000","last_active":"2024-04-25T15:46:34.127585+0000","last_peered":"2024-04-25T15:46:34.127585+0000","last_clean":"2024-04-25T15:46:34.127585+0000","last_became_active":"2024-04-25T15:46:32.926836+0000","last_became_peered":"2024-04-25T15:46:32.926836+0000","last_unstale":"2024-04-25T15:46:34.127585+0000","last_undegraded":"2024-04-25T15:46:34.127585+0000","last_fullsized":"2024-04-25T15:46:34.127585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:21.339594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072201+0000","last_change":"2024-04-25T15:46:33.041900+0000","last_active":"2024-04-25T15:46:34.072201+0000","last_peered":"2024-04-25T15:46:34.072201+0000","last_clean":"2024-04-25T15:46:34.072201+0000","last_became_active":"2024-04-25T15:46:33.040821+0000","last_became_peered":"2024-04-25T15:46:33.040821+0000","last_unstale":"2024-04-25T15:46:34.072201+0000","last_undegraded":"2024-04-25T15:46:34.072201+0000","last_fullsized":"2024-04-25T15:46:34.072201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.128074+0000","last_change":"2024-04-25T15:46:32.926772+0000","last_active":"2024-04-25T15:46:34.128074+0000","last_peered":"2024-04-25T15:46:34.128074+0000","last_clean":"2024-04-25T15:46:34.128074+0000","last_became_active":"2024-04-25T15:46:32.926468+0000","last_became_peered":"2024-04-25T15:46:32.926468+0000","last_unstale":"2024-04-25T15:46:34.128074+0000","last_undegraded":"2024-04-25T15:46:34.128074+0000","last_fullsized":"2024-04-25T15:46:34.128074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:21:35.665923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279365+0000","last_change":"2024-04-25T15:46:33.031482+0000","last_active":"2024-04-25T15:46:34.279365+0000","last_peered":"2024-04-25T15:46:34.279365+0000","last_clean":"2024-04-25T15:46:34.279365+0000","last_became_active":"2024-04-25T15:46:33.031182+0000","last_became_peered":"2024-04-25T15:46:33.031182+0000","last_unstale":"2024-04-25T15:46:34.279365+0000","last_undegraded":"2024-04-25T15:46:34.279365+0000","last_fullsized":"2024-04-25T15:46:34.279365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079941+0000","last_change":"2024-04-25T15:46:32.931992+0000","last_active":"2024-04-25T15:46:34.079941+0000","last_peered":"2024-04-25T15:46:34.079941+0000","last_clean":"2024-04-25T15:46:34.079941+0000","last_became_active":"2024-04-25T15:46:32.931684+0000","last_became_peered":"2024-04-25T15:46:32.931684+0000","last_unstale":"2024-04-25T15:46:34.079941+0000","last_undegraded":"2024-04-25T15:46:34.079941+0000","last_fullsized":"2024-04-25T15:46:34.079941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:12.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127825+0000","last_change":"2024-04-25T15:46:32.926461+0000","last_active":"2024-04-25T15:46:34.127825+0000","last_peered":"2024-04-25T15:46:34.127825+0000","last_clean":"2024-04-25T15:46:34.127825+0000","last_became_active":"2024-04-25T15:46:32.926136+0000","last_became_peered":"2024-04-25T15:46:32.926136+0000","last_unstale":"2024-04-25T15:46:34.127825+0000","last_undegraded":"2024-04-25T15:46:34.127825+0000","last_fullsized":"2024-04-25T15:46:34.127825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:29.896062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279231+0000","last_change":"2024-04-25T15:46:33.022460+0000","last_active":"2024-04-25T15:46:34.279231+0000","last_peered":"2024-04-25T15:46:34.279231+0000","last_clean":"2024-04-25T15:46:34.279231+0000","last_became_active":"2024-04-25T15:46:33.022116+0000","last_became_peered":"2024-04-25T15:46:33.022116+0000","last_unstale":"2024-04-25T15:46:34.279231+0000","last_undegraded":"2024-04-25T15:46:34.279231+0000","last_fullsized":"2024-04-25T15:46:34.279231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:22.980615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072889+0000","last_change":"2024-04-25T15:46:33.040668+0000","last_active":"2024-04-25T15:46:34.072889+0000","last_peered":"2024-04-25T15:46:34.072889+0000","last_clean":"2024-04-25T15:46:34.072889+0000","last_became_active":"2024-04-25T15:46:33.040134+0000","last_became_peered":"2024-04-25T15:46:33.040134+0000","last_unstale":"2024-04-25T15:46:34.072889+0000","last_undegraded":"2024-04-25T15:46:34.072889+0000","last_fullsized":"2024-04-25T15:46:34.072889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:16.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278491+0000","last_change":"2024-04-25T15:46:33.062510+0000","last_active":"2024-04-25T15:46:34.278491+0000","last_peered":"2024-04-25T15:46:34.278491+0000","last_clean":"2024-04-25T15:46:34.278491+0000","last_became_active":"2024-04-25T15:46:33.062166+0000","last_became_peered":"2024-04-25T15:46:33.062166+0000","last_unstale":"2024-04-25T15:46:34.278491+0000","last_undegraded":"2024-04-25T15:46:34.278491+0000","last_fullsized":"2024-04-25T15:46:34.278491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:31.093111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279330+0000","last_change":"2024-04-25T15:46:33.022223+0000","last_active":"2024-04-25T15:46:34.279330+0000","last_peered":"2024-04-25T15:46:34.279330+0000","last_clean":"2024-04-25T15:46:34.279330+0000","last_became_active":"2024-04-25T15:46:33.021888+0000","last_became_peered":"2024-04-25T15:46:33.021888+0000","last_unstale":"2024-04-25T15:46:34.279330+0000","last_undegraded":"2024-04-25T15:46:34.279330+0000","last_fullsized":"2024-04-25T15:46:34.279330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:23.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279381+0000","last_change":"2024-04-25T15:46:32.929281+0000","last_active":"2024-04-25T15:46:34.279381+0000","last_peered":"2024-04-25T15:46:34.279381+0000","last_clean":"2024-04-25T15:46:34.279381+0000","last_became_active":"2024-04-25T15:46:32.929019+0000","last_became_peered":"2024-04-25T15:46:32.929019+0000","last_unstale":"2024-04-25T15:46:34.279381+0000","last_undegraded":"2024-04-25T15:46:34.279381+0000","last_fullsized":"2024-04-25T15:46:34.279381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:55.692126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.522003+0000","last_change":"2024-04-25T15:46:31.685950+0000","last_active":"2024-04-25T15:46:39.522003+0000","last_peered":"2024-04-25T15:46:39.522003+0000","last_clean":"2024-04-25T15:46:39.522003+0000","last_became_active":"2024-04-25T15:46:31.685602+0000","last_became_peered":"2024-04-25T15:46:31.685602+0000","last_unstale":"2024-04-25T15:46:39.522003+0000","last_undegraded":"2024-04-25T15:46:39.522003+0000","last_fullsized":"2024-04-25T15:46:39.522003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:29.676427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279266+0000","last_change":"2024-04-25T15:46:33.023655+0000","last_active":"2024-04-25T15:46:34.279266+0000","last_peered":"2024-04-25T15:46:34.279266+0000","last_clean":"2024-04-25T15:46:34.279266+0000","last_became_active":"2024-04-25T15:46:33.023432+0000","last_became_peered":"2024-04-25T15:46:33.023432+0000","last_unstale":"2024-04-25T15:46:34.279266+0000","last_undegraded":"2024-04-25T15:46:34.279266+0000","last_fullsized":"2024-04-25T15:46:34.279266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:21.339594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.782101+0000","last_change":"2024-04-25T15:46:31.659079+0000","last_active":"2024-04-25T15:46:41.782101+0000","last_peered":"2024-04-25T15:46:41.782101+0000","last_clean":"2024-04-25T15:46:41.782101+0000","last_became_active":"2024-04-25T15:46:31.658681+0000","last_became_peered":"2024-04-25T15:46:31.658681+0000","last_unstale":"2024-04-25T15:46:41.782101+0000","last_undegraded":"2024-04-25T15:46:41.782101+0000","last_fullsized":"2024-04-25T15:46:41.782101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.779115+0000","last_change":"2024-04-25T15:46:31.684220+0000","last_active":"2024-04-25T15:46:41.779115+0000","last_peered":"2024-04-25T15:46:41.779115+0000","last_clean":"2024-04-25T15:46:41.779115+0000","last_became_active":"2024-04-25T15:46:31.682936+0000","last_became_peered":"2024-04-25T15:46:31.682936+0000","last_unstale":"2024-04-25T15:46:41.779115+0000","last_undegraded":"2024-04-25T15:46:41.779115+0000","last_fullsized":"2024-04-25T15:46:41.779115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:53.729696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127570+0000","last_change":"2024-04-25T15:46:33.019843+0000","last_active":"2024-04-25T15:46:34.127570+0000","last_peered":"2024-04-25T15:46:34.127570+0000","last_clean":"2024-04-25T15:46:34.127570+0000","last_became_active":"2024-04-25T15:46:33.019526+0000","last_became_peered":"2024-04-25T15:46:33.019526+0000","last_unstale":"2024-04-25T15:46:34.127570+0000","last_undegraded":"2024-04-25T15:46:34.127570+0000","last_fullsized":"2024-04-25T15:46:34.127570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:22.980615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072467+0000","last_change":"2024-04-25T15:46:31.689444+0000","last_active":"2024-04-25T15:46:34.072467+0000","last_peered":"2024-04-25T15:46:34.072467+0000","last_clean":"2024-04-25T15:46:34.072467+0000","last_became_active":"2024-04-25T15:46:31.689130+0000","last_became_peered":"2024-04-25T15:46:31.689130+0000","last_unstale":"2024-04-25T15:46:34.072467+0000","last_undegraded":"2024-04-25T15:46:34.072467+0000","last_fullsized":"2024-04-25T15:46:34.072467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079523+0000","last_change":"2024-04-25T15:46:32.931979+0000","last_active":"2024-04-25T15:46:34.079523+0000","last_peered":"2024-04-25T15:46:34.079523+0000","last_clean":"2024-04-25T15:46:34.079523+0000","last_became_active":"2024-04-25T15:46:32.931648+0000","last_became_peered":"2024-04-25T15:46:32.931648+0000","last_unstale":"2024-04-25T15:46:34.079523+0000","last_undegraded":"2024-04-25T15:46:34.079523+0000","last_fullsized":"2024-04-25T15:46:34.079523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:23.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.520120+0000","last_change":"2024-04-25T15:46:31.685721+0000","last_active":"2024-04-25T15:46:39.520120+0000","last_peered":"2024-04-25T15:46:39.520120+0000","last_clean":"2024-04-25T15:46:39.520120+0000","last_became_active":"2024-04-25T15:46:31.685244+0000","last_became_peered":"2024-04-25T15:46:31.685244+0000","last_unstale":"2024-04-25T15:46:39.520120+0000","last_undegraded":"2024-04-25T15:46:39.520120+0000","last_fullsized":"2024-04-25T15:46:39.520120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072360+0000","last_change":"2024-04-25T15:46:33.043533+0000","last_active":"2024-04-25T15:46:34.072360+0000","last_peered":"2024-04-25T15:46:34.072360+0000","last_clean":"2024-04-25T15:46:34.072360+0000","last_became_active":"2024-04-25T15:46:33.043228+0000","last_became_peered":"2024-04-25T15:46:33.043228+0000","last_unstale":"2024-04-25T15:46:34.072360+0000","last_undegraded":"2024-04-25T15:46:34.072360+0000","last_fullsized":"2024-04-25T15:46:34.072360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.519834+0000","last_change":"2024-04-25T15:46:31.692399+0000","last_active":"2024-04-25T15:46:39.519834+0000","last_peered":"2024-04-25T15:46:39.519834+0000","last_clean":"2024-04-25T15:46:39.519834+0000","last_became_active":"2024-04-25T15:46:31.692063+0000","last_became_peered":"2024-04-25T15:46:31.692063+0000","last_unstale":"2024-04-25T15:46:39.519834+0000","last_undegraded":"2024-04-25T15:46:39.519834+0000","last_fullsized":"2024-04-25T15:46:39.519834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279587+0000","last_change":"2024-04-25T15:46:33.043275+0000","last_active":"2024-04-25T15:46:34.279587+0000","last_peered":"2024-04-25T15:46:34.279587+0000","last_clean":"2024-04-25T15:46:34.279587+0000","last_became_active":"2024-04-25T15:46:33.042941+0000","last_became_peered":"2024-04-25T15:46:33.042941+0000","last_unstale":"2024-04-25T15:46:34.279587+0000","last_undegraded":"2024-04-25T15:46:34.279587+0000","last_fullsized":"2024-04-25T15:46:34.279587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:22.959149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.598215+0000","last_change":"2024-04-25T15:46:31.686299+0000","last_active":"2024-04-25T15:46:34.598215+0000","last_peered":"2024-04-25T15:46:34.598215+0000","last_clean":"2024-04-25T15:46:34.598215+0000","last_became_active":"2024-04-25T15:46:31.685993+0000","last_became_peered":"2024-04-25T15:46:31.685993+0000","last_unstale":"2024-04-25T15:46:34.598215+0000","last_undegraded":"2024-04-25T15:46:34.598215+0000","last_fullsized":"2024-04-25T15:46:34.598215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280313+0000","last_change":"2024-04-25T15:46:33.035207+0000","last_active":"2024-04-25T15:46:34.280313+0000","last_peered":"2024-04-25T15:46:34.280313+0000","last_clean":"2024-04-25T15:46:34.280313+0000","last_became_active":"2024-04-25T15:46:33.034926+0000","last_became_peered":"2024-04-25T15:46:33.034926+0000","last_unstale":"2024-04-25T15:46:34.280313+0000","last_undegraded":"2024-04-25T15:46:34.280313+0000","last_fullsized":"2024-04-25T15:46:34.280313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:28.844626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.518399+0000","last_change":"2024-04-25T15:46:31.683086+0000","last_active":"2024-04-25T15:46:39.518399+0000","last_peered":"2024-04-25T15:46:39.518399+0000","last_clean":"2024-04-25T15:46:39.518399+0000","last_became_active":"2024-04-25T15:46:31.682661+0000","last_became_peered":"2024-04-25T15:46:31.682661+0000","last_unstale":"2024-04-25T15:46:39.518399+0000","last_undegraded":"2024-04-25T15:46:39.518399+0000","last_fullsized":"2024-04-25T15:46:39.518399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280485+0000","last_change":"2024-04-25T15:46:33.034800+0000","last_active":"2024-04-25T15:46:34.280485+0000","last_peered":"2024-04-25T15:46:34.280485+0000","last_clean":"2024-04-25T15:46:34.280485+0000","last_became_active":"2024-04-25T15:46:33.034493+0000","last_became_peered":"2024-04-25T15:46:33.034493+0000","last_unstale":"2024-04-25T15:46:34.280485+0000","last_undegraded":"2024-04-25T15:46:34.280485+0000","last_fullsized":"2024-04-25T15:46:34.280485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:16.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.773070+0000","last_change":"2024-04-25T15:46:31.688398+0000","last_active":"2024-04-25T15:46:41.773070+0000","last_peered":"2024-04-25T15:46:41.773070+0000","last_clean":"2024-04-25T15:46:41.773070+0000","last_became_active":"2024-04-25T15:46:31.688096+0000","last_became_peered":"2024-04-25T15:46:31.688096+0000","last_unstale":"2024-04-25T15:46:41.773070+0000","last_undegraded":"2024-04-25T15:46:41.773070+0000","last_fullsized":"2024-04-25T15:46:41.773070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:53.729696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279191+0000","last_change":"2024-04-25T15:46:33.031520+0000","last_active":"2024-04-25T15:46:34.279191+0000","last_peered":"2024-04-25T15:46:34.279191+0000","last_clean":"2024-04-25T15:46:34.279191+0000","last_became_active":"2024-04-25T15:46:33.031282+0000","last_became_peered":"2024-04-25T15:46:33.031282+0000","last_unstale":"2024-04-25T15:46:34.279191+0000","last_undegraded":"2024-04-25T15:46:34.279191+0000","last_fullsized":"2024-04-25T15:46:34.279191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:41.663796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.520081+0000","last_change":"2024-04-25T15:46:31.691191+0000","last_active":"2024-04-25T15:46:39.520081+0000","last_peered":"2024-04-25T15:46:39.520081+0000","last_clean":"2024-04-25T15:46:39.520081+0000","last_became_active":"2024-04-25T15:46:31.690848+0000","last_became_peered":"2024-04-25T15:46:31.690848+0000","last_unstale":"2024-04-25T15:46:39.520081+0000","last_undegraded":"2024-04-25T15:46:39.520081+0000","last_fullsized":"2024-04-25T15:46:39.520081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279897+0000","last_change":"2024-04-25T15:46:33.040890+0000","last_active":"2024-04-25T15:46:34.279897+0000","last_peered":"2024-04-25T15:46:34.279897+0000","last_clean":"2024-04-25T15:46:34.279897+0000","last_became_active":"2024-04-25T15:46:33.040568+0000","last_became_peered":"2024-04-25T15:46:33.040568+0000","last_unstale":"2024-04-25T15:46:34.279897+0000","last_undegraded":"2024-04-25T15:46:34.279897+0000","last_fullsized":"2024-04-25T15:46:34.279897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:04.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.784901+0000","last_change":"2024-04-25T15:46:31.659031+0000","last_active":"2024-04-25T15:46:41.784901+0000","last_peered":"2024-04-25T15:46:41.784901+0000","last_clean":"2024-04-25T15:46:41.784901+0000","last_became_active":"2024-04-25T15:46:31.658670+0000","last_became_peered":"2024-04-25T15:46:31.658670+0000","last_unstale":"2024-04-25T15:46:41.784901+0000","last_undegraded":"2024-04-25T15:46:41.784901+0000","last_fullsized":"2024-04-25T15:46:41.784901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279448+0000","last_change":"2024-04-25T15:46:33.021142+0000","last_active":"2024-04-25T15:46:34.279448+0000","last_peered":"2024-04-25T15:46:34.279448+0000","last_clean":"2024-04-25T15:46:34.279448+0000","last_became_active":"2024-04-25T15:46:33.020753+0000","last_became_peered":"2024-04-25T15:46:33.020753+0000","last_unstale":"2024-04-25T15:46:34.279448+0000","last_undegraded":"2024-04-25T15:46:34.279448+0000","last_fullsized":"2024-04-25T15:46:34.279448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'15","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.910630+0000","last_change":"2024-04-25T15:46:31.703454+0000","last_active":"2024-04-25T15:46:41.910630+0000","last_peered":"2024-04-25T15:46:41.910630+0000","last_clean":"2024-04-25T15:46:41.910630+0000","last_became_active":"2024-04-25T15:46:31.703167+0000","last_became_peered":"2024-04-25T15:46:31.703167+0000","last_unstale":"2024-04-25T15:46:41.910630+0000","last_undegraded":"2024-04-25T15:46:41.910630+0000","last_fullsized":"2024-04-25T15:46:41.910630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:02.958438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279066+0000","last_change":"2024-04-25T15:46:33.039900+0000","last_active":"2024-04-25T15:46:34.279066+0000","last_peered":"2024-04-25T15:46:34.279066+0000","last_clean":"2024-04-25T15:46:34.279066+0000","last_became_active":"2024-04-25T15:46:33.039613+0000","last_became_peered":"2024-04-25T15:46:33.039613+0000","last_unstale":"2024-04-25T15:46:34.279066+0000","last_undegraded":"2024-04-25T15:46:34.279066+0000","last_fullsized":"2024-04-25T15:46:34.279066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.556040+0000","last_change":"2024-04-25T15:46:31.684537+0000","last_active":"2024-04-25T15:46:34.556040+0000","last_peered":"2024-04-25T15:46:34.556040+0000","last_clean":"2024-04-25T15:46:34.556040+0000","last_became_active":"2024-04-25T15:46:31.684173+0000","last_became_peered":"2024-04-25T15:46:31.684173+0000","last_unstale":"2024-04-25T15:46:34.556040+0000","last_undegraded":"2024-04-25T15:46:34.556040+0000","last_fullsized":"2024-04-25T15:46:34.556040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:41.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279453+0000","last_change":"2024-04-25T15:46:33.037831+0000","last_active":"2024-04-25T15:46:34.279453+0000","last_peered":"2024-04-25T15:46:34.279453+0000","last_clean":"2024-04-25T15:46:34.279453+0000","last_became_active":"2024-04-25T15:46:33.037529+0000","last_became_peered":"2024-04-25T15:46:33.037529+0000","last_unstale":"2024-04-25T15:46:34.279453+0000","last_undegraded":"2024-04-25T15:46:34.279453+0000","last_fullsized":"2024-04-25T15:46:34.279453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:20.677976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.683508+0000","last_change":"2024-04-25T15:46:31.704159+0000","last_active":"2024-04-25T15:46:34.683508+0000","last_peered":"2024-04-25T15:46:34.683508+0000","last_clean":"2024-04-25T15:46:34.683508+0000","last_became_active":"2024-04-25T15:46:31.703896+0000","last_became_peered":"2024-04-25T15:46:31.703896+0000","last_unstale":"2024-04-25T15:46:34.683508+0000","last_undegraded":"2024-04-25T15:46:34.683508+0000","last_fullsized":"2024-04-25T15:46:34.683508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280621+0000","last_change":"2024-04-25T15:46:33.038719+0000","last_active":"2024-04-25T15:46:34.280621+0000","last_peered":"2024-04-25T15:46:34.280621+0000","last_clean":"2024-04-25T15:46:34.280621+0000","last_became_active":"2024-04-25T15:46:33.038380+0000","last_became_peered":"2024-04-25T15:46:33.038380+0000","last_unstale":"2024-04-25T15:46:34.280621+0000","last_undegraded":"2024-04-25T15:46:34.280621+0000","last_fullsized":"2024-04-25T15:46:34.280621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:13:33.423087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079971+0000","last_change":"2024-04-25T15:46:31.690489+0000","last_active":"2024-04-25T15:46:34.079971+0000","last_peered":"2024-04-25T15:46:34.079971+0000","last_clean":"2024-04-25T15:46:34.079971+0000","last_became_active":"2024-04-25T15:46:31.690181+0000","last_became_peered":"2024-04-25T15:46:31.690181+0000","last_unstale":"2024-04-25T15:46:34.079971+0000","last_undegraded":"2024-04-25T15:46:34.079971+0000","last_fullsized":"2024-04-25T15:46:34.079971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072683+0000","last_change":"2024-04-25T15:46:33.036460+0000","last_active":"2024-04-25T15:46:34.072683+0000","last_peered":"2024-04-25T15:46:34.072683+0000","last_clean":"2024-04-25T15:46:34.072683+0000","last_became_active":"2024-04-25T15:46:33.036033+0000","last_became_peered":"2024-04-25T15:46:33.036033+0000","last_unstale":"2024-04-25T15:46:34.072683+0000","last_undegraded":"2024-04-25T15:46:34.072683+0000","last_fullsized":"2024-04-25T15:46:34.072683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.908940+0000","last_change":"2024-04-25T15:46:31.703571+0000","last_active":"2024-04-25T15:46:41.908940+0000","last_peered":"2024-04-25T15:46:41.908940+0000","last_clean":"2024-04-25T15:46:41.908940+0000","last_became_active":"2024-04-25T15:46:31.703234+0000","last_became_peered":"2024-04-25T15:46:31.703234+0000","last_unstale":"2024-04-25T15:46:41.908940+0000","last_undegraded":"2024-04-25T15:46:41.908940+0000","last_fullsized":"2024-04-25T15:46:41.908940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280501+0000","last_change":"2024-04-25T15:46:33.043464+0000","last_active":"2024-04-25T15:46:34.280501+0000","last_peered":"2024-04-25T15:46:34.280501+0000","last_clean":"2024-04-25T15:46:34.280501+0000","last_became_active":"2024-04-25T15:46:33.043145+0000","last_became_peered":"2024-04-25T15:46:33.043145+0000","last_unstale":"2024-04-25T15:46:34.280501+0000","last_undegraded":"2024-04-25T15:46:34.280501+0000","last_fullsized":"2024-04-25T15:46:34.280501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:06.648469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278676+0000","last_change":"2024-04-25T15:46:20.235628+0000","last_active":"2024-04-25T15:46:34.278676+0000","last_peered":"2024-04-25T15:46:34.278676+0000","last_clean":"2024-04-25T15:46:34.278676+0000","last_became_active":"2024-04-25T15:46:20.234477+0000","last_became_peered":"2024-04-25T15:46:20.234477+0000","last_unstale":"2024-04-25T15:46:34.278676+0000","last_undegraded":"2024-04-25T15:46:34.278676+0000","last_fullsized":"2024-04-25T15:46:34.278676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:17.824148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:17.824148+0000","last_clean_scrub_stamp":"2024-04-25T15:46:17.824148+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:50:25.187348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.520967+0000","last_change":"2024-04-25T15:46:31.702774+0000","last_active":"2024-04-25T15:46:39.520967+0000","last_peered":"2024-04-25T15:46:39.520967+0000","last_clean":"2024-04-25T15:46:39.520967+0000","last_became_active":"2024-04-25T15:46:31.702517+0000","last_became_peered":"2024-04-25T15:46:31.702517+0000","last_unstale":"2024-04-25T15:46:39.520967+0000","last_undegraded":"2024-04-25T15:46:39.520967+0000","last_fullsized":"2024-04-25T15:46:39.520967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127685+0000","last_change":"2024-04-25T15:46:33.043034+0000","last_active":"2024-04-25T15:46:34.127685+0000","last_peered":"2024-04-25T15:46:34.127685+0000","last_clean":"2024-04-25T15:46:34.127685+0000","last_became_active":"2024-04-25T15:46:33.042522+0000","last_became_peered":"2024-04-25T15:46:33.042522+0000","last_unstale":"2024-04-25T15:46:34.127685+0000","last_undegraded":"2024-04-25T15:46:34.127685+0000","last_fullsized":"2024-04-25T15:46:34.127685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:40.746464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.784860+0000","last_change":"2024-04-25T15:46:31.689200+0000","last_active":"2024-04-25T15:46:41.784860+0000","last_peered":"2024-04-25T15:46:41.784860+0000","last_clean":"2024-04-25T15:46:41.784860+0000","last_became_active":"2024-04-25T15:46:31.687761+0000","last_became_peered":"2024-04-25T15:46:31.687761+0000","last_unstale":"2024-04-25T15:46:41.784860+0000","last_undegraded":"2024-04-25T15:46:41.784860+0000","last_fullsized":"2024-04-25T15:46:41.784860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278867+0000","last_change":"2024-04-25T15:46:33.021652+0000","last_active":"2024-04-25T15:46:34.278867+0000","last_peered":"2024-04-25T15:46:34.278867+0000","last_clean":"2024-04-25T15:46:34.278867+0000","last_became_active":"2024-04-25T15:46:33.020828+0000","last_became_peered":"2024-04-25T15:46:33.020828+0000","last_unstale":"2024-04-25T15:46:34.278867+0000","last_undegraded":"2024-04-25T15:46:34.278867+0000","last_fullsized":"2024-04-25T15:46:34.278867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:11.243833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.909249+0000","last_change":"2024-04-25T15:46:31.704698+0000","last_active":"2024-04-25T15:46:41.909249+0000","last_peered":"2024-04-25T15:46:41.909249+0000","last_clean":"2024-04-25T15:46:41.909249+0000","last_became_active":"2024-04-25T15:46:31.704412+0000","last_became_peered":"2024-04-25T15:46:31.704412+0000","last_unstale":"2024-04-25T15:46:41.909249+0000","last_undegraded":"2024-04-25T15:46:41.909249+0000","last_fullsized":"2024-04-25T15:46:41.909249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079474+0000","last_change":"2024-04-25T15:46:33.061942+0000","last_active":"2024-04-25T15:46:34.079474+0000","last_peered":"2024-04-25T15:46:34.079474+0000","last_clean":"2024-04-25T15:46:34.079474+0000","last_became_active":"2024-04-25T15:46:33.061619+0000","last_became_peered":"2024-04-25T15:46:33.061619+0000","last_unstale":"2024-04-25T15:46:34.079474+0000","last_undegraded":"2024-04-25T15:46:34.079474+0000","last_fullsized":"2024-04-25T15:46:34.079474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:45.123026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.073122+0000","last_change":"2024-04-25T15:46:31.690694+0000","last_active":"2024-04-25T15:46:34.073122+0000","last_peered":"2024-04-25T15:46:34.073122+0000","last_clean":"2024-04-25T15:46:34.073122+0000","last_became_active":"2024-04-25T15:46:31.690339+0000","last_became_peered":"2024-04-25T15:46:31.690339+0000","last_unstale":"2024-04-25T15:46:34.073122+0000","last_undegraded":"2024-04-25T15:46:34.073122+0000","last_fullsized":"2024-04-25T15:46:34.073122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280771+0000","last_change":"2024-04-25T15:46:33.022306+0000","last_active":"2024-04-25T15:46:34.280771+0000","last_peered":"2024-04-25T15:46:34.280771+0000","last_clean":"2024-04-25T15:46:34.280771+0000","last_became_active":"2024-04-25T15:46:33.021995+0000","last_became_peered":"2024-04-25T15:46:33.021995+0000","last_unstale":"2024-04-25T15:46:34.280771+0000","last_undegraded":"2024-04-25T15:46:34.280771+0000","last_fullsized":"2024-04-25T15:46:34.280771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:03.749619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079765+0000","last_change":"2024-04-25T15:46:31.684114+0000","last_active":"2024-04-25T15:46:34.079765+0000","last_peered":"2024-04-25T15:46:34.079765+0000","last_clean":"2024-04-25T15:46:34.079765+0000","last_became_active":"2024-04-25T15:46:31.683802+0000","last_became_peered":"2024-04-25T15:46:31.683802+0000","last_unstale":"2024-04-25T15:46:34.079765+0000","last_undegraded":"2024-04-25T15:46:34.079765+0000","last_fullsized":"2024-04-25T15:46:34.079765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072964+0000","last_change":"2024-04-25T15:46:33.040119+0000","last_active":"2024-04-25T15:46:34.072964+0000","last_peered":"2024-04-25T15:46:34.072964+0000","last_clean":"2024-04-25T15:46:34.072964+0000","last_became_active":"2024-04-25T15:46:33.039820+0000","last_became_peered":"2024-04-25T15:46:33.039820+0000","last_unstale":"2024-04-25T15:46:34.072964+0000","last_undegraded":"2024-04-25T15:46:34.072964+0000","last_fullsized":"2024-04-25T15:46:34.072964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:06.648469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280760+0000","last_change":"2024-04-25T15:46:31.688610+0000","last_active":"2024-04-25T15:46:34.280760+0000","last_peered":"2024-04-25T15:46:34.280760+0000","last_clean":"2024-04-25T15:46:34.280760+0000","last_became_active":"2024-04-25T15:46:31.688274+0000","last_became_peered":"2024-04-25T15:46:31.688274+0000","last_unstale":"2024-04-25T15:46:34.280760+0000","last_undegraded":"2024-04-25T15:46:34.280760+0000","last_fullsized":"2024-04-25T15:46:34.280760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:02.574106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079663+0000","last_change":"2024-04-25T15:46:33.062042+0000","last_active":"2024-04-25T15:46:34.079663+0000","last_peered":"2024-04-25T15:46:34.079663+0000","last_clean":"2024-04-25T15:46:34.079663+0000","last_became_active":"2024-04-25T15:46:33.061680+0000","last_became_peered":"2024-04-25T15:46:33.061680+0000","last_unstale":"2024-04-25T15:46:34.079663+0000","last_undegraded":"2024-04-25T15:46:34.079663+0000","last_fullsized":"2024-04-25T15:46:34.079663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.910757+0000","last_change":"2024-04-25T15:46:31.687114+0000","last_active":"2024-04-25T15:46:41.910757+0000","last_peered":"2024-04-25T15:46:41.910757+0000","last_clean":"2024-04-25T15:46:41.910757+0000","last_became_active":"2024-04-25T15:46:31.686758+0000","last_became_peered":"2024-04-25T15:46:31.686758+0000","last_unstale":"2024-04-25T15:46:41.910757+0000","last_undegraded":"2024-04-25T15:46:41.910757+0000","last_fullsized":"2024-04-25T15:46:41.910757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.128107+0000","last_change":"2024-04-25T15:46:33.031231+0000","last_active":"2024-04-25T15:46:34.128107+0000","last_peered":"2024-04-25T15:46:34.128107+0000","last_clean":"2024-04-25T15:46:34.128107+0000","last_became_active":"2024-04-25T15:46:33.030894+0000","last_became_peered":"2024-04-25T15:46:33.030894+0000","last_unstale":"2024-04-25T15:46:34.128107+0000","last_undegraded":"2024-04-25T15:46:34.128107+0000","last_fullsized":"2024-04-25T15:46:34.128107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:40.210974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.518049+0000","last_change":"2024-04-25T15:46:31.688577+0000","last_active":"2024-04-25T15:46:39.518049+0000","last_peered":"2024-04-25T15:46:39.518049+0000","last_clean":"2024-04-25T15:46:39.518049+0000","last_became_active":"2024-04-25T15:46:31.687691+0000","last_became_peered":"2024-04-25T15:46:31.687691+0000","last_unstale":"2024-04-25T15:46:39.518049+0000","last_undegraded":"2024-04-25T15:46:39.518049+0000","last_fullsized":"2024-04-25T15:46:39.518049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279504+0000","last_change":"2024-04-25T15:46:33.021249+0000","last_active":"2024-04-25T15:46:34.279504+0000","last_peered":"2024-04-25T15:46:34.279504+0000","last_clean":"2024-04-25T15:46:34.279504+0000","last_became_active":"2024-04-25T15:46:33.020779+0000","last_became_peered":"2024-04-25T15:46:33.020779+0000","last_unstale":"2024-04-25T15:46:34.279504+0000","last_undegraded":"2024-04-25T15:46:34.279504+0000","last_fullsized":"2024-04-25T15:46:34.279504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:39.504513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.406934+0000","last_change":"2024-04-25T15:46:31.689494+0000","last_active":"2024-04-25T15:46:39.406934+0000","last_peered":"2024-04-25T15:46:39.406934+0000","last_clean":"2024-04-25T15:46:39.406934+0000","last_became_active":"2024-04-25T15:46:31.688192+0000","last_became_peered":"2024-04-25T15:46:31.688192+0000","last_unstale":"2024-04-25T15:46:39.406934+0000","last_undegraded":"2024-04-25T15:46:39.406934+0000","last_fullsized":"2024-04-25T15:46:39.406934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278866+0000","last_change":"2024-04-25T15:46:33.062043+0000","last_active":"2024-04-25T15:46:34.278866+0000","last_peered":"2024-04-25T15:46:34.278866+0000","last_clean":"2024-04-25T15:46:34.278866+0000","last_became_active":"2024-04-25T15:46:33.061651+0000","last_became_peered":"2024-04-25T15:46:33.061651+0000","last_unstale":"2024-04-25T15:46:34.278866+0000","last_undegraded":"2024-04-25T15:46:34.278866+0000","last_fullsized":"2024-04-25T15:46:34.278866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:21.340361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.495665+0000","last_change":"2024-04-25T15:46:31.685055+0000","last_active":"2024-04-25T15:46:39.495665+0000","last_peered":"2024-04-25T15:46:39.495665+0000","last_clean":"2024-04-25T15:46:39.495665+0000","last_became_active":"2024-04-25T15:46:31.684706+0000","last_became_peered":"2024-04-25T15:46:31.684706+0000","last_unstale":"2024-04-25T15:46:39.495665+0000","last_undegraded":"2024-04-25T15:46:39.495665+0000","last_fullsized":"2024-04-25T15:46:39.495665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:29.917598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127645+0000","last_change":"2024-04-25T15:46:32.929240+0000","last_active":"2024-04-25T15:46:34.127645+0000","last_peered":"2024-04-25T15:46:34.127645+0000","last_clean":"2024-04-25T15:46:34.127645+0000","last_became_active":"2024-04-25T15:46:32.928971+0000","last_became_peered":"2024-04-25T15:46:32.928971+0000","last_unstale":"2024-04-25T15:46:34.127645+0000","last_undegraded":"2024-04-25T15:46:34.127645+0000","last_fullsized":"2024-04-25T15:46:34.127645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:39.504513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079841+0000","last_change":"2024-04-25T15:46:31.687651+0000","last_active":"2024-04-25T15:46:34.079841+0000","last_peered":"2024-04-25T15:46:34.079841+0000","last_clean":"2024-04-25T15:46:34.079841+0000","last_became_active":"2024-04-25T15:46:31.687335+0000","last_became_peered":"2024-04-25T15:46:31.687335+0000","last_unstale":"2024-04-25T15:46:34.079841+0000","last_undegraded":"2024-04-25T15:46:34.079841+0000","last_fullsized":"2024-04-25T15:46:34.079841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127741+0000","last_change":"2024-04-25T15:46:33.021215+0000","last_active":"2024-04-25T15:46:34.127741+0000","last_peered":"2024-04-25T15:46:34.127741+0000","last_clean":"2024-04-25T15:46:34.127741+0000","last_became_active":"2024-04-25T15:46:33.020855+0000","last_became_peered":"2024-04-25T15:46:33.020855+0000","last_unstale":"2024-04-25T15:46:34.127741+0000","last_undegraded":"2024-04-25T15:46:34.127741+0000","last_fullsized":"2024-04-25T15:46:34.127741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:54.058601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.407002+0000","last_change":"2024-04-25T15:46:31.693099+0000","last_active":"2024-04-25T15:46:39.407002+0000","last_peered":"2024-04-25T15:46:39.407002+0000","last_clean":"2024-04-25T15:46:39.407002+0000","last_became_active":"2024-04-25T15:46:31.692762+0000","last_became_peered":"2024-04-25T15:46:31.692762+0000","last_unstale":"2024-04-25T15:46:39.407002+0000","last_undegraded":"2024-04-25T15:46:39.407002+0000","last_fullsized":"2024-04-25T15:46:39.407002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:29.917598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278877+0000","last_change":"2024-04-25T15:46:33.014467+0000","last_active":"2024-04-25T15:46:34.278877+0000","last_peered":"2024-04-25T15:46:34.278877+0000","last_clean":"2024-04-25T15:46:34.278877+0000","last_became_active":"2024-04-25T15:46:33.014116+0000","last_became_peered":"2024-04-25T15:46:33.014116+0000","last_unstale":"2024-04-25T15:46:34.278877+0000","last_undegraded":"2024-04-25T15:46:34.278877+0000","last_fullsized":"2024-04-25T15:46:34.278877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:44.912712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072776+0000","last_change":"2024-04-25T15:46:33.040027+0000","last_active":"2024-04-25T15:46:34.072776+0000","last_peered":"2024-04-25T15:46:34.072776+0000","last_clean":"2024-04-25T15:46:34.072776+0000","last_became_active":"2024-04-25T15:46:33.039713+0000","last_became_peered":"2024-04-25T15:46:33.039713+0000","last_unstale":"2024-04-25T15:46:34.072776+0000","last_undegraded":"2024-04-25T15:46:34.072776+0000","last_fullsized":"2024-04-25T15:46:34.072776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:49.811317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.600911+0000","last_change":"2024-04-25T15:46:31.686712+0000","last_active":"2024-04-25T15:46:34.600911+0000","last_peered":"2024-04-25T15:46:34.600911+0000","last_clean":"2024-04-25T15:46:34.600911+0000","last_became_active":"2024-04-25T15:46:31.686390+0000","last_became_peered":"2024-04-25T15:46:31.686390+0000","last_unstale":"2024-04-25T15:46:34.600911+0000","last_undegraded":"2024-04-25T15:46:34.600911+0000","last_fullsized":"2024-04-25T15:46:34.600911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072515+0000","last_change":"2024-04-25T15:46:33.041233+0000","last_active":"2024-04-25T15:46:34.072515+0000","last_peered":"2024-04-25T15:46:34.072515+0000","last_clean":"2024-04-25T15:46:34.072515+0000","last_became_active":"2024-04-25T15:46:33.040941+0000","last_became_peered":"2024-04-25T15:46:33.040941+0000","last_unstale":"2024-04-25T15:46:34.072515+0000","last_undegraded":"2024-04-25T15:46:34.072515+0000","last_fullsized":"2024-04-25T15:46:34.072515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.785446+0000","last_change":"2024-04-25T15:46:31.688658+0000","last_active":"2024-04-25T15:46:41.785446+0000","last_peered":"2024-04-25T15:46:41.785446+0000","last_clean":"2024-04-25T15:46:41.785446+0000","last_became_active":"2024-04-25T15:46:31.688342+0000","last_became_peered":"2024-04-25T15:46:31.688342+0000","last_unstale":"2024-04-25T15:46:41.785446+0000","last_undegraded":"2024-04-25T15:46:41.785446+0000","last_fullsized":"2024-04-25T15:46:41.785446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279544+0000","last_change":"2024-04-25T15:46:33.043423+0000","last_active":"2024-04-25T15:46:34.279544+0000","last_peered":"2024-04-25T15:46:34.279544+0000","last_clean":"2024-04-25T15:46:34.279544+0000","last_became_active":"2024-04-25T15:46:33.043134+0000","last_became_peered":"2024-04-25T15:46:33.043134+0000","last_unstale":"2024-04-25T15:46:34.279544+0000","last_undegraded":"2024-04-25T15:46:34.279544+0000","last_fullsized":"2024-04-25T15:46:34.279544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:40.746464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:35.307909+0000","last_change":"2024-04-25T15:46:31.685427+0000","last_active":"2024-04-25T15:46:35.307909+0000","last_peered":"2024-04-25T15:46:35.307909+0000","last_clean":"2024-04-25T15:46:35.307909+0000","last_became_active":"2024-04-25T15:46:31.684729+0000","last_became_peered":"2024-04-25T15:46:31.684729+0000","last_unstale":"2024-04-25T15:46:35.307909+0000","last_undegraded":"2024-04-25T15:46:35.307909+0000","last_fullsized":"2024-04-25T15:46:35.307909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:06.621567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.128030+0000","last_change":"2024-04-25T15:46:33.012259+0000","last_active":"2024-04-25T15:46:34.128030+0000","last_peered":"2024-04-25T15:46:34.128030+0000","last_clean":"2024-04-25T15:46:34.128030+0000","last_became_active":"2024-04-25T15:46:33.011979+0000","last_became_peered":"2024-04-25T15:46:33.011979+0000","last_unstale":"2024-04-25T15:46:34.128030+0000","last_undegraded":"2024-04-25T15:46:34.128030+0000","last_fullsized":"2024-04-25T15:46:34.128030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:47.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'9","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.774905+0000","last_change":"2024-04-25T15:46:31.688031+0000","last_active":"2024-04-25T15:46:41.774905+0000","last_peered":"2024-04-25T15:46:41.774905+0000","last_clean":"2024-04-25T15:46:41.774905+0000","last_became_active":"2024-04-25T15:46:31.687705+0000","last_became_peered":"2024-04-25T15:46:31.687705+0000","last_unstale":"2024-04-25T15:46:41.774905+0000","last_undegraded":"2024-04-25T15:46:41.774905+0000","last_fullsized":"2024-04-25T15:46:41.774905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:28.618857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5222,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":10444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":835584,"data_stored":668322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":78928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":78016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":77352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":77456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":77582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":78962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":831488,"data_stored":667666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:46:50.359 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:46:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.504+0000 7fe1ed892640 1 Processor -- start 2024-04-25T15:46:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.504+0000 7fe1ed892640 1 -- start start 2024-04-25T15:46:50.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.505+0000 7fe1ed892640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe1e806cf50 0x7fe1e806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:50.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.505+0000 7fe1ed892640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e8070ea0 con 0x7fe1e8070a90 2024-04-25T15:46:50.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.505+0000 7fe1ed892640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e80ca670 con 0x7fe1e80710b0 2024-04-25T15:46:50.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.505+0000 7fe1ed892640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fe1e815a400 con 0x7fe1e806cf50 2024-04-25T15:46:50.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.506+0000 7fe1e6ffd640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe1e8070a90 0x7fe1e8154110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39524/0 (socket says 172.21.15.59:39524) 2024-04-25T15:46:50.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.506+0000 7fe1e6ffd640 1 -- 172.21.15.59:0/119783762 learned_addr learned my addr 172.21.15.59:0/119783762 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:50.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.506+0000 7fe1e77fe640 1 --2- 172.21.15.59:0/119783762 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe1e806cf50 0x7fe1e806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:50.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.508+0000 7fe1e5ffb640 1 -- 172.21.15.59:0/119783762 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2723134662 0 0) 0x7fe1e8070ea0 con 0x7fe1e8070a90 2024-04-25T15:46:50.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.508+0000 7fe1e5ffb640 1 -- 172.21.15.59:0/119783762 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1d0003520 con 0x7fe1e8070a90 2024-04-25T15:46:50.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.508+0000 7fe1e5ffb640 1 -- 172.21.15.59:0/119783762 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3884631148 0 0) 0x7fe1dc001110 con 0x7fe1e80710b0 2024-04-25T15:46:50.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.508+0000 7fe1e5ffb640 1 -- 172.21.15.59:0/119783762 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1e8070ea0 con 0x7fe1e80710b0 2024-04-25T15:46:50.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.509+0000 7fe1e77fe640 1 -- 172.21.15.59:0/119783762 >> v1:172.21.15.64:6789/0 conn(0x7fe1e80710b0 legacy=0x7fe1e806c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:50.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.509+0000 7fe1e77fe640 1 -- 172.21.15.59:0/119783762 >> v1:172.21.15.59:6789/0 conn(0x7fe1e8070a90 legacy=0x7fe1e8154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:50.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.509+0000 7fe1e77fe640 1 -- 172.21.15.59:0/119783762 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e815a6e0 con 0x7fe1e806cf50 2024-04-25T15:46:50.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.511+0000 7fe1e77fe640 1 --2- 172.21.15.59:0/119783762 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe1e806cf50 0x7fe1e806d6b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80097d0 tx=0x7fe1d802a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b32ba4451fb42da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:50.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.516+0000 7fe1e5ffb640 1 -- 172.21.15.59:0/119783762 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8037070 con 0x7fe1e806cf50 2024-04-25T15:46:50.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.516+0000 7fe1e5ffb640 1 -- 172.21.15.59:0/119783762 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d8032440 con 0x7fe1e806cf50 2024-04-25T15:46:50.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.516+0000 7fe1e5ffb640 1 -- 172.21.15.59:0/119783762 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d80327f0 con 0x7fe1e806cf50 2024-04-25T15:46:50.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.517+0000 7fe1ed892640 1 -- 172.21.15.59:0/119783762 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe1e806cf50 msgr2=0x7fe1e806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:50.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.517+0000 7fe1ed892640 1 --2- 172.21.15.59:0/119783762 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe1e806cf50 0x7fe1e806d6b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80097d0 tx=0x7fe1d802a290 comp rx=0 tx=0).stop 2024-04-25T15:46:50.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.517+0000 7fe1ed892640 1 -- 172.21.15.59:0/119783762 shutdown_connections 2024-04-25T15:46:50.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.517+0000 7fe1ed892640 1 --2- 172.21.15.59:0/119783762 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe1e806cf50 0x7fe1e806d6b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:50.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.517+0000 7fe1ed892640 1 -- 172.21.15.59:0/119783762 >> 172.21.15.59:0/119783762 conn(0x7fe1e8072500 msgr2=0x7fe1e80cb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:50.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.517+0000 7fe1ed892640 1 -- 172.21.15.59:0/119783762 shutdown_connections 2024-04-25T15:46:50.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.517+0000 7fe1ed892640 1 -- 172.21.15.59:0/119783762 wait complete. 2024-04-25T15:46:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.519+0000 7fe1ed892640 1 Processor -- start 2024-04-25T15:46:50.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.519+0000 7fe1ed892640 1 -- start start 2024-04-25T15:46:50.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.520+0000 7fe1ed892640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e806cf50 0x7fe1e80ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:50.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.520+0000 7fe1ed892640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e8070a90 0x7fe1e81f0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:50.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.520+0000 7fe1ed892640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe1e80710b0 0x7fe1e80cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:50.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.520+0000 7fe1ed892640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e815af80 con 0x7fe1e8070a90 2024-04-25T15:46:50.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.520+0000 7fe1ed892640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e815aca0 con 0x7fe1e806cf50 2024-04-25T15:46:50.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.520+0000 7fe1ed892640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fe1e80714c0 con 0x7fe1e80710b0 2024-04-25T15:46:50.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.521+0000 7fe1e77fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe1e80710b0 0x7fe1e80cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:50.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.521+0000 7fe1e6ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e806cf50 0x7fe1e80ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:50.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.521+0000 7fe1e67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e8070a90 0x7fe1e81f0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:50.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.521+0000 7fe1e77fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe1e80710b0 0x7fe1e80cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53614/0 (socket says 172.21.15.59:53614) 2024-04-25T15:46:50.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.521+0000 7fe1e77fe640 1 -- 172.21.15.59:0/1124615629 learned_addr learned my addr 172.21.15.59:0/1124615629 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:50.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.525+0000 7fe1e6ffd640 1 -- 172.21.15.59:0/1124615629 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe1e80710b0 msgr2=0x7fe1e80cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:50.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.525+0000 7fe1e6ffd640 1 --2- 172.21.15.59:0/1124615629 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe1e80710b0 0x7fe1e80cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:50.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.525+0000 7fe1e6ffd640 1 -- 172.21.15.59:0/1124615629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e8070a90 msgr2=0x7fe1e81f0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:50.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.525+0000 7fe1e6ffd640 1 --2- 172.21.15.59:0/1124615629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e8070a90 0x7fe1e81f0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:50.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.525+0000 7fe1e6ffd640 1 -- 172.21.15.59:0/1124615629 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e8158420 con 0x7fe1e806cf50 2024-04-25T15:46:50.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.527+0000 7fe1e6ffd640 1 --2- 172.21.15.59:0/1124615629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e806cf50 0x7fe1e80ccfe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0005c00 tx=0x7fe1e000cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:50.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.531+0000 7fe1cffff640 1 -- 172.21.15.59:0/1124615629 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0017070 con 0x7fe1e806cf50 2024-04-25T15:46:50.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.531+0000 7fe1cffff640 1 -- 172.21.15.59:0/1124615629 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e000abd0 con 0x7fe1e806cf50 2024-04-25T15:46:50.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.531+0000 7fe1ed892640 1 -- 172.21.15.59:0/1124615629 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e8158140 con 0x7fe1e806cf50 2024-04-25T15:46:50.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.531+0000 7fe1cffff640 1 -- 172.21.15.59:0/1124615629 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0012400 con 0x7fe1e806cf50 2024-04-25T15:46:50.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.531+0000 7fe1ed892640 1 -- 172.21.15.59:0/1124615629 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e81f0310 con 0x7fe1e806cf50 2024-04-25T15:46:50.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.532+0000 7fe1ed892640 1 -- 172.21.15.59:0/1124615629 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e80cbbd0 con 0x7fe1e806cf50 2024-04-25T15:46:50.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.555+0000 7fe1cffff640 1 -- 172.21.15.59:0/1124615629 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe1e001a070 con 0x7fe1e806cf50 2024-04-25T15:46:50.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.555+0000 7fe1cffff640 1 --2- 172.21.15.59:0/1124615629 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fe1d4074500 0x7fe1d4076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:50.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.555+0000 7fe1e67fc640 1 --2- 172.21.15.59:0/1124615629 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fe1d4074500 0x7fe1d4076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:50.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.556+0000 7fe1e67fc640 1 --2- 172.21.15.59:0/1124615629 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fe1d4074500 0x7fe1d4076a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc0012b0 tx=0x7fe1dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:50.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.558+0000 7fe1cffff640 1 -- 172.21.15.59:0/1124615629 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe1e005b770 con 0x7fe1e806cf50 2024-04-25T15:46:50.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:50.842+0000 7fe1cffff640 1 -- 172.21.15.59:0/1124615629 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe1e0021020 con 0x7fe1e806cf50 2024-04-25T15:46:51.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.031+0000 7fe1ed892640 1 -- 172.21.15.59:0/1124615629 --> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe1e8157ef0 con 0x7fe1d4074500 2024-04-25T15:46:51.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.044+0000 7fe1cffff640 1 -- 172.21.15.59:0/1124615629 <== mgr.4102 v2:172.21.15.59:6800/2368090706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251880 (secure 0 0 0) 0x7fe1e8157ef0 con 0x7fe1d4074500 2024-04-25T15:46:51.049 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:51.051 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T15:46:51.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.047+0000 7fe1ed892640 1 -- 172.21.15.59:0/1124615629 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fe1d4074500 msgr2=0x7fe1d4076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.047+0000 7fe1ed892640 1 --2- 172.21.15.59:0/1124615629 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fe1d4074500 0x7fe1d4076a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc0012b0 tx=0x7fe1dc009040 comp rx=0 tx=0).stop 2024-04-25T15:46:51.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.047+0000 7fe1ed892640 1 -- 172.21.15.59:0/1124615629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e806cf50 msgr2=0x7fe1e80ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.047+0000 7fe1ed892640 1 --2- 172.21.15.59:0/1124615629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e806cf50 0x7fe1e80ccfe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0005c00 tx=0x7fe1e000cf00 comp rx=0 tx=0).stop 2024-04-25T15:46:51.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.047+0000 7fe1ed892640 1 -- 172.21.15.59:0/1124615629 shutdown_connections 2024-04-25T15:46:51.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.047+0000 7fe1ed892640 1 --2- 172.21.15.59:0/1124615629 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fe1d4074500 0x7fe1d4076a10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.047+0000 7fe1ed892640 1 --2- 172.21.15.59:0/1124615629 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe1e80710b0 0x7fe1e80cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.047+0000 7fe1ed892640 1 --2- 172.21.15.59:0/1124615629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e8070a90 0x7fe1e81f0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.047+0000 7fe1ed892640 1 --2- 172.21.15.59:0/1124615629 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e806cf50 0x7fe1e80ccfe0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.047+0000 7fe1ed892640 1 -- 172.21.15.59:0/1124615629 >> 172.21.15.59:0/1124615629 conn(0x7fe1e8072500 msgr2=0x7fe1e80c73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:51.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.047+0000 7fe1ed892640 1 -- 172.21.15.59:0/1124615629 shutdown_connections 2024-04-25T15:46:51.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.047+0000 7fe1ed892640 1 -- 172.21.15.59:0/1124615629 wait complete. 2024-04-25T15:46:51.059 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-25T15:46:50.311349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595590,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":226,"num_write_kb":1666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219176,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755544,"statfs":{"total":773094113280,"available":772869677056,"internally_reserved":0,"allocated":3121152,"data_stored":1804284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2812,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003076"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280274+0000","last_change":"2024-04-25T15:46:33.037109+0000","last_active":"2024-04-25T15:46:34.280274+0000","last_peered":"2024-04-25T15:46:34.280274+0000","last_clean":"2024-04-25T15:46:34.280274+0000","last_became_active":"2024-04-25T15:46:33.036415+0000","last_became_peered":"2024-04-25T15:46:33.036415+0000","last_unstale":"2024-04-25T15:46:34.280274+0000","last_undegraded":"2024-04-25T15:46:34.280274+0000","last_fullsized":"2024-04-25T15:46:34.280274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:33.557001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079837+0000","last_change":"2024-04-25T15:46:33.022420+0000","last_active":"2024-04-25T15:46:34.079837+0000","last_peered":"2024-04-25T15:46:34.079837+0000","last_clean":"2024-04-25T15:46:34.079837+0000","last_became_active":"2024-04-25T15:46:33.022095+0000","last_became_peered":"2024-04-25T15:46:33.022095+0000","last_unstale":"2024-04-25T15:46:34.079837+0000","last_undegraded":"2024-04-25T15:46:34.079837+0000","last_fullsized":"2024-04-25T15:46:34.079837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279160+0000","last_change":"2024-04-25T15:46:33.063451+0000","last_active":"2024-04-25T15:46:34.279160+0000","last_peered":"2024-04-25T15:46:34.279160+0000","last_clean":"2024-04-25T15:46:34.279160+0000","last_became_active":"2024-04-25T15:46:33.063038+0000","last_became_peered":"2024-04-25T15:46:33.063038+0000","last_unstale":"2024-04-25T15:46:34.279160+0000","last_undegraded":"2024-04-25T15:46:34.279160+0000","last_fullsized":"2024-04-25T15:46:34.279160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:49:29.792442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072346+0000","last_change":"2024-04-25T15:46:33.041049+0000","last_active":"2024-04-25T15:46:34.072346+0000","last_peered":"2024-04-25T15:46:34.072346+0000","last_clean":"2024-04-25T15:46:34.072346+0000","last_became_active":"2024-04-25T15:46:33.040716+0000","last_became_peered":"2024-04-25T15:46:33.040716+0000","last_unstale":"2024-04-25T15:46:34.072346+0000","last_undegraded":"2024-04-25T15:46:34.072346+0000","last_fullsized":"2024-04-25T15:46:34.072346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:12.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279724+0000","last_change":"2024-04-25T15:46:33.063350+0000","last_active":"2024-04-25T15:46:34.279724+0000","last_peered":"2024-04-25T15:46:34.279724+0000","last_clean":"2024-04-25T15:46:34.279724+0000","last_became_active":"2024-04-25T15:46:33.063110+0000","last_became_peered":"2024-04-25T15:46:33.063110+0000","last_unstale":"2024-04-25T15:46:34.279724+0000","last_undegraded":"2024-04-25T15:46:34.279724+0000","last_fullsized":"2024-04-25T15:46:34.279724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072549+0000","last_change":"2024-04-25T15:46:33.040765+0000","last_active":"2024-04-25T15:46:34.072549+0000","last_peered":"2024-04-25T15:46:34.072549+0000","last_clean":"2024-04-25T15:46:34.072549+0000","last_became_active":"2024-04-25T15:46:33.040272+0000","last_became_peered":"2024-04-25T15:46:33.040272+0000","last_unstale":"2024-04-25T15:46:34.072549+0000","last_undegraded":"2024-04-25T15:46:34.072549+0000","last_fullsized":"2024-04-25T15:46:34.072549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:20.677976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278880+0000","last_change":"2024-04-25T15:46:33.037395+0000","last_active":"2024-04-25T15:46:34.278880+0000","last_peered":"2024-04-25T15:46:34.278880+0000","last_clean":"2024-04-25T15:46:34.278880+0000","last_became_active":"2024-04-25T15:46:33.036613+0000","last_became_peered":"2024-04-25T15:46:33.036613+0000","last_unstale":"2024-04-25T15:46:34.278880+0000","last_undegraded":"2024-04-25T15:46:34.278880+0000","last_fullsized":"2024-04-25T15:46:34.278880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127454+0000","last_change":"2024-04-25T15:46:33.039941+0000","last_active":"2024-04-25T15:46:34.127454+0000","last_peered":"2024-04-25T15:46:34.127454+0000","last_clean":"2024-04-25T15:46:34.127454+0000","last_became_active":"2024-04-25T15:46:33.039696+0000","last_became_peered":"2024-04-25T15:46:33.039696+0000","last_unstale":"2024-04-25T15:46:34.127454+0000","last_undegraded":"2024-04-25T15:46:34.127454+0000","last_fullsized":"2024-04-25T15:46:34.127454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:41.663796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280450+0000","last_change":"2024-04-25T15:46:33.043405+0000","last_active":"2024-04-25T15:46:34.280450+0000","last_peered":"2024-04-25T15:46:34.280450+0000","last_clean":"2024-04-25T15:46:34.280450+0000","last_became_active":"2024-04-25T15:46:33.043094+0000","last_became_peered":"2024-04-25T15:46:33.043094+0000","last_unstale":"2024-04-25T15:46:34.280450+0000","last_undegraded":"2024-04-25T15:46:34.280450+0000","last_fullsized":"2024-04-25T15:46:34.280450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:49.811317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279156+0000","last_change":"2024-04-25T15:46:33.037180+0000","last_active":"2024-04-25T15:46:34.279156+0000","last_peered":"2024-04-25T15:46:34.279156+0000","last_clean":"2024-04-25T15:46:34.279156+0000","last_became_active":"2024-04-25T15:46:33.036822+0000","last_became_peered":"2024-04-25T15:46:33.036822+0000","last_unstale":"2024-04-25T15:46:34.279156+0000","last_undegraded":"2024-04-25T15:46:34.279156+0000","last_fullsized":"2024-04-25T15:46:34.279156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:45.123026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279431+0000","last_change":"2024-04-25T15:46:33.040594+0000","last_active":"2024-04-25T15:46:34.279431+0000","last_peered":"2024-04-25T15:46:34.279431+0000","last_clean":"2024-04-25T15:46:34.279431+0000","last_became_active":"2024-04-25T15:46:33.040296+0000","last_became_peered":"2024-04-25T15:46:33.040296+0000","last_unstale":"2024-04-25T15:46:34.279431+0000","last_undegraded":"2024-04-25T15:46:34.279431+0000","last_fullsized":"2024-04-25T15:46:34.279431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:47.844325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280119+0000","last_change":"2024-04-25T15:46:33.011129+0000","last_active":"2024-04-25T15:46:34.280119+0000","last_peered":"2024-04-25T15:46:34.280119+0000","last_clean":"2024-04-25T15:46:34.280119+0000","last_became_active":"2024-04-25T15:46:33.010754+0000","last_became_peered":"2024-04-25T15:46:33.010754+0000","last_unstale":"2024-04-25T15:46:34.280119+0000","last_undegraded":"2024-04-25T15:46:34.280119+0000","last_fullsized":"2024-04-25T15:46:34.280119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:31.093111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127704+0000","last_change":"2024-04-25T15:46:33.011388+0000","last_active":"2024-04-25T15:46:34.127704+0000","last_peered":"2024-04-25T15:46:34.127704+0000","last_clean":"2024-04-25T15:46:34.127704+0000","last_became_active":"2024-04-25T15:46:33.011083+0000","last_became_peered":"2024-04-25T15:46:33.011083+0000","last_unstale":"2024-04-25T15:46:34.127704+0000","last_undegraded":"2024-04-25T15:46:34.127704+0000","last_fullsized":"2024-04-25T15:46:34.127704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:22.959149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279003+0000","last_change":"2024-04-25T15:46:33.022531+0000","last_active":"2024-04-25T15:46:34.279003+0000","last_peered":"2024-04-25T15:46:34.279003+0000","last_clean":"2024-04-25T15:46:34.279003+0000","last_became_active":"2024-04-25T15:46:33.022214+0000","last_became_peered":"2024-04-25T15:46:33.022214+0000","last_unstale":"2024-04-25T15:46:34.279003+0000","last_undegraded":"2024-04-25T15:46:34.279003+0000","last_fullsized":"2024-04-25T15:46:34.279003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:19.052124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079530+0000","last_change":"2024-04-25T15:46:32.929715+0000","last_active":"2024-04-25T15:46:34.079530+0000","last_peered":"2024-04-25T15:46:34.079530+0000","last_clean":"2024-04-25T15:46:34.079530+0000","last_became_active":"2024-04-25T15:46:32.929386+0000","last_became_peered":"2024-04-25T15:46:32.929386+0000","last_unstale":"2024-04-25T15:46:34.079530+0000","last_undegraded":"2024-04-25T15:46:34.079530+0000","last_fullsized":"2024-04-25T15:46:34.079530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:47.844325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072189+0000","last_change":"2024-04-25T15:46:33.041583+0000","last_active":"2024-04-25T15:46:34.072189+0000","last_peered":"2024-04-25T15:46:34.072189+0000","last_clean":"2024-04-25T15:46:34.072189+0000","last_became_active":"2024-04-25T15:46:33.040240+0000","last_became_peered":"2024-04-25T15:46:33.040240+0000","last_unstale":"2024-04-25T15:46:34.072189+0000","last_undegraded":"2024-04-25T15:46:34.072189+0000","last_fullsized":"2024-04-25T15:46:34.072189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072738+0000","last_change":"2024-04-25T15:46:33.044561+0000","last_active":"2024-04-25T15:46:34.072738+0000","last_peered":"2024-04-25T15:46:34.072738+0000","last_clean":"2024-04-25T15:46:34.072738+0000","last_became_active":"2024-04-25T15:46:33.044065+0000","last_became_peered":"2024-04-25T15:46:33.044065+0000","last_unstale":"2024-04-25T15:46:34.072738+0000","last_undegraded":"2024-04-25T15:46:34.072738+0000","last_fullsized":"2024-04-25T15:46:34.072738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:33.557001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278571+0000","last_change":"2024-04-25T15:46:33.061929+0000","last_active":"2024-04-25T15:46:34.278571+0000","last_peered":"2024-04-25T15:46:34.278571+0000","last_clean":"2024-04-25T15:46:34.278571+0000","last_became_active":"2024-04-25T15:46:33.061623+0000","last_became_peered":"2024-04-25T15:46:33.061623+0000","last_unstale":"2024-04-25T15:46:34.278571+0000","last_undegraded":"2024-04-25T15:46:34.278571+0000","last_fullsized":"2024-04-25T15:46:34.278571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:28.844626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280701+0000","last_change":"2024-04-25T15:46:33.063451+0000","last_active":"2024-04-25T15:46:34.280701+0000","last_peered":"2024-04-25T15:46:34.280701+0000","last_clean":"2024-04-25T15:46:34.280701+0000","last_became_active":"2024-04-25T15:46:33.063126+0000","last_became_peered":"2024-04-25T15:46:33.063126+0000","last_unstale":"2024-04-25T15:46:34.280701+0000","last_undegraded":"2024-04-25T15:46:34.280701+0000","last_fullsized":"2024-04-25T15:46:34.280701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:49.144595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278998+0000","last_change":"2024-04-25T15:46:33.014377+0000","last_active":"2024-04-25T15:46:34.278998+0000","last_peered":"2024-04-25T15:46:34.278998+0000","last_clean":"2024-04-25T15:46:34.278998+0000","last_became_active":"2024-04-25T15:46:33.014056+0000","last_became_peered":"2024-04-25T15:46:33.014056+0000","last_unstale":"2024-04-25T15:46:34.278998+0000","last_undegraded":"2024-04-25T15:46:34.278998+0000","last_fullsized":"2024-04-25T15:46:34.278998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:49.025646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279064+0000","last_change":"2024-04-25T15:46:33.032744+0000","last_active":"2024-04-25T15:46:34.279064+0000","last_peered":"2024-04-25T15:46:34.279064+0000","last_clean":"2024-04-25T15:46:34.279064+0000","last_became_active":"2024-04-25T15:46:33.032498+0000","last_became_peered":"2024-04-25T15:46:33.032498+0000","last_unstale":"2024-04-25T15:46:34.279064+0000","last_undegraded":"2024-04-25T15:46:34.279064+0000","last_fullsized":"2024-04-25T15:46:34.279064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:04.861299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072714+0000","last_change":"2024-04-25T15:46:33.043548+0000","last_active":"2024-04-25T15:46:34.072714+0000","last_peered":"2024-04-25T15:46:34.072714+0000","last_clean":"2024-04-25T15:46:34.072714+0000","last_became_active":"2024-04-25T15:46:33.043251+0000","last_became_peered":"2024-04-25T15:46:33.043251+0000","last_unstale":"2024-04-25T15:46:34.072714+0000","last_undegraded":"2024-04-25T15:46:34.072714+0000","last_fullsized":"2024-04-25T15:46:34.072714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:04.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127585+0000","last_change":"2024-04-25T15:46:32.927532+0000","last_active":"2024-04-25T15:46:34.127585+0000","last_peered":"2024-04-25T15:46:34.127585+0000","last_clean":"2024-04-25T15:46:34.127585+0000","last_became_active":"2024-04-25T15:46:32.926836+0000","last_became_peered":"2024-04-25T15:46:32.926836+0000","last_unstale":"2024-04-25T15:46:34.127585+0000","last_undegraded":"2024-04-25T15:46:34.127585+0000","last_fullsized":"2024-04-25T15:46:34.127585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:21.339594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072201+0000","last_change":"2024-04-25T15:46:33.041900+0000","last_active":"2024-04-25T15:46:34.072201+0000","last_peered":"2024-04-25T15:46:34.072201+0000","last_clean":"2024-04-25T15:46:34.072201+0000","last_became_active":"2024-04-25T15:46:33.040821+0000","last_became_peered":"2024-04-25T15:46:33.040821+0000","last_unstale":"2024-04-25T15:46:34.072201+0000","last_undegraded":"2024-04-25T15:46:34.072201+0000","last_fullsized":"2024-04-25T15:46:34.072201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.128074+0000","last_change":"2024-04-25T15:46:32.926772+0000","last_active":"2024-04-25T15:46:34.128074+0000","last_peered":"2024-04-25T15:46:34.128074+0000","last_clean":"2024-04-25T15:46:34.128074+0000","last_became_active":"2024-04-25T15:46:32.926468+0000","last_became_peered":"2024-04-25T15:46:32.926468+0000","last_unstale":"2024-04-25T15:46:34.128074+0000","last_undegraded":"2024-04-25T15:46:34.128074+0000","last_fullsized":"2024-04-25T15:46:34.128074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:21:35.665923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279365+0000","last_change":"2024-04-25T15:46:33.031482+0000","last_active":"2024-04-25T15:46:34.279365+0000","last_peered":"2024-04-25T15:46:34.279365+0000","last_clean":"2024-04-25T15:46:34.279365+0000","last_became_active":"2024-04-25T15:46:33.031182+0000","last_became_peered":"2024-04-25T15:46:33.031182+0000","last_unstale":"2024-04-25T15:46:34.279365+0000","last_undegraded":"2024-04-25T15:46:34.279365+0000","last_fullsized":"2024-04-25T15:46:34.279365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079941+0000","last_change":"2024-04-25T15:46:32.931992+0000","last_active":"2024-04-25T15:46:34.079941+0000","last_peered":"2024-04-25T15:46:34.079941+0000","last_clean":"2024-04-25T15:46:34.079941+0000","last_became_active":"2024-04-25T15:46:32.931684+0000","last_became_peered":"2024-04-25T15:46:32.931684+0000","last_unstale":"2024-04-25T15:46:34.079941+0000","last_undegraded":"2024-04-25T15:46:34.079941+0000","last_fullsized":"2024-04-25T15:46:34.079941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:12.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127825+0000","last_change":"2024-04-25T15:46:32.926461+0000","last_active":"2024-04-25T15:46:34.127825+0000","last_peered":"2024-04-25T15:46:34.127825+0000","last_clean":"2024-04-25T15:46:34.127825+0000","last_became_active":"2024-04-25T15:46:32.926136+0000","last_became_peered":"2024-04-25T15:46:32.926136+0000","last_unstale":"2024-04-25T15:46:34.127825+0000","last_undegraded":"2024-04-25T15:46:34.127825+0000","last_fullsized":"2024-04-25T15:46:34.127825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:29.896062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279231+0000","last_change":"2024-04-25T15:46:33.022460+0000","last_active":"2024-04-25T15:46:34.279231+0000","last_peered":"2024-04-25T15:46:34.279231+0000","last_clean":"2024-04-25T15:46:34.279231+0000","last_became_active":"2024-04-25T15:46:33.022116+0000","last_became_peered":"2024-04-25T15:46:33.022116+0000","last_unstale":"2024-04-25T15:46:34.279231+0000","last_undegraded":"2024-04-25T15:46:34.279231+0000","last_fullsized":"2024-04-25T15:46:34.279231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:22.980615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072889+0000","last_change":"2024-04-25T15:46:33.040668+0000","last_active":"2024-04-25T15:46:34.072889+0000","last_peered":"2024-04-25T15:46:34.072889+0000","last_clean":"2024-04-25T15:46:34.072889+0000","last_became_active":"2024-04-25T15:46:33.040134+0000","last_became_peered":"2024-04-25T15:46:33.040134+0000","last_unstale":"2024-04-25T15:46:34.072889+0000","last_undegraded":"2024-04-25T15:46:34.072889+0000","last_fullsized":"2024-04-25T15:46:34.072889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:16.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278491+0000","last_change":"2024-04-25T15:46:33.062510+0000","last_active":"2024-04-25T15:46:34.278491+0000","last_peered":"2024-04-25T15:46:34.278491+0000","last_clean":"2024-04-25T15:46:34.278491+0000","last_became_active":"2024-04-25T15:46:33.062166+0000","last_became_peered":"2024-04-25T15:46:33.062166+0000","last_unstale":"2024-04-25T15:46:34.278491+0000","last_undegraded":"2024-04-25T15:46:34.278491+0000","last_fullsized":"2024-04-25T15:46:34.278491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:31.093111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279330+0000","last_change":"2024-04-25T15:46:33.022223+0000","last_active":"2024-04-25T15:46:34.279330+0000","last_peered":"2024-04-25T15:46:34.279330+0000","last_clean":"2024-04-25T15:46:34.279330+0000","last_became_active":"2024-04-25T15:46:33.021888+0000","last_became_peered":"2024-04-25T15:46:33.021888+0000","last_unstale":"2024-04-25T15:46:34.279330+0000","last_undegraded":"2024-04-25T15:46:34.279330+0000","last_fullsized":"2024-04-25T15:46:34.279330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:23.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279381+0000","last_change":"2024-04-25T15:46:32.929281+0000","last_active":"2024-04-25T15:46:34.279381+0000","last_peered":"2024-04-25T15:46:34.279381+0000","last_clean":"2024-04-25T15:46:34.279381+0000","last_became_active":"2024-04-25T15:46:32.929019+0000","last_became_peered":"2024-04-25T15:46:32.929019+0000","last_unstale":"2024-04-25T15:46:34.279381+0000","last_undegraded":"2024-04-25T15:46:34.279381+0000","last_fullsized":"2024-04-25T15:46:34.279381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:55.692126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.522003+0000","last_change":"2024-04-25T15:46:31.685950+0000","last_active":"2024-04-25T15:46:39.522003+0000","last_peered":"2024-04-25T15:46:39.522003+0000","last_clean":"2024-04-25T15:46:39.522003+0000","last_became_active":"2024-04-25T15:46:31.685602+0000","last_became_peered":"2024-04-25T15:46:31.685602+0000","last_unstale":"2024-04-25T15:46:39.522003+0000","last_undegraded":"2024-04-25T15:46:39.522003+0000","last_fullsized":"2024-04-25T15:46:39.522003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:29.676427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279266+0000","last_change":"2024-04-25T15:46:33.023655+0000","last_active":"2024-04-25T15:46:34.279266+0000","last_peered":"2024-04-25T15:46:34.279266+0000","last_clean":"2024-04-25T15:46:34.279266+0000","last_became_active":"2024-04-25T15:46:33.023432+0000","last_became_peered":"2024-04-25T15:46:33.023432+0000","last_unstale":"2024-04-25T15:46:34.279266+0000","last_undegraded":"2024-04-25T15:46:34.279266+0000","last_fullsized":"2024-04-25T15:46:34.279266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:21.339594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.782101+0000","last_change":"2024-04-25T15:46:31.659079+0000","last_active":"2024-04-25T15:46:41.782101+0000","last_peered":"2024-04-25T15:46:41.782101+0000","last_clean":"2024-04-25T15:46:41.782101+0000","last_became_active":"2024-04-25T15:46:31.658681+0000","last_became_peered":"2024-04-25T15:46:31.658681+0000","last_unstale":"2024-04-25T15:46:41.782101+0000","last_undegraded":"2024-04-25T15:46:41.782101+0000","last_fullsized":"2024-04-25T15:46:41.782101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.779115+0000","last_change":"2024-04-25T15:46:31.684220+0000","last_active":"2024-04-25T15:46:41.779115+0000","last_peered":"2024-04-25T15:46:41.779115+0000","last_clean":"2024-04-25T15:46:41.779115+0000","last_became_active":"2024-04-25T15:46:31.682936+0000","last_became_peered":"2024-04-25T15:46:31.682936+0000","last_unstale":"2024-04-25T15:46:41.779115+0000","last_undegraded":"2024-04-25T15:46:41.779115+0000","last_fullsized":"2024-04-25T15:46:41.779115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:53.729696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127570+0000","last_change":"2024-04-25T15:46:33.019843+0000","last_active":"2024-04-25T15:46:34.127570+0000","last_peered":"2024-04-25T15:46:34.127570+0000","last_clean":"2024-04-25T15:46:34.127570+0000","last_became_active":"2024-04-25T15:46:33.019526+0000","last_became_peered":"2024-04-25T15:46:33.019526+0000","last_unstale":"2024-04-25T15:46:34.127570+0000","last_undegraded":"2024-04-25T15:46:34.127570+0000","last_fullsized":"2024-04-25T15:46:34.127570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:22.980615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072467+0000","last_change":"2024-04-25T15:46:31.689444+0000","last_active":"2024-04-25T15:46:34.072467+0000","last_peered":"2024-04-25T15:46:34.072467+0000","last_clean":"2024-04-25T15:46:34.072467+0000","last_became_active":"2024-04-25T15:46:31.689130+0000","last_became_peered":"2024-04-25T15:46:31.689130+0000","last_unstale":"2024-04-25T15:46:34.072467+0000","last_undegraded":"2024-04-25T15:46:34.072467+0000","last_fullsized":"2024-04-25T15:46:34.072467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079523+0000","last_change":"2024-04-25T15:46:32.931979+0000","last_active":"2024-04-25T15:46:34.079523+0000","last_peered":"2024-04-25T15:46:34.079523+0000","last_clean":"2024-04-25T15:46:34.079523+0000","last_became_active":"2024-04-25T15:46:32.931648+0000","last_became_peered":"2024-04-25T15:46:32.931648+0000","last_unstale":"2024-04-25T15:46:34.079523+0000","last_undegraded":"2024-04-25T15:46:34.079523+0000","last_fullsized":"2024-04-25T15:46:34.079523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:23.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.520120+0000","last_change":"2024-04-25T15:46:31.685721+0000","last_active":"2024-04-25T15:46:39.520120+0000","last_peered":"2024-04-25T15:46:39.520120+0000","last_clean":"2024-04-25T15:46:39.520120+0000","last_became_active":"2024-04-25T15:46:31.685244+0000","last_became_peered":"2024-04-25T15:46:31.685244+0000","last_unstale":"2024-04-25T15:46:39.520120+0000","last_undegraded":"2024-04-25T15:46:39.520120+0000","last_fullsized":"2024-04-25T15:46:39.520120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072360+0000","last_change":"2024-04-25T15:46:33.043533+0000","last_active":"2024-04-25T15:46:34.072360+0000","last_peered":"2024-04-25T15:46:34.072360+0000","last_clean":"2024-04-25T15:46:34.072360+0000","last_became_active":"2024-04-25T15:46:33.043228+0000","last_became_peered":"2024-04-25T15:46:33.043228+0000","last_unstale":"2024-04-25T15:46:34.072360+0000","last_undegraded":"2024-04-25T15:46:34.072360+0000","last_fullsized":"2024-04-25T15:46:34.072360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.519834+0000","last_change":"2024-04-25T15:46:31.692399+0000","last_active":"2024-04-25T15:46:39.519834+0000","last_peered":"2024-04-25T15:46:39.519834+0000","last_clean":"2024-04-25T15:46:39.519834+0000","last_became_active":"2024-04-25T15:46:31.692063+0000","last_became_peered":"2024-04-25T15:46:31.692063+0000","last_unstale":"2024-04-25T15:46:39.519834+0000","last_undegraded":"2024-04-25T15:46:39.519834+0000","last_fullsized":"2024-04-25T15:46:39.519834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279587+0000","last_change":"2024-04-25T15:46:33.043275+0000","last_active":"2024-04-25T15:46:34.279587+0000","last_peered":"2024-04-25T15:46:34.279587+0000","last_clean":"2024-04-25T15:46:34.279587+0000","last_became_active":"2024-04-25T15:46:33.042941+0000","last_became_peered":"2024-04-25T15:46:33.042941+0000","last_unstale":"2024-04-25T15:46:34.279587+0000","last_undegraded":"2024-04-25T15:46:34.279587+0000","last_fullsized":"2024-04-25T15:46:34.279587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:22.959149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.598215+0000","last_change":"2024-04-25T15:46:31.686299+0000","last_active":"2024-04-25T15:46:34.598215+0000","last_peered":"2024-04-25T15:46:34.598215+0000","last_clean":"2024-04-25T15:46:34.598215+0000","last_became_active":"2024-04-25T15:46:31.685993+0000","last_became_peered":"2024-04-25T15:46:31.685993+0000","last_unstale":"2024-04-25T15:46:34.598215+0000","last_undegraded":"2024-04-25T15:46:34.598215+0000","last_fullsized":"2024-04-25T15:46:34.598215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280313+0000","last_change":"2024-04-25T15:46:33.035207+0000","last_active":"2024-04-25T15:46:34.280313+0000","last_peered":"2024-04-25T15:46:34.280313+0000","last_clean":"2024-04-25T15:46:34.280313+0000","last_became_active":"2024-04-25T15:46:33.034926+0000","last_became_peered":"2024-04-25T15:46:33.034926+0000","last_unstale":"2024-04-25T15:46:34.280313+0000","last_undegraded":"2024-04-25T15:46:34.280313+0000","last_fullsized":"2024-04-25T15:46:34.280313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:28.844626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.518399+0000","last_change":"2024-04-25T15:46:31.683086+0000","last_active":"2024-04-25T15:46:39.518399+0000","last_peered":"2024-04-25T15:46:39.518399+0000","last_clean":"2024-04-25T15:46:39.518399+0000","last_became_active":"2024-04-25T15:46:31.682661+0000","last_became_peered":"2024-04-25T15:46:31.682661+0000","last_unstale":"2024-04-25T15:46:39.518399+0000","last_undegraded":"2024-04-25T15:46:39.518399+0000","last_fullsized":"2024-04-25T15:46:39.518399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280485+0000","last_change":"2024-04-25T15:46:33.034800+0000","last_active":"2024-04-25T15:46:34.280485+0000","last_peered":"2024-04-25T15:46:34.280485+0000","last_clean":"2024-04-25T15:46:34.280485+0000","last_became_active":"2024-04-25T15:46:33.034493+0000","last_became_peered":"2024-04-25T15:46:33.034493+0000","last_unstale":"2024-04-25T15:46:34.280485+0000","last_undegraded":"2024-04-25T15:46:34.280485+0000","last_fullsized":"2024-04-25T15:46:34.280485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:16.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.773070+0000","last_change":"2024-04-25T15:46:31.688398+0000","last_active":"2024-04-25T15:46:41.773070+0000","last_peered":"2024-04-25T15:46:41.773070+0000","last_clean":"2024-04-25T15:46:41.773070+0000","last_became_active":"2024-04-25T15:46:31.688096+0000","last_became_peered":"2024-04-25T15:46:31.688096+0000","last_unstale":"2024-04-25T15:46:41.773070+0000","last_undegraded":"2024-04-25T15:46:41.773070+0000","last_fullsized":"2024-04-25T15:46:41.773070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:53.729696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279191+0000","last_change":"2024-04-25T15:46:33.031520+0000","last_active":"2024-04-25T15:46:34.279191+0000","last_peered":"2024-04-25T15:46:34.279191+0000","last_clean":"2024-04-25T15:46:34.279191+0000","last_became_active":"2024-04-25T15:46:33.031282+0000","last_became_peered":"2024-04-25T15:46:33.031282+0000","last_unstale":"2024-04-25T15:46:34.279191+0000","last_undegraded":"2024-04-25T15:46:34.279191+0000","last_fullsized":"2024-04-25T15:46:34.279191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:41.663796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.520081+0000","last_change":"2024-04-25T15:46:31.691191+0000","last_active":"2024-04-25T15:46:39.520081+0000","last_peered":"2024-04-25T15:46:39.520081+0000","last_clean":"2024-04-25T15:46:39.520081+0000","last_became_active":"2024-04-25T15:46:31.690848+0000","last_became_peered":"2024-04-25T15:46:31.690848+0000","last_unstale":"2024-04-25T15:46:39.520081+0000","last_undegraded":"2024-04-25T15:46:39.520081+0000","last_fullsized":"2024-04-25T15:46:39.520081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279897+0000","last_change":"2024-04-25T15:46:33.040890+0000","last_active":"2024-04-25T15:46:34.279897+0000","last_peered":"2024-04-25T15:46:34.279897+0000","last_clean":"2024-04-25T15:46:34.279897+0000","last_became_active":"2024-04-25T15:46:33.040568+0000","last_became_peered":"2024-04-25T15:46:33.040568+0000","last_unstale":"2024-04-25T15:46:34.279897+0000","last_undegraded":"2024-04-25T15:46:34.279897+0000","last_fullsized":"2024-04-25T15:46:34.279897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:04.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.784901+0000","last_change":"2024-04-25T15:46:31.659031+0000","last_active":"2024-04-25T15:46:41.784901+0000","last_peered":"2024-04-25T15:46:41.784901+0000","last_clean":"2024-04-25T15:46:41.784901+0000","last_became_active":"2024-04-25T15:46:31.658670+0000","last_became_peered":"2024-04-25T15:46:31.658670+0000","last_unstale":"2024-04-25T15:46:41.784901+0000","last_undegraded":"2024-04-25T15:46:41.784901+0000","last_fullsized":"2024-04-25T15:46:41.784901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279448+0000","last_change":"2024-04-25T15:46:33.021142+0000","last_active":"2024-04-25T15:46:34.279448+0000","last_peered":"2024-04-25T15:46:34.279448+0000","last_clean":"2024-04-25T15:46:34.279448+0000","last_became_active":"2024-04-25T15:46:33.020753+0000","last_became_peered":"2024-04-25T15:46:33.020753+0000","last_unstale":"2024-04-25T15:46:34.279448+0000","last_undegraded":"2024-04-25T15:46:34.279448+0000","last_fullsized":"2024-04-25T15:46:34.279448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'15","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.910630+0000","last_change":"2024-04-25T15:46:31.703454+0000","last_active":"2024-04-25T15:46:41.910630+0000","last_peered":"2024-04-25T15:46:41.910630+0000","last_clean":"2024-04-25T15:46:41.910630+0000","last_became_active":"2024-04-25T15:46:31.703167+0000","last_became_peered":"2024-04-25T15:46:31.703167+0000","last_unstale":"2024-04-25T15:46:41.910630+0000","last_undegraded":"2024-04-25T15:46:41.910630+0000","last_fullsized":"2024-04-25T15:46:41.910630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:02.958438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279066+0000","last_change":"2024-04-25T15:46:33.039900+0000","last_active":"2024-04-25T15:46:34.279066+0000","last_peered":"2024-04-25T15:46:34.279066+0000","last_clean":"2024-04-25T15:46:34.279066+0000","last_became_active":"2024-04-25T15:46:33.039613+0000","last_became_peered":"2024-04-25T15:46:33.039613+0000","last_unstale":"2024-04-25T15:46:34.279066+0000","last_undegraded":"2024-04-25T15:46:34.279066+0000","last_fullsized":"2024-04-25T15:46:34.279066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.556040+0000","last_change":"2024-04-25T15:46:31.684537+0000","last_active":"2024-04-25T15:46:34.556040+0000","last_peered":"2024-04-25T15:46:34.556040+0000","last_clean":"2024-04-25T15:46:34.556040+0000","last_became_active":"2024-04-25T15:46:31.684173+0000","last_became_peered":"2024-04-25T15:46:31.684173+0000","last_unstale":"2024-04-25T15:46:34.556040+0000","last_undegraded":"2024-04-25T15:46:34.556040+0000","last_fullsized":"2024-04-25T15:46:34.556040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:41.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279453+0000","last_change":"2024-04-25T15:46:33.037831+0000","last_active":"2024-04-25T15:46:34.279453+0000","last_peered":"2024-04-25T15:46:34.279453+0000","last_clean":"2024-04-25T15:46:34.279453+0000","last_became_active":"2024-04-25T15:46:33.037529+0000","last_became_peered":"2024-04-25T15:46:33.037529+0000","last_unstale":"2024-04-25T15:46:34.279453+0000","last_undegraded":"2024-04-25T15:46:34.279453+0000","last_fullsized":"2024-04-25T15:46:34.279453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:20.677976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.683508+0000","last_change":"2024-04-25T15:46:31.704159+0000","last_active":"2024-04-25T15:46:34.683508+0000","last_peered":"2024-04-25T15:46:34.683508+0000","last_clean":"2024-04-25T15:46:34.683508+0000","last_became_active":"2024-04-25T15:46:31.703896+0000","last_became_peered":"2024-04-25T15:46:31.703896+0000","last_unstale":"2024-04-25T15:46:34.683508+0000","last_undegraded":"2024-04-25T15:46:34.683508+0000","last_fullsized":"2024-04-25T15:46:34.683508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280621+0000","last_change":"2024-04-25T15:46:33.038719+0000","last_active":"2024-04-25T15:46:34.280621+0000","last_peered":"2024-04-25T15:46:34.280621+0000","last_clean":"2024-04-25T15:46:34.280621+0000","last_became_active":"2024-04-25T15:46:33.038380+0000","last_became_peered":"2024-04-25T15:46:33.038380+0000","last_unstale":"2024-04-25T15:46:34.280621+0000","last_undegraded":"2024-04-25T15:46:34.280621+0000","last_fullsized":"2024-04-25T15:46:34.280621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:13:33.423087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079971+0000","last_change":"2024-04-25T15:46:31.690489+0000","last_active":"2024-04-25T15:46:34.079971+0000","last_peered":"2024-04-25T15:46:34.079971+0000","last_clean":"2024-04-25T15:46:34.079971+0000","last_became_active":"2024-04-25T15:46:31.690181+0000","last_became_peered":"2024-04-25T15:46:31.690181+0000","last_unstale":"2024-04-25T15:46:34.079971+0000","last_undegraded":"2024-04-25T15:46:34.079971+0000","last_fullsized":"2024-04-25T15:46:34.079971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072683+0000","last_change":"2024-04-25T15:46:33.036460+0000","last_active":"2024-04-25T15:46:34.072683+0000","last_peered":"2024-04-25T15:46:34.072683+0000","last_clean":"2024-04-25T15:46:34.072683+0000","last_became_active":"2024-04-25T15:46:33.036033+0000","last_became_peered":"2024-04-25T15:46:33.036033+0000","last_unstale":"2024-04-25T15:46:34.072683+0000","last_undegraded":"2024-04-25T15:46:34.072683+0000","last_fullsized":"2024-04-25T15:46:34.072683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.908940+0000","last_change":"2024-04-25T15:46:31.703571+0000","last_active":"2024-04-25T15:46:41.908940+0000","last_peered":"2024-04-25T15:46:41.908940+0000","last_clean":"2024-04-25T15:46:41.908940+0000","last_became_active":"2024-04-25T15:46:31.703234+0000","last_became_peered":"2024-04-25T15:46:31.703234+0000","last_unstale":"2024-04-25T15:46:41.908940+0000","last_undegraded":"2024-04-25T15:46:41.908940+0000","last_fullsized":"2024-04-25T15:46:41.908940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280501+0000","last_change":"2024-04-25T15:46:33.043464+0000","last_active":"2024-04-25T15:46:34.280501+0000","last_peered":"2024-04-25T15:46:34.280501+0000","last_clean":"2024-04-25T15:46:34.280501+0000","last_became_active":"2024-04-25T15:46:33.043145+0000","last_became_peered":"2024-04-25T15:46:33.043145+0000","last_unstale":"2024-04-25T15:46:34.280501+0000","last_undegraded":"2024-04-25T15:46:34.280501+0000","last_fullsized":"2024-04-25T15:46:34.280501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:06.648469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":110,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278676+0000","last_change":"2024-04-25T15:46:20.235628+0000","last_active":"2024-04-25T15:46:34.278676+0000","last_peered":"2024-04-25T15:46:34.278676+0000","last_clean":"2024-04-25T15:46:34.278676+0000","last_became_active":"2024-04-25T15:46:20.234477+0000","last_became_peered":"2024-04-25T15:46:20.234477+0000","last_unstale":"2024-04-25T15:46:34.278676+0000","last_undegraded":"2024-04-25T15:46:34.278676+0000","last_fullsized":"2024-04-25T15:46:34.278676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:17.824148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:17.824148+0000","last_clean_scrub_stamp":"2024-04-25T15:46:17.824148+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:50:25.187348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.520967+0000","last_change":"2024-04-25T15:46:31.702774+0000","last_active":"2024-04-25T15:46:39.520967+0000","last_peered":"2024-04-25T15:46:39.520967+0000","last_clean":"2024-04-25T15:46:39.520967+0000","last_became_active":"2024-04-25T15:46:31.702517+0000","last_became_peered":"2024-04-25T15:46:31.702517+0000","last_unstale":"2024-04-25T15:46:39.520967+0000","last_undegraded":"2024-04-25T15:46:39.520967+0000","last_fullsized":"2024-04-25T15:46:39.520967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127685+0000","last_change":"2024-04-25T15:46:33.043034+0000","last_active":"2024-04-25T15:46:34.127685+0000","last_peered":"2024-04-25T15:46:34.127685+0000","last_clean":"2024-04-25T15:46:34.127685+0000","last_became_active":"2024-04-25T15:46:33.042522+0000","last_became_peered":"2024-04-25T15:46:33.042522+0000","last_unstale":"2024-04-25T15:46:34.127685+0000","last_undegraded":"2024-04-25T15:46:34.127685+0000","last_fullsized":"2024-04-25T15:46:34.127685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:40.746464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.784860+0000","last_change":"2024-04-25T15:46:31.689200+0000","last_active":"2024-04-25T15:46:41.784860+0000","last_peered":"2024-04-25T15:46:41.784860+0000","last_clean":"2024-04-25T15:46:41.784860+0000","last_became_active":"2024-04-25T15:46:31.687761+0000","last_became_peered":"2024-04-25T15:46:31.687761+0000","last_unstale":"2024-04-25T15:46:41.784860+0000","last_undegraded":"2024-04-25T15:46:41.784860+0000","last_fullsized":"2024-04-25T15:46:41.784860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278867+0000","last_change":"2024-04-25T15:46:33.021652+0000","last_active":"2024-04-25T15:46:34.278867+0000","last_peered":"2024-04-25T15:46:34.278867+0000","last_clean":"2024-04-25T15:46:34.278867+0000","last_became_active":"2024-04-25T15:46:33.020828+0000","last_became_peered":"2024-04-25T15:46:33.020828+0000","last_unstale":"2024-04-25T15:46:34.278867+0000","last_undegraded":"2024-04-25T15:46:34.278867+0000","last_fullsized":"2024-04-25T15:46:34.278867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:11.243833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.909249+0000","last_change":"2024-04-25T15:46:31.704698+0000","last_active":"2024-04-25T15:46:41.909249+0000","last_peered":"2024-04-25T15:46:41.909249+0000","last_clean":"2024-04-25T15:46:41.909249+0000","last_became_active":"2024-04-25T15:46:31.704412+0000","last_became_peered":"2024-04-25T15:46:31.704412+0000","last_unstale":"2024-04-25T15:46:41.909249+0000","last_undegraded":"2024-04-25T15:46:41.909249+0000","last_fullsized":"2024-04-25T15:46:41.909249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079474+0000","last_change":"2024-04-25T15:46:33.061942+0000","last_active":"2024-04-25T15:46:34.079474+0000","last_peered":"2024-04-25T15:46:34.079474+0000","last_clean":"2024-04-25T15:46:34.079474+0000","last_became_active":"2024-04-25T15:46:33.061619+0000","last_became_peered":"2024-04-25T15:46:33.061619+0000","last_unstale":"2024-04-25T15:46:34.079474+0000","last_undegraded":"2024-04-25T15:46:34.079474+0000","last_fullsized":"2024-04-25T15:46:34.079474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:45.123026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.073122+0000","last_change":"2024-04-25T15:46:31.690694+0000","last_active":"2024-04-25T15:46:34.073122+0000","last_peered":"2024-04-25T15:46:34.073122+0000","last_clean":"2024-04-25T15:46:34.073122+0000","last_became_active":"2024-04-25T15:46:31.690339+0000","last_became_peered":"2024-04-25T15:46:31.690339+0000","last_unstale":"2024-04-25T15:46:34.073122+0000","last_undegraded":"2024-04-25T15:46:34.073122+0000","last_fullsized":"2024-04-25T15:46:34.073122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280771+0000","last_change":"2024-04-25T15:46:33.022306+0000","last_active":"2024-04-25T15:46:34.280771+0000","last_peered":"2024-04-25T15:46:34.280771+0000","last_clean":"2024-04-25T15:46:34.280771+0000","last_became_active":"2024-04-25T15:46:33.021995+0000","last_became_peered":"2024-04-25T15:46:33.021995+0000","last_unstale":"2024-04-25T15:46:34.280771+0000","last_undegraded":"2024-04-25T15:46:34.280771+0000","last_fullsized":"2024-04-25T15:46:34.280771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:03.749619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079765+0000","last_change":"2024-04-25T15:46:31.684114+0000","last_active":"2024-04-25T15:46:34.079765+0000","last_peered":"2024-04-25T15:46:34.079765+0000","last_clean":"2024-04-25T15:46:34.079765+0000","last_became_active":"2024-04-25T15:46:31.683802+0000","last_became_peered":"2024-04-25T15:46:31.683802+0000","last_unstale":"2024-04-25T15:46:34.079765+0000","last_undegraded":"2024-04-25T15:46:34.079765+0000","last_fullsized":"2024-04-25T15:46:34.079765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072964+0000","last_change":"2024-04-25T15:46:33.040119+0000","last_active":"2024-04-25T15:46:34.072964+0000","last_peered":"2024-04-25T15:46:34.072964+0000","last_clean":"2024-04-25T15:46:34.072964+0000","last_became_active":"2024-04-25T15:46:33.039820+0000","last_became_peered":"2024-04-25T15:46:33.039820+0000","last_unstale":"2024-04-25T15:46:34.072964+0000","last_undegraded":"2024-04-25T15:46:34.072964+0000","last_fullsized":"2024-04-25T15:46:34.072964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:06.648469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.280760+0000","last_change":"2024-04-25T15:46:31.688610+0000","last_active":"2024-04-25T15:46:34.280760+0000","last_peered":"2024-04-25T15:46:34.280760+0000","last_clean":"2024-04-25T15:46:34.280760+0000","last_became_active":"2024-04-25T15:46:31.688274+0000","last_became_peered":"2024-04-25T15:46:31.688274+0000","last_unstale":"2024-04-25T15:46:34.280760+0000","last_undegraded":"2024-04-25T15:46:34.280760+0000","last_fullsized":"2024-04-25T15:46:34.280760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:02.574106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079663+0000","last_change":"2024-04-25T15:46:33.062042+0000","last_active":"2024-04-25T15:46:34.079663+0000","last_peered":"2024-04-25T15:46:34.079663+0000","last_clean":"2024-04-25T15:46:34.079663+0000","last_became_active":"2024-04-25T15:46:33.061680+0000","last_became_peered":"2024-04-25T15:46:33.061680+0000","last_unstale":"2024-04-25T15:46:34.079663+0000","last_undegraded":"2024-04-25T15:46:34.079663+0000","last_fullsized":"2024-04-25T15:46:34.079663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.910757+0000","last_change":"2024-04-25T15:46:31.687114+0000","last_active":"2024-04-25T15:46:41.910757+0000","last_peered":"2024-04-25T15:46:41.910757+0000","last_clean":"2024-04-25T15:46:41.910757+0000","last_became_active":"2024-04-25T15:46:31.686758+0000","last_became_peered":"2024-04-25T15:46:31.686758+0000","last_unstale":"2024-04-25T15:46:41.910757+0000","last_undegraded":"2024-04-25T15:46:41.910757+0000","last_fullsized":"2024-04-25T15:46:41.910757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.128107+0000","last_change":"2024-04-25T15:46:33.031231+0000","last_active":"2024-04-25T15:46:34.128107+0000","last_peered":"2024-04-25T15:46:34.128107+0000","last_clean":"2024-04-25T15:46:34.128107+0000","last_became_active":"2024-04-25T15:46:33.030894+0000","last_became_peered":"2024-04-25T15:46:33.030894+0000","last_unstale":"2024-04-25T15:46:34.128107+0000","last_undegraded":"2024-04-25T15:46:34.128107+0000","last_fullsized":"2024-04-25T15:46:34.128107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:40.210974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.518049+0000","last_change":"2024-04-25T15:46:31.688577+0000","last_active":"2024-04-25T15:46:39.518049+0000","last_peered":"2024-04-25T15:46:39.518049+0000","last_clean":"2024-04-25T15:46:39.518049+0000","last_became_active":"2024-04-25T15:46:31.687691+0000","last_became_peered":"2024-04-25T15:46:31.687691+0000","last_unstale":"2024-04-25T15:46:39.518049+0000","last_undegraded":"2024-04-25T15:46:39.518049+0000","last_fullsized":"2024-04-25T15:46:39.518049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279504+0000","last_change":"2024-04-25T15:46:33.021249+0000","last_active":"2024-04-25T15:46:34.279504+0000","last_peered":"2024-04-25T15:46:34.279504+0000","last_clean":"2024-04-25T15:46:34.279504+0000","last_became_active":"2024-04-25T15:46:33.020779+0000","last_became_peered":"2024-04-25T15:46:33.020779+0000","last_unstale":"2024-04-25T15:46:34.279504+0000","last_undegraded":"2024-04-25T15:46:34.279504+0000","last_fullsized":"2024-04-25T15:46:34.279504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:39.504513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.406934+0000","last_change":"2024-04-25T15:46:31.689494+0000","last_active":"2024-04-25T15:46:39.406934+0000","last_peered":"2024-04-25T15:46:39.406934+0000","last_clean":"2024-04-25T15:46:39.406934+0000","last_became_active":"2024-04-25T15:46:31.688192+0000","last_became_peered":"2024-04-25T15:46:31.688192+0000","last_unstale":"2024-04-25T15:46:39.406934+0000","last_undegraded":"2024-04-25T15:46:39.406934+0000","last_fullsized":"2024-04-25T15:46:39.406934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278866+0000","last_change":"2024-04-25T15:46:33.062043+0000","last_active":"2024-04-25T15:46:34.278866+0000","last_peered":"2024-04-25T15:46:34.278866+0000","last_clean":"2024-04-25T15:46:34.278866+0000","last_became_active":"2024-04-25T15:46:33.061651+0000","last_became_peered":"2024-04-25T15:46:33.061651+0000","last_unstale":"2024-04-25T15:46:34.278866+0000","last_undegraded":"2024-04-25T15:46:34.278866+0000","last_fullsized":"2024-04-25T15:46:34.278866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:21.340361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.495665+0000","last_change":"2024-04-25T15:46:31.685055+0000","last_active":"2024-04-25T15:46:39.495665+0000","last_peered":"2024-04-25T15:46:39.495665+0000","last_clean":"2024-04-25T15:46:39.495665+0000","last_became_active":"2024-04-25T15:46:31.684706+0000","last_became_peered":"2024-04-25T15:46:31.684706+0000","last_unstale":"2024-04-25T15:46:39.495665+0000","last_undegraded":"2024-04-25T15:46:39.495665+0000","last_fullsized":"2024-04-25T15:46:39.495665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:29.917598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127645+0000","last_change":"2024-04-25T15:46:32.929240+0000","last_active":"2024-04-25T15:46:34.127645+0000","last_peered":"2024-04-25T15:46:34.127645+0000","last_clean":"2024-04-25T15:46:34.127645+0000","last_became_active":"2024-04-25T15:46:32.928971+0000","last_became_peered":"2024-04-25T15:46:32.928971+0000","last_unstale":"2024-04-25T15:46:34.127645+0000","last_undegraded":"2024-04-25T15:46:34.127645+0000","last_fullsized":"2024-04-25T15:46:34.127645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:39.504513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.079841+0000","last_change":"2024-04-25T15:46:31.687651+0000","last_active":"2024-04-25T15:46:34.079841+0000","last_peered":"2024-04-25T15:46:34.079841+0000","last_clean":"2024-04-25T15:46:34.079841+0000","last_became_active":"2024-04-25T15:46:31.687335+0000","last_became_peered":"2024-04-25T15:46:31.687335+0000","last_unstale":"2024-04-25T15:46:34.079841+0000","last_undegraded":"2024-04-25T15:46:34.079841+0000","last_fullsized":"2024-04-25T15:46:34.079841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.127741+0000","last_change":"2024-04-25T15:46:33.021215+0000","last_active":"2024-04-25T15:46:34.127741+0000","last_peered":"2024-04-25T15:46:34.127741+0000","last_clean":"2024-04-25T15:46:34.127741+0000","last_became_active":"2024-04-25T15:46:33.020855+0000","last_became_peered":"2024-04-25T15:46:33.020855+0000","last_unstale":"2024-04-25T15:46:34.127741+0000","last_undegraded":"2024-04-25T15:46:34.127741+0000","last_fullsized":"2024-04-25T15:46:34.127741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:54.058601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:39.407002+0000","last_change":"2024-04-25T15:46:31.693099+0000","last_active":"2024-04-25T15:46:39.407002+0000","last_peered":"2024-04-25T15:46:39.407002+0000","last_clean":"2024-04-25T15:46:39.407002+0000","last_became_active":"2024-04-25T15:46:31.692762+0000","last_became_peered":"2024-04-25T15:46:31.692762+0000","last_unstale":"2024-04-25T15:46:39.407002+0000","last_undegraded":"2024-04-25T15:46:39.407002+0000","last_fullsized":"2024-04-25T15:46:39.407002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:29.917598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.278877+0000","last_change":"2024-04-25T15:46:33.014467+0000","last_active":"2024-04-25T15:46:34.278877+0000","last_peered":"2024-04-25T15:46:34.278877+0000","last_clean":"2024-04-25T15:46:34.278877+0000","last_became_active":"2024-04-25T15:46:33.014116+0000","last_became_peered":"2024-04-25T15:46:33.014116+0000","last_unstale":"2024-04-25T15:46:34.278877+0000","last_undegraded":"2024-04-25T15:46:34.278877+0000","last_fullsized":"2024-04-25T15:46:34.278877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:44.912712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072776+0000","last_change":"2024-04-25T15:46:33.040027+0000","last_active":"2024-04-25T15:46:34.072776+0000","last_peered":"2024-04-25T15:46:34.072776+0000","last_clean":"2024-04-25T15:46:34.072776+0000","last_became_active":"2024-04-25T15:46:33.039713+0000","last_became_peered":"2024-04-25T15:46:33.039713+0000","last_unstale":"2024-04-25T15:46:34.072776+0000","last_undegraded":"2024-04-25T15:46:34.072776+0000","last_fullsized":"2024-04-25T15:46:34.072776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:49.811317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.600911+0000","last_change":"2024-04-25T15:46:31.686712+0000","last_active":"2024-04-25T15:46:34.600911+0000","last_peered":"2024-04-25T15:46:34.600911+0000","last_clean":"2024-04-25T15:46:34.600911+0000","last_became_active":"2024-04-25T15:46:31.686390+0000","last_became_peered":"2024-04-25T15:46:31.686390+0000","last_unstale":"2024-04-25T15:46:34.600911+0000","last_undegraded":"2024-04-25T15:46:34.600911+0000","last_fullsized":"2024-04-25T15:46:34.600911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.072515+0000","last_change":"2024-04-25T15:46:33.041233+0000","last_active":"2024-04-25T15:46:34.072515+0000","last_peered":"2024-04-25T15:46:34.072515+0000","last_clean":"2024-04-25T15:46:34.072515+0000","last_became_active":"2024-04-25T15:46:33.040941+0000","last_became_peered":"2024-04-25T15:46:33.040941+0000","last_unstale":"2024-04-25T15:46:34.072515+0000","last_undegraded":"2024-04-25T15:46:34.072515+0000","last_fullsized":"2024-04-25T15:46:34.072515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.785446+0000","last_change":"2024-04-25T15:46:31.688658+0000","last_active":"2024-04-25T15:46:41.785446+0000","last_peered":"2024-04-25T15:46:41.785446+0000","last_clean":"2024-04-25T15:46:41.785446+0000","last_became_active":"2024-04-25T15:46:31.688342+0000","last_became_peered":"2024-04-25T15:46:31.688342+0000","last_unstale":"2024-04-25T15:46:41.785446+0000","last_undegraded":"2024-04-25T15:46:41.785446+0000","last_fullsized":"2024-04-25T15:46:41.785446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.279544+0000","last_change":"2024-04-25T15:46:33.043423+0000","last_active":"2024-04-25T15:46:34.279544+0000","last_peered":"2024-04-25T15:46:34.279544+0000","last_clean":"2024-04-25T15:46:34.279544+0000","last_became_active":"2024-04-25T15:46:33.043134+0000","last_became_peered":"2024-04-25T15:46:33.043134+0000","last_unstale":"2024-04-25T15:46:34.279544+0000","last_undegraded":"2024-04-25T15:46:34.279544+0000","last_fullsized":"2024-04-25T15:46:34.279544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:40.746464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:35.307909+0000","last_change":"2024-04-25T15:46:31.685427+0000","last_active":"2024-04-25T15:46:35.307909+0000","last_peered":"2024-04-25T15:46:35.307909+0000","last_clean":"2024-04-25T15:46:35.307909+0000","last_became_active":"2024-04-25T15:46:31.684729+0000","last_became_peered":"2024-04-25T15:46:31.684729+0000","last_unstale":"2024-04-25T15:46:35.307909+0000","last_undegraded":"2024-04-25T15:46:35.307909+0000","last_fullsized":"2024-04-25T15:46:35.307909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:06.621567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:34.128030+0000","last_change":"2024-04-25T15:46:33.012259+0000","last_active":"2024-04-25T15:46:34.128030+0000","last_peered":"2024-04-25T15:46:34.128030+0000","last_clean":"2024-04-25T15:46:34.128030+0000","last_became_active":"2024-04-25T15:46:33.011979+0000","last_became_peered":"2024-04-25T15:46:33.011979+0000","last_unstale":"2024-04-25T15:46:34.128030+0000","last_undegraded":"2024-04-25T15:46:34.128030+0000","last_fullsized":"2024-04-25T15:46:34.128030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:47.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'9","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-25T15:46:41.774905+0000","last_change":"2024-04-25T15:46:31.688031+0000","last_active":"2024-04-25T15:46:41.774905+0000","last_peered":"2024-04-25T15:46:41.774905+0000","last_clean":"2024-04-25T15:46:41.774905+0000","last_became_active":"2024-04-25T15:46:31.687705+0000","last_became_peered":"2024-04-25T15:46:31.687705+0000","last_unstale":"2024-04-25T15:46:41.774905+0000","last_undegraded":"2024-04-25T15:46:41.774905+0000","last_fullsized":"2024-04-25T15:46:41.774905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:28.618857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5222,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":10444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":835584,"data_stored":668322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":78928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":78016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":77352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":77456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":77582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":78962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":831488,"data_stored":667666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:46:51.064 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T15:46:51.064 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T15:46:51.064 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T15:46:51.064 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T15:46:51.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.211+0000 7f68f9e20640 1 Processor -- start 2024-04-25T15:46:51.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.211+0000 7f68f9e20640 1 -- start start 2024-04-25T15:46:51.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.212+0000 7f68f9e20640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68f415cf50 0x7f68f40cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.212+0000 7f68f9e20640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f68f40cc520 0x7f68f40cc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.212+0000 7f68f9e20640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f40cd9e0 con 0x7f68f40c72a0 2024-04-25T15:46:51.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.212+0000 7f68f9e20640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f68f40cd7a0 con 0x7f68f40cc520 2024-04-25T15:46:51.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.212+0000 7f68f9e20640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f68f415fac0 con 0x7f68f415cf50 2024-04-25T15:46:51.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.213+0000 7f68f3fff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f68f40c72a0 0x7f68f40c76b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39526/0 (socket says 172.21.15.59:39526) 2024-04-25T15:46:51.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.213+0000 7f68f3fff640 1 -- 172.21.15.59:0/612433490 learned_addr learned my addr 172.21.15.59:0/612433490 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:51.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.213+0000 7f68f37fe640 1 --2- 172.21.15.59:0/612433490 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68f415cf50 0x7f68f40cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.213+0000 7f68f2ffd640 1 --2- 172.21.15.59:0/612433490 >> v2:172.21.15.64:3300/0 conn(0x7f68f40cc520 0x7f68f40cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.216+0000 7f68f27fc640 1 -- 172.21.15.59:0/612433490 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1447672408 0 0) 0x7f68f40cd9e0 con 0x7f68f40c72a0 2024-04-25T15:46:51.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.216+0000 7f68f27fc640 1 -- 172.21.15.59:0/612433490 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68dc003520 con 0x7f68f40c72a0 2024-04-25T15:46:51.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.217+0000 7f68f37fe640 1 -- 172.21.15.59:0/612433490 >> v2:172.21.15.64:3300/0 conn(0x7f68f40cc520 msgr2=0x7f68f40cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:51.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.217+0000 7f68f37fe640 1 --2- 172.21.15.59:0/612433490 >> v2:172.21.15.64:3300/0 conn(0x7f68f40cc520 0x7f68f40cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.217+0000 7f68f37fe640 1 -- 172.21.15.59:0/612433490 >> v1:172.21.15.59:6789/0 conn(0x7f68f40c72a0 legacy=0x7f68f40c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.217+0000 7f68f37fe640 1 -- 172.21.15.59:0/612433490 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f415fd60 con 0x7f68f415cf50 2024-04-25T15:46:51.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.220+0000 7f68f37fe640 1 --2- 172.21.15.59:0/612433490 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68f415cf50 0x7f68f40cd260 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f68e80097a0 tx=0x7f68e802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=933669e6e5ee3452 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.225+0000 7f68f27fc640 1 -- 172.21.15.59:0/612433490 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8037070 con 0x7f68f415cf50 2024-04-25T15:46:51.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.225+0000 7f68f27fc640 1 -- 172.21.15.59:0/612433490 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e8032440 con 0x7f68f415cf50 2024-04-25T15:46:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.225+0000 7f68f27fc640 1 -- 172.21.15.59:0/612433490 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8032810 con 0x7f68f415cf50 2024-04-25T15:46:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.225+0000 7f68f9e20640 1 -- 172.21.15.59:0/612433490 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68f415cf50 msgr2=0x7f68f40cd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.225+0000 7f68f9e20640 1 --2- 172.21.15.59:0/612433490 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68f415cf50 0x7f68f40cd260 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f68e80097a0 tx=0x7f68e802a210 comp rx=0 tx=0).stop 2024-04-25T15:46:51.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.226+0000 7f68f9e20640 1 -- 172.21.15.59:0/612433490 shutdown_connections 2024-04-25T15:46:51.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.226+0000 7f68f9e20640 1 --2- 172.21.15.59:0/612433490 >> v2:172.21.15.64:3300/0 conn(0x7f68f40cc520 0x7f68f40cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.226+0000 7f68f9e20640 1 --2- 172.21.15.59:0/612433490 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68f415cf50 0x7f68f40cd260 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.226+0000 7f68f9e20640 1 -- 172.21.15.59:0/612433490 >> 172.21.15.59:0/612433490 conn(0x7f68f406f3e0 msgr2=0x7f68f40684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:51.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.226+0000 7f68f9e20640 1 -- 172.21.15.59:0/612433490 shutdown_connections 2024-04-25T15:46:51.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.226+0000 7f68f9e20640 1 -- 172.21.15.59:0/612433490 wait complete. 2024-04-25T15:46:51.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.227+0000 7f68f9e20640 1 Processor -- start 2024-04-25T15:46:51.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.228+0000 7f68f9e20640 1 -- start start 2024-04-25T15:46:51.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.229+0000 7f68f9e20640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68f40c72a0 0x7f68f40d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.229+0000 7f68f9e20640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68f40cc520 0x7f68f4151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.229+0000 7f68f9e20640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68f415cf50 0x7f68f41524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.229+0000 7f68f9e20640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f68f4160600 con 0x7f68f40cc520 2024-04-25T15:46:51.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.229+0000 7f68f9e20640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f68f4160320 con 0x7f68f40c72a0 2024-04-25T15:46:51.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.229+0000 7f68f9e20640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f68f41608e0 con 0x7f68f415cf50 2024-04-25T15:46:51.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.229+0000 7f68f2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68f40cc520 0x7f68f4151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.229+0000 7f68f3fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68f415cf50 0x7f68f41524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.229+0000 7f68f37fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68f40c72a0 0x7f68f40d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.230+0000 7f68f2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68f40cc520 0x7f68f4151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59952/0 (socket says 172.21.15.59:59952) 2024-04-25T15:46:51.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.230+0000 7f68f2ffd640 1 -- 172.21.15.59:0/2722284907 learned_addr learned my addr 172.21.15.59:0/2722284907 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:51.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.234+0000 7f68f2ffd640 1 -- 172.21.15.59:0/2722284907 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68f415cf50 msgr2=0x7f68f41524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.234+0000 7f68f2ffd640 1 --2- 172.21.15.59:0/2722284907 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68f415cf50 0x7f68f41524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.234+0000 7f68f2ffd640 1 -- 172.21.15.59:0/2722284907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68f40c72a0 msgr2=0x7f68f40d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.234+0000 7f68f2ffd640 1 --2- 172.21.15.59:0/2722284907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68f40c72a0 0x7f68f40d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.234+0000 7f68f2ffd640 1 -- 172.21.15.59:0/2722284907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f41f5990 con 0x7f68f40cc520 2024-04-25T15:46:51.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.236+0000 7f68f2ffd640 1 --2- 172.21.15.59:0/2722284907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68f40cc520 0x7f68f4151f70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f68e400e870 tx=0x7f68e400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:51.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.242+0000 7f68dbfff640 1 -- 172.21.15.59:0/2722284907 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4017070 con 0x7f68f40cc520 2024-04-25T15:46:51.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.242+0000 7f68dbfff640 1 -- 172.21.15.59:0/2722284907 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e400c940 con 0x7f68f40cc520 2024-04-25T15:46:51.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.242+0000 7f68f9e20640 1 -- 172.21.15.59:0/2722284907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f4157310 con 0x7f68f40cc520 2024-04-25T15:46:51.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.242+0000 7f68dbfff640 1 -- 172.21.15.59:0/2722284907 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e400cd30 con 0x7f68f40cc520 2024-04-25T15:46:51.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.242+0000 7f68f9e20640 1 -- 172.21.15.59:0/2722284907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f41f5f10 con 0x7f68f40cc520 2024-04-25T15:46:51.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.244+0000 7f68f9e20640 1 -- 172.21.15.59:0/2722284907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f4069910 con 0x7f68f40cc520 2024-04-25T15:46:51.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.267+0000 7f68dbfff640 1 -- 172.21.15.59:0/2722284907 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f68e401a070 con 0x7f68f40cc520 2024-04-25T15:46:51.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.268+0000 7f68dbfff640 1 --2- 172.21.15.59:0/2722284907 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f68e0074500 0x7f68e0076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.268+0000 7f68f37fe640 1 --2- 172.21.15.59:0/2722284907 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f68e0074500 0x7f68e0076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.268+0000 7f68f37fe640 1 --2- 172.21.15.59:0/2722284907 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f68e0074500 0x7f68e0076a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f68e8034000 tx=0x7f68e802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:51.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.272+0000 7f68dbfff640 1 -- 172.21.15.59:0/2722284907 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f68e405bbf0 con 0x7f68f40cc520 2024-04-25T15:46:51.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.557+0000 7f68dbfff640 1 -- 172.21.15.59:0/2722284907 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f68e405f960 con 0x7f68f40cc520 2024-04-25T15:46:51.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.790+0000 7f68f9e20640 1 -- 172.21.15.59:0/2722284907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f68f40cbd20 con 0x7f68f40cc520 2024-04-25T15:46:51.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.798+0000 7f68dbfff640 1 -- 172.21.15.59:0/2722284907 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f68e4063c60 con 0x7f68f40cc520 2024-04-25T15:46:51.798 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:51.799 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T15:46:51.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.800+0000 7f68f9e20640 1 -- 172.21.15.59:0/2722284907 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f68e0074500 msgr2=0x7f68e0076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.800+0000 7f68f9e20640 1 --2- 172.21.15.59:0/2722284907 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f68e0074500 0x7f68e0076a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f68e8034000 tx=0x7f68e802e000 comp rx=0 tx=0).stop 2024-04-25T15:46:51.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.800+0000 7f68f9e20640 1 -- 172.21.15.59:0/2722284907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68f40cc520 msgr2=0x7f68f4151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.800+0000 7f68f9e20640 1 --2- 172.21.15.59:0/2722284907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68f40cc520 0x7f68f4151f70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f68e400e870 tx=0x7f68e400ed30 comp rx=0 tx=0).stop 2024-04-25T15:46:51.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.800+0000 7f68f9e20640 1 -- 172.21.15.59:0/2722284907 shutdown_connections 2024-04-25T15:46:51.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.800+0000 7f68f9e20640 1 --2- 172.21.15.59:0/2722284907 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f68e0074500 0x7f68e0076a10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.800+0000 7f68f9e20640 1 --2- 172.21.15.59:0/2722284907 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68f415cf50 0x7f68f41524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.800+0000 7f68f9e20640 1 --2- 172.21.15.59:0/2722284907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68f40cc520 0x7f68f4151f70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.800+0000 7f68f9e20640 1 --2- 172.21.15.59:0/2722284907 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68f40c72a0 0x7f68f40d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.800+0000 7f68f9e20640 1 -- 172.21.15.59:0/2722284907 >> 172.21.15.59:0/2722284907 conn(0x7f68f406f3e0 msgr2=0x7f68f40684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:51.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.800+0000 7f68f9e20640 1 -- 172.21.15.59:0/2722284907 shutdown_connections 2024-04-25T15:46:51.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.800+0000 7f68f9e20640 1 -- 172.21.15.59:0/2722284907 wait complete. 2024-04-25T15:46:51.812 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T15:46:51.812 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.923+0000 7f3ce041a640 1 Processor -- start 2024-04-25T15:46:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.923+0000 7f3ce041a640 1 -- start start 2024-04-25T15:46:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.924+0000 7f3ce041a640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3cd80b41c0 0x7f3cd80cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.924+0000 7f3ce041a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3cd80cd680 0x7f3cd815c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.924+0000 7f3ce041a640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cd815cd60 con 0x7f3cd815c6f0 2024-04-25T15:46:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.924+0000 7f3ce041a640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd815cb00 con 0x7f3cd80b41c0 2024-04-25T15:46:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.924+0000 7f3ce041a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd815d040 con 0x7f3cd80cd680 2024-04-25T15:46:51.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.925+0000 7f3cde1b6640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3cd80b41c0 0x7f3cd80cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.925+0000 7f3cdd9b5640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3cd80cd680 0x7f3cd815c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.925+0000 7f3cdd9b5640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3cd80cd680 0x7f3cd815c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:53798/0 (socket says 172.21.15.59:53798) 2024-04-25T15:46:51.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.925+0000 7f3cdd9b5640 1 -- 172.21.15.59:0/4232952489 learned_addr learned my addr 172.21.15.59:0/4232952489 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:51.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.928+0000 7f3cdd9b5640 1 -- 172.21.15.59:0/4232952489 >> v2:172.21.15.59:3300/0 conn(0x7f3cd80b41c0 msgr2=0x7f3cd80cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:51.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.928+0000 7f3cdd9b5640 1 --2- 172.21.15.59:0/4232952489 >> v2:172.21.15.59:3300/0 conn(0x7f3cd80b41c0 0x7f3cd80cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.928+0000 7f3cdd9b5640 1 -- 172.21.15.59:0/4232952489 >> v1:172.21.15.59:6789/0 conn(0x7f3cd815c6f0 legacy=0x7f3cd80ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.928+0000 7f3cdd9b5640 1 -- 172.21.15.59:0/4232952489 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd815d320 con 0x7f3cd80cd680 2024-04-25T15:46:51.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.930+0000 7f3cdd9b5640 1 --2- 172.21.15.59:0/4232952489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cd80cd680 0x7f3cd815c1b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80b73e0 tx=0x7f3cc802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bc30c5c55b7538e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.934+0000 7f3cdd1b4640 1 -- 172.21.15.59:0/4232952489 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8037070 con 0x7f3cd80cd680 2024-04-25T15:46:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.934+0000 7f3cdd1b4640 1 -- 172.21.15.59:0/4232952489 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc8032440 con 0x7f3cd80cd680 2024-04-25T15:46:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.934+0000 7f3cdd1b4640 1 -- 172.21.15.59:0/4232952489 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8032810 con 0x7f3cd80cd680 2024-04-25T15:46:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.935+0000 7f3ce041a640 1 -- 172.21.15.59:0/4232952489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cd80cd680 msgr2=0x7f3cd815c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.935+0000 7f3ce041a640 1 --2- 172.21.15.59:0/4232952489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cd80cd680 0x7f3cd815c1b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80b73e0 tx=0x7f3cc802a270 comp rx=0 tx=0).stop 2024-04-25T15:46:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.935+0000 7f3ce041a640 1 -- 172.21.15.59:0/4232952489 shutdown_connections 2024-04-25T15:46:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.935+0000 7f3ce041a640 1 --2- 172.21.15.59:0/4232952489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cd80cd680 0x7f3cd815c1b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.935+0000 7f3ce041a640 1 --2- 172.21.15.59:0/4232952489 >> v2:172.21.15.59:3300/0 conn(0x7f3cd80b41c0 0x7f3cd80cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.935+0000 7f3ce041a640 1 -- 172.21.15.59:0/4232952489 >> 172.21.15.59:0/4232952489 conn(0x7f3cd806ed70 msgr2=0x7f3cd806f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.935+0000 7f3ce041a640 1 -- 172.21.15.59:0/4232952489 shutdown_connections 2024-04-25T15:46:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.935+0000 7f3ce041a640 1 -- 172.21.15.59:0/4232952489 wait complete. 2024-04-25T15:46:51.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.937+0000 7f3ce041a640 1 Processor -- start 2024-04-25T15:46:51.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.937+0000 7f3ce041a640 1 -- start start 2024-04-25T15:46:51.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.938+0000 7f3ce041a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3cd80b41c0 0x7f3cd814d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.938+0000 7f3ce041a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cd80cd680 0x7f3cd81527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.938+0000 7f3ce041a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd815c6f0 0x7f3cd814bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.938+0000 7f3ce041a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd80b78a0 con 0x7f3cd815c6f0 2024-04-25T15:46:51.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.938+0000 7f3ce041a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd80ce020 con 0x7f3cd80cd680 2024-04-25T15:46:51.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.938+0000 7f3ce041a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd80c51e0 con 0x7f3cd80b41c0 2024-04-25T15:46:51.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.938+0000 7f3cdd9b5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cd80cd680 0x7f3cd81527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.938+0000 7f3cde9b7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd815c6f0 0x7f3cd814bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.939+0000 7f3cde1b6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3cd80b41c0 0x7f3cd814d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.939+0000 7f3cde9b7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd815c6f0 0x7f3cd814bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59972/0 (socket says 172.21.15.59:59972) 2024-04-25T15:46:51.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.939+0000 7f3cde9b7640 1 -- 172.21.15.59:0/2283191535 learned_addr learned my addr 172.21.15.59:0/2283191535 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:51.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.943+0000 7f3cde9b7640 1 -- 172.21.15.59:0/2283191535 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3cd80b41c0 msgr2=0x7f3cd814d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.943+0000 7f3cde9b7640 1 --2- 172.21.15.59:0/2283191535 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3cd80b41c0 0x7f3cd814d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.943+0000 7f3cde9b7640 1 -- 172.21.15.59:0/2283191535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cd80cd680 msgr2=0x7f3cd81527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:51.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.943+0000 7f3cde9b7640 1 --2- 172.21.15.59:0/2283191535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cd80cd680 0x7f3cd81527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:51.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.943+0000 7f3cde9b7640 1 -- 172.21.15.59:0/2283191535 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd80cb0c0 con 0x7f3cd815c6f0 2024-04-25T15:46:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.945+0000 7f3cde9b7640 1 --2- 172.21.15.59:0/2283191535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd815c6f0 0x7f3cd814bca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000c6b0 tx=0x7f3cd000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:51.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.949+0000 7f3cceffd640 1 -- 172.21.15.59:0/2283191535 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0003b70 con 0x7f3cd815c6f0 2024-04-25T15:46:51.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.949+0000 7f3cceffd640 1 -- 172.21.15.59:0/2283191535 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cd0003d10 con 0x7f3cd815c6f0 2024-04-25T15:46:51.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.949+0000 7f3cceffd640 1 -- 172.21.15.59:0/2283191535 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0005310 con 0x7f3cd815c6f0 2024-04-25T15:46:51.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.949+0000 7f3ce041a640 1 -- 172.21.15.59:0/2283191535 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd80cb380 con 0x7f3cd815c6f0 2024-04-25T15:46:51.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.949+0000 7f3ce041a640 1 -- 172.21.15.59:0/2283191535 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd81578d0 con 0x7f3cd815c6f0 2024-04-25T15:46:51.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.950+0000 7f3ce041a640 1 -- 172.21.15.59:0/2283191535 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd8076940 con 0x7f3cd815c6f0 2024-04-25T15:46:51.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.973+0000 7f3cceffd640 1 -- 172.21.15.59:0/2283191535 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3cd00054b0 con 0x7f3cd815c6f0 2024-04-25T15:46:51.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.974+0000 7f3cceffd640 1 --2- 172.21.15.59:0/2283191535 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f3cbc074530 0x7f3cbc076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:51.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.974+0000 7f3cde1b6640 1 --2- 172.21.15.59:0/2283191535 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f3cbc074530 0x7f3cbc076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:51.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.974+0000 7f3cde1b6640 1 --2- 172.21.15.59:0/2283191535 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f3cbc074530 0x7f3cbc076a40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009aa0 tx=0x7f3cd4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:51.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:51.977+0000 7f3cceffd640 1 -- 172.21.15.59:0/2283191535 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3cd00057a0 con 0x7f3cd815c6f0 2024-04-25T15:46:52.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.258+0000 7f3cceffd640 1 -- 172.21.15.59:0/2283191535 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3cd8076940 con 0x7f3cd815c6f0 2024-04-25T15:46:52.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.445+0000 7f3ce041a640 1 -- 172.21.15.59:0/2283191535 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3cd80d0bf0 con 0x7f3cd815c6f0 2024-04-25T15:46:52.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.487+0000 7f3cceffd640 1 -- 172.21.15.59:0/2283191535 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16545 (secure 0 0 0) 0x7f3cd0068110 con 0x7f3cd815c6f0 2024-04-25T15:46:52.488 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:52.488 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":22,"fsid":"9bb5d7ca-5217-467b-882c-0a18cd57f08f","created":"2024-04-25T15:46:00.198001+0000","modified":"2024-04-25T15:46:33.915756+0000","last_up_change":"2024-04-25T15:46:15.850827+0000","last_in_change":"2024-04-25T15:46:06.311980+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:46:16.936340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:30.174141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:31.372481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34cee654-11dd-4f4b-99fe-093462f8abad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6803","nonce":1314235095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6805","nonce":1314235095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6809","nonce":1314235095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6807","nonce":1314235095}]},"public_addr":"172.21.15.59:6803/1314235095","cluster_addr":"172.21.15.59:6805/1314235095","heartbeat_back_addr":"172.21.15.59:6809/1314235095","heartbeat_front_addr":"172.21.15.59:6807/1314235095","state":["exists","up"]},{"osd":1,"uuid":"3c15505b-4abd-4a24-b30c-edc2732f8ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6827","nonce":3550810151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6829","nonce":3550810151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6833","nonce":3550810151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6831","nonce":3550810151}]},"public_addr":"172.21.15.59:6827/3550810151","cluster_addr":"172.21.15.59:6829/3550810151","heartbeat_back_addr":"172.21.15.59:6833/3550810151","heartbeat_front_addr":"172.21.15.59:6831/3550810151","state":["exists","up"]},{"osd":2,"uuid":"5884bf21-e6b4-4813-b8bc-6baa92443c87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6811","nonce":1651189093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6813","nonce":1651189093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6817","nonce":1651189093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6815","nonce":1651189093}]},"public_addr":"172.21.15.59:6811/1651189093","cluster_addr":"172.21.15.59:6813/1651189093","heartbeat_back_addr":"172.21.15.59:6817/1651189093","heartbeat_front_addr":"172.21.15.59:6815/1651189093","state":["exists","up"]},{"osd":3,"uuid":"6ff71700-3b00-4350-b3c9-f6c41ec46b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6819","nonce":1300858236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6821","nonce":1300858236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6825","nonce":1300858236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6823","nonce":1300858236}]},"public_addr":"172.21.15.59:6819/1300858236","cluster_addr":"172.21.15.59:6821/1300858236","heartbeat_back_addr":"172.21.15.59:6825/1300858236","heartbeat_front_addr":"172.21.15.59:6823/1300858236","state":["exists","up"]},{"osd":4,"uuid":"d0a72143-93fd-4712-aadb-f3fade303426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6817","nonce":2206186554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6819","nonce":2206186554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6823","nonce":2206186554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6821","nonce":2206186554}]},"public_addr":"172.21.15.64:6817/2206186554","cluster_addr":"172.21.15.64:6819/2206186554","heartbeat_back_addr":"172.21.15.64:6823/2206186554","heartbeat_front_addr":"172.21.15.64:6821/2206186554","state":["exists","up"]},{"osd":5,"uuid":"9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6825","nonce":639697697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6827","nonce":639697697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6831","nonce":639697697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6829","nonce":639697697}]},"public_addr":"172.21.15.64:6825/639697697","cluster_addr":"172.21.15.64:6827/639697697","heartbeat_back_addr":"172.21.15.64:6831/639697697","heartbeat_front_addr":"172.21.15.64:6829/639697697","state":["exists","up"]},{"osd":6,"uuid":"311d9a6b-8fbc-4809-8d33-b9248a3562f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6809","nonce":2335675289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6811","nonce":2335675289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6815","nonce":2335675289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6813","nonce":2335675289}]},"public_addr":"172.21.15.64:6809/2335675289","cluster_addr":"172.21.15.64:6811/2335675289","heartbeat_back_addr":"172.21.15.64:6815/2335675289","heartbeat_front_addr":"172.21.15.64:6813/2335675289","state":["exists","up"]},{"osd":7,"uuid":"d0f7436e-882f-4aa7-b2ae-684b9894b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6801","nonce":970439753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6803","nonce":970439753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6807","nonce":970439753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6805","nonce":970439753}]},"public_addr":"172.21.15.64:6801/970439753","cluster_addr":"172.21.15.64:6803/970439753","heartbeat_back_addr":"172.21.15.64:6807/970439753","heartbeat_front_addr":"172.21.15.64:6805/970439753","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.807777+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.945589+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.926832+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.943537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.925062+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.957550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.913559+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.839159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.489+0000 7f3ce041a640 1 -- 172.21.15.59:0/2283191535 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f3cbc074530 msgr2=0x7f3cbc076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.489+0000 7f3ce041a640 1 --2- 172.21.15.59:0/2283191535 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f3cbc074530 0x7f3cbc076a40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009aa0 tx=0x7f3cd4009190 comp rx=0 tx=0).stop 2024-04-25T15:46:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.489+0000 7f3ce041a640 1 -- 172.21.15.59:0/2283191535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd815c6f0 msgr2=0x7f3cd814bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.489+0000 7f3ce041a640 1 --2- 172.21.15.59:0/2283191535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd815c6f0 0x7f3cd814bca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000c6b0 tx=0x7f3cd000cb70 comp rx=0 tx=0).stop 2024-04-25T15:46:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.489+0000 7f3ce041a640 1 -- 172.21.15.59:0/2283191535 shutdown_connections 2024-04-25T15:46:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.489+0000 7f3ce041a640 1 --2- 172.21.15.59:0/2283191535 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f3cbc074530 0x7f3cbc076a40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.489+0000 7f3ce041a640 1 --2- 172.21.15.59:0/2283191535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd815c6f0 0x7f3cd814bca0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.489+0000 7f3ce041a640 1 --2- 172.21.15.59:0/2283191535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cd80cd680 0x7f3cd81527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.489+0000 7f3ce041a640 1 --2- 172.21.15.59:0/2283191535 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3cd80b41c0 0x7f3cd814d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.489+0000 7f3ce041a640 1 -- 172.21.15.59:0/2283191535 >> 172.21.15.59:0/2283191535 conn(0x7f3cd806ed70 msgr2=0x7f3cd80ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.489+0000 7f3ce041a640 1 -- 172.21.15.59:0/2283191535 shutdown_connections 2024-04-25T15:46:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.489+0000 7f3ce041a640 1 -- 172.21.15.59:0/2283191535 wait complete. 2024-04-25T15:46:52.502 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:46:16.936340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:46:30.174141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:46:31.372481+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:46:52.503 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:46:52.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.619+0000 7f8c56fb2640 1 Processor -- start 2024-04-25T15:46:52.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.619+0000 7f8c56fb2640 1 -- start start 2024-04-25T15:46:52.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.620+0000 7f8c56fb2640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8c500c8470 0x7f8c50154580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.620+0000 7f8c56fb2640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c5006ff60 0x7f8c500c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.620+0000 7f8c56fb2640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c5015e8c0 con 0x7f8c5015e380 2024-04-25T15:46:52.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.620+0000 7f8c56fb2640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f8c500c8b50 con 0x7f8c500c8470 2024-04-25T15:46:52.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.620+0000 7f8c56fb2640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f8c500cb080 con 0x7f8c5006ff60 2024-04-25T15:46:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.621+0000 7f8c5554f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c5006ff60 0x7f8c500c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.621+0000 7f8c4ffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8c500c8470 0x7f8c50154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.621+0000 7f8c5554f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c5006ff60 0x7f8c500c6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53642/0 (socket says 172.21.15.59:53642) 2024-04-25T15:46:52.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.621+0000 7f8c5554f640 1 -- 172.21.15.59:0/4026330649 learned_addr learned my addr 172.21.15.59:0/4026330649 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:52.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.625+0000 7f8c5554f640 1 -- 172.21.15.59:0/4026330649 >> v2:172.21.15.64:3300/0 conn(0x7f8c500c8470 msgr2=0x7f8c50154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:52.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.625+0000 7f8c5554f640 1 --2- 172.21.15.59:0/4026330649 >> v2:172.21.15.64:3300/0 conn(0x7f8c500c8470 0x7f8c50154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.625+0000 7f8c5554f640 1 -- 172.21.15.59:0/4026330649 >> v1:172.21.15.64:6789/0 conn(0x7f8c5015e380 legacy=0x7f8c5015ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:52.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.625+0000 7f8c5554f640 1 -- 172.21.15.59:0/4026330649 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c5015a350 con 0x7f8c5006ff60 2024-04-25T15:46:52.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.628+0000 7f8c5554f640 1 --2- 172.21.15.59:0/4026330649 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c5006ff60 0x7f8c500c6d50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009e50 tx=0x7f8c4802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba8562082bbb7c79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:52.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.633+0000 7f8c4f7fe640 1 -- 172.21.15.59:0/4026330649 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c48036070 con 0x7f8c5006ff60 2024-04-25T15:46:52.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.633+0000 7f8c4f7fe640 1 -- 172.21.15.59:0/4026330649 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c48031600 con 0x7f8c5006ff60 2024-04-25T15:46:52.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.633+0000 7f8c4f7fe640 1 -- 172.21.15.59:0/4026330649 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c480319d0 con 0x7f8c5006ff60 2024-04-25T15:46:52.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.633+0000 7f8c56fb2640 1 -- 172.21.15.59:0/4026330649 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c5006ff60 msgr2=0x7f8c500c6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:52.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.633+0000 7f8c56fb2640 1 --2- 172.21.15.59:0/4026330649 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c5006ff60 0x7f8c500c6d50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009e50 tx=0x7f8c4802a710 comp rx=0 tx=0).stop 2024-04-25T15:46:52.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.633+0000 7f8c56fb2640 1 -- 172.21.15.59:0/4026330649 shutdown_connections 2024-04-25T15:46:52.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.633+0000 7f8c56fb2640 1 --2- 172.21.15.59:0/4026330649 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c5006ff60 0x7f8c500c6d50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.633+0000 7f8c56fb2640 1 --2- 172.21.15.59:0/4026330649 >> v2:172.21.15.64:3300/0 conn(0x7f8c500c8470 0x7f8c50154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.633+0000 7f8c56fb2640 1 -- 172.21.15.59:0/4026330649 >> 172.21.15.59:0/4026330649 conn(0x7f8c50071720 msgr2=0x7f8c500ca140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:52.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.633+0000 7f8c56fb2640 1 -- 172.21.15.59:0/4026330649 shutdown_connections 2024-04-25T15:46:52.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.634+0000 7f8c56fb2640 1 -- 172.21.15.59:0/4026330649 wait complete. 2024-04-25T15:46:52.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.635+0000 7f8c56fb2640 1 Processor -- start 2024-04-25T15:46:52.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.635+0000 7f8c56fb2640 1 -- start start 2024-04-25T15:46:52.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.636+0000 7f8c56fb2640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c5006ff60 0x7f8c5014fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.636+0000 7f8c56fb2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c500c8470 0x7f8c500cd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.637+0000 7f8c56fb2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c5015e380 0x7f8c501574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.637+0000 7f8c56fb2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5006f6d0 con 0x7f8c500c8470 2024-04-25T15:46:52.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.637+0000 7f8c56fb2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8c50154ac0 con 0x7f8c5015e380 2024-04-25T15:46:52.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.637+0000 7f8c56fb2640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f8c5006f9b0 con 0x7f8c5006ff60 2024-04-25T15:46:52.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.637+0000 7f8c54d4e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c5006ff60 0x7f8c5014fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.637+0000 7f8c5554f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c5015e380 0x7f8c501574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.637+0000 7f8c4ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c500c8470 0x7f8c500cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.637+0000 7f8c54d4e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c5006ff60 0x7f8c5014fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53648/0 (socket says 172.21.15.59:53648) 2024-04-25T15:46:52.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.637+0000 7f8c54d4e640 1 -- 172.21.15.59:0/4272899099 learned_addr learned my addr 172.21.15.59:0/4272899099 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:52.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.642+0000 7f8c4ffff640 1 -- 172.21.15.59:0/4272899099 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c5006ff60 msgr2=0x7f8c5014fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:52.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.642+0000 7f8c4ffff640 1 --2- 172.21.15.59:0/4272899099 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c5006ff60 0x7f8c5014fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.642+0000 7f8c4ffff640 1 -- 172.21.15.59:0/4272899099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c5015e380 msgr2=0x7f8c501574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:52.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.642+0000 7f8c4ffff640 1 --2- 172.21.15.59:0/4272899099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c5015e380 0x7f8c501574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:52.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.642+0000 7f8c4ffff640 1 -- 172.21.15.59:0/4272899099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c50150050 con 0x7f8c500c8470 2024-04-25T15:46:52.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.644+0000 7f8c4ffff640 1 --2- 172.21.15.59:0/4272899099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c500c8470 0x7f8c500cd050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400e8a0 tx=0x7f8c4400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:52.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.648+0000 7f8c4d7fa640 1 -- 172.21.15.59:0/4272899099 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44017070 con 0x7f8c500c8470 2024-04-25T15:46:52.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.648+0000 7f8c4d7fa640 1 -- 172.21.15.59:0/4272899099 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c4400c940 con 0x7f8c500c8470 2024-04-25T15:46:52.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.648+0000 7f8c56fb2640 1 -- 172.21.15.59:0/4272899099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c5015a060 con 0x7f8c500c8470 2024-04-25T15:46:52.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.648+0000 7f8c4d7fa640 1 -- 172.21.15.59:0/4272899099 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44009e60 con 0x7f8c500c8470 2024-04-25T15:46:52.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.649+0000 7f8c56fb2640 1 -- 172.21.15.59:0/4272899099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c501568a0 con 0x7f8c500c8470 2024-04-25T15:46:52.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.650+0000 7f8c56fb2640 1 -- 172.21.15.59:0/4272899099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c500c7d30 con 0x7f8c500c8470 2024-04-25T15:46:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.673+0000 7f8c4d7fa640 1 -- 172.21.15.59:0/4272899099 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8c4401a070 con 0x7f8c500c8470 2024-04-25T15:46:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.674+0000 7f8c4d7fa640 1 --2- 172.21.15.59:0/4272899099 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f8c3c074500 0x7f8c3c076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:52.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.674+0000 7f8c54d4e640 1 --2- 172.21.15.59:0/4272899099 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f8c3c074500 0x7f8c3c076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:52.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.674+0000 7f8c54d4e640 1 --2- 172.21.15.59:0/4272899099 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f8c3c074500 0x7f8c3c076a10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8c40001850 tx=0x7f8c40009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:52.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.977+0000 7f8c4d7fa640 1 -- 172.21.15.59:0/4272899099 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8c4400cd10 con 0x7f8c500c8470 2024-04-25T15:46:52.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:52.978+0000 7f8c4d7fa640 1 -- 172.21.15.59:0/4272899099 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8c500c7d30 con 0x7f8c500c8470 2024-04-25T15:46:53.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.164+0000 7f8c56fb2640 1 -- 172.21.15.59:0/4272899099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8c50069910 con 0x7f8c500c8470 2024-04-25T15:46:53.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.190+0000 7f8c4d7fa640 1 -- 172.21.15.59:0/4272899099 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f8c4405f900 con 0x7f8c500c8470 2024-04-25T15:46:53.191 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T15:46:53.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.193+0000 7f8c56fb2640 1 -- 172.21.15.59:0/4272899099 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f8c3c074500 msgr2=0x7f8c3c076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.193+0000 7f8c56fb2640 1 --2- 172.21.15.59:0/4272899099 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f8c3c074500 0x7f8c3c076a10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8c40001850 tx=0x7f8c40009040 comp rx=0 tx=0).stop 2024-04-25T15:46:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.193+0000 7f8c56fb2640 1 -- 172.21.15.59:0/4272899099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c500c8470 msgr2=0x7f8c500cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.193+0000 7f8c56fb2640 1 --2- 172.21.15.59:0/4272899099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c500c8470 0x7f8c500cd050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400e8a0 tx=0x7f8c4400ed60 comp rx=0 tx=0).stop 2024-04-25T15:46:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.193+0000 7f8c56fb2640 1 -- 172.21.15.59:0/4272899099 shutdown_connections 2024-04-25T15:46:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.193+0000 7f8c56fb2640 1 --2- 172.21.15.59:0/4272899099 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f8c3c074500 0x7f8c3c076a10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.193+0000 7f8c56fb2640 1 --2- 172.21.15.59:0/4272899099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c5015e380 0x7f8c501574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.193+0000 7f8c56fb2640 1 --2- 172.21.15.59:0/4272899099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c500c8470 0x7f8c500cd050 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.193+0000 7f8c56fb2640 1 --2- 172.21.15.59:0/4272899099 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8c5006ff60 0x7f8c5014fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.193+0000 7f8c56fb2640 1 -- 172.21.15.59:0/4272899099 >> 172.21.15.59:0/4272899099 conn(0x7f8c50071720 msgr2=0x7f8c50157fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.193+0000 7f8c56fb2640 1 -- 172.21.15.59:0/4272899099 shutdown_connections 2024-04-25T15:46:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.193+0000 7f8c56fb2640 1 -- 172.21.15.59:0/4272899099 wait complete. 2024-04-25T15:46:53.205 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:46:53.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.322+0000 7fbe938e0640 1 Processor -- start 2024-04-25T15:46:53.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.322+0000 7fbe938e0640 1 -- start start 2024-04-25T15:46:53.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.323+0000 7fbe938e0640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe8c073c20 0x7fbe8c074030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:53.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.323+0000 7fbe938e0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbe8c0c7990 0x7fbe8c0c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:53.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.323+0000 7fbe938e0640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe8c15c880 con 0x7fbe8c153040 2024-04-25T15:46:53.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.323+0000 7fbe938e0640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbe8c15cb20 con 0x7fbe8c073c20 2024-04-25T15:46:53.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.323+0000 7fbe938e0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fbe8c15cdc0 con 0x7fbe8c0c7990 2024-04-25T15:46:53.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.384+0000 7fbe90e7b640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe8c073c20 0x7fbe8c074030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:53.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.386+0000 7fbe90e7b640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe8c073c20 0x7fbe8c074030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59994/0 (socket says 172.21.15.59:59994) 2024-04-25T15:46:53.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.386+0000 7fbe90e7b640 1 -- 172.21.15.59:0/3033458755 learned_addr learned my addr 172.21.15.59:0/3033458755 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:53.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.386+0000 7fbe91e7d640 1 --2- 172.21.15.59:0/3033458755 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbe8c0c7990 0x7fbe8c0c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:53.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.389+0000 7fbe90e7b640 1 -- 172.21.15.59:0/3033458755 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbe8c0c7990 msgr2=0x7fbe8c0c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:53.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.389+0000 7fbe90e7b640 1 --2- 172.21.15.59:0/3033458755 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbe8c0c7990 0x7fbe8c0c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.389+0000 7fbe90e7b640 1 -- 172.21.15.59:0/3033458755 >> v1:172.21.15.59:6789/0 conn(0x7fbe8c153040 legacy=0x7fbe8c06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:53.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.389+0000 7fbe90e7b640 1 -- 172.21.15.59:0/3033458755 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8c15d360 con 0x7fbe8c073c20 2024-04-25T15:46:53.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.392+0000 7fbe90e7b640 1 --2- 172.21.15.59:0/3033458755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c073c20 0x7fbe8c074030 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009870 tx=0x7fbe7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68819fb48a6b228 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.407+0000 7fbe83fff640 1 -- 172.21.15.59:0/3033458755 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c037070 con 0x7fbe8c073c20 2024-04-25T15:46:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.407+0000 7fbe83fff640 1 -- 172.21.15.59:0/3033458755 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7c032440 con 0x7fbe8c073c20 2024-04-25T15:46:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.407+0000 7fbe83fff640 1 -- 172.21.15.59:0/3033458755 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c032810 con 0x7fbe8c073c20 2024-04-25T15:46:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.408+0000 7fbe938e0640 1 -- 172.21.15.59:0/3033458755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c073c20 msgr2=0x7fbe8c074030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.408+0000 7fbe938e0640 1 --2- 172.21.15.59:0/3033458755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c073c20 0x7fbe8c074030 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009870 tx=0x7fbe7c02a270 comp rx=0 tx=0).stop 2024-04-25T15:46:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.408+0000 7fbe938e0640 1 -- 172.21.15.59:0/3033458755 shutdown_connections 2024-04-25T15:46:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.408+0000 7fbe938e0640 1 --2- 172.21.15.59:0/3033458755 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbe8c0c7990 0x7fbe8c0c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.408+0000 7fbe938e0640 1 --2- 172.21.15.59:0/3033458755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c073c20 0x7fbe8c074030 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.408+0000 7fbe938e0640 1 -- 172.21.15.59:0/3033458755 >> 172.21.15.59:0/3033458755 conn(0x7fbe8c0ca890 msgr2=0x7fbe8c0caca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.408+0000 7fbe938e0640 1 -- 172.21.15.59:0/3033458755 shutdown_connections 2024-04-25T15:46:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.408+0000 7fbe938e0640 1 -- 172.21.15.59:0/3033458755 wait complete. 2024-04-25T15:46:53.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.410+0000 7fbe938e0640 1 Processor -- start 2024-04-25T15:46:53.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.410+0000 7fbe938e0640 1 -- start start 2024-04-25T15:46:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.411+0000 7fbe938e0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe8c073c20 0x7fbe8c0cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.411+0000 7fbe938e0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbe8c0c7990 0x7fbe8c151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.411+0000 7fbe938e0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c153040 0x7fbe8c14bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.411+0000 7fbe938e0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c0c5ca0 con 0x7fbe8c153040 2024-04-25T15:46:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.411+0000 7fbe938e0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c0c7470 con 0x7fbe8c073c20 2024-04-25T15:46:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.411+0000 7fbe938e0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fbe8c06dea0 con 0x7fbe8c0c7990 2024-04-25T15:46:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.412+0000 7fbe90e7b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbe8c0c7990 0x7fbe8c151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.412+0000 7fbe90e7b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbe8c0c7990 0x7fbe8c151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53672/0 (socket says 172.21.15.59:53672) 2024-04-25T15:46:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.412+0000 7fbe90e7b640 1 -- 172.21.15.59:0/1916149810 learned_addr learned my addr 172.21.15.59:0/1916149810 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.414+0000 7fbe9167c640 1 --2- 172.21.15.59:0/1916149810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe8c073c20 0x7fbe8c0cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:53.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.418+0000 7fbe90e7b640 1 -- 172.21.15.59:0/1916149810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe8c073c20 msgr2=0x7fbe8c0cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:53.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.418+0000 7fbe90e7b640 1 --2- 172.21.15.59:0/1916149810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe8c073c20 0x7fbe8c0cc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.418+0000 7fbe90e7b640 1 -- 172.21.15.59:0/1916149810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c153040 msgr2=0x7fbe8c14bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:53.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.418+0000 7fbe90e7b640 1 --2- 172.21.15.59:0/1916149810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c153040 0x7fbe8c14bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.418+0000 7fbe90e7b640 1 -- 172.21.15.59:0/1916149810 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8c0cea70 con 0x7fbe8c0c7990 2024-04-25T15:46:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.422+0000 7fbe90e7b640 1 --2- 172.21.15.59:0/1916149810 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbe8c0c7990 0x7fbe8c151c50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009990 tx=0x7fbe7c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:53.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.427+0000 7fbe81ffb640 1 -- 172.21.15.59:0/1916149810 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c041020 con 0x7fbe8c0c7990 2024-04-25T15:46:53.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.427+0000 7fbe81ffb640 1 -- 172.21.15.59:0/1916149810 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7c030780 con 0x7fbe8c0c7990 2024-04-25T15:46:53.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.427+0000 7fbe81ffb640 1 -- 172.21.15.59:0/1916149810 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c037040 con 0x7fbe8c0c7990 2024-04-25T15:46:53.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.427+0000 7fbe938e0640 1 -- 172.21.15.59:0/1916149810 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe8c1f68e0 con 0x7fbe8c0c7990 2024-04-25T15:46:53.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.427+0000 7fbe938e0640 1 -- 172.21.15.59:0/1916149810 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe8c156a40 con 0x7fbe8c0c7990 2024-04-25T15:46:53.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.428+0000 7fbe938e0640 1 -- 172.21.15.59:0/1916149810 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe8c069fb0 con 0x7fbe8c0c7990 2024-04-25T15:46:53.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.737+0000 7fbe81ffb640 1 -- 172.21.15.59:0/1916149810 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbe7c044020 con 0x7fbe8c0c7990 2024-04-25T15:46:53.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.737+0000 7fbe81ffb640 1 --2- 172.21.15.59:0/1916149810 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbe700744e0 0x7fbe700769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:53.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.737+0000 7fbe81ffb640 1 -- 172.21.15.59:0/1916149810 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbe7c0b5dd0 con 0x7fbe8c0c7990 2024-04-25T15:46:53.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.737+0000 7fbe9167c640 1 --2- 172.21.15.59:0/1916149810 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbe700744e0 0x7fbe700769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:53.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.738+0000 7fbe9167c640 1 --2- 172.21.15.59:0/1916149810 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbe700744e0 0x7fbe700769f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbe88000f60 tx=0x7fbe88009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:53.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.749+0000 7fbe81ffb640 1 -- 172.21.15.59:0/1916149810 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbe7c04b030 con 0x7fbe8c0c7990 2024-04-25T15:46:53.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.936+0000 7fbe938e0640 1 -- 172.21.15.59:0/1916149810 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbe8c0ce800 con 0x7fbe8c0c7990 2024-04-25T15:46:53.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.944+0000 7fbe81ffb640 1 -- 172.21.15.59:0/1916149810 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fbe7c080640 con 0x7fbe8c0c7990 2024-04-25T15:46:53.944 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T15:46:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.946+0000 7fbe938e0640 1 -- 172.21.15.59:0/1916149810 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbe700744e0 msgr2=0x7fbe700769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.946+0000 7fbe938e0640 1 --2- 172.21.15.59:0/1916149810 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbe700744e0 0x7fbe700769f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbe88000f60 tx=0x7fbe88009040 comp rx=0 tx=0).stop 2024-04-25T15:46:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.946+0000 7fbe938e0640 1 -- 172.21.15.59:0/1916149810 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbe8c0c7990 msgr2=0x7fbe8c151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.946+0000 7fbe938e0640 1 --2- 172.21.15.59:0/1916149810 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbe8c0c7990 0x7fbe8c151c50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009990 tx=0x7fbe7c0046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.946+0000 7fbe938e0640 1 -- 172.21.15.59:0/1916149810 shutdown_connections 2024-04-25T15:46:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.946+0000 7fbe938e0640 1 --2- 172.21.15.59:0/1916149810 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbe700744e0 0x7fbe700769f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.946+0000 7fbe938e0640 1 --2- 172.21.15.59:0/1916149810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe8c153040 0x7fbe8c14bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.946+0000 7fbe938e0640 1 --2- 172.21.15.59:0/1916149810 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbe8c0c7990 0x7fbe8c151c50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.946+0000 7fbe938e0640 1 --2- 172.21.15.59:0/1916149810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbe8c073c20 0x7fbe8c0cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.946+0000 7fbe938e0640 1 -- 172.21.15.59:0/1916149810 >> 172.21.15.59:0/1916149810 conn(0x7fbe8c0ca890 msgr2=0x7fbe8c06d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.946+0000 7fbe938e0640 1 -- 172.21.15.59:0/1916149810 shutdown_connections 2024-04-25T15:46:53.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:53.946+0000 7fbe938e0640 1 -- 172.21.15.59:0/1916149810 wait complete. 2024-04-25T15:46:53.958 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:46:54.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.072+0000 7f2c28867640 1 Processor -- start 2024-04-25T15:46:54.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.073+0000 7f2c28867640 1 -- start start 2024-04-25T15:46:54.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.074+0000 7f2c28867640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c24160810 0x7f2c241565d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.074+0000 7f2c28867640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2c240c70b0 0x7f2c240b5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.074+0000 7f2c28867640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c240cf080 con 0x7f2c2415c5a0 2024-04-25T15:46:54.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.074+0000 7f2c28867640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f2c240b58d0 con 0x7f2c240c70b0 2024-04-25T15:46:54.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.074+0000 7f2c28867640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f2c2415d030 con 0x7f2c24160810 2024-04-25T15:46:54.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.075+0000 7f2c2259c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c24160810 0x7f2c241565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.075+0000 7f2c22d9d640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f2c2415c5a0 0x7f2c240ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.59:35980/0 (socket says 172.21.15.59:35980) 2024-04-25T15:46:54.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.075+0000 7f2c22d9d640 1 -- 172.21.15.59:0/1846738407 learned_addr learned my addr 172.21.15.59:0/1846738407 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:54.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.075+0000 7f2c21d9b640 1 --2- 172.21.15.59:0/1846738407 >> v2:172.21.15.59:3300/0 conn(0x7f2c240c70b0 0x7f2c240b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.078+0000 7f2c2259c640 1 -- 172.21.15.59:0/1846738407 >> v2:172.21.15.59:3300/0 conn(0x7f2c240c70b0 msgr2=0x7f2c240b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:54.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.078+0000 7f2c2259c640 1 --2- 172.21.15.59:0/1846738407 >> v2:172.21.15.59:3300/0 conn(0x7f2c240c70b0 0x7f2c240b5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.078+0000 7f2c2259c640 1 -- 172.21.15.59:0/1846738407 >> v1:172.21.15.64:6789/0 conn(0x7f2c2415c5a0 legacy=0x7f2c240ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:54.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.078+0000 7f2c2259c640 1 -- 172.21.15.59:0/1846738407 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2415d310 con 0x7f2c24160810 2024-04-25T15:46:54.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.080+0000 7f2c2259c640 1 --2- 172.21.15.59:0/1846738407 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c24160810 0x7f2c241565d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0097a0 tx=0x7f2c1c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34a6dc661b04a0ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:54.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.084+0000 7f2c2159a640 1 -- 172.21.15.59:0/1846738407 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c037070 con 0x7f2c24160810 2024-04-25T15:46:54.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.084+0000 7f2c2159a640 1 -- 172.21.15.59:0/1846738407 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c1c032440 con 0x7f2c24160810 2024-04-25T15:46:54.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.084+0000 7f2c2159a640 1 -- 172.21.15.59:0/1846738407 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c032810 con 0x7f2c24160810 2024-04-25T15:46:54.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.085+0000 7f2c28867640 1 -- 172.21.15.59:0/1846738407 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c24160810 msgr2=0x7f2c241565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:54.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.085+0000 7f2c28867640 1 --2- 172.21.15.59:0/1846738407 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c24160810 0x7f2c241565d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0097a0 tx=0x7f2c1c02a210 comp rx=0 tx=0).stop 2024-04-25T15:46:54.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.085+0000 7f2c28867640 1 -- 172.21.15.59:0/1846738407 shutdown_connections 2024-04-25T15:46:54.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.085+0000 7f2c28867640 1 --2- 172.21.15.59:0/1846738407 >> v2:172.21.15.59:3300/0 conn(0x7f2c240c70b0 0x7f2c240b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.085+0000 7f2c28867640 1 --2- 172.21.15.59:0/1846738407 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c24160810 0x7f2c241565d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.085+0000 7f2c28867640 1 -- 172.21.15.59:0/1846738407 >> 172.21.15.59:0/1846738407 conn(0x7f2c240684e0 msgr2=0x7f2c240688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:54.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.085+0000 7f2c28867640 1 -- 172.21.15.59:0/1846738407 shutdown_connections 2024-04-25T15:46:54.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.085+0000 7f2c28867640 1 -- 172.21.15.59:0/1846738407 wait complete. 2024-04-25T15:46:54.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.087+0000 7f2c28867640 1 Processor -- start 2024-04-25T15:46:54.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.087+0000 7f2c28867640 1 -- start start 2024-04-25T15:46:54.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.088+0000 7f2c28867640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c240c70b0 0x7f2c2415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.088+0000 7f2c28867640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c2415c5a0 0x7f2c24158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.088+0000 7f2c28867640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c24160810 0x7f2c241e7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.088+0000 7f2c28867640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2c241602f0 con 0x7f2c2415c5a0 2024-04-25T15:46:54.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.088+0000 7f2c28867640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2c24160010 con 0x7f2c240c70b0 2024-04-25T15:46:54.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.088+0000 7f2c28867640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f2c240cea60 con 0x7f2c24160810 2024-04-25T15:46:54.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.089+0000 7f2c22d9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c24160810 0x7f2c241e7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.089+0000 7f2c22d9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c24160810 0x7f2c241e7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:45394/0 (socket says 172.21.15.59:45394) 2024-04-25T15:46:54.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.089+0000 7f2c22d9d640 1 -- 172.21.15.59:0/3264103778 learned_addr learned my addr 172.21.15.59:0/3264103778 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:54.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.090+0000 7f2c21d9b640 1 --2- 172.21.15.59:0/3264103778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c2415c5a0 0x7f2c24158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.091+0000 7f2c2259c640 1 --2- 172.21.15.59:0/3264103778 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c240c70b0 0x7f2c2415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.093+0000 7f2c22d9d640 1 -- 172.21.15.59:0/3264103778 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c240c70b0 msgr2=0x7f2c2415bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:54.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.093+0000 7f2c22d9d640 1 --2- 172.21.15.59:0/3264103778 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c240c70b0 0x7f2c2415bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.093+0000 7f2c22d9d640 1 -- 172.21.15.59:0/3264103778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c2415c5a0 msgr2=0x7f2c24158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:54.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.093+0000 7f2c22d9d640 1 --2- 172.21.15.59:0/3264103778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c2415c5a0 0x7f2c24158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.093+0000 7f2c22d9d640 1 -- 172.21.15.59:0/3264103778 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c24158e90 con 0x7f2c24160810 2024-04-25T15:46:54.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.099+0000 7f2c22d9d640 1 --2- 172.21.15.59:0/3264103778 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c24160810 0x7f2c241e7e60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400cab0 tx=0x7f2c1400cf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:54.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.102+0000 7f2c12ffd640 1 -- 172.21.15.59:0/3264103778 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c14017070 con 0x7f2c24160810 2024-04-25T15:46:54.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.103+0000 7f2c12ffd640 1 -- 172.21.15.59:0/3264103778 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c1400ac30 con 0x7f2c24160810 2024-04-25T15:46:54.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.103+0000 7f2c28867640 1 -- 172.21.15.59:0/3264103778 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c2415b6a0 con 0x7f2c24160810 2024-04-25T15:46:54.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.103+0000 7f2c12ffd640 1 -- 172.21.15.59:0/3264103778 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c14012400 con 0x7f2c24160810 2024-04-25T15:46:54.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.103+0000 7f2c28867640 1 -- 172.21.15.59:0/3264103778 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c2415a3f0 con 0x7f2c24160810 2024-04-25T15:46:54.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.104+0000 7f2c28867640 1 -- 172.21.15.59:0/3264103778 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c24069910 con 0x7f2c24160810 2024-04-25T15:46:54.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.413+0000 7f2c12ffd640 1 -- 172.21.15.59:0/3264103778 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2c1401a070 con 0x7f2c24160810 2024-04-25T15:46:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.413+0000 7f2c12ffd640 1 --2- 172.21.15.59:0/3264103778 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2c04074500 0x7f2c04076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.413+0000 7f2c12ffd640 1 -- 172.21.15.59:0/3264103778 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2c140951f0 con 0x7f2c24160810 2024-04-25T15:46:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.413+0000 7f2c2259c640 1 --2- 172.21.15.59:0/3264103778 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2c04074500 0x7f2c04076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.414+0000 7f2c2259c640 1 --2- 172.21.15.59:0/3264103778 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2c04074500 0x7f2c04076a10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c034000 tx=0x7f2c1c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:54.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.425+0000 7f2c12ffd640 1 -- 172.21.15.59:0/3264103778 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2c1405f430 con 0x7f2c24160810 2024-04-25T15:46:54.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.611+0000 7f2c28867640 1 -- 172.21.15.59:0/3264103778 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2c240cbda0 con 0x7f2c24160810 2024-04-25T15:46:54.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.688+0000 7f2c12ffd640 1 -- 172.21.15.59:0/3264103778 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f2c14063730 con 0x7f2c24160810 2024-04-25T15:46:54.689 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T15:46:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.690+0000 7f2c28867640 1 -- 172.21.15.59:0/3264103778 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2c04074500 msgr2=0x7f2c04076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.690+0000 7f2c28867640 1 --2- 172.21.15.59:0/3264103778 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2c04074500 0x7f2c04076a10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c034000 tx=0x7f2c1c02e000 comp rx=0 tx=0).stop 2024-04-25T15:46:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.690+0000 7f2c28867640 1 -- 172.21.15.59:0/3264103778 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c24160810 msgr2=0x7f2c241e7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.690+0000 7f2c28867640 1 --2- 172.21.15.59:0/3264103778 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c24160810 0x7f2c241e7e60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400cab0 tx=0x7f2c1400cf70 comp rx=0 tx=0).stop 2024-04-25T15:46:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.690+0000 7f2c28867640 1 -- 172.21.15.59:0/3264103778 shutdown_connections 2024-04-25T15:46:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.690+0000 7f2c28867640 1 --2- 172.21.15.59:0/3264103778 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2c04074500 0x7f2c04076a10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.690+0000 7f2c28867640 1 --2- 172.21.15.59:0/3264103778 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2c24160810 0x7f2c241e7e60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.690+0000 7f2c28867640 1 --2- 172.21.15.59:0/3264103778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c2415c5a0 0x7f2c24158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.690+0000 7f2c28867640 1 --2- 172.21.15.59:0/3264103778 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c240c70b0 0x7f2c2415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.690+0000 7f2c28867640 1 -- 172.21.15.59:0/3264103778 >> 172.21.15.59:0/3264103778 conn(0x7f2c240684e0 msgr2=0x7f2c24155c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.690+0000 7f2c28867640 1 -- 172.21.15.59:0/3264103778 shutdown_connections 2024-04-25T15:46:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.690+0000 7f2c28867640 1 -- 172.21.15.59:0/3264103778 wait complete. 2024-04-25T15:46:54.702 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:54.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.813+0000 7fca998f2640 1 Processor -- start 2024-04-25T15:46:54.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.813+0000 7fca998f2640 1 -- start start 2024-04-25T15:46:54.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.815+0000 7fca998f2640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fca94156770 0x7fca940cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.815+0000 7fca998f2640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca940cfad0 0x7fca940cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.815+0000 7fca998f2640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca9408d750 con 0x7fca9415fc80 2024-04-25T15:46:54.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.815+0000 7fca998f2640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fca940cb420 con 0x7fca940cfad0 2024-04-25T15:46:54.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.815+0000 7fca998f2640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fca9415d340 con 0x7fca94156770 2024-04-25T15:46:54.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.815+0000 7fca927fc640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca940cfad0 0x7fca940cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.815+0000 7fca92ffd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fca94156770 0x7fca940cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.816+0000 7fca92ffd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fca94156770 0x7fca940cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:44706/0 (socket says 172.21.15.59:44706) 2024-04-25T15:46:54.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.816+0000 7fca92ffd640 1 -- 172.21.15.59:0/3853076490 learned_addr learned my addr 172.21.15.59:0/3853076490 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:54.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.818+0000 7fca92ffd640 1 -- 172.21.15.59:0/3853076490 >> v2:172.21.15.59:3300/0 conn(0x7fca940cfad0 msgr2=0x7fca940cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:54.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.818+0000 7fca92ffd640 1 --2- 172.21.15.59:0/3853076490 >> v2:172.21.15.59:3300/0 conn(0x7fca940cfad0 0x7fca940cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.818+0000 7fca92ffd640 1 -- 172.21.15.59:0/3853076490 >> v1:172.21.15.59:6789/0 conn(0x7fca9415fc80 legacy=0x7fca94160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:54.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.818+0000 7fca92ffd640 1 -- 172.21.15.59:0/3853076490 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9415c730 con 0x7fca94156770 2024-04-25T15:46:54.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.820+0000 7fca92ffd640 1 --2- 172.21.15.59:0/3853076490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca94156770 0x7fca940cae00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fca94074920 tx=0x7fca8c02a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a1abde33ae8b7e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:54.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.824+0000 7fca91ffb640 1 -- 172.21.15.59:0/3853076490 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c037070 con 0x7fca94156770 2024-04-25T15:46:54.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.824+0000 7fca91ffb640 1 -- 172.21.15.59:0/3853076490 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca8c02ae50 con 0x7fca94156770 2024-04-25T15:46:54.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.824+0000 7fca91ffb640 1 -- 172.21.15.59:0/3853076490 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c032860 con 0x7fca94156770 2024-04-25T15:46:54.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.825+0000 7fca998f2640 1 -- 172.21.15.59:0/3853076490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca94156770 msgr2=0x7fca940cae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:54.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.825+0000 7fca998f2640 1 --2- 172.21.15.59:0/3853076490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca94156770 0x7fca940cae00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fca94074920 tx=0x7fca8c02a300 comp rx=0 tx=0).stop 2024-04-25T15:46:54.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.825+0000 7fca998f2640 1 -- 172.21.15.59:0/3853076490 shutdown_connections 2024-04-25T15:46:54.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.825+0000 7fca998f2640 1 --2- 172.21.15.59:0/3853076490 >> v2:172.21.15.59:3300/0 conn(0x7fca940cfad0 0x7fca940cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.825+0000 7fca998f2640 1 --2- 172.21.15.59:0/3853076490 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca94156770 0x7fca940cae00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.825+0000 7fca998f2640 1 -- 172.21.15.59:0/3853076490 >> 172.21.15.59:0/3853076490 conn(0x7fca94073200 msgr2=0x7fca94073610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:54.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.825+0000 7fca998f2640 1 -- 172.21.15.59:0/3853076490 shutdown_connections 2024-04-25T15:46:54.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.825+0000 7fca998f2640 1 -- 172.21.15.59:0/3853076490 wait complete. 2024-04-25T15:46:54.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.827+0000 7fca998f2640 1 Processor -- start 2024-04-25T15:46:54.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.827+0000 7fca998f2640 1 -- start start 2024-04-25T15:46:54.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.829+0000 7fca998f2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca940cfad0 0x7fca9415eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.829+0000 7fca998f2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca94156770 0x7fca941f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.829+0000 7fca998f2640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fca9415fc80 0x7fca9414b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.829+0000 7fca998f2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fca9415cfd0 con 0x7fca94156770 2024-04-25T15:46:54.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.829+0000 7fca998f2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fca9415ccf0 con 0x7fca940cfad0 2024-04-25T15:46:54.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.829+0000 7fca998f2640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fca940c57d0 con 0x7fca9415fc80 2024-04-25T15:46:54.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.829+0000 7fca927fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca94156770 0x7fca941f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.829+0000 7fca937fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fca9415fc80 0x7fca9414b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.829+0000 7fca92ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca940cfad0 0x7fca9415eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.830+0000 7fca937fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fca9415fc80 0x7fca9414b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:45410/0 (socket says 172.21.15.59:45410) 2024-04-25T15:46:54.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.830+0000 7fca92ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca940cfad0 0x7fca9415eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:44710/0 (socket says 172.21.15.59:44710) 2024-04-25T15:46:54.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.830+0000 7fca937fe640 1 -- 172.21.15.59:0/2913918810 learned_addr learned my addr 172.21.15.59:0/2913918810 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:54.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.834+0000 7fca92ffd640 1 -- 172.21.15.59:0/2913918810 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fca9415fc80 msgr2=0x7fca9414b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:54.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.834+0000 7fca92ffd640 1 --2- 172.21.15.59:0/2913918810 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fca9415fc80 0x7fca9414b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.834+0000 7fca92ffd640 1 -- 172.21.15.59:0/2913918810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca94156770 msgr2=0x7fca941f29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:54.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.834+0000 7fca92ffd640 1 --2- 172.21.15.59:0/2913918810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca94156770 0x7fca941f29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:54.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.834+0000 7fca92ffd640 1 -- 172.21.15.59:0/2913918810 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca941f2ee0 con 0x7fca940cfad0 2024-04-25T15:46:54.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.836+0000 7fca92ffd640 1 --2- 172.21.15.59:0/2913918810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca940cfad0 0x7fca9415eb70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fca8c031000 tx=0x7fca8c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:54.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.840+0000 7fca8bfff640 1 -- 172.21.15.59:0/2913918810 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c041070 con 0x7fca940cfad0 2024-04-25T15:46:54.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.840+0000 7fca8bfff640 1 -- 172.21.15.59:0/2913918810 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca8c03c6a0 con 0x7fca940cfad0 2024-04-25T15:46:54.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.840+0000 7fca8bfff640 1 -- 172.21.15.59:0/2913918810 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c037040 con 0x7fca940cfad0 2024-04-25T15:46:54.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.840+0000 7fca998f2640 1 -- 172.21.15.59:0/2913918810 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca9406f120 con 0x7fca940cfad0 2024-04-25T15:46:54.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.840+0000 7fca998f2640 1 -- 172.21.15.59:0/2913918810 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca9415f1f0 con 0x7fca940cfad0 2024-04-25T15:46:54.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.841+0000 7fca998f2640 1 -- 172.21.15.59:0/2913918810 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca940698a0 con 0x7fca940cfad0 2024-04-25T15:46:54.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.904+0000 7fca8bfff640 1 -- 172.21.15.59:0/2913918810 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fca8c044070 con 0x7fca940cfad0 2024-04-25T15:46:54.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.905+0000 7fca8bfff640 1 --2- 172.21.15.59:0/2913918810 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fca740744b0 0x7fca740769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:54.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.905+0000 7fca927fc640 1 --2- 172.21.15.59:0/2913918810 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fca740744b0 0x7fca740769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:54.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:54.905+0000 7fca927fc640 1 --2- 172.21.15.59:0/2913918810 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fca740744b0 0x7fca740769c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009aa0 tx=0x7fca7c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:55.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.137+0000 7fca8bfff640 1 -- 172.21.15.59:0/2913918810 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fca8c07c3d0 con 0x7fca940cfad0 2024-04-25T15:46:55.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.150+0000 7fca8bfff640 1 -- 172.21.15.59:0/2913918810 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fca8c080140 con 0x7fca940cfad0 2024-04-25T15:46:55.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.381+0000 7fca998f2640 1 -- 172.21.15.59:0/2913918810 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca940cb960 con 0x7fca940cfad0 2024-04-25T15:46:55.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.409+0000 7fca8bfff640 1 -- 172.21.15.59:0/2913918810 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6862 (secure 0 0 0) 0x7fca8c084440 con 0x7fca940cfad0 2024-04-25T15:46:55.410 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:55.410 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/783440137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":783440137},{"type":"v1","addr":"172.21.15.64:6835","nonce":783440137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2150121481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2150121481},{"type":"v1","addr":"172.21.15.59:6835","nonce":2150121481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4208,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2853549826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2853549826},{"type":"v1","addr":"172.21.15.64:6833","nonce":2853549826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:32.561262+0000","modified":"2024-04-25T15:46:42.826371+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4284,"mds_1":4281,"mds_2":4217},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4217":{"gid":4217,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.59:6837/2036351360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2036351360},{"type":"v1","addr":"172.21.15.59:6837","nonce":2036351360}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/4162601241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4162601241},{"type":"v1","addr":"172.21.15.59:6839","nonce":4162601241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6837/2368752795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2368752795},{"type":"v1","addr":"172.21.15.64:6837","nonce":2368752795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4217,4281,4284]},"id":1}]} 2024-04-25T15:46:55.410 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 13 2024-04-25T15:46:55.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.411+0000 7fca998f2640 1 -- 172.21.15.59:0/2913918810 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fca740744b0 msgr2=0x7fca740769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.411+0000 7fca998f2640 1 --2- 172.21.15.59:0/2913918810 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fca740744b0 0x7fca740769c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009aa0 tx=0x7fca7c009190 comp rx=0 tx=0).stop 2024-04-25T15:46:55.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.411+0000 7fca998f2640 1 -- 172.21.15.59:0/2913918810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca940cfad0 msgr2=0x7fca9415eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.411+0000 7fca998f2640 1 --2- 172.21.15.59:0/2913918810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca940cfad0 0x7fca9415eb70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fca8c031000 tx=0x7fca8c0046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.411+0000 7fca998f2640 1 -- 172.21.15.59:0/2913918810 shutdown_connections 2024-04-25T15:46:55.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.411+0000 7fca998f2640 1 --2- 172.21.15.59:0/2913918810 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fca740744b0 0x7fca740769c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.411+0000 7fca998f2640 1 --2- 172.21.15.59:0/2913918810 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fca9415fc80 0x7fca9414b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.411+0000 7fca998f2640 1 --2- 172.21.15.59:0/2913918810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca94156770 0x7fca941f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.411+0000 7fca998f2640 1 --2- 172.21.15.59:0/2913918810 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fca940cfad0 0x7fca9415eb70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.411+0000 7fca998f2640 1 -- 172.21.15.59:0/2913918810 >> 172.21.15.59:0/2913918810 conn(0x7fca94073200 msgr2=0x7fca94160090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:55.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.411+0000 7fca998f2640 1 -- 172.21.15.59:0/2913918810 shutdown_connections 2024-04-25T15:46:55.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.411+0000 7fca998f2640 1 -- 172.21.15.59:0/2913918810 wait complete. 2024-04-25T15:46:55.424 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:55.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.534+0000 7fc4589e3640 1 Processor -- start 2024-04-25T15:46:55.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.534+0000 7fc4589e3640 1 -- start start 2024-04-25T15:46:55.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.536+0000 7fc4589e3640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc4540cae40 0x7fc45415fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.536+0000 7fc4589e3640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc4541600c0 0x7fc454166f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.536+0000 7fc4589e3640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4540cb380 con 0x7fc4540c5630 2024-04-25T15:46:55.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.536+0000 7fc4589e3640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fc45408d750 con 0x7fc4540cae40 2024-04-25T15:46:55.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.536+0000 7fc4589e3640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fc45415c6a0 con 0x7fc4541600c0 2024-04-25T15:46:55.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.536+0000 7fc44bfff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc4540cae40 0x7fc45415fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.537+0000 7fc452d9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc4541600c0 0x7fc454166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.537+0000 7fc44bfff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc4540cae40 0x7fc45415fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39900/0 (socket says 172.21.15.59:39900) 2024-04-25T15:46:55.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.537+0000 7fc44bfff640 1 -- 172.21.15.59:0/4156296387 learned_addr learned my addr 172.21.15.59:0/4156296387 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:55.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.540+0000 7fc452d9d640 1 -- 172.21.15.59:0/4156296387 >> v2:172.21.15.59:3300/0 conn(0x7fc4540cae40 msgr2=0x7fc45415fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:55.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.540+0000 7fc452d9d640 1 --2- 172.21.15.59:0/4156296387 >> v2:172.21.15.59:3300/0 conn(0x7fc4540cae40 0x7fc45415fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.540+0000 7fc452d9d640 1 -- 172.21.15.59:0/4156296387 >> v1:172.21.15.59:6789/0 conn(0x7fc4540c5630 legacy=0x7fc4540cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.540+0000 7fc452d9d640 1 -- 172.21.15.59:0/4156296387 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc45415c980 con 0x7fc4541600c0 2024-04-25T15:46:55.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.542+0000 7fc452d9d640 1 --2- 172.21.15.59:0/4156296387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4541600c0 0x7fc454166f10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc454070b50 tx=0x7fc44c02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ce554cc34b19518 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:55.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.546+0000 7fc451d9b640 1 -- 172.21.15.59:0/4156296387 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c007740 con 0x7fc4541600c0 2024-04-25T15:46:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.546+0000 7fc451d9b640 1 -- 172.21.15.59:0/4156296387 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc44c0078e0 con 0x7fc4541600c0 2024-04-25T15:46:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.546+0000 7fc451d9b640 1 -- 172.21.15.59:0/4156296387 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c007cb0 con 0x7fc4541600c0 2024-04-25T15:46:55.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.547+0000 7fc4589e3640 1 -- 172.21.15.59:0/4156296387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4541600c0 msgr2=0x7fc454166f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.547+0000 7fc4589e3640 1 --2- 172.21.15.59:0/4156296387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4541600c0 0x7fc454166f10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc454070b50 tx=0x7fc44c02a680 comp rx=0 tx=0).stop 2024-04-25T15:46:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.547+0000 7fc4589e3640 1 -- 172.21.15.59:0/4156296387 shutdown_connections 2024-04-25T15:46:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.547+0000 7fc4589e3640 1 --2- 172.21.15.59:0/4156296387 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4541600c0 0x7fc454166f10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.547+0000 7fc4589e3640 1 --2- 172.21.15.59:0/4156296387 >> v2:172.21.15.59:3300/0 conn(0x7fc4540cae40 0x7fc45415fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.547+0000 7fc4589e3640 1 -- 172.21.15.59:0/4156296387 >> 172.21.15.59:0/4156296387 conn(0x7fc454073200 msgr2=0x7fc454073610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.547+0000 7fc4589e3640 1 -- 172.21.15.59:0/4156296387 shutdown_connections 2024-04-25T15:46:55.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.547+0000 7fc4589e3640 1 -- 172.21.15.59:0/4156296387 wait complete. 2024-04-25T15:46:55.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.549+0000 7fc4589e3640 1 Processor -- start 2024-04-25T15:46:55.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.549+0000 7fc4589e3640 1 -- start start 2024-04-25T15:46:55.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.550+0000 7fc4589e3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4540c5630 0x7fc45415dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.550+0000 7fc4589e3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4540cae40 0x7fc45414b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.550+0000 7fc4589e3640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc4541600c0 0x7fc4541f3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.550+0000 7fc4589e3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc4541604d0 con 0x7fc4540c5630 2024-04-25T15:46:55.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.550+0000 7fc4589e3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc45415cf40 con 0x7fc4540cae40 2024-04-25T15:46:55.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.550+0000 7fc4589e3640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fc4540cb650 con 0x7fc4541600c0 2024-04-25T15:46:55.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.551+0000 7fc45259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4540c5630 0x7fc45415dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.551+0000 7fc452d9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc4541600c0 0x7fc4541f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.551+0000 7fc45259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4540c5630 0x7fc45415dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39906/0 (socket says 172.21.15.59:39906) 2024-04-25T15:46:55.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.551+0000 7fc45259c640 1 -- 172.21.15.59:0/1223901722 learned_addr learned my addr 172.21.15.59:0/1223901722 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:55.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.552+0000 7fc44bfff640 1 --2- 172.21.15.59:0/1223901722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4540cae40 0x7fc45414b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.556+0000 7fc45259c640 1 -- 172.21.15.59:0/1223901722 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc4541600c0 msgr2=0x7fc4541f3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.556+0000 7fc45259c640 1 --2- 172.21.15.59:0/1223901722 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc4541600c0 0x7fc4541f3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.556+0000 7fc45259c640 1 -- 172.21.15.59:0/1223901722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4540cae40 msgr2=0x7fc45414b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:55.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.556+0000 7fc45259c640 1 --2- 172.21.15.59:0/1223901722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4540cae40 0x7fc45414b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:55.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.556+0000 7fc45259c640 1 -- 172.21.15.59:0/1223901722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4541f3c70 con 0x7fc4540c5630 2024-04-25T15:46:55.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.560+0000 7fc45259c640 1 --2- 172.21.15.59:0/1223901722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4540c5630 0x7fc45415dee0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc44400c3c0 tx=0x7fc44400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:55.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.566+0000 7fc44affd640 1 -- 172.21.15.59:0/1223901722 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4440052d0 con 0x7fc4540c5630 2024-04-25T15:46:55.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.566+0000 7fc44affd640 1 -- 172.21.15.59:0/1223901722 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc444005490 con 0x7fc4540c5630 2024-04-25T15:46:55.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.566+0000 7fc44affd640 1 -- 172.21.15.59:0/1223901722 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444007260 con 0x7fc4540c5630 2024-04-25T15:46:55.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.566+0000 7fc4589e3640 1 -- 172.21.15.59:0/1223901722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc454155d40 con 0x7fc4540c5630 2024-04-25T15:46:55.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.566+0000 7fc4589e3640 1 -- 172.21.15.59:0/1223901722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4541f3210 con 0x7fc4540c5630 2024-04-25T15:46:55.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.567+0000 7fc4589e3640 1 -- 172.21.15.59:0/1223901722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4541f3e40 con 0x7fc4540c5630 2024-04-25T15:46:55.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.590+0000 7fc44affd640 1 -- 172.21.15.59:0/1223901722 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc444007400 con 0x7fc4540c5630 2024-04-25T15:46:55.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.591+0000 7fc44affd640 1 --2- 172.21.15.59:0/1223901722 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc434074500 0x7fc434076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:55.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.591+0000 7fc44bfff640 1 --2- 172.21.15.59:0/1223901722 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc434074500 0x7fc434076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:55.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.591+0000 7fc44bfff640 1 --2- 172.21.15.59:0/1223901722 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc434074500 0x7fc434076a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc454160010 tx=0x7fc43c009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:55.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.595+0000 7fc44affd640 1 -- 172.21.15.59:0/1223901722 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc44405af00 con 0x7fc4540c5630 2024-04-25T15:46:55.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:55.882+0000 7fc44affd640 1 -- 172.21.15.59:0/1223901722 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc44405ec70 con 0x7fc4540c5630 2024-04-25T15:46:56.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.071+0000 7fc4589e3640 1 -- 172.21.15.59:0/1223901722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4540698a0 con 0x7fc4540c5630 2024-04-25T15:46:56.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.113+0000 7fc44affd640 1 -- 172.21.15.59:0/1223901722 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16545 (secure 0 0 0) 0x7fc444067340 con 0x7fc4540c5630 2024-04-25T15:46:56.117 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:56.118 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":22,"fsid":"9bb5d7ca-5217-467b-882c-0a18cd57f08f","created":"2024-04-25T15:46:00.198001+0000","modified":"2024-04-25T15:46:33.915756+0000","last_up_change":"2024-04-25T15:46:15.850827+0000","last_in_change":"2024-04-25T15:46:06.311980+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:46:16.936340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:30.174141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:31.372481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34cee654-11dd-4f4b-99fe-093462f8abad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6803","nonce":1314235095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6805","nonce":1314235095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6809","nonce":1314235095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6807","nonce":1314235095}]},"public_addr":"172.21.15.59:6803/1314235095","cluster_addr":"172.21.15.59:6805/1314235095","heartbeat_back_addr":"172.21.15.59:6809/1314235095","heartbeat_front_addr":"172.21.15.59:6807/1314235095","state":["exists","up"]},{"osd":1,"uuid":"3c15505b-4abd-4a24-b30c-edc2732f8ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6827","nonce":3550810151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6829","nonce":3550810151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6833","nonce":3550810151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6831","nonce":3550810151}]},"public_addr":"172.21.15.59:6827/3550810151","cluster_addr":"172.21.15.59:6829/3550810151","heartbeat_back_addr":"172.21.15.59:6833/3550810151","heartbeat_front_addr":"172.21.15.59:6831/3550810151","state":["exists","up"]},{"osd":2,"uuid":"5884bf21-e6b4-4813-b8bc-6baa92443c87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6811","nonce":1651189093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6813","nonce":1651189093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6817","nonce":1651189093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6815","nonce":1651189093}]},"public_addr":"172.21.15.59:6811/1651189093","cluster_addr":"172.21.15.59:6813/1651189093","heartbeat_back_addr":"172.21.15.59:6817/1651189093","heartbeat_front_addr":"172.21.15.59:6815/1651189093","state":["exists","up"]},{"osd":3,"uuid":"6ff71700-3b00-4350-b3c9-f6c41ec46b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6819","nonce":1300858236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6821","nonce":1300858236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6825","nonce":1300858236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6823","nonce":1300858236}]},"public_addr":"172.21.15.59:6819/1300858236","cluster_addr":"172.21.15.59:6821/1300858236","heartbeat_back_addr":"172.21.15.59:6825/1300858236","heartbeat_front_addr":"172.21.15.59:6823/1300858236","state":["exists","up"]},{"osd":4,"uuid":"d0a72143-93fd-4712-aadb-f3fade303426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6817","nonce":2206186554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6819","nonce":2206186554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6823","nonce":2206186554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6821","nonce":2206186554}]},"public_addr":"172.21.15.64:6817/2206186554","cluster_addr":"172.21.15.64:6819/2206186554","heartbeat_back_addr":"172.21.15.64:6823/2206186554","heartbeat_front_addr":"172.21.15.64:6821/2206186554","state":["exists","up"]},{"osd":5,"uuid":"9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6825","nonce":639697697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6827","nonce":639697697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6831","nonce":639697697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6829","nonce":639697697}]},"public_addr":"172.21.15.64:6825/639697697","cluster_addr":"172.21.15.64:6827/639697697","heartbeat_back_addr":"172.21.15.64:6831/639697697","heartbeat_front_addr":"172.21.15.64:6829/639697697","state":["exists","up"]},{"osd":6,"uuid":"311d9a6b-8fbc-4809-8d33-b9248a3562f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6809","nonce":2335675289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6811","nonce":2335675289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6815","nonce":2335675289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6813","nonce":2335675289}]},"public_addr":"172.21.15.64:6809/2335675289","cluster_addr":"172.21.15.64:6811/2335675289","heartbeat_back_addr":"172.21.15.64:6815/2335675289","heartbeat_front_addr":"172.21.15.64:6813/2335675289","state":["exists","up"]},{"osd":7,"uuid":"d0f7436e-882f-4aa7-b2ae-684b9894b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6801","nonce":970439753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6803","nonce":970439753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6807","nonce":970439753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6805","nonce":970439753}]},"public_addr":"172.21.15.64:6801/970439753","cluster_addr":"172.21.15.64:6803/970439753","heartbeat_back_addr":"172.21.15.64:6807/970439753","heartbeat_front_addr":"172.21.15.64:6805/970439753","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.807777+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.945589+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.926832+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.943537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.925062+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.957550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.913559+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.839159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:56.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.116+0000 7fc4589e3640 1 -- 172.21.15.59:0/1223901722 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc434074500 msgr2=0x7fc434076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:56.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.116+0000 7fc4589e3640 1 --2- 172.21.15.59:0/1223901722 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc434074500 0x7fc434076a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc454160010 tx=0x7fc43c009240 comp rx=0 tx=0).stop 2024-04-25T15:46:56.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.116+0000 7fc4589e3640 1 -- 172.21.15.59:0/1223901722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4540c5630 msgr2=0x7fc45415dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:56.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.116+0000 7fc4589e3640 1 --2- 172.21.15.59:0/1223901722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4540c5630 0x7fc45415dee0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc44400c3c0 tx=0x7fc44400c880 comp rx=0 tx=0).stop 2024-04-25T15:46:56.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.116+0000 7fc4589e3640 1 -- 172.21.15.59:0/1223901722 shutdown_connections 2024-04-25T15:46:56.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.116+0000 7fc4589e3640 1 --2- 172.21.15.59:0/1223901722 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc434074500 0x7fc434076a10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.116+0000 7fc4589e3640 1 --2- 172.21.15.59:0/1223901722 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc4541600c0 0x7fc4541f3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.116+0000 7fc4589e3640 1 --2- 172.21.15.59:0/1223901722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4540cae40 0x7fc45414b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.116+0000 7fc4589e3640 1 --2- 172.21.15.59:0/1223901722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4540c5630 0x7fc45415dee0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.116+0000 7fc4589e3640 1 -- 172.21.15.59:0/1223901722 >> 172.21.15.59:0/1223901722 conn(0x7fc454073200 msgr2=0x7fc4540cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:56.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.116+0000 7fc4589e3640 1 -- 172.21.15.59:0/1223901722 shutdown_connections 2024-04-25T15:46:56.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.116+0000 7fc4589e3640 1 -- 172.21.15.59:0/1223901722 wait complete. 2024-04-25T15:46:56.128 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:46:16.936340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:46:30.174141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:46:31.372481+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:46:56.129 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:46:56.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.243+0000 7f47cbf4d640 1 Processor -- start 2024-04-25T15:46:56.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.243+0000 7f47cbf4d640 1 -- start start 2024-04-25T15:46:56.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.244+0000 7f47cbf4d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f47c40c70b0 0x7f47c41565d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.244+0000 7f47cbf4d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47c40b5390 0x7f47c40ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.244+0000 7f47cbf4d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c40cf080 con 0x7f47c4160810 2024-04-25T15:46:56.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.244+0000 7f47cbf4d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f47c415d030 con 0x7f47c40c70b0 2024-04-25T15:46:56.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.244+0000 7f47cbf4d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f47c415d310 con 0x7f47c40b5390 2024-04-25T15:46:56.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.245+0000 7f47ca4ea640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47c40b5390 0x7f47c40ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.245+0000 7f47c94e8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f47c40c70b0 0x7f47c41565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.245+0000 7f47ca4ea640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47c40b5390 0x7f47c40ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:45420/0 (socket says 172.21.15.59:45420) 2024-04-25T15:46:56.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.245+0000 7f47ca4ea640 1 -- 172.21.15.59:0/3798662542 learned_addr learned my addr 172.21.15.59:0/3798662542 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:56.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.248+0000 7f47ca4ea640 1 -- 172.21.15.59:0/3798662542 >> v2:172.21.15.64:3300/0 conn(0x7f47c40c70b0 msgr2=0x7f47c41565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:56.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.248+0000 7f47ca4ea640 1 --2- 172.21.15.59:0/3798662542 >> v2:172.21.15.64:3300/0 conn(0x7f47c40c70b0 0x7f47c41565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.248+0000 7f47ca4ea640 1 -- 172.21.15.59:0/3798662542 >> v1:172.21.15.64:6789/0 conn(0x7f47c4160810 legacy=0x7f47c415c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:56.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.248+0000 7f47ca4ea640 1 -- 172.21.15.59:0/3798662542 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c415fd30 con 0x7f47c40b5390 2024-04-25T15:46:56.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.250+0000 7f47ca4ea640 1 --2- 172.21.15.59:0/3798662542 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47c40b5390 0x7f47c40ce350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009e50 tx=0x7f47bc02a750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b9ba51c007d68d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:56.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.254+0000 7f47c8ce7640 1 -- 172.21.15.59:0/3798662542 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc036070 con 0x7f47c40b5390 2024-04-25T15:46:56.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.254+0000 7f47c8ce7640 1 -- 172.21.15.59:0/3798662542 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc031600 con 0x7f47c40b5390 2024-04-25T15:46:56.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.254+0000 7f47c8ce7640 1 -- 172.21.15.59:0/3798662542 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0319d0 con 0x7f47c40b5390 2024-04-25T15:46:56.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.255+0000 7f47cbf4d640 1 -- 172.21.15.59:0/3798662542 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47c40b5390 msgr2=0x7f47c40ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:56.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.255+0000 7f47cbf4d640 1 --2- 172.21.15.59:0/3798662542 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47c40b5390 0x7f47c40ce350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009e50 tx=0x7f47bc02a750 comp rx=0 tx=0).stop 2024-04-25T15:46:56.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.255+0000 7f47cbf4d640 1 -- 172.21.15.59:0/3798662542 shutdown_connections 2024-04-25T15:46:56.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.255+0000 7f47cbf4d640 1 --2- 172.21.15.59:0/3798662542 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47c40b5390 0x7f47c40ce350 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.255+0000 7f47cbf4d640 1 --2- 172.21.15.59:0/3798662542 >> v2:172.21.15.64:3300/0 conn(0x7f47c40c70b0 0x7f47c41565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.255+0000 7f47cbf4d640 1 -- 172.21.15.59:0/3798662542 >> 172.21.15.59:0/3798662542 conn(0x7f47c40684e0 msgr2=0x7f47c40688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:56.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.255+0000 7f47cbf4d640 1 -- 172.21.15.59:0/3798662542 shutdown_connections 2024-04-25T15:46:56.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.255+0000 7f47cbf4d640 1 -- 172.21.15.59:0/3798662542 wait complete. 2024-04-25T15:46:56.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.257+0000 7f47cbf4d640 1 Processor -- start 2024-04-25T15:46:56.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.257+0000 7f47cbf4d640 1 -- start start 2024-04-25T15:46:56.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.258+0000 7f47cbf4d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47c40b5390 0x7f47c4157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.258+0000 7f47cbf4d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47c40c70b0 0x7f47c4158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.258+0000 7f47cbf4d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c4160810 0x7f47c40cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.258+0000 7f47cbf4d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f47c415ccb0 con 0x7f47c4160810 2024-04-25T15:46:56.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.258+0000 7f47cbf4d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f47c41602f0 con 0x7f47c40c70b0 2024-04-25T15:46:56.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.258+0000 7f47cbf4d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f47c40b57a0 con 0x7f47c40b5390 2024-04-25T15:46:56.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.259+0000 7f47c94e8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47c40c70b0 0x7f47c4158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.259+0000 7f47c9ce9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47c40b5390 0x7f47c4157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.259+0000 7f47ca4ea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c4160810 0x7f47c40cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.259+0000 7f47c9ce9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47c40b5390 0x7f47c4157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:45426/0 (socket says 172.21.15.59:45426) 2024-04-25T15:46:56.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.259+0000 7f47c9ce9640 1 -- 172.21.15.59:0/863418824 learned_addr learned my addr 172.21.15.59:0/863418824 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:56.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.263+0000 7f47c9ce9640 1 -- 172.21.15.59:0/863418824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47c40c70b0 msgr2=0x7f47c4158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:56.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.263+0000 7f47c9ce9640 1 --2- 172.21.15.59:0/863418824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47c40c70b0 0x7f47c4158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.263+0000 7f47c9ce9640 1 -- 172.21.15.59:0/863418824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c4160810 msgr2=0x7f47c40cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:56.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.263+0000 7f47c9ce9640 1 --2- 172.21.15.59:0/863418824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c4160810 0x7f47c40cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.263+0000 7f47c9ce9640 1 -- 172.21.15.59:0/863418824 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c41e8540 con 0x7f47c40b5390 2024-04-25T15:46:56.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.265+0000 7f47c9ce9640 1 --2- 172.21.15.59:0/863418824 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47c40b5390 0x7f47c4157ac0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f47c000b3c0 tx=0x7f47c000b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:56.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.269+0000 7f47ba7fc640 1 -- 172.21.15.59:0/863418824 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0011830 con 0x7f47c40b5390 2024-04-25T15:46:56.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.269+0000 7f47ba7fc640 1 -- 172.21.15.59:0/863418824 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c0016070 con 0x7f47c40b5390 2024-04-25T15:46:56.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.269+0000 7f47ba7fc640 1 -- 172.21.15.59:0/863418824 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0011c50 con 0x7f47c40b5390 2024-04-25T15:46:56.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.269+0000 7f47cbf4d640 1 -- 172.21.15.59:0/863418824 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c41e8820 con 0x7f47c40b5390 2024-04-25T15:46:56.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.269+0000 7f47cbf4d640 1 -- 172.21.15.59:0/863418824 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c41575a0 con 0x7f47c40b5390 2024-04-25T15:46:56.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.270+0000 7f47cbf4d640 1 -- 172.21.15.59:0/863418824 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c415d520 con 0x7f47c40b5390 2024-04-25T15:46:56.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.334+0000 7f47ba7fc640 1 -- 172.21.15.59:0/863418824 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f47c0004020 con 0x7f47c40b5390 2024-04-25T15:46:56.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.335+0000 7f47ba7fc640 1 --2- 172.21.15.59:0/863418824 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f47a8074500 0x7f47a8076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.335+0000 7f47c94e8640 1 --2- 172.21.15.59:0/863418824 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f47a8074500 0x7f47a8076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.335+0000 7f47c94e8640 1 --2- 172.21.15.59:0/863418824 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f47a8074500 0x7f47a8076a10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f47c40d0f20 tx=0x7f47b4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:56.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.579+0000 7f47ba7fc640 1 -- 172.21.15.59:0/863418824 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f47c0004310 con 0x7f47c40b5390 2024-04-25T15:46:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.591+0000 7f47ba7fc640 1 -- 172.21.15.59:0/863418824 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f47c415d520 con 0x7f47c40b5390 2024-04-25T15:46:56.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.776+0000 7f47cbf4d640 1 -- 172.21.15.59:0/863418824 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f47c40cbda0 con 0x7f47c40b5390 2024-04-25T15:46:56.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.783+0000 7f47ba7fc640 1 -- 172.21.15.59:0/863418824 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f47c0020020 con 0x7f47c40b5390 2024-04-25T15:46:56.784 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T15:46:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.785+0000 7f47cbf4d640 1 -- 172.21.15.59:0/863418824 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f47a8074500 msgr2=0x7f47a8076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.785+0000 7f47cbf4d640 1 --2- 172.21.15.59:0/863418824 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f47a8074500 0x7f47a8076a10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f47c40d0f20 tx=0x7f47b4009190 comp rx=0 tx=0).stop 2024-04-25T15:46:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.785+0000 7f47cbf4d640 1 -- 172.21.15.59:0/863418824 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47c40b5390 msgr2=0x7f47c4157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.785+0000 7f47cbf4d640 1 --2- 172.21.15.59:0/863418824 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47c40b5390 0x7f47c4157ac0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f47c000b3c0 tx=0x7f47c000b880 comp rx=0 tx=0).stop 2024-04-25T15:46:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.785+0000 7f47cbf4d640 1 -- 172.21.15.59:0/863418824 shutdown_connections 2024-04-25T15:46:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.785+0000 7f47cbf4d640 1 --2- 172.21.15.59:0/863418824 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f47a8074500 0x7f47a8076a10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.785+0000 7f47cbf4d640 1 --2- 172.21.15.59:0/863418824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47c4160810 0x7f47c40cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.785+0000 7f47cbf4d640 1 --2- 172.21.15.59:0/863418824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47c40c70b0 0x7f47c4158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.785+0000 7f47cbf4d640 1 --2- 172.21.15.59:0/863418824 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f47c40b5390 0x7f47c4157ac0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.785+0000 7f47cbf4d640 1 -- 172.21.15.59:0/863418824 >> 172.21.15.59:0/863418824 conn(0x7f47c40684e0 msgr2=0x7f47c40cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.785+0000 7f47cbf4d640 1 -- 172.21.15.59:0/863418824 shutdown_connections 2024-04-25T15:46:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.785+0000 7f47cbf4d640 1 -- 172.21.15.59:0/863418824 wait complete. 2024-04-25T15:46:56.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:46:56.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.914+0000 7f22e773f640 1 Processor -- start 2024-04-25T15:46:56.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.915+0000 7f22e773f640 1 -- start start 2024-04-25T15:46:56.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.916+0000 7f22e773f640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f22e00ccd60 0x7f22e0154780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.916+0000 7f22e773f640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f22e00b51b0 0x7f22e015e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.916+0000 7f22e773f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22e015b820 0x7f22e00cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.916+0000 7f22e773f640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f22e00c9840 con 0x7f22e00b51b0 2024-04-25T15:46:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.916+0000 7f22e773f640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f22e00cc8d0 con 0x7f22e00ccd60 2024-04-25T15:46:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.916+0000 7f22e773f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f22e00cb1d0 con 0x7f22e015b820 2024-04-25T15:46:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.916+0000 7f22e5cdc640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22e015b820 0x7f22e00cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.917+0000 7f22e54db640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f22e00ccd60 0x7f22e0154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.917+0000 7f22e5cdc640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22e015b820 0x7f22e00cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:45438/0 (socket says 172.21.15.59:45438) 2024-04-25T15:46:56.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.917+0000 7f22e5cdc640 1 -- 172.21.15.59:0/696924264 learned_addr learned my addr 172.21.15.59:0/696924264 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:56.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.919+0000 7f22e5cdc640 1 -- 172.21.15.59:0/696924264 >> v2:172.21.15.64:3300/0 conn(0x7f22e00ccd60 msgr2=0x7f22e0154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:56.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.919+0000 7f22e5cdc640 1 --2- 172.21.15.59:0/696924264 >> v2:172.21.15.64:3300/0 conn(0x7f22e00ccd60 0x7f22e0154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.919+0000 7f22e5cdc640 1 -- 172.21.15.59:0/696924264 >> v2:172.21.15.59:3300/0 conn(0x7f22e00b51b0 msgr2=0x7f22e015e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:56.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.919+0000 7f22e5cdc640 1 --2- 172.21.15.59:0/696924264 >> v2:172.21.15.59:3300/0 conn(0x7f22e00b51b0 0x7f22e015e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.919+0000 7f22e5cdc640 1 -- 172.21.15.59:0/696924264 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e00cb5d0 con 0x7f22e015b820 2024-04-25T15:46:56.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.921+0000 7f22e5cdc640 1 --2- 172.21.15.59:0/696924264 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22e015b820 0x7f22e00cfa40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22e00d0680 tx=0x7f22d802a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8851a8043096f487 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:56.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.926+0000 7f22d7fff640 1 -- 172.21.15.59:0/696924264 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8036070 con 0x7f22e015b820 2024-04-25T15:46:56.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.926+0000 7f22d7fff640 1 -- 172.21.15.59:0/696924264 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d8031600 con 0x7f22e015b820 2024-04-25T15:46:56.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.926+0000 7f22d7fff640 1 -- 172.21.15.59:0/696924264 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d80319d0 con 0x7f22e015b820 2024-04-25T15:46:56.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.926+0000 7f22e773f640 1 -- 172.21.15.59:0/696924264 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22e015b820 msgr2=0x7f22e00cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:56.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.926+0000 7f22e773f640 1 --2- 172.21.15.59:0/696924264 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22e015b820 0x7f22e00cfa40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22e00d0680 tx=0x7f22d802a6a0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.926+0000 7f22e773f640 1 -- 172.21.15.59:0/696924264 shutdown_connections 2024-04-25T15:46:56.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.926+0000 7f22e773f640 1 --2- 172.21.15.59:0/696924264 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22e015b820 0x7f22e00cfa40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.926+0000 7f22e773f640 1 --2- 172.21.15.59:0/696924264 >> v2:172.21.15.59:3300/0 conn(0x7f22e00b51b0 0x7f22e015e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.926+0000 7f22e773f640 1 --2- 172.21.15.59:0/696924264 >> v2:172.21.15.64:3300/0 conn(0x7f22e00ccd60 0x7f22e0154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.926+0000 7f22e773f640 1 -- 172.21.15.59:0/696924264 >> 172.21.15.59:0/696924264 conn(0x7f22e006c760 msgr2=0x7f22e006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:56.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.926+0000 7f22e773f640 1 -- 172.21.15.59:0/696924264 shutdown_connections 2024-04-25T15:46:56.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.927+0000 7f22e773f640 1 -- 172.21.15.59:0/696924264 wait complete. 2024-04-25T15:46:56.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.928+0000 7f22e773f640 1 Processor -- start 2024-04-25T15:46:56.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.928+0000 7f22e773f640 1 -- start start 2024-04-25T15:46:56.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.930+0000 7f22e773f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22e00b51b0 0x7f22e01f1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.930+0000 7f22e773f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22e015b820 0x7f22e00ced30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.930+0000 7f22e773f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22e0153ae0 0x7f22e0149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.930+0000 7f22e773f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f22e00caef0 con 0x7f22e0153ae0 2024-04-25T15:46:56.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.930+0000 7f22e773f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f22e015e840 con 0x7f22e015b820 2024-04-25T15:46:56.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.930+0000 7f22e773f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f22e00cbfa0 con 0x7f22e00b51b0 2024-04-25T15:46:56.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.930+0000 7f22e54db640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22e00b51b0 0x7f22e01f1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.930+0000 7f22e4cda640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22e015b820 0x7f22e00ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.930+0000 7f22e54db640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22e00b51b0 0x7f22e01f1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:45442/0 (socket says 172.21.15.59:45442) 2024-04-25T15:46:56.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.930+0000 7f22e54db640 1 -- 172.21.15.59:0/328464320 learned_addr learned my addr 172.21.15.59:0/328464320 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:56.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.934+0000 7f22e54db640 1 -- 172.21.15.59:0/328464320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22e015b820 msgr2=0x7f22e00ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:56.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.934+0000 7f22e54db640 1 --2- 172.21.15.59:0/328464320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22e015b820 0x7f22e00ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.934+0000 7f22e54db640 1 -- 172.21.15.59:0/328464320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22e0153ae0 msgr2=0x7f22e0149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:56.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.934+0000 7f22e54db640 1 --2- 172.21.15.59:0/328464320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22e0153ae0 0x7f22e0149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:56.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.934+0000 7f22e54db640 1 -- 172.21.15.59:0/328464320 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e00c4b40 con 0x7f22e00b51b0 2024-04-25T15:46:56.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.937+0000 7f22e54db640 1 --2- 172.21.15.59:0/328464320 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22e00b51b0 0x7f22e01f1580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f22d000e8a0 tx=0x7f22d000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:56.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.941+0000 7f22d5ffb640 1 -- 172.21.15.59:0/328464320 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d0017070 con 0x7f22e00b51b0 2024-04-25T15:46:56.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.941+0000 7f22d5ffb640 1 -- 172.21.15.59:0/328464320 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d000c940 con 0x7f22e00b51b0 2024-04-25T15:46:56.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.941+0000 7f22e773f640 1 -- 172.21.15.59:0/328464320 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e00c3d80 con 0x7f22e00b51b0 2024-04-25T15:46:56.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.941+0000 7f22d5ffb640 1 -- 172.21.15.59:0/328464320 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d000cd30 con 0x7f22e00b51b0 2024-04-25T15:46:56.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.941+0000 7f22e773f640 1 -- 172.21.15.59:0/328464320 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e00c4340 con 0x7f22e00b51b0 2024-04-25T15:46:56.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.942+0000 7f22e773f640 1 -- 172.21.15.59:0/328464320 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22e0069fb0 con 0x7f22e00b51b0 2024-04-25T15:46:56.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.971+0000 7f22d5ffb640 1 -- 172.21.15.59:0/328464320 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f22d001a070 con 0x7f22e00b51b0 2024-04-25T15:46:56.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.971+0000 7f22d5ffb640 1 --2- 172.21.15.59:0/328464320 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f22c4074530 0x7f22c4076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:56.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.971+0000 7f22d5ffb640 1 -- 172.21.15.59:0/328464320 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f22d0095840 con 0x7f22e00b51b0 2024-04-25T15:46:56.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.971+0000 7f22e4cda640 1 --2- 172.21.15.59:0/328464320 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f22c4074530 0x7f22c4076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:56.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:56.972+0000 7f22e4cda640 1 --2- 172.21.15.59:0/328464320 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f22c4074530 0x7f22c4076a40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f22e015b1c0 tx=0x7f22dc009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:57.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.312+0000 7f22d5ffb640 1 -- 172.21.15.59:0/328464320 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f22d005f960 con 0x7f22e00b51b0 2024-04-25T15:46:57.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.502+0000 7f22e773f640 1 -- 172.21.15.59:0/328464320 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f22e015e4a0 con 0x7f22e00b51b0 2024-04-25T15:46:57.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.510+0000 7f22d5ffb640 1 -- 172.21.15.59:0/328464320 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f22d0063c60 con 0x7f22e00b51b0 2024-04-25T15:46:57.510 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T15:46:57.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.511+0000 7f22e773f640 1 -- 172.21.15.59:0/328464320 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f22c4074530 msgr2=0x7f22c4076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.511+0000 7f22e773f640 1 --2- 172.21.15.59:0/328464320 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f22c4074530 0x7f22c4076a40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f22e015b1c0 tx=0x7f22dc009060 comp rx=0 tx=0).stop 2024-04-25T15:46:57.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.511+0000 7f22e773f640 1 -- 172.21.15.59:0/328464320 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22e00b51b0 msgr2=0x7f22e01f1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.511+0000 7f22e773f640 1 --2- 172.21.15.59:0/328464320 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22e00b51b0 0x7f22e01f1580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f22d000e8a0 tx=0x7f22d000ed60 comp rx=0 tx=0).stop 2024-04-25T15:46:57.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.511+0000 7f22e773f640 1 -- 172.21.15.59:0/328464320 shutdown_connections 2024-04-25T15:46:57.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.511+0000 7f22e773f640 1 --2- 172.21.15.59:0/328464320 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f22c4074530 0x7f22c4076a40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.511+0000 7f22e773f640 1 --2- 172.21.15.59:0/328464320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22e0153ae0 0x7f22e0149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.511+0000 7f22e773f640 1 --2- 172.21.15.59:0/328464320 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22e015b820 0x7f22e00ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.511+0000 7f22e773f640 1 --2- 172.21.15.59:0/328464320 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22e00b51b0 0x7f22e01f1580 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.511+0000 7f22e773f640 1 -- 172.21.15.59:0/328464320 >> 172.21.15.59:0/328464320 conn(0x7f22e006c760 msgr2=0x7f22e0075ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:57.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.511+0000 7f22e773f640 1 -- 172.21.15.59:0/328464320 shutdown_connections 2024-04-25T15:46:57.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.511+0000 7f22e773f640 1 -- 172.21.15.59:0/328464320 wait complete. 2024-04-25T15:46:57.523 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:46:57.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.639+0000 7f77a5114640 1 Processor -- start 2024-04-25T15:46:57.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.639+0000 7f77a5114640 1 -- start start 2024-04-25T15:46:57.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.640+0000 7f77a5114640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f77a0160810 0x7f77a01565d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.640+0000 7f77a5114640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a00cf080 con 0x7f77a00b5390 2024-04-25T15:46:57.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.640+0000 7f77a5114640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a015d030 con 0x7f77a00c70b0 2024-04-25T15:46:57.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.640+0000 7f77a5114640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f77a015d310 con 0x7f77a0160810 2024-04-25T15:46:57.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.641+0000 7f779ed9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f77a0160810 0x7f77a01565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.641+0000 7f779f59e640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f77a00b5390 0x7f77a00ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41562/0 (socket says 172.21.15.59:41562) 2024-04-25T15:46:57.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.641+0000 7f779f59e640 1 -- 172.21.15.59:0/3336493096 learned_addr learned my addr 172.21.15.59:0/3336493096 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:57.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.644+0000 7f779dd9b640 1 -- 172.21.15.59:0/3336493096 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1181352721 0 0) 0x7f77a015d030 con 0x7f77a00c70b0 2024-04-25T15:46:57.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.644+0000 7f779dd9b640 1 -- 172.21.15.59:0/3336493096 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f778c003520 con 0x7f77a00c70b0 2024-04-25T15:46:57.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.644+0000 7f779dd9b640 1 -- 172.21.15.59:0/3336493096 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933625867 0 0) 0x7f77a00cf080 con 0x7f77a00b5390 2024-04-25T15:46:57.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.644+0000 7f779dd9b640 1 -- 172.21.15.59:0/3336493096 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77a015d030 con 0x7f77a00b5390 2024-04-25T15:46:57.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.644+0000 7f779ed9d640 1 -- 172.21.15.59:0/3336493096 >> v1:172.21.15.64:6789/0 conn(0x7f77a00c70b0 legacy=0x7f77a015c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.644+0000 7f779ed9d640 1 -- 172.21.15.59:0/3336493096 >> v1:172.21.15.59:6789/0 conn(0x7f77a00b5390 legacy=0x7f77a00ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.644+0000 7f779ed9d640 1 -- 172.21.15.59:0/3336493096 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a015fd30 con 0x7f77a0160810 2024-04-25T15:46:57.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.647+0000 7f779ed9d640 1 --2- 172.21.15.59:0/3336493096 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f77a0160810 0x7f77a01565d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f77980097d0 tx=0x7f779802a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1da675e3c0721ff9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:57.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.651+0000 7f779dd9b640 1 -- 172.21.15.59:0/3336493096 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7798037070 con 0x7f77a0160810 2024-04-25T15:46:57.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.651+0000 7f779dd9b640 1 -- 172.21.15.59:0/3336493096 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7798032440 con 0x7f77a0160810 2024-04-25T15:46:57.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.652+0000 7f779dd9b640 1 -- 172.21.15.59:0/3336493096 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77980327f0 con 0x7f77a0160810 2024-04-25T15:46:57.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.652+0000 7f77a5114640 1 -- 172.21.15.59:0/3336493096 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f77a0160810 msgr2=0x7f77a01565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.652+0000 7f77a5114640 1 --2- 172.21.15.59:0/3336493096 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f77a0160810 0x7f77a01565d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f77980097d0 tx=0x7f779802a290 comp rx=0 tx=0).stop 2024-04-25T15:46:57.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.652+0000 7f77a5114640 1 -- 172.21.15.59:0/3336493096 shutdown_connections 2024-04-25T15:46:57.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.652+0000 7f77a5114640 1 --2- 172.21.15.59:0/3336493096 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f77a0160810 0x7f77a01565d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.652+0000 7f77a5114640 1 -- 172.21.15.59:0/3336493096 >> 172.21.15.59:0/3336493096 conn(0x7f77a00684e0 msgr2=0x7f77a00688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:57.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.652+0000 7f77a5114640 1 -- 172.21.15.59:0/3336493096 shutdown_connections 2024-04-25T15:46:57.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.652+0000 7f77a5114640 1 -- 172.21.15.59:0/3336493096 wait complete. 2024-04-25T15:46:57.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.654+0000 7f77a5114640 1 Processor -- start 2024-04-25T15:46:57.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.655+0000 7f77a5114640 1 -- start start 2024-04-25T15:46:57.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.656+0000 7f77a5114640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f77a00b5390 0x7f77a01f2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.656+0000 7f77a5114640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77a00c70b0 0x7f77a0150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.656+0000 7f77a5114640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77a0160810 0x7f77a0157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.656+0000 7f77a5114640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f77a015ccb0 con 0x7f77a0160810 2024-04-25T15:46:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.656+0000 7f77a5114640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f77a01602f0 con 0x7f77a00c70b0 2024-04-25T15:46:57.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.656+0000 7f77a5114640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f77a00b57a0 con 0x7f77a00b5390 2024-04-25T15:46:57.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.656+0000 7f779ed9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f77a00b5390 0x7f77a01f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.656+0000 7f779e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77a00c70b0 0x7f77a0150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.656+0000 7f779f59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77a0160810 0x7f77a0157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.657+0000 7f779ed9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f77a00b5390 0x7f77a01f2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:45464/0 (socket says 172.21.15.59:45464) 2024-04-25T15:46:57.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.657+0000 7f779ed9d640 1 -- 172.21.15.59:0/3302331561 learned_addr learned my addr 172.21.15.59:0/3302331561 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:57.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.661+0000 7f779ed9d640 1 -- 172.21.15.59:0/3302331561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77a00c70b0 msgr2=0x7f77a0150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.661+0000 7f779ed9d640 1 --2- 172.21.15.59:0/3302331561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77a00c70b0 0x7f77a0150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.661+0000 7f779ed9d640 1 -- 172.21.15.59:0/3302331561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77a0160810 msgr2=0x7f77a0157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:57.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.661+0000 7f779ed9d640 1 --2- 172.21.15.59:0/3302331561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77a0160810 0x7f77a0157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:57.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.661+0000 7f779ed9d640 1 -- 172.21.15.59:0/3302331561 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a01f2f40 con 0x7f77a00b5390 2024-04-25T15:46:57.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.663+0000 7f779ed9d640 1 --2- 172.21.15.59:0/3302331561 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f77a00b5390 0x7f77a01f2a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77980098f0 tx=0x7f77980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.667+0000 7f77977fe640 1 -- 172.21.15.59:0/3302331561 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7798037050 con 0x7f77a00b5390 2024-04-25T15:46:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.667+0000 7f77977fe640 1 -- 172.21.15.59:0/3302331561 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7798043070 con 0x7f77a00b5390 2024-04-25T15:46:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.667+0000 7f77977fe640 1 -- 172.21.15.59:0/3302331561 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779803cb30 con 0x7f77a00b5390 2024-04-25T15:46:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.667+0000 7f77a5114640 1 -- 172.21.15.59:0/3302331561 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a015a590 con 0x7f77a00b5390 2024-04-25T15:46:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.667+0000 7f77a5114640 1 -- 172.21.15.59:0/3302331561 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a015ab30 con 0x7f77a00b5390 2024-04-25T15:46:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.668+0000 7f77a5114640 1 -- 172.21.15.59:0/3302331561 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77a01f3110 con 0x7f77a00b5390 2024-04-25T15:46:57.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.985+0000 7f77977fe640 1 -- 172.21.15.59:0/3302331561 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f779803ccd0 con 0x7f77a00b5390 2024-04-25T15:46:57.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.985+0000 7f77977fe640 1 --2- 172.21.15.59:0/3302331561 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f7780074500 0x7f7780076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:57.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.986+0000 7f779e59c640 1 --2- 172.21.15.59:0/3302331561 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f7780074500 0x7f7780076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:57.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.986+0000 7f779e59c640 1 --2- 172.21.15.59:0/3302331561 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f7780074500 0x7f7780076a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f77a006a470 tx=0x7f7788009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:57.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:57.993+0000 7f77977fe640 1 -- 172.21.15.59:0/3302331561 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f779807cd40 con 0x7f77a00b5390 2024-04-25T15:46:58.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.012+0000 7f77977fe640 1 -- 172.21.15.59:0/3302331561 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f77a01f3110 con 0x7f77a00b5390 2024-04-25T15:46:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.200+0000 7f77a5114640 1 -- 172.21.15.59:0/3302331561 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f77a015b910 con 0x7f77a00b5390 2024-04-25T15:46:58.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.207+0000 7f77977fe640 1 -- 172.21.15.59:0/3302331561 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f77980890f0 con 0x7f77a00b5390 2024-04-25T15:46:58.208 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T15:46:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.209+0000 7f77a5114640 1 -- 172.21.15.59:0/3302331561 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f7780074500 msgr2=0x7f7780076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.209+0000 7f77a5114640 1 --2- 172.21.15.59:0/3302331561 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f7780074500 0x7f7780076a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f77a006a470 tx=0x7f7788009040 comp rx=0 tx=0).stop 2024-04-25T15:46:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.209+0000 7f77a5114640 1 -- 172.21.15.59:0/3302331561 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f77a00b5390 msgr2=0x7f77a01f2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.209+0000 7f77a5114640 1 --2- 172.21.15.59:0/3302331561 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f77a00b5390 0x7f77a01f2a00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77980098f0 tx=0x7f77980046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.209+0000 7f77a5114640 1 -- 172.21.15.59:0/3302331561 shutdown_connections 2024-04-25T15:46:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.209+0000 7f77a5114640 1 --2- 172.21.15.59:0/3302331561 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f7780074500 0x7f7780076a10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.209+0000 7f77a5114640 1 --2- 172.21.15.59:0/3302331561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77a0160810 0x7f77a0157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.209+0000 7f77a5114640 1 --2- 172.21.15.59:0/3302331561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77a00c70b0 0x7f77a0150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.209+0000 7f77a5114640 1 --2- 172.21.15.59:0/3302331561 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f77a00b5390 0x7f77a01f2a00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.209+0000 7f77a5114640 1 -- 172.21.15.59:0/3302331561 >> 172.21.15.59:0/3302331561 conn(0x7f77a00684e0 msgr2=0x7f77a00c68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.209+0000 7f77a5114640 1 -- 172.21.15.59:0/3302331561 shutdown_connections 2024-04-25T15:46:58.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.209+0000 7f77a5114640 1 -- 172.21.15.59:0/3302331561 wait complete. 2024-04-25T15:46:58.221 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:58.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.332+0000 7ffabe642640 1 Processor -- start 2024-04-25T15:46:58.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.332+0000 7ffabe642640 1 -- start start 2024-04-25T15:46:58.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.333+0000 7ffabe642640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffab80b41c0 0x7ffab80cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.333+0000 7ffabe642640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ffab80cd680 0x7ffab815c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.333+0000 7ffabe642640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffab815c6f0 0x7ffab80ce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.333+0000 7ffabe642640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ffab815cb00 con 0x7ffab815c6f0 2024-04-25T15:46:58.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.333+0000 7ffabe642640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7ffab815cd60 con 0x7ffab80cd680 2024-04-25T15:46:58.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.333+0000 7ffabe642640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ffab815d040 con 0x7ffab80b41c0 2024-04-25T15:46:58.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.334+0000 7ffab77fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ffab80cd680 0x7ffab815c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.334+0000 7ffab7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffab80b41c0 0x7ffab80cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.334+0000 7ffab7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffab80b41c0 0x7ffab80cd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:45470/0 (socket says 172.21.15.59:45470) 2024-04-25T15:46:58.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.334+0000 7ffab7fff640 1 -- 172.21.15.59:0/1390745416 learned_addr learned my addr 172.21.15.59:0/1390745416 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:58.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.336+0000 7ffab7fff640 1 -- 172.21.15.59:0/1390745416 >> v2:172.21.15.64:3300/0 conn(0x7ffab80cd680 msgr2=0x7ffab815c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:58.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.336+0000 7ffab7fff640 1 --2- 172.21.15.59:0/1390745416 >> v2:172.21.15.64:3300/0 conn(0x7ffab80cd680 0x7ffab815c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.336+0000 7ffab7fff640 1 -- 172.21.15.59:0/1390745416 >> v2:172.21.15.59:3300/0 conn(0x7ffab815c6f0 msgr2=0x7ffab80ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:58.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.336+0000 7ffab7fff640 1 --2- 172.21.15.59:0/1390745416 >> v2:172.21.15.59:3300/0 conn(0x7ffab815c6f0 0x7ffab80ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.336+0000 7ffab7fff640 1 -- 172.21.15.59:0/1390745416 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab815d320 con 0x7ffab80b41c0 2024-04-25T15:46:58.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.340+0000 7ffab7fff640 1 --2- 172.21.15.59:0/1390745416 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffab80b41c0 0x7ffab80cd140 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffab80cf500 tx=0x7ffaa802a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a660f31bb491250 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:58.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.344+0000 7ffab6ffd640 1 -- 172.21.15.59:0/1390745416 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8037070 con 0x7ffab80b41c0 2024-04-25T15:46:58.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.345+0000 7ffab6ffd640 1 -- 172.21.15.59:0/1390745416 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa8032440 con 0x7ffab80b41c0 2024-04-25T15:46:58.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.345+0000 7ffab6ffd640 1 -- 172.21.15.59:0/1390745416 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8032810 con 0x7ffab80b41c0 2024-04-25T15:46:58.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.345+0000 7ffabe642640 1 -- 172.21.15.59:0/1390745416 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffab80b41c0 msgr2=0x7ffab80cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.345+0000 7ffabe642640 1 --2- 172.21.15.59:0/1390745416 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffab80b41c0 0x7ffab80cd140 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffab80cf500 tx=0x7ffaa802a1e0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.345+0000 7ffabe642640 1 -- 172.21.15.59:0/1390745416 shutdown_connections 2024-04-25T15:46:58.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.345+0000 7ffabe642640 1 --2- 172.21.15.59:0/1390745416 >> v2:172.21.15.59:3300/0 conn(0x7ffab815c6f0 0x7ffab80ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.345+0000 7ffabe642640 1 --2- 172.21.15.59:0/1390745416 >> v2:172.21.15.64:3300/0 conn(0x7ffab80cd680 0x7ffab815c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.345+0000 7ffabe642640 1 --2- 172.21.15.59:0/1390745416 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffab80b41c0 0x7ffab80cd140 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.345+0000 7ffabe642640 1 -- 172.21.15.59:0/1390745416 >> 172.21.15.59:0/1390745416 conn(0x7ffab806ed70 msgr2=0x7ffab806f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:58.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.345+0000 7ffabe642640 1 -- 172.21.15.59:0/1390745416 shutdown_connections 2024-04-25T15:46:58.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.345+0000 7ffabe642640 1 -- 172.21.15.59:0/1390745416 wait complete. 2024-04-25T15:46:58.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.347+0000 7ffabe642640 1 Processor -- start 2024-04-25T15:46:58.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.347+0000 7ffabe642640 1 -- start start 2024-04-25T15:46:58.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.348+0000 7ffabe642640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab80b41c0 0x7ffab81e8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.349+0000 7ffabe642640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffab80cd680 0x7ffab80cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.349+0000 7ffabe642640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffab815c6f0 0x7ffab80cad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.349+0000 7ffabe642640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffab80b78a0 con 0x7ffab80b41c0 2024-04-25T15:46:58.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.349+0000 7ffabe642640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ffab80ce020 con 0x7ffab80cd680 2024-04-25T15:46:58.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.349+0000 7ffabe642640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ffab80c51e0 con 0x7ffab815c6f0 2024-04-25T15:46:58.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.349+0000 7ffabcbdf640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffab815c6f0 0x7ffab80cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.349+0000 7ffab7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab80b41c0 0x7ffab81e8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.349+0000 7ffab77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffab80cd680 0x7ffab80cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.349+0000 7ffabcbdf640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffab815c6f0 0x7ffab80cad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:45472/0 (socket says 172.21.15.59:45472) 2024-04-25T15:46:58.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.349+0000 7ffabcbdf640 1 -- 172.21.15.59:0/2210522223 learned_addr learned my addr 172.21.15.59:0/2210522223 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:58.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.353+0000 7ffab7fff640 1 -- 172.21.15.59:0/2210522223 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffab815c6f0 msgr2=0x7ffab80cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.353+0000 7ffab7fff640 1 --2- 172.21.15.59:0/2210522223 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffab815c6f0 0x7ffab80cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.353+0000 7ffab7fff640 1 -- 172.21.15.59:0/2210522223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffab80cd680 msgr2=0x7ffab80cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.353+0000 7ffab7fff640 1 --2- 172.21.15.59:0/2210522223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffab80cd680 0x7ffab80cfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.353+0000 7ffab7fff640 1 -- 172.21.15.59:0/2210522223 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab80d0220 con 0x7ffab80b41c0 2024-04-25T15:46:58.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.353+0000 7ffabcbdf640 1 --2- 172.21.15.59:0/2210522223 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffab815c6f0 0x7ffab80cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:46:58.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.356+0000 7ffab7fff640 1 --2- 172.21.15.59:0/2210522223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab80b41c0 0x7ffab81e8000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8031000 tx=0x7ffaa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:58.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.360+0000 7ffab4ff9640 1 -- 172.21.15.59:0/2210522223 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8041070 con 0x7ffab80b41c0 2024-04-25T15:46:58.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.360+0000 7ffab4ff9640 1 -- 172.21.15.59:0/2210522223 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa803c870 con 0x7ffab80b41c0 2024-04-25T15:46:58.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.360+0000 7ffab4ff9640 1 -- 172.21.15.59:0/2210522223 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8037040 con 0x7ffab80b41c0 2024-04-25T15:46:58.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.360+0000 7ffabe642640 1 -- 172.21.15.59:0/2210522223 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab81e88d0 con 0x7ffab80b41c0 2024-04-25T15:46:58.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.360+0000 7ffabe642640 1 -- 172.21.15.59:0/2210522223 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab80c80c0 con 0x7ffab80b41c0 2024-04-25T15:46:58.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.361+0000 7ffabe642640 1 -- 172.21.15.59:0/2210522223 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab80c7eb0 con 0x7ffab80b41c0 2024-04-25T15:46:58.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.384+0000 7ffab4ff9640 1 -- 172.21.15.59:0/2210522223 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ffaa8044070 con 0x7ffab80b41c0 2024-04-25T15:46:58.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.385+0000 7ffab4ff9640 1 --2- 172.21.15.59:0/2210522223 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ffaa4074500 0x7ffaa4076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:58.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.385+0000 7ffab77fe640 1 --2- 172.21.15.59:0/2210522223 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ffaa4074500 0x7ffaa4076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:58.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.385+0000 7ffab77fe640 1 --2- 172.21.15.59:0/2210522223 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ffaa4074500 0x7ffaa4076a10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffab806f560 tx=0x7ffaac009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:58.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.668+0000 7ffab4ff9640 1 -- 172.21.15.59:0/2210522223 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ffaa807c350 con 0x7ffab80b41c0 2024-04-25T15:46:58.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.668+0000 7ffab4ff9640 1 -- 172.21.15.59:0/2210522223 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffaa80800c0 con 0x7ffab80b41c0 2024-04-25T15:46:58.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.905+0000 7ffabe642640 1 -- 172.21.15.59:0/2210522223 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffab80698a0 con 0x7ffab80b41c0 2024-04-25T15:46:58.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.930+0000 7ffab4ff9640 1 -- 172.21.15.59:0/2210522223 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6862 (secure 0 0 0) 0x7ffaa80843c0 con 0x7ffab80b41c0 2024-04-25T15:46:58.932 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:58.932 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/783440137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":783440137},{"type":"v1","addr":"172.21.15.64:6835","nonce":783440137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2150121481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2150121481},{"type":"v1","addr":"172.21.15.59:6835","nonce":2150121481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4208,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2853549826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2853549826},{"type":"v1","addr":"172.21.15.64:6833","nonce":2853549826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:32.561262+0000","modified":"2024-04-25T15:46:42.826371+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4284,"mds_1":4281,"mds_2":4217},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4217":{"gid":4217,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.59:6837/2036351360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2036351360},{"type":"v1","addr":"172.21.15.59:6837","nonce":2036351360}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/4162601241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4162601241},{"type":"v1","addr":"172.21.15.59:6839","nonce":4162601241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6837/2368752795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2368752795},{"type":"v1","addr":"172.21.15.64:6837","nonce":2368752795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4217,4281,4284]},"id":1}]} 2024-04-25T15:46:58.932 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 13 2024-04-25T15:46:58.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.933+0000 7ffabe642640 1 -- 172.21.15.59:0/2210522223 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ffaa4074500 msgr2=0x7ffaa4076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.933+0000 7ffabe642640 1 --2- 172.21.15.59:0/2210522223 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ffaa4074500 0x7ffaa4076a10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffab806f560 tx=0x7ffaac009190 comp rx=0 tx=0).stop 2024-04-25T15:46:58.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.933+0000 7ffabe642640 1 -- 172.21.15.59:0/2210522223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab80b41c0 msgr2=0x7ffab81e8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:58.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.933+0000 7ffabe642640 1 --2- 172.21.15.59:0/2210522223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab80b41c0 0x7ffab81e8000 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8031000 tx=0x7ffaa80046c0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.933+0000 7ffabe642640 1 -- 172.21.15.59:0/2210522223 shutdown_connections 2024-04-25T15:46:58.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.933+0000 7ffabe642640 1 --2- 172.21.15.59:0/2210522223 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ffaa4074500 0x7ffaa4076a10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.933+0000 7ffabe642640 1 --2- 172.21.15.59:0/2210522223 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffab815c6f0 0x7ffab80cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.933+0000 7ffabe642640 1 --2- 172.21.15.59:0/2210522223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffab80cd680 0x7ffab80cfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.933+0000 7ffabe642640 1 --2- 172.21.15.59:0/2210522223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab80b41c0 0x7ffab81e8000 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:58.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.933+0000 7ffabe642640 1 -- 172.21.15.59:0/2210522223 >> 172.21.15.59:0/2210522223 conn(0x7ffab806ed70 msgr2=0x7ffab80b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:58.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.933+0000 7ffabe642640 1 -- 172.21.15.59:0/2210522223 shutdown_connections 2024-04-25T15:46:58.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:58.933+0000 7ffabe642640 1 -- 172.21.15.59:0/2210522223 wait complete. 2024-04-25T15:46:58.945 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:46:59.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.056+0000 7f4c57851640 1 Processor -- start 2024-04-25T15:46:59.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.056+0000 7f4c57851640 1 -- start start 2024-04-25T15:46:59.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.057+0000 7f4c57851640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c500c5300 0x7f4c500c5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.057+0000 7f4c57851640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c50152fa0 con 0x7f4c50152b90 2024-04-25T15:46:59.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.057+0000 7f4c57851640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c500c79a0 con 0x7f4c500c49d0 2024-04-25T15:46:59.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.057+0000 7f4c57851640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f4c500c8610 con 0x7f4c500c5300 2024-04-25T15:46:59.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.058+0000 7f4c55dee640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c500c5300 0x7f4c500c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.058+0000 7f4c54dec640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4c50152b90 0x7f4c500c7290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41576/0 (socket says 172.21.15.59:41576) 2024-04-25T15:46:59.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.058+0000 7f4c54dec640 1 -- 172.21.15.59:0/152466654 learned_addr learned my addr 172.21.15.59:0/152466654 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:59.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.060+0000 7f4c47fff640 1 -- 172.21.15.59:0/152466654 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1048230302 0 0) 0x7f4c500c79a0 con 0x7f4c500c49d0 2024-04-25T15:46:59.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.060+0000 7f4c47fff640 1 -- 172.21.15.59:0/152466654 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c3c003520 con 0x7f4c500c49d0 2024-04-25T15:46:59.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.061+0000 7f4c47fff640 1 -- 172.21.15.59:0/152466654 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 350335135 0 0) 0x7f4c50152fa0 con 0x7f4c50152b90 2024-04-25T15:46:59.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.061+0000 7f4c47fff640 1 -- 172.21.15.59:0/152466654 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c500c79a0 con 0x7f4c50152b90 2024-04-25T15:46:59.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.061+0000 7f4c55dee640 1 -- 172.21.15.59:0/152466654 >> v1:172.21.15.64:6789/0 conn(0x7f4c500c49d0 legacy=0x7f4c5015bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:59.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.061+0000 7f4c55dee640 1 -- 172.21.15.59:0/152466654 >> v1:172.21.15.59:6789/0 conn(0x7f4c50152b90 legacy=0x7f4c500c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:59.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.061+0000 7f4c55dee640 1 -- 172.21.15.59:0/152466654 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c500c8050 con 0x7f4c500c5300 2024-04-25T15:46:59.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.064+0000 7f4c55dee640 1 --2- 172.21.15.59:0/152466654 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c500c5300 0x7f4c500c5710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4c500c8790 tx=0x7f4c4802b7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f8119594b4bdafe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:59.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.068+0000 7f4c47fff640 1 -- 172.21.15.59:0/152466654 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c48039070 con 0x7f4c500c5300 2024-04-25T15:46:59.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.068+0000 7f4c47fff640 1 -- 172.21.15.59:0/152466654 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c48030070 con 0x7f4c500c5300 2024-04-25T15:46:59.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.068+0000 7f4c47fff640 1 -- 172.21.15.59:0/152466654 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c48007960 con 0x7f4c500c5300 2024-04-25T15:46:59.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.069+0000 7f4c57851640 1 -- 172.21.15.59:0/152466654 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c500c5300 msgr2=0x7f4c500c5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:59.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.069+0000 7f4c57851640 1 --2- 172.21.15.59:0/152466654 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c500c5300 0x7f4c500c5710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4c500c8790 tx=0x7f4c4802b7d0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.069+0000 7f4c57851640 1 -- 172.21.15.59:0/152466654 shutdown_connections 2024-04-25T15:46:59.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.069+0000 7f4c57851640 1 --2- 172.21.15.59:0/152466654 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c500c5300 0x7f4c500c5710 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.069+0000 7f4c57851640 1 -- 172.21.15.59:0/152466654 >> 172.21.15.59:0/152466654 conn(0x7f4c50068900 msgr2=0x7f4c5006f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:59.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.069+0000 7f4c57851640 1 -- 172.21.15.59:0/152466654 shutdown_connections 2024-04-25T15:46:59.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.069+0000 7f4c57851640 1 -- 172.21.15.59:0/152466654 wait complete. 2024-04-25T15:46:59.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.071+0000 7f4c57851640 1 Processor -- start 2024-04-25T15:46:59.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.071+0000 7f4c57851640 1 -- start start 2024-04-25T15:46:59.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.072+0000 7f4c57851640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c500c49d0 0x7f4c50149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.072+0000 7f4c57851640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c500c5300 0x7f4c501ee530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.072+0000 7f4c57851640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c50152b90 0x7f4c50146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.072+0000 7f4c57851640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4c500cd590 con 0x7f4c500c49d0 2024-04-25T15:46:59.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.072+0000 7f4c57851640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5015c5d0 con 0x7f4c50152b90 2024-04-25T15:46:59.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.072+0000 7f4c57851640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f4c500cd870 con 0x7f4c500c5300 2024-04-25T15:46:59.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.073+0000 7f4c55dee640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c50152b90 0x7f4c50146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.073+0000 7f4c54dec640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c500c5300 0x7f4c501ee530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.073+0000 7f4c555ed640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c500c49d0 0x7f4c50149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.073+0000 7f4c54dec640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c500c5300 0x7f4c501ee530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:45488/0 (socket says 172.21.15.59:45488) 2024-04-25T15:46:59.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.073+0000 7f4c54dec640 1 -- 172.21.15.59:0/3668885643 learned_addr learned my addr 172.21.15.59:0/3668885643 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:59.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.077+0000 7f4c555ed640 1 -- 172.21.15.59:0/3668885643 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c500c5300 msgr2=0x7f4c501ee530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:59.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.077+0000 7f4c555ed640 1 --2- 172.21.15.59:0/3668885643 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c500c5300 0x7f4c501ee530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.077+0000 7f4c555ed640 1 -- 172.21.15.59:0/3668885643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c50152b90 msgr2=0x7f4c50146da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:59.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.077+0000 7f4c555ed640 1 --2- 172.21.15.59:0/3668885643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c50152b90 0x7f4c50146da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.077+0000 7f4c555ed640 1 -- 172.21.15.59:0/3668885643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5014e3b0 con 0x7f4c500c49d0 2024-04-25T15:46:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.079+0000 7f4c555ed640 1 --2- 172.21.15.59:0/3668885643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c500c49d0 0x7f4c50149520 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0010e0 tx=0x7f4c4c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:59.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.083+0000 7f4c45ffb640 1 -- 172.21.15.59:0/3668885643 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c017070 con 0x7f4c500c49d0 2024-04-25T15:46:59.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.084+0000 7f4c45ffb640 1 -- 172.21.15.59:0/3668885643 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c4c0052d0 con 0x7f4c500c49d0 2024-04-25T15:46:59.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.084+0000 7f4c45ffb640 1 -- 172.21.15.59:0/3668885643 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c003830 con 0x7f4c500c49d0 2024-04-25T15:46:59.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.084+0000 7f4c57851640 1 -- 172.21.15.59:0/3668885643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c50154a50 con 0x7f4c500c49d0 2024-04-25T15:46:59.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.084+0000 7f4c57851640 1 -- 172.21.15.59:0/3668885643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c50155010 con 0x7f4c500c49d0 2024-04-25T15:46:59.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.085+0000 7f4c57851640 1 -- 172.21.15.59:0/3668885643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c500698a0 con 0x7f4c500c49d0 2024-04-25T15:46:59.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.106+0000 7f4c45ffb640 1 -- 172.21.15.59:0/3668885643 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4c4c01a070 con 0x7f4c500c49d0 2024-04-25T15:46:59.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.107+0000 7f4c45ffb640 1 --2- 172.21.15.59:0/3668885643 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f4c34076710 0x7f4c34078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.107+0000 7f4c54dec640 1 --2- 172.21.15.59:0/3668885643 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f4c34076710 0x7f4c34078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.107+0000 7f4c54dec640 1 --2- 172.21.15.59:0/3668885643 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f4c34076710 0x7f4c34078c20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4c501513c0 tx=0x7f4c40009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:59.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.395+0000 7f4c45ffb640 1 -- 172.21.15.59:0/3668885643 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4c4c05ad80 con 0x7f4c500c49d0 2024-04-25T15:46:59.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.396+0000 7f4c45ffb640 1 -- 172.21.15.59:0/3668885643 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4c4c021020 con 0x7f4c500c49d0 2024-04-25T15:46:59.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.582+0000 7f4c57851640 1 -- 172.21.15.59:0/3668885643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c501562f0 con 0x7f4c500c49d0 2024-04-25T15:46:59.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.624+0000 7f4c45ffb640 1 -- 172.21.15.59:0/3668885643 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16545 (secure 0 0 0) 0x7f4c4c067130 con 0x7f4c500c49d0 2024-04-25T15:46:59.625 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:46:59.626 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":22,"fsid":"9bb5d7ca-5217-467b-882c-0a18cd57f08f","created":"2024-04-25T15:46:00.198001+0000","modified":"2024-04-25T15:46:33.915756+0000","last_up_change":"2024-04-25T15:46:15.850827+0000","last_in_change":"2024-04-25T15:46:06.311980+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:46:16.936340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:30.174141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:31.372481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34cee654-11dd-4f4b-99fe-093462f8abad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6803","nonce":1314235095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6805","nonce":1314235095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6809","nonce":1314235095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6807","nonce":1314235095}]},"public_addr":"172.21.15.59:6803/1314235095","cluster_addr":"172.21.15.59:6805/1314235095","heartbeat_back_addr":"172.21.15.59:6809/1314235095","heartbeat_front_addr":"172.21.15.59:6807/1314235095","state":["exists","up"]},{"osd":1,"uuid":"3c15505b-4abd-4a24-b30c-edc2732f8ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6827","nonce":3550810151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6829","nonce":3550810151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6833","nonce":3550810151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6831","nonce":3550810151}]},"public_addr":"172.21.15.59:6827/3550810151","cluster_addr":"172.21.15.59:6829/3550810151","heartbeat_back_addr":"172.21.15.59:6833/3550810151","heartbeat_front_addr":"172.21.15.59:6831/3550810151","state":["exists","up"]},{"osd":2,"uuid":"5884bf21-e6b4-4813-b8bc-6baa92443c87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6811","nonce":1651189093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6813","nonce":1651189093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6817","nonce":1651189093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6815","nonce":1651189093}]},"public_addr":"172.21.15.59:6811/1651189093","cluster_addr":"172.21.15.59:6813/1651189093","heartbeat_back_addr":"172.21.15.59:6817/1651189093","heartbeat_front_addr":"172.21.15.59:6815/1651189093","state":["exists","up"]},{"osd":3,"uuid":"6ff71700-3b00-4350-b3c9-f6c41ec46b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6819","nonce":1300858236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6821","nonce":1300858236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6825","nonce":1300858236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6823","nonce":1300858236}]},"public_addr":"172.21.15.59:6819/1300858236","cluster_addr":"172.21.15.59:6821/1300858236","heartbeat_back_addr":"172.21.15.59:6825/1300858236","heartbeat_front_addr":"172.21.15.59:6823/1300858236","state":["exists","up"]},{"osd":4,"uuid":"d0a72143-93fd-4712-aadb-f3fade303426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6817","nonce":2206186554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6819","nonce":2206186554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6823","nonce":2206186554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6821","nonce":2206186554}]},"public_addr":"172.21.15.64:6817/2206186554","cluster_addr":"172.21.15.64:6819/2206186554","heartbeat_back_addr":"172.21.15.64:6823/2206186554","heartbeat_front_addr":"172.21.15.64:6821/2206186554","state":["exists","up"]},{"osd":5,"uuid":"9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6825","nonce":639697697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6827","nonce":639697697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6831","nonce":639697697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6829","nonce":639697697}]},"public_addr":"172.21.15.64:6825/639697697","cluster_addr":"172.21.15.64:6827/639697697","heartbeat_back_addr":"172.21.15.64:6831/639697697","heartbeat_front_addr":"172.21.15.64:6829/639697697","state":["exists","up"]},{"osd":6,"uuid":"311d9a6b-8fbc-4809-8d33-b9248a3562f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6809","nonce":2335675289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6811","nonce":2335675289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6815","nonce":2335675289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6813","nonce":2335675289}]},"public_addr":"172.21.15.64:6809/2335675289","cluster_addr":"172.21.15.64:6811/2335675289","heartbeat_back_addr":"172.21.15.64:6815/2335675289","heartbeat_front_addr":"172.21.15.64:6813/2335675289","state":["exists","up"]},{"osd":7,"uuid":"d0f7436e-882f-4aa7-b2ae-684b9894b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6801","nonce":970439753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6803","nonce":970439753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6807","nonce":970439753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6805","nonce":970439753}]},"public_addr":"172.21.15.64:6801/970439753","cluster_addr":"172.21.15.64:6803/970439753","heartbeat_back_addr":"172.21.15.64:6807/970439753","heartbeat_front_addr":"172.21.15.64:6805/970439753","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.807777+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.945589+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.926832+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.943537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.925062+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.957550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.913559+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.839159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:46:59.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.626+0000 7f4c57851640 1 -- 172.21.15.59:0/3668885643 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f4c34076710 msgr2=0x7f4c34078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:59.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.626+0000 7f4c57851640 1 --2- 172.21.15.59:0/3668885643 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f4c34076710 0x7f4c34078c20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4c501513c0 tx=0x7f4c40009040 comp rx=0 tx=0).stop 2024-04-25T15:46:59.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.626+0000 7f4c57851640 1 -- 172.21.15.59:0/3668885643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c500c49d0 msgr2=0x7f4c50149520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:59.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.626+0000 7f4c57851640 1 --2- 172.21.15.59:0/3668885643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c500c49d0 0x7f4c50149520 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0010e0 tx=0x7f4c4c00c820 comp rx=0 tx=0).stop 2024-04-25T15:46:59.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.626+0000 7f4c57851640 1 -- 172.21.15.59:0/3668885643 shutdown_connections 2024-04-25T15:46:59.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.626+0000 7f4c57851640 1 --2- 172.21.15.59:0/3668885643 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f4c34076710 0x7f4c34078c20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.626+0000 7f4c57851640 1 --2- 172.21.15.59:0/3668885643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c50152b90 0x7f4c50146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.626+0000 7f4c57851640 1 --2- 172.21.15.59:0/3668885643 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4c500c5300 0x7f4c501ee530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.626+0000 7f4c57851640 1 --2- 172.21.15.59:0/3668885643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c500c49d0 0x7f4c50149520 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.626+0000 7f4c57851640 1 -- 172.21.15.59:0/3668885643 >> 172.21.15.59:0/3668885643 conn(0x7f4c50068900 msgr2=0x7f4c50070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:59.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.627+0000 7f4c57851640 1 -- 172.21.15.59:0/3668885643 shutdown_connections 2024-04-25T15:46:59.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.627+0000 7f4c57851640 1 -- 172.21.15.59:0/3668885643 wait complete. 2024-04-25T15:46:59.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:46:59.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.752+0000 7f385844c640 1 Processor -- start 2024-04-25T15:46:59.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.753+0000 7f385844c640 1 -- start start 2024-04-25T15:46:59.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.754+0000 7f385844c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f38500b41c0 0x7f38500cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.754+0000 7f385844c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f38500cd680 0x7f385015c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.754+0000 7f385844c640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f385015cd60 con 0x7f385015c6f0 2024-04-25T15:46:59.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.754+0000 7f385844c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f385015cb00 con 0x7f38500b41c0 2024-04-25T15:46:59.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.754+0000 7f385844c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f385015d040 con 0x7f38500cd680 2024-04-25T15:46:59.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.783+0000 7f38569e9640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f385015c6f0 0x7f38500ce540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41580/0 (socket says 172.21.15.59:41580) 2024-04-25T15:46:59.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.783+0000 7f38569e9640 1 -- 172.21.15.59:0/4215386800 learned_addr learned my addr 172.21.15.59:0/4215386800 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:46:59.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.785+0000 7f38551e6640 1 -- 172.21.15.59:0/4215386800 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1864473534 0 0) 0x7f385015cd60 con 0x7f385015c6f0 2024-04-25T15:46:59.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.785+0000 7f38551e6640 1 -- 172.21.15.59:0/4215386800 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f383c003520 con 0x7f385015c6f0 2024-04-25T15:46:59.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.786+0000 7f38559e7640 1 --2- 172.21.15.59:0/4215386800 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f38500cd680 0x7f385015c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.788+0000 7f38561e8640 1 --2- 172.21.15.59:0/4215386800 >> v2:172.21.15.64:3300/0 conn(0x7f38500b41c0 0x7f38500cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.790+0000 7f38551e6640 1 -- 172.21.15.59:0/4215386800 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1029394157 0 0) 0x7f383c003520 con 0x7f385015c6f0 2024-04-25T15:46:59.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.790+0000 7f38551e6640 1 -- 172.21.15.59:0/4215386800 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f38500cd680 msgr2=0x7f385015c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:59.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.790+0000 7f38551e6640 1 --2- 172.21.15.59:0/4215386800 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f38500cd680 0x7f385015c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.790+0000 7f38551e6640 1 -- 172.21.15.59:0/4215386800 >> v2:172.21.15.64:3300/0 conn(0x7f38500b41c0 msgr2=0x7f38500cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:59.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.790+0000 7f38551e6640 1 --2- 172.21.15.59:0/4215386800 >> v2:172.21.15.64:3300/0 conn(0x7f38500b41c0 0x7f38500cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.790+0000 7f38551e6640 1 -- 172.21.15.59:0/4215386800 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385015d320 con 0x7f385015c6f0 2024-04-25T15:46:59.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.790+0000 7f38551e6640 1 -- 172.21.15.59:0/4215386800 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 763030806 0 0) 0x7f38480019f0 con 0x7f385015c6f0 2024-04-25T15:46:59.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.790+0000 7f38551e6640 1 -- 172.21.15.59:0/4215386800 >> v1:172.21.15.59:6789/0 conn(0x7f385015c6f0 legacy=0x7f38500ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:59.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.790+0000 7f38551e6640 1 --2- 172.21.15.59:0/4215386800 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f38500cd680 0x7f383c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.790+0000 7f38551e6640 1 --2- 172.21.15.59:0/4215386800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f383c003f80 0x7f383c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.790+0000 7f38551e6640 1 --2- 172.21.15.59:0/4215386800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f383c004d40 0x7f383c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.790+0000 7f38551e6640 1 -- 172.21.15.59:0/4215386800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f385015cb00 con 0x7f383c004d40 2024-04-25T15:46:59.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.790+0000 7f38551e6640 1 -- 172.21.15.59:0/4215386800 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f385015d040 con 0x7f383c003f80 2024-04-25T15:46:59.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.790+0000 7f38551e6640 1 -- 172.21.15.59:0/4215386800 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f383c00ba70 con 0x7f38500cd680 2024-04-25T15:46:59.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.793+0000 7f38559e7640 1 --2- 172.21.15.59:0/4215386800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f383c003f80 0x7f383c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.794+0000 7f38561e8640 1 --2- 172.21.15.59:0/4215386800 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f38500cd680 0x7f383c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.796+0000 7f38569e9640 1 --2- 172.21.15.59:0/4215386800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f383c004d40 0x7f383c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.797+0000 7f38559e7640 1 -- 172.21.15.59:0/4215386800 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f38500cd680 msgr2=0x7f383c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:59.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.797+0000 7f38559e7640 1 --2- 172.21.15.59:0/4215386800 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f38500cd680 0x7f383c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.797+0000 7f38559e7640 1 -- 172.21.15.59:0/4215386800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f383c004d40 msgr2=0x7f383c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:46:59.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.797+0000 7f38559e7640 1 --2- 172.21.15.59:0/4215386800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f383c004d40 0x7f383c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.797+0000 7f38559e7640 1 -- 172.21.15.59:0/4215386800 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383c003520 con 0x7f383c003f80 2024-04-25T15:46:59.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.797+0000 7f38569e9640 1 --2- 172.21.15.59:0/4215386800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f383c004d40 0x7f383c005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:46:59.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.799+0000 7f38559e7640 1 --2- 172.21.15.59:0/4215386800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f383c003f80 0x7f383c004800 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f38500d19a0 tx=0x7f383c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5ec448b5d62af28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:59.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.803+0000 7f38551e6640 1 -- 172.21.15.59:0/4215386800 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3844036070 con 0x7f383c003f80 2024-04-25T15:46:59.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.803+0000 7f38551e6640 1 -- 172.21.15.59:0/4215386800 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3844031400 con 0x7f383c003f80 2024-04-25T15:46:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.803+0000 7f38551e6640 1 -- 172.21.15.59:0/4215386800 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3844009690 con 0x7f383c003f80 2024-04-25T15:46:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.804+0000 7f385844c640 1 -- 172.21.15.59:0/4215386800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f383c003f80 msgr2=0x7f383c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.804+0000 7f385844c640 1 --2- 172.21.15.59:0/4215386800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f383c003f80 0x7f383c004800 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f38500d19a0 tx=0x7f383c005830 comp rx=0 tx=0).stop 2024-04-25T15:46:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.804+0000 7f38569e9640 1 -- 172.21.15.59:0/4215386800 reap_dead start 2024-04-25T15:46:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.804+0000 7f385844c640 1 -- 172.21.15.59:0/4215386800 shutdown_connections 2024-04-25T15:46:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.804+0000 7f385844c640 1 -- 172.21.15.59:0/4215386800 >> 172.21.15.59:0/4215386800 conn(0x7f385006ed70 msgr2=0x7f385006f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:46:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.804+0000 7f385844c640 1 -- 172.21.15.59:0/4215386800 shutdown_connections 2024-04-25T15:46:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.804+0000 7f385844c640 1 -- 172.21.15.59:0/4215386800 wait complete. 2024-04-25T15:46:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.806+0000 7f385844c640 1 Processor -- start 2024-04-25T15:46:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.806+0000 7f385844c640 1 -- start start 2024-04-25T15:46:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.807+0000 7f385844c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f383c003f80 0x7f385015dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.807+0000 7f385844c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38500b4820 0x7f3850160190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.807+0000 7f385844c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38501606d0 0x7f3850154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.807+0000 7f385844c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f38500b78a0 con 0x7f38501606d0 2024-04-25T15:46:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.807+0000 7f385844c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f38500ce020 con 0x7f38500b4820 2024-04-25T15:46:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.807+0000 7f385844c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f38500c51e0 con 0x7f383c003f80 2024-04-25T15:46:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.808+0000 7f38569e9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38501606d0 0x7f3850154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.808+0000 7f38559e7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38500b4820 0x7f3850160190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.808+0000 7f38561e8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f383c003f80 0x7f385015dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.808+0000 7f38561e8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f383c003f80 0x7f385015dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:45512/0 (socket says 172.21.15.59:45512) 2024-04-25T15:46:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.808+0000 7f38561e8640 1 -- 172.21.15.59:0/146492167 learned_addr learned my addr 172.21.15.59:0/146492167 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:46:59.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.812+0000 7f38569e9640 1 -- 172.21.15.59:0/146492167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f383c003f80 msgr2=0x7f385015dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:59.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.812+0000 7f38569e9640 1 --2- 172.21.15.59:0/146492167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f383c003f80 0x7f385015dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.812+0000 7f38569e9640 1 -- 172.21.15.59:0/146492167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38500b4820 msgr2=0x7f3850160190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:46:59.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.812+0000 7f38569e9640 1 --2- 172.21.15.59:0/146492167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38500b4820 0x7f3850160190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:46:59.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.812+0000 7f38569e9640 1 -- 172.21.15.59:0/146492167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3850160ae0 con 0x7f38501606d0 2024-04-25T15:46:59.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.815+0000 7f38569e9640 1 --2- 172.21.15.59:0/146492167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38501606d0 0x7f3850154cc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f38500ccea0 tx=0x7f384800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:46:59.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.819+0000 7f3842ffd640 1 -- 172.21.15.59:0/146492167 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384800eb90 con 0x7f38501606d0 2024-04-25T15:46:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.819+0000 7f3842ffd640 1 -- 172.21.15.59:0/146492167 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3848018070 con 0x7f38501606d0 2024-04-25T15:46:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.819+0000 7f385844c640 1 -- 172.21.15.59:0/146492167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385015e120 con 0x7f38501606d0 2024-04-25T15:46:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.819+0000 7f3842ffd640 1 -- 172.21.15.59:0/146492167 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848013420 con 0x7f38501606d0 2024-04-25T15:46:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.819+0000 7f385844c640 1 -- 172.21.15.59:0/146492167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38501e9a20 con 0x7f38501606d0 2024-04-25T15:46:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.820+0000 7f385844c640 1 -- 172.21.15.59:0/146492167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38500698a0 con 0x7f38501606d0 2024-04-25T15:46:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.843+0000 7f3842ffd640 1 -- 172.21.15.59:0/146492167 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f38480135c0 con 0x7f38501606d0 2024-04-25T15:46:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.843+0000 7f3842ffd640 1 --2- 172.21.15.59:0/146492167 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f38340744e0 0x7f38340769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:46:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.844+0000 7f38561e8640 1 --2- 172.21.15.59:0/146492167 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f38340744e0 0x7f38340769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:46:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:46:59.844+0000 7f38561e8640 1 --2- 172.21.15.59:0/146492167 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f38340744e0 0x7f38340769f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f384c006d40 tx=0x7f384c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:00.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:00.126+0000 7f3842ffd640 1 -- 172.21.15.59:0/146492167 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f384805c2b0 con 0x7f38501606d0 2024-04-25T15:47:00.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:00.126+0000 7f3842ffd640 1 -- 172.21.15.59:0/146492167 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3848060020 con 0x7f38501606d0 2024-04-25T15:47:00.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:00.355+0000 7f385844c640 1 -- 172.21.15.59:0/146492167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38500b6340 con 0x7f38501606d0 2024-04-25T15:47:00.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:00.370+0000 7f3842ffd640 1 -- 172.21.15.59:0/146492167 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6862 (secure 0 0 0) 0x7f3848064320 con 0x7f38501606d0 2024-04-25T15:47:00.371 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T15:47:00.372 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/783440137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":783440137},{"type":"v1","addr":"172.21.15.64:6835","nonce":783440137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2150121481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2150121481},{"type":"v1","addr":"172.21.15.59:6835","nonce":2150121481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4208,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2853549826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2853549826},{"type":"v1","addr":"172.21.15.64:6833","nonce":2853549826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:32.561262+0000","modified":"2024-04-25T15:46:42.826371+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4284,"mds_1":4281,"mds_2":4217},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4217":{"gid":4217,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.59:6837/2036351360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2036351360},{"type":"v1","addr":"172.21.15.59:6837","nonce":2036351360}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/4162601241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4162601241},{"type":"v1","addr":"172.21.15.59:6839","nonce":4162601241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6837/2368752795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2368752795},{"type":"v1","addr":"172.21.15.64:6837","nonce":2368752795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4217,4281,4284]},"id":1}]} 2024-04-25T15:47:00.372 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 13 2024-04-25T15:47:00.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:00.372+0000 7f385844c640 1 -- 172.21.15.59:0/146492167 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f38340744e0 msgr2=0x7f38340769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:00.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:00.372+0000 7f385844c640 1 --2- 172.21.15.59:0/146492167 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f38340744e0 0x7f38340769f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f384c006d40 tx=0x7f384c009190 comp rx=0 tx=0).stop 2024-04-25T15:47:00.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:00.372+0000 7f385844c640 1 -- 172.21.15.59:0/146492167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38501606d0 msgr2=0x7f3850154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:00.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:00.372+0000 7f385844c640 1 --2- 172.21.15.59:0/146492167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38501606d0 0x7f3850154cc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f38500ccea0 tx=0x7f384800e530 comp rx=0 tx=0).stop 2024-04-25T15:47:00.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:00.372+0000 7f385844c640 1 -- 172.21.15.59:0/146492167 shutdown_connections 2024-04-25T15:47:00.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:00.372+0000 7f385844c640 1 --2- 172.21.15.59:0/146492167 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f38340744e0 0x7f38340769f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:00.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:00.372+0000 7f385844c640 1 --2- 172.21.15.59:0/146492167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38501606d0 0x7f3850154cc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:00.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:00.372+0000 7f385844c640 1 --2- 172.21.15.59:0/146492167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38500b4820 0x7f3850160190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:00.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:00.372+0000 7f385844c640 1 --2- 172.21.15.59:0/146492167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f383c003f80 0x7f385015dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:00.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:00.373+0000 7f385844c640 1 -- 172.21.15.59:0/146492167 >> 172.21.15.59:0/146492167 conn(0x7f385006ed70 msgr2=0x7f38500d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:00.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:00.373+0000 7f385844c640 1 -- 172.21.15.59:0/146492167 shutdown_connections 2024-04-25T15:47:00.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:00.373+0000 7f385844c640 1 -- 172.21.15.59:0/146492167 wait complete. 2024-04-25T15:47:00.990 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T15:46:32.561262+0000', 'modified': '2024-04-25T15:46:42.826371+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4284, 'mds_1': 4281, 'mds_2': 4217}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4217': {'gid': 4217, 'name': 'e', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.59:6837/2036351360', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6836', 'nonce': 2036351360}, {'type': 'v1', 'addr': '172.21.15.59:6837', 'nonce': 2036351360}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4281': {'gid': 4281, 'name': 'c', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.59:6839/4162601241', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6838', 'nonce': 4162601241}, {'type': 'v1', 'addr': '172.21.15.59:6839', 'nonce': 4162601241}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4284': {'gid': 4284, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.64:6837/2368752795', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6836', 'nonce': 2368752795}, {'type': 'v1', 'addr': '172.21.15.64:6837', 'nonce': 2368752795}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4284, 'qdb_cluster': [4217, 4281, 4284]} 2024-04-25T15:47:00.990 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-25T15:47:00.990 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-25T15:47:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.102+0000 7fde300a7640 1 Processor -- start 2024-04-25T15:47:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.102+0000 7fde300a7640 1 -- start start 2024-04-25T15:47:01.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.103+0000 7fde300a7640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde280b4670 0x7fde28156720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.103+0000 7fde300a7640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde280cd5a0 con 0x7fde280d1ec0 2024-04-25T15:47:01.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.103+0000 7fde300a7640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde2815cf40 con 0x7fde280c68c0 2024-04-25T15:47:01.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.103+0000 7fde300a7640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fde2815d4e0 con 0x7fde280b4670 2024-04-25T15:47:01.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.104+0000 7fde2d642640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde280b4670 0x7fde28156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.104+0000 7fde2de43640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fde280c68c0 0x7fde28160170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.59:36006/0 (socket says 172.21.15.59:36006) 2024-04-25T15:47:01.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.104+0000 7fde2de43640 1 -- 172.21.15.59:0/2077652684 learned_addr learned my addr 172.21.15.59:0/2077652684 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:47:01.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.107+0000 7fde2ce41640 1 -- 172.21.15.59:0/2077652684 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 461431819 0 0) 0x7fde2815cf40 con 0x7fde280c68c0 2024-04-25T15:47:01.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.107+0000 7fde2ce41640 1 -- 172.21.15.59:0/2077652684 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde10003520 con 0x7fde280c68c0 2024-04-25T15:47:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.110+0000 7fde2d642640 1 -- 172.21.15.59:0/2077652684 >> v1:172.21.15.64:6789/0 conn(0x7fde280c68c0 legacy=0x7fde28160170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.110+0000 7fde2d642640 1 -- 172.21.15.59:0/2077652684 >> v1:172.21.15.59:6789/0 conn(0x7fde280d1ec0 legacy=0x7fde28166e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.110+0000 7fde2d642640 1 -- 172.21.15.59:0/2077652684 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2815d200 con 0x7fde280b4670 2024-04-25T15:47:01.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.114+0000 7fde2d642640 1 --2- 172.21.15.59:0/2077652684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde280b4670 0x7fde28156720 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0097d0 tx=0x7fde1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b20a3210aeb7534 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:01.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.118+0000 7fde2ce41640 1 -- 172.21.15.59:0/2077652684 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c037070 con 0x7fde280b4670 2024-04-25T15:47:01.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.118+0000 7fde2ce41640 1 -- 172.21.15.59:0/2077652684 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c032440 con 0x7fde280b4670 2024-04-25T15:47:01.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.118+0000 7fde2ce41640 1 -- 172.21.15.59:0/2077652684 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c032810 con 0x7fde280b4670 2024-04-25T15:47:01.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.119+0000 7fde300a7640 1 -- 172.21.15.59:0/2077652684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde280b4670 msgr2=0x7fde28156720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:01.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.119+0000 7fde300a7640 1 --2- 172.21.15.59:0/2077652684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde280b4670 0x7fde28156720 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0097d0 tx=0x7fde1c02a270 comp rx=0 tx=0).stop 2024-04-25T15:47:01.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.119+0000 7fde300a7640 1 -- 172.21.15.59:0/2077652684 shutdown_connections 2024-04-25T15:47:01.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.119+0000 7fde300a7640 1 --2- 172.21.15.59:0/2077652684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde280b4670 0x7fde28156720 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.119+0000 7fde300a7640 1 -- 172.21.15.59:0/2077652684 >> 172.21.15.59:0/2077652684 conn(0x7fde2806dec0 msgr2=0x7fde2806e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:01.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.119+0000 7fde300a7640 1 -- 172.21.15.59:0/2077652684 shutdown_connections 2024-04-25T15:47:01.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.119+0000 7fde300a7640 1 -- 172.21.15.59:0/2077652684 wait complete. 2024-04-25T15:47:01.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.121+0000 7fde300a7640 1 Processor -- start 2024-04-25T15:47:01.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.121+0000 7fde300a7640 1 -- start start 2024-04-25T15:47:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.122+0000 7fde300a7640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fde280b4670 0x7fde280caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.122+0000 7fde300a7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde280c68c0 0x7fde281f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.122+0000 7fde300a7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde280d1ec0 0x7fde281f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.122+0000 7fde300a7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fde2815fc50 con 0x7fde280c68c0 2024-04-25T15:47:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.122+0000 7fde300a7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fde28160880 con 0x7fde280d1ec0 2024-04-25T15:47:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.122+0000 7fde300a7640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fde28160a00 con 0x7fde280b4670 2024-04-25T15:47:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.123+0000 7fde2d642640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde280c68c0 0x7fde281f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.123+0000 7fde2e644640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde280d1ec0 0x7fde281f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.123+0000 7fde2de43640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fde280b4670 0x7fde280caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.123+0000 7fde2e644640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde280d1ec0 0x7fde281f2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:44832/0 (socket says 172.21.15.59:44832) 2024-04-25T15:47:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.123+0000 7fde2e644640 1 -- 172.21.15.59:0/2988302992 learned_addr learned my addr 172.21.15.59:0/2988302992 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:47:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.127+0000 7fde2e644640 1 -- 172.21.15.59:0/2988302992 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fde280b4670 msgr2=0x7fde280caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.127+0000 7fde2e644640 1 --2- 172.21.15.59:0/2988302992 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fde280b4670 0x7fde280caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.127+0000 7fde2e644640 1 -- 172.21.15.59:0/2988302992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde280c68c0 msgr2=0x7fde281f6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.127+0000 7fde2e644640 1 --2- 172.21.15.59:0/2988302992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde280c68c0 0x7fde281f6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.127+0000 7fde2e644640 1 -- 172.21.15.59:0/2988302992 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde281f3330 con 0x7fde280d1ec0 2024-04-25T15:47:01.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.130+0000 7fde2e644640 1 --2- 172.21.15.59:0/2988302992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde280d1ec0 0x7fde281f2df0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fde1800c6e0 tx=0x7fde1800cba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:01.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.134+0000 7fde267fc640 1 -- 172.21.15.59:0/2988302992 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18003b70 con 0x7fde280d1ec0 2024-04-25T15:47:01.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.134+0000 7fde267fc640 1 -- 172.21.15.59:0/2988302992 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde18003d10 con 0x7fde280d1ec0 2024-04-25T15:47:01.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.134+0000 7fde300a7640 1 -- 172.21.15.59:0/2988302992 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde280c75c0 con 0x7fde280d1ec0 2024-04-25T15:47:01.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.134+0000 7fde267fc640 1 -- 172.21.15.59:0/2988302992 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18005310 con 0x7fde280d1ec0 2024-04-25T15:47:01.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.134+0000 7fde300a7640 1 -- 172.21.15.59:0/2988302992 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde280d13f0 con 0x7fde280d1ec0 2024-04-25T15:47:01.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.137+0000 7fde37030740 1 Processor -- start 2024-04-25T15:47:01.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.137+0000 7fde37030740 1 -- start start 2024-04-25T15:47:01.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.138+0000 7fde37030740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20d4270 0x55c6a24765e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.138+0000 7fde37030740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c6a20ab3b0 0x55c6a2470880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.138+0000 7fde37030740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20b3590 0x55c6a2470dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.138+0000 7fde37030740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c6a23da740 con 0x55c6a20b3590 2024-04-25T15:47:01.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.138+0000 7fde37030740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c6a23763a0 con 0x55c6a20ab3b0 2024-04-25T15:47:01.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.138+0000 7fde37030740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55c6a23d6700 con 0x55c6a20d4270 2024-04-25T15:47:01.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.139+0000 7fde2d642640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20d4270 0x55c6a24765e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.139+0000 7fde2d642640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20b3590 0x55c6a2470dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.139+0000 7fde2d642640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20b3590 0x55c6a2470dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40020/0 (socket says 172.21.15.59:40020) 2024-04-25T15:47:01.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.139+0000 7fde2d642640 1 -- 172.21.15.59:0/1374954488 learned_addr learned my addr 172.21.15.59:0/1374954488 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:47:01.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.142+0000 7fde2d642640 1 -- 172.21.15.59:0/1374954488 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20d4270 msgr2=0x55c6a24765e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:01.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.142+0000 7fde2d642640 1 --2- 172.21.15.59:0/1374954488 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20d4270 0x55c6a24765e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.142+0000 7fde2d642640 1 -- 172.21.15.59:0/1374954488 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c6a20ab3b0 msgr2=0x55c6a2470880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:01.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.142+0000 7fde2d642640 1 --2- 172.21.15.59:0/1374954488 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c6a20ab3b0 0x55c6a2470880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.142+0000 7fde2d642640 1 -- 172.21.15.59:0/1374954488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6a2392750 con 0x55c6a20b3590 2024-04-25T15:47:01.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.144+0000 7fde2d642640 1 --2- 172.21.15.59:0/1374954488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20b3590 0x55c6a2470dc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fde1c009720 tx=0x7fde1c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92332d72731022c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:01.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.148+0000 7fde0f7fe640 1 -- 172.21.15.59:0/1374954488 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c037030 con 0x55c6a20b3590 2024-04-25T15:47:01.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.148+0000 7fde0f7fe640 1 -- 172.21.15.59:0/1374954488 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c038040 con 0x55c6a20b3590 2024-04-25T15:47:01.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.148+0000 7fde0f7fe640 1 -- 172.21.15.59:0/1374954488 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c03e430 con 0x55c6a20b3590 2024-04-25T15:47:01.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.149+0000 7fde37030740 1 -- 172.21.15.59:0/1374954488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20b3590 msgr2=0x55c6a2470dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:01.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.149+0000 7fde37030740 1 --2- 172.21.15.59:0/1374954488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20b3590 0x55c6a2470dc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fde1c009720 tx=0x7fde1c02e000 comp rx=0 tx=0).stop 2024-04-25T15:47:01.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.149+0000 7fde37030740 1 -- 172.21.15.59:0/1374954488 shutdown_connections 2024-04-25T15:47:01.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.149+0000 7fde37030740 1 --2- 172.21.15.59:0/1374954488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20b3590 0x55c6a2470dc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.149+0000 7fde37030740 1 --2- 172.21.15.59:0/1374954488 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c6a20ab3b0 0x55c6a2470880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.149+0000 7fde37030740 1 --2- 172.21.15.59:0/1374954488 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20d4270 0x55c6a24765e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.149+0000 7fde37030740 1 -- 172.21.15.59:0/1374954488 >> 172.21.15.59:0/1374954488 conn(0x55c6a20c83c0 msgr2=0x55c6a2474d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:01.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.149+0000 7fde37030740 1 -- 172.21.15.59:0/1374954488 shutdown_connections 2024-04-25T15:47:01.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.149+0000 7fde37030740 1 -- 172.21.15.59:0/1374954488 wait complete. 2024-04-25T15:47:01.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.150+0000 7fde37030740 1 -- start start 2024-04-25T15:47:01.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.150+0000 7fde37030740 1 Processor -- start 2024-04-25T15:47:01.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.151+0000 7fde37030740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20ab3b0 0x55c6a24c7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.152+0000 7fde37030740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20b3590 0x55c6a249dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.152+0000 7fde37030740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c6a20d4270 0x55c6a249ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.152+0000 7fde37030740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c6a24b4d00 con 0x55c6a20ab3b0 2024-04-25T15:47:01.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.152+0000 7fde37030740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c6a2361fe0 con 0x55c6a20d4270 2024-04-25T15:47:01.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.152+0000 7fde37030740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55c6a2474be0 con 0x55c6a20b3590 2024-04-25T15:47:01.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.152+0000 7fde37030740 10 client.0 _ll_register_callbacks cb 0x55c6a2378150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:47:01.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.152+0000 7fde2d642640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20ab3b0 0x55c6a24c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.152+0000 7fde2de43640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20b3590 0x55c6a249dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.152+0000 7fde2d642640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20ab3b0 0x55c6a24c7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40030/0 (socket says 172.21.15.59:40030) 2024-04-25T15:47:01.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.152+0000 7fde2d642640 1 -- 172.21.15.59:0/3001186371 learned_addr learned my addr 172.21.15.59:0/3001186371 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:47:01.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.156+0000 7fde2d642640 1 -- 172.21.15.59:0/3001186371 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20b3590 msgr2=0x55c6a249dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:01.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.156+0000 7fde2d642640 1 --2- 172.21.15.59:0/3001186371 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20b3590 0x55c6a249dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.156+0000 7fde2d642640 1 -- 172.21.15.59:0/3001186371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c6a20d4270 msgr2=0x55c6a249ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:01.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.156+0000 7fde2d642640 1 --2- 172.21.15.59:0/3001186371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c6a20d4270 0x55c6a249ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.156+0000 7fde2d642640 1 -- 172.21.15.59:0/3001186371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6a20ec2d0 con 0x55c6a20ab3b0 2024-04-25T15:47:01.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.158+0000 7fde2d642640 1 --2- 172.21.15.59:0/3001186371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20ab3b0 0x55c6a24c7370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fde1c02a860 tx=0x7fde1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d86bbe87b24695 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:01.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.158+0000 7fde0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T15:47:01.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.162+0000 7fde0cff9640 1 -- 172.21.15.59:0/3001186371 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c050060 con 0x55c6a20ab3b0 2024-04-25T15:47:01.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.162+0000 7fde0cff9640 1 -- 172.21.15.59:0/3001186371 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fde1c04b610 con 0x55c6a20ab3b0 2024-04-25T15:47:01.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.162+0000 7fde37030740 1 -- 172.21.15.59:0/3001186371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde1c038040 con 0x55c6a20ab3b0 2024-04-25T15:47:01.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.163+0000 7fde267fc640 1 -- 172.21.15.59:0/2988302992 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fde180054b0 con 0x7fde280d1ec0 2024-04-25T15:47:01.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.164+0000 7fde267fc640 1 --2- 172.21.15.59:0/2988302992 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fde14074490 0x7fde140769a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.164+0000 7fde267fc640 1 -- 172.21.15.59:0/2988302992 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fde18094e80 con 0x7fde280d1ec0 2024-04-25T15:47:01.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.164+0000 7fde2de43640 1 --2- 172.21.15.59:0/2988302992 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fde14074490 0x7fde140769a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.164+0000 7fde2de43640 1 --2- 172.21.15.59:0/2988302992 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fde14074490 0x7fde140769a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55c6a2474940 tx=0x7fde20007f20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:01.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.165+0000 7fde0cff9640 1 -- 172.21.15.59:0/3001186371 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fde1c056050 con 0x55c6a20ab3b0 2024-04-25T15:47:01.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.165+0000 7fde37030740 10 client.4560 fetch_fsmap learned FSMap version 13 2024-04-25T15:47:01.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.165+0000 7fde37030740 1 -- 172.21.15.59:0/3001186371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55c6a21b66b0 con 0x55c6a20ab3b0 2024-04-25T15:47:01.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.171+0000 7fde0cff9640 1 -- 172.21.15.59:0/3001186371 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c038040 con 0x55c6a20ab3b0 2024-04-25T15:47:01.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.171+0000 7fde0cff9640 1 -- 172.21.15.59:0/3001186371 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7fde1c059020 con 0x55c6a20ab3b0 2024-04-25T15:47:01.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.171+0000 7fde37030740 10 client.4560 fetch_fsmap finished waiting for FSMap version 13 2024-04-25T15:47:01.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.171+0000 7fde37030740 10 client.4560 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-25T15:47:01.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.171+0000 7fde37030740 20 client.4560 populate_metadata read hostname 'smithi059' 2024-04-25T15:47:01.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.171+0000 7fde37030740 1 --2- 172.21.15.59:0/3001186371 >> [v2:172.21.15.59:6836/2036351360,v1:172.21.15.59:6837/2036351360] conn(0x55c6a2092e40 0x55c6a24d5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.172+0000 7fde37030740 4 client.4560 mds_command: new command op to 4217 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:47:01.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.172+0000 7fde37030740 1 -- 172.21.15.59:0/3001186371 --> [v2:172.21.15.59:6836/2036351360,v1:172.21.15.59:6837/2036351360] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6a23e8350 con 0x55c6a2092e40 2024-04-25T15:47:01.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.181+0000 7fde2d642640 1 --2- 172.21.15.59:0/3001186371 >> [v2:172.21.15.59:6836/2036351360,v1:172.21.15.59:6837/2036351360] conn(0x55c6a2092e40 0x55c6a24d5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.325+0000 7fde0cff9640 10 client.4560 ms_handle_connect on v2:172.21.15.59:6836/2036351360 2024-04-25T15:47:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.325+0000 7fde2d642640 1 --2- 172.21.15.59:0/3001186371 >> [v2:172.21.15.59:6836/2036351360,v1:172.21.15.59:6837/2036351360] conn(0x55c6a2092e40 0x55c6a24d5410 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=749c3a58a705e6f0 server_cookie=2f6643b288349d04 in_seq=0 out_seq=0 2024-04-25T15:47:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.481+0000 7fde0cff9640 1 -- 172.21.15.59:0/3001186371 <== mds.2 v2:172.21.15.59:6836/2036351360 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c6a23e8350 con 0x55c6a2092e40 2024-04-25T15:47:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.481+0000 7fde0cff9640 10 client.4560 handle_command_reply: tid=0 2024-04-25T15:47:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.481+0000 7fde37030740 1 client.4560 shutdown 2024-04-25T15:47:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.481+0000 7fde37030740 1 -- 172.21.15.59:0/3001186371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20ab3b0 msgr2=0x55c6a24c7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.481+0000 7fde37030740 1 --2- 172.21.15.59:0/3001186371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20ab3b0 0x55c6a24c7370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fde1c02a860 tx=0x7fde1c004730 comp rx=0 tx=0).stop 2024-04-25T15:47:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.481+0000 7fde37030740 1 -- 172.21.15.59:0/3001186371 shutdown_connections 2024-04-25T15:47:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.481+0000 7fde37030740 1 --2- 172.21.15.59:0/3001186371 >> [v2:172.21.15.59:6836/2036351360,v1:172.21.15.59:6837/2036351360] conn(0x55c6a2092e40 0x55c6a24d5410 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.481+0000 7fde37030740 1 --2- 172.21.15.59:0/3001186371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c6a20d4270 0x55c6a249ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.481+0000 7fde37030740 1 --2- 172.21.15.59:0/3001186371 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20b3590 0x55c6a249dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.481+0000 7fde37030740 1 --2- 172.21.15.59:0/3001186371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20ab3b0 0x55c6a24c7370 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.481+0000 7fde0cff9640 0 client.4560 ms_handle_reset on v2:172.21.15.59:6836/2036351360 2024-04-25T15:47:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.481+0000 7fde37030740 1 -- 172.21.15.59:0/3001186371 >> 172.21.15.59:0/3001186371 conn(0x55c6a20c83c0 msgr2=0x55c6a24759c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:01.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.482+0000 7fde37030740 1 -- 172.21.15.59:0/3001186371 shutdown_connections 2024-04-25T15:47:01.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.482+0000 7fde37030740 1 -- 172.21.15.59:0/3001186371 wait complete. 2024-04-25T15:47:01.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.482+0000 7fde37030740 20 client.4560 trim_cache size 0 max 16384 2024-04-25T15:47:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.501+0000 7fde37030740 1 Processor -- start 2024-04-25T15:47:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.501+0000 7fde37030740 1 -- start start 2024-04-25T15:47:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.502+0000 7fde37030740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c6a2092e40 0x55c6a24b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.502+0000 7fde37030740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20ab3b0 0x55c6a24b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.502+0000 7fde37030740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20b3590 0x55c6a24b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.502+0000 7fde37030740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fde280cf920 con 0x55c6a20ab3b0 2024-04-25T15:47:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.502+0000 7fde37030740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c6a24b02a0 con 0x55c6a2092e40 2024-04-25T15:47:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.502+0000 7fde37030740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55c6a24b5be0 con 0x55c6a20b3590 2024-04-25T15:47:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.503+0000 7fde2d642640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20ab3b0 0x55c6a24b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.503+0000 7fde2de43640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c6a2092e40 0x55c6a24b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.503+0000 7fde2e644640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20b3590 0x55c6a24b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.503+0000 7fde2d642640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20ab3b0 0x55c6a24b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40042/0 (socket says 172.21.15.59:40042) 2024-04-25T15:47:01.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.503+0000 7fde2d642640 1 -- 172.21.15.59:0/3962569074 learned_addr learned my addr 172.21.15.59:0/3962569074 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:47:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.506+0000 7fde2d642640 1 -- 172.21.15.59:0/3962569074 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20b3590 msgr2=0x55c6a24b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.506+0000 7fde2d642640 1 --2- 172.21.15.59:0/3962569074 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20b3590 0x55c6a24b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.506+0000 7fde2d642640 1 -- 172.21.15.59:0/3962569074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c6a2092e40 msgr2=0x55c6a24b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.506+0000 7fde2d642640 1 --2- 172.21.15.59:0/3962569074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c6a2092e40 0x55c6a24b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.506+0000 7fde2d642640 1 -- 172.21.15.59:0/3962569074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6a2474970 con 0x55c6a20ab3b0 2024-04-25T15:47:01.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.508+0000 7fde2d642640 1 --2- 172.21.15.59:0/3962569074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20ab3b0 0x55c6a24b2480 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fde1c04cfd0 tx=0x7fde1c042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459fb9185be416f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:01.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.512+0000 7fde0effd640 1 -- 172.21.15.59:0/3962569074 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c037020 con 0x55c6a20ab3b0 2024-04-25T15:47:01.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.512+0000 7fde0effd640 1 -- 172.21.15.59:0/3962569074 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c040da0 con 0x55c6a20ab3b0 2024-04-25T15:47:01.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.512+0000 7fde0effd640 1 -- 172.21.15.59:0/3962569074 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c02a8b0 con 0x55c6a20ab3b0 2024-04-25T15:47:01.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.513+0000 7fde37030740 1 -- 172.21.15.59:0/3962569074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20ab3b0 msgr2=0x55c6a24b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:01.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.513+0000 7fde37030740 1 --2- 172.21.15.59:0/3962569074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20ab3b0 0x55c6a24b2480 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fde1c04cfd0 tx=0x7fde1c042000 comp rx=0 tx=0).stop 2024-04-25T15:47:01.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.513+0000 7fde37030740 1 -- 172.21.15.59:0/3962569074 shutdown_connections 2024-04-25T15:47:01.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.513+0000 7fde37030740 1 --2- 172.21.15.59:0/3962569074 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20b3590 0x55c6a24b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.513+0000 7fde37030740 1 --2- 172.21.15.59:0/3962569074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20ab3b0 0x55c6a24b2480 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.513+0000 7fde37030740 1 --2- 172.21.15.59:0/3962569074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c6a2092e40 0x55c6a24b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.513+0000 7fde37030740 1 -- 172.21.15.59:0/3962569074 >> 172.21.15.59:0/3962569074 conn(0x55c6a20c83c0 msgr2=0x55c6a249f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:01.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.513+0000 7fde37030740 1 -- 172.21.15.59:0/3962569074 shutdown_connections 2024-04-25T15:47:01.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.513+0000 7fde37030740 1 -- 172.21.15.59:0/3962569074 wait complete. 2024-04-25T15:47:01.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.514+0000 7fde37030740 1 -- start start 2024-04-25T15:47:01.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.514+0000 7fde37030740 1 Processor -- start 2024-04-25T15:47:01.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.515+0000 7fde37030740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c6a2092e40 0x55c6a2497130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.515+0000 7fde37030740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20ab3b0 0x55c6a246f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.515+0000 7fde37030740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20b3590 0x55c6a252da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.515+0000 7fde37030740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c6a2490dd0 con 0x55c6a20b3590 2024-04-25T15:47:01.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.515+0000 7fde37030740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55c6a249c060 con 0x55c6a2092e40 2024-04-25T15:47:01.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.515+0000 7fde37030740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55c6a24c9d40 con 0x55c6a20ab3b0 2024-04-25T15:47:01.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.515+0000 7fde37030740 10 client.0 _ll_register_callbacks cb 0x7fde1c009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:47:01.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.516+0000 7fde2e644640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20b3590 0x55c6a252da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.516+0000 7fde2d642640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20ab3b0 0x55c6a246f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.516+0000 7fde2de43640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c6a2092e40 0x55c6a2497130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.516+0000 7fde2e644640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20b3590 0x55c6a252da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40056/0 (socket says 172.21.15.59:40056) 2024-04-25T15:47:01.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.516+0000 7fde2e644640 1 -- 172.21.15.59:0/3940636551 learned_addr learned my addr 172.21.15.59:0/3940636551 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:47:01.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.520+0000 7fde2e644640 1 -- 172.21.15.59:0/3940636551 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20ab3b0 msgr2=0x55c6a246f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:01.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.520+0000 7fde2e644640 1 --2- 172.21.15.59:0/3940636551 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20ab3b0 0x55c6a246f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.520+0000 7fde2e644640 1 -- 172.21.15.59:0/3940636551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c6a2092e40 msgr2=0x55c6a2497130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:01.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.520+0000 7fde2e644640 1 --2- 172.21.15.59:0/3940636551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c6a2092e40 0x55c6a2497130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.520+0000 7fde2e644640 1 -- 172.21.15.59:0/3940636551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6a24763f0 con 0x55c6a20b3590 2024-04-25T15:47:01.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.522+0000 7fde2e644640 1 --2- 172.21.15.59:0/3940636551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20b3590 0x55c6a252da00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fde1800a430 tx=0x7fde1805e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cc5888d662241c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:01.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.522+0000 7fde0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T15:47:01.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.526+0000 7fde0cff9640 1 -- 172.21.15.59:0/3940636551 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1805e320 con 0x55c6a20b3590 2024-04-25T15:47:01.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.526+0000 7fde0cff9640 1 -- 172.21.15.59:0/3940636551 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fde1805e4c0 con 0x55c6a20b3590 2024-04-25T15:47:01.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.526+0000 7fde37030740 1 -- 172.21.15.59:0/3940636551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde1c040da0 con 0x55c6a20b3590 2024-04-25T15:47:01.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.528+0000 7fde0cff9640 1 -- 172.21.15.59:0/3940636551 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fde1805aa30 con 0x55c6a20b3590 2024-04-25T15:47:01.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.528+0000 7fde37030740 10 client.4566 fetch_fsmap learned FSMap version 13 2024-04-25T15:47:01.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.528+0000 7fde37030740 1 -- 172.21.15.59:0/3940636551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55c6a2493730 con 0x55c6a20b3590 2024-04-25T15:47:01.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.532+0000 7fde0cff9640 1 -- 172.21.15.59:0/3940636551 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c040da0 con 0x55c6a20b3590 2024-04-25T15:47:01.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.532+0000 7fde0cff9640 1 -- 172.21.15.59:0/3940636551 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7fde180805e0 con 0x55c6a20b3590 2024-04-25T15:47:01.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.532+0000 7fde37030740 10 client.4566 fetch_fsmap finished waiting for FSMap version 13 2024-04-25T15:47:01.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.532+0000 7fde37030740 10 client.4566 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-25T15:47:01.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.532+0000 7fde37030740 20 client.4566 populate_metadata read hostname 'smithi059' 2024-04-25T15:47:01.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.532+0000 7fde37030740 1 --2- 172.21.15.59:0/3940636551 >> [v2:172.21.15.59:6836/2036351360,v1:172.21.15.59:6837/2036351360] conn(0x55c6a2068280 0x55c6a25404f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.532+0000 7fde37030740 4 client.4566 mds_command: new command op to 4217 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T15:47:01.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.532+0000 7fde37030740 1 -- 172.21.15.59:0/3940636551 --> [v2:172.21.15.59:6836/2036351360,v1:172.21.15.59:6837/2036351360] -- command(tid 0: {"prefix": "status"}) -- 0x55c6a23e21c0 con 0x55c6a2068280 2024-04-25T15:47:01.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.533+0000 7fde2de43640 1 --2- 172.21.15.59:0/3940636551 >> [v2:172.21.15.59:6836/2036351360,v1:172.21.15.59:6837/2036351360] conn(0x55c6a2068280 0x55c6a25404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.536+0000 7fde2de43640 1 --2- 172.21.15.59:0/3940636551 >> [v2:172.21.15.59:6836/2036351360,v1:172.21.15.59:6837/2036351360] conn(0x55c6a2068280 0x55c6a25404f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fe3fd9ff2b06994a server_cookie=bc4d341f6ffffdf2 in_seq=0 out_seq=0 2024-04-25T15:47:01.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.536+0000 7fde0cff9640 10 client.4566 ms_handle_connect on v2:172.21.15.59:6836/2036351360 2024-04-25T15:47:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.556+0000 7fde0cff9640 1 -- 172.21.15.59:0/3940636551 <== mds.2 v2:172.21.15.59:6836/2036351360 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55c6a23e21c0 con 0x55c6a2068280 2024-04-25T15:47:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.556+0000 7fde0cff9640 10 client.4566 handle_command_reply: tid=0 2024-04-25T15:47:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.557+0000 7fde37030740 1 client.4566 shutdown 2024-04-25T15:47:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.557+0000 7fde37030740 1 -- 172.21.15.59:0/3940636551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20b3590 msgr2=0x55c6a252da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.557+0000 7fde37030740 1 --2- 172.21.15.59:0/3940636551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20b3590 0x55c6a252da00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fde1800a430 tx=0x7fde1805e960 comp rx=0 tx=0).stop 2024-04-25T15:47:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.557+0000 7fde37030740 1 -- 172.21.15.59:0/3940636551 shutdown_connections 2024-04-25T15:47:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.557+0000 7fde37030740 1 --2- 172.21.15.59:0/3940636551 >> [v2:172.21.15.59:6836/2036351360,v1:172.21.15.59:6837/2036351360] conn(0x55c6a2068280 0x55c6a25404f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.557+0000 7fde37030740 1 --2- 172.21.15.59:0/3940636551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6a20b3590 0x55c6a252da00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.557+0000 7fde37030740 1 --2- 172.21.15.59:0/3940636551 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55c6a20ab3b0 0x55c6a246f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.557+0000 7fde37030740 1 --2- 172.21.15.59:0/3940636551 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55c6a2092e40 0x55c6a2497130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.557+0000 7fde0cff9640 0 client.4566 ms_handle_reset on v2:172.21.15.59:6836/2036351360 2024-04-25T15:47:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.557+0000 7fde37030740 1 -- 172.21.15.59:0/3940636551 >> 172.21.15.59:0/3940636551 conn(0x55c6a20c83c0 msgr2=0x55c6a249cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.557+0000 7fde37030740 1 -- 172.21.15.59:0/3940636551 shutdown_connections 2024-04-25T15:47:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.557+0000 7fde37030740 1 -- 172.21.15.59:0/3940636551 wait complete. 2024-04-25T15:47:01.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.557+0000 7fde37030740 20 client.4566 trim_cache size 0 max 16384 2024-04-25T15:47:01.559 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T15:47:01.560 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "9bb5d7ca-5217-467b-882c-0a18cd57f08f", 2024-04-25T15:47:01.560 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 2, 2024-04-25T15:47:01.560 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4217, 2024-04-25T15:47:01.560 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-04-25T15:47:01.560 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-04-25T15:47:01.560 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-04-25T15:47:01.560 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 20.862919074000001, 2024-04-25T15:47:01.560 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 13, 2024-04-25T15:47:01.560 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 22, 2024-04-25T15:47:01.560 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 22, 2024-04-25T15:47:01.560 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 37.247144368999997 2024-04-25T15:47:01.560 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T15:47:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.558+0000 7fde300a7640 1 -- 172.21.15.59:0/2988302992 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fde14074490 msgr2=0x7fde140769a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.558+0000 7fde300a7640 1 --2- 172.21.15.59:0/2988302992 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fde14074490 0x7fde140769a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x55c6a2474940 tx=0x7fde20007f20 comp rx=0 tx=0).stop 2024-04-25T15:47:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.558+0000 7fde300a7640 1 -- 172.21.15.59:0/2988302992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde280d1ec0 msgr2=0x7fde281f2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:01.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.558+0000 7fde300a7640 1 --2- 172.21.15.59:0/2988302992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde280d1ec0 0x7fde281f2df0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fde1800c6e0 tx=0x7fde1800cba0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.558+0000 7fde300a7640 1 -- 172.21.15.59:0/2988302992 shutdown_connections 2024-04-25T15:47:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.558+0000 7fde300a7640 1 --2- 172.21.15.59:0/2988302992 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fde14074490 0x7fde140769a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.558+0000 7fde300a7640 1 --2- 172.21.15.59:0/2988302992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde280d1ec0 0x7fde281f2df0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.558+0000 7fde300a7640 1 --2- 172.21.15.59:0/2988302992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde280c68c0 0x7fde281f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.558+0000 7fde300a7640 1 --2- 172.21.15.59:0/2988302992 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fde280b4670 0x7fde280caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.558+0000 7fde300a7640 1 -- 172.21.15.59:0/2988302992 >> 172.21.15.59:0/2988302992 conn(0x7fde2806dec0 msgr2=0x7fde28154620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.558+0000 7fde300a7640 1 -- 172.21.15.59:0/2988302992 shutdown_connections 2024-04-25T15:47:01.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.558+0000 7fde300a7640 1 -- 172.21.15.59:0/2988302992 wait complete. 2024-04-25T15:47:01.569 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T15:47:01.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.681+0000 7fde1a164640 1 Processor -- start 2024-04-25T15:47:01.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.681+0000 7fde1a164640 1 -- start start 2024-04-25T15:47:01.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.683+0000 7fde1a164640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fde140c90f0 0x7fde141567d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.683+0000 7fde1a164640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde140c4fa0 con 0x7fde1415ffc0 2024-04-25T15:47:01.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.683+0000 7fde1a164640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde1415d040 con 0x7fde140ca020 2024-04-25T15:47:01.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.683+0000 7fde1a164640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fde140c5760 con 0x7fde140c90f0 2024-04-25T15:47:01.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.683+0000 7fde137fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fde140c90f0 0x7fde141567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.684+0000 7fde137fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fde140c90f0 0x7fde141567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:44868/0 (socket says 172.21.15.59:44868) 2024-04-25T15:47:01.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.684+0000 7fde137fe640 1 -- 172.21.15.59:0/2416085493 learned_addr learned my addr 172.21.15.59:0/2416085493 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:47:01.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.687+0000 7fde137fe640 1 -- 172.21.15.59:0/2416085493 >> v1:172.21.15.64:6789/0 conn(0x7fde140ca020 legacy=0x7fde14070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:01.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.687+0000 7fde137fe640 1 -- 172.21.15.59:0/2416085493 >> v1:172.21.15.59:6789/0 conn(0x7fde1415ffc0 legacy=0x7fde141603d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:01.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.687+0000 7fde137fe640 1 -- 172.21.15.59:0/2416085493 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde1415d320 con 0x7fde140c90f0 2024-04-25T15:47:01.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.689+0000 7fde137fe640 1 --2- 172.21.15.59:0/2416085493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde140c90f0 0x7fde141567d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fde04009870 tx=0x7fde0402a2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3bd906095b076aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:01.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.692+0000 7fde127fc640 1 -- 172.21.15.59:0/2416085493 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde04037070 con 0x7fde140c90f0 2024-04-25T15:47:01.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.694+0000 7fde127fc640 1 -- 172.21.15.59:0/2416085493 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde04032440 con 0x7fde140c90f0 2024-04-25T15:47:01.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.694+0000 7fde127fc640 1 -- 172.21.15.59:0/2416085493 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde04032810 con 0x7fde140c90f0 2024-04-25T15:47:01.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.695+0000 7fde1a164640 1 -- 172.21.15.59:0/2416085493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde140c90f0 msgr2=0x7fde141567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:01.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.695+0000 7fde1a164640 1 --2- 172.21.15.59:0/2416085493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde140c90f0 0x7fde141567d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fde04009870 tx=0x7fde0402a2a0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.695+0000 7fde1a164640 1 -- 172.21.15.59:0/2416085493 shutdown_connections 2024-04-25T15:47:01.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.695+0000 7fde1a164640 1 --2- 172.21.15.59:0/2416085493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde140c90f0 0x7fde141567d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.695+0000 7fde1a164640 1 -- 172.21.15.59:0/2416085493 >> 172.21.15.59:0/2416085493 conn(0x7fde14071f60 msgr2=0x7fde14072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:01.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.695+0000 7fde1a164640 1 -- 172.21.15.59:0/2416085493 shutdown_connections 2024-04-25T15:47:01.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.695+0000 7fde1a164640 1 -- 172.21.15.59:0/2416085493 wait complete. 2024-04-25T15:47:01.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.697+0000 7fde1a164640 1 Processor -- start 2024-04-25T15:47:01.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.697+0000 7fde1a164640 1 -- start start 2024-04-25T15:47:01.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.698+0000 7fde1a164640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde140c90f0 0x7fde141f39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.698+0000 7fde1a164640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fde140ca020 0x7fde140cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.698+0000 7fde1a164640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde1415ffc0 0x7fde140cef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.698+0000 7fde1a164640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fde140c39f0 con 0x7fde140c90f0 2024-04-25T15:47:01.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.698+0000 7fde1a164640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fde1415fb30 con 0x7fde1415ffc0 2024-04-25T15:47:01.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.698+0000 7fde1a164640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fde140c3cd0 con 0x7fde140ca020 2024-04-25T15:47:01.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.699+0000 7fde137fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde140c90f0 0x7fde141f39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.699+0000 7fde13fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde1415ffc0 0x7fde140cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.699+0000 7fde12ffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fde140ca020 0x7fde140cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.699+0000 7fde137fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde140c90f0 0x7fde141f39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40058/0 (socket says 172.21.15.59:40058) 2024-04-25T15:47:01.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.699+0000 7fde137fe640 1 -- 172.21.15.59:0/214261835 learned_addr learned my addr 172.21.15.59:0/214261835 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:47:01.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.703+0000 7fde137fe640 1 -- 172.21.15.59:0/214261835 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fde140ca020 msgr2=0x7fde140cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:01.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.703+0000 7fde137fe640 1 --2- 172.21.15.59:0/214261835 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fde140ca020 0x7fde140cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.703+0000 7fde137fe640 1 -- 172.21.15.59:0/214261835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde1415ffc0 msgr2=0x7fde140cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:01.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.703+0000 7fde137fe640 1 --2- 172.21.15.59:0/214261835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde1415ffc0 0x7fde140cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.703+0000 7fde137fe640 1 -- 172.21.15.59:0/214261835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde141e6fd0 con 0x7fde140c90f0 2024-04-25T15:47:01.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.703+0000 7fde13fff640 1 --2- 172.21.15.59:0/214261835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde1415ffc0 0x7fde140cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:47:01.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.706+0000 7fde137fe640 1 --2- 172.21.15.59:0/214261835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde140c90f0 0x7fde141f39a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fde04000c00 tx=0x7fde040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:01.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.710+0000 7fddfbfff640 1 -- 172.21.15.59:0/214261835 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde04041070 con 0x7fde140c90f0 2024-04-25T15:47:01.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.710+0000 7fddfbfff640 1 -- 172.21.15.59:0/214261835 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde0403c870 con 0x7fde140c90f0 2024-04-25T15:47:01.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.710+0000 7fde1a164640 1 -- 172.21.15.59:0/214261835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde141f3ee0 con 0x7fde140c90f0 2024-04-25T15:47:01.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.710+0000 7fddfbfff640 1 -- 172.21.15.59:0/214261835 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde04037040 con 0x7fde140c90f0 2024-04-25T15:47:01.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.710+0000 7fde1a164640 1 -- 172.21.15.59:0/214261835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde140cca70 con 0x7fde140c90f0 2024-04-25T15:47:01.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.714+0000 7fde21014740 1 Processor -- start 2024-04-25T15:47:01.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.714+0000 7fde21014740 1 -- start start 2024-04-25T15:47:01.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.715+0000 7fde21014740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1e4270 0x55adff5865e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.715+0000 7fde21014740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1bb3b0 0x55adff580880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.715+0000 7fde21014740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1c3590 0x55adff580dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.715+0000 7fde21014740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55adff4ea740 con 0x55adff1bb3b0 2024-04-25T15:47:01.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.715+0000 7fde21014740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55adff4863a0 con 0x55adff1c3590 2024-04-25T15:47:01.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.715+0000 7fde21014740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55adff4e6700 con 0x55adff1e4270 2024-04-25T15:47:01.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.716+0000 7fde13fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1e4270 0x55adff5865e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.716+0000 7fde12ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1c3590 0x55adff580dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.716+0000 7fde12ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1c3590 0x55adff580dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:44888/0 (socket says 172.21.15.59:44888) 2024-04-25T15:47:01.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.716+0000 7fde12ffd640 1 -- 172.21.15.59:0/704412131 learned_addr learned my addr 172.21.15.59:0/704412131 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:47:01.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.719+0000 7fde12ffd640 1 -- 172.21.15.59:0/704412131 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1e4270 msgr2=0x55adff5865e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:01.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.719+0000 7fde12ffd640 1 --2- 172.21.15.59:0/704412131 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1e4270 0x55adff5865e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.719+0000 7fde12ffd640 1 -- 172.21.15.59:0/704412131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1bb3b0 msgr2=0x55adff580880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:01.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.719+0000 7fde12ffd640 1 --2- 172.21.15.59:0/704412131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1bb3b0 0x55adff580880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.719+0000 7fde12ffd640 1 -- 172.21.15.59:0/704412131 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adff4a2750 con 0x55adff1c3590 2024-04-25T15:47:01.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.721+0000 7fde12ffd640 1 --2- 172.21.15.59:0/704412131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1c3590 0x55adff580dc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fde080099c0 tx=0x7fde08009e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0b36789e1db54ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:01.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.724+0000 7fddf97fa640 1 -- 172.21.15.59:0/704412131 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde08017070 con 0x55adff1c3590 2024-04-25T15:47:01.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.724+0000 7fddf97fa640 1 -- 172.21.15.59:0/704412131 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde0800eae0 con 0x55adff1c3590 2024-04-25T15:47:01.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.724+0000 7fddf97fa640 1 -- 172.21.15.59:0/704412131 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde08013470 con 0x55adff1c3590 2024-04-25T15:47:01.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.725+0000 7fde21014740 1 -- 172.21.15.59:0/704412131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1c3590 msgr2=0x55adff580dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:01.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.725+0000 7fde21014740 1 --2- 172.21.15.59:0/704412131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1c3590 0x55adff580dc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fde080099c0 tx=0x7fde08009e80 comp rx=0 tx=0).stop 2024-04-25T15:47:01.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.725+0000 7fde21014740 1 -- 172.21.15.59:0/704412131 shutdown_connections 2024-04-25T15:47:01.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.725+0000 7fde21014740 1 --2- 172.21.15.59:0/704412131 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1c3590 0x55adff580dc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.725+0000 7fde21014740 1 --2- 172.21.15.59:0/704412131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1bb3b0 0x55adff580880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.725+0000 7fde21014740 1 --2- 172.21.15.59:0/704412131 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1e4270 0x55adff5865e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.725+0000 7fde21014740 1 -- 172.21.15.59:0/704412131 >> 172.21.15.59:0/704412131 conn(0x55adff1d83c0 msgr2=0x55adff584d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.725+0000 7fde21014740 1 -- 172.21.15.59:0/704412131 shutdown_connections 2024-04-25T15:47:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.725+0000 7fde21014740 1 -- 172.21.15.59:0/704412131 wait complete. 2024-04-25T15:47:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.726+0000 7fde21014740 1 -- start start 2024-04-25T15:47:01.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.726+0000 7fde21014740 1 Processor -- start 2024-04-25T15:47:01.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.727+0000 7fde21014740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1bb3b0 0x55adff5ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.727+0000 7fde21014740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1c3590 0x55adff5daf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.727+0000 7fde21014740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1e4270 0x55adff5a4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.727+0000 7fde21014740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55adff5c4d00 con 0x55adff1bb3b0 2024-04-25T15:47:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.727+0000 7fde21014740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55adff471fe0 con 0x55adff1e4270 2024-04-25T15:47:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.727+0000 7fde21014740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55adff584be0 con 0x55adff1c3590 2024-04-25T15:47:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.728+0000 7fde21014740 10 client.0 _ll_register_callbacks cb 0x55adff488150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:47:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.728+0000 7fde137fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1c3590 0x55adff5daf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.728+0000 7fde12ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1e4270 0x55adff5a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.728+0000 7fde12ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1e4270 0x55adff5a4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:44902/0 (socket says 172.21.15.59:44902) 2024-04-25T15:47:01.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.728+0000 7fde12ffd640 1 -- 172.21.15.59:0/3583533934 learned_addr learned my addr 172.21.15.59:0/3583533934 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:47:01.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.732+0000 7fde12ffd640 1 -- 172.21.15.59:0/3583533934 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1c3590 msgr2=0x55adff5daf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:01.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.732+0000 7fde12ffd640 1 --2- 172.21.15.59:0/3583533934 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1c3590 0x55adff5daf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.732+0000 7fde12ffd640 1 -- 172.21.15.59:0/3583533934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1bb3b0 msgr2=0x55adff5ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:01.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.732+0000 7fde12ffd640 1 --2- 172.21.15.59:0/3583533934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1bb3b0 0x55adff5ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:01.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.732+0000 7fde12ffd640 1 -- 172.21.15.59:0/3583533934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adff1fc2d0 con 0x55adff1e4270 2024-04-25T15:47:01.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.735+0000 7fde12ffd640 1 --2- 172.21.15.59:0/3583533934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1e4270 0x55adff5a4340 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde080069a0 tx=0x7fde08004680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e66a3d8ef839b6d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:01.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.735+0000 7fddfbfff640 1 -- 172.21.15.59:0/214261835 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fde04044070 con 0x7fde140c90f0 2024-04-25T15:47:01.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.735+0000 7fddf27fc640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2024-04-25T15:47:01.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.735+0000 7fddfbfff640 1 --2- 172.21.15.59:0/214261835 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fde00074410 0x7fde00076920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.735+0000 7fde13fff640 1 --2- 172.21.15.59:0/214261835 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fde00074410 0x7fde00076920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.735+0000 7fde13fff640 1 --2- 172.21.15.59:0/214261835 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fde00074410 0x7fde00076920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fde0c0012e0 tx=0x7fde0c001630 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:01.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.739+0000 7fddf27fc640 1 -- 172.21.15.59:0/3583533934 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde08017040 con 0x55adff1e4270 2024-04-25T15:47:01.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.739+0000 7fddf27fc640 1 -- 172.21.15.59:0/3583533934 <== mon.1 v2:172.21.15.64:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fde08027aa0 con 0x55adff1e4270 2024-04-25T15:47:01.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.739+0000 7fde21014740 1 -- 172.21.15.59:0/3583533934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde0800eae0 con 0x55adff1e4270 2024-04-25T15:47:01.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.740+0000 7fddfbfff640 1 -- 172.21.15.59:0/214261835 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fde0407c5d0 con 0x7fde140c90f0 2024-04-25T15:47:01.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.740+0000 7fddf27fc640 1 -- 172.21.15.59:0/3583533934 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fde08027ca0 con 0x55adff1e4270 2024-04-25T15:47:01.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.740+0000 7fde21014740 10 client.4519 fetch_fsmap learned FSMap version 13 2024-04-25T15:47:01.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.740+0000 7fde21014740 1 -- 172.21.15.59:0/3583533934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55adff2c66b0 con 0x55adff1e4270 2024-04-25T15:47:01.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.746+0000 7fddf27fc640 1 -- 172.21.15.59:0/3583533934 <== mon.1 v2:172.21.15.64:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde0800eae0 con 0x55adff1e4270 2024-04-25T15:47:01.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.746+0000 7fddf27fc640 1 -- 172.21.15.59:0/3583533934 <== mon.1 v2:172.21.15.64:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7fde080037f0 con 0x55adff1e4270 2024-04-25T15:47:01.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.746+0000 7fde21014740 10 client.4519 fetch_fsmap finished waiting for FSMap version 13 2024-04-25T15:47:01.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.746+0000 7fde21014740 10 client.4519 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T15:47:01.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.746+0000 7fde21014740 20 client.4519 populate_metadata read hostname 'smithi059' 2024-04-25T15:47:01.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.746+0000 7fde21014740 1 --2- 172.21.15.59:0/3583533934 >> [v2:172.21.15.59:6838/4162601241,v1:172.21.15.59:6839/4162601241] conn(0x55adff1a2e40 0x55adff5ad050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:01.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.746+0000 7fde21014740 4 client.4519 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:47:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.746+0000 7fde21014740 1 -- 172.21.15.59:0/3583533934 --> [v2:172.21.15.59:6838/4162601241,v1:172.21.15.59:6839/4162601241] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55adff4f8350 con 0x55adff1a2e40 2024-04-25T15:47:01.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.747+0000 7fde137fe640 1 --2- 172.21.15.59:0/3583533934 >> [v2:172.21.15.59:6838/4162601241,v1:172.21.15.59:6839/4162601241] conn(0x55adff1a2e40 0x55adff5ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:01.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.845+0000 7fde137fe640 1 --2- 172.21.15.59:0/3583533934 >> [v2:172.21.15.59:6838/4162601241,v1:172.21.15.59:6839/4162601241] conn(0x55adff1a2e40 0x55adff5ad050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f66f2c349fc57397 server_cookie=922f76f78b9b6b89 in_seq=0 out_seq=0 2024-04-25T15:47:01.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:01.845+0000 7fddf27fc640 10 client.4519 ms_handle_connect on v2:172.21.15.59:6838/4162601241 2024-04-25T15:47:02.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.007+0000 7fddf27fc640 1 -- 172.21.15.59:0/3583533934 <== mds.1 v2:172.21.15.59:6838/4162601241 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55adff4f8350 con 0x55adff1a2e40 2024-04-25T15:47:02.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.007+0000 7fddf27fc640 10 client.4519 handle_command_reply: tid=0 2024-04-25T15:47:02.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.007+0000 7fde21014740 1 client.4519 shutdown 2024-04-25T15:47:02.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.007+0000 7fde21014740 1 -- 172.21.15.59:0/3583533934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1e4270 msgr2=0x55adff5a4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.007+0000 7fde21014740 1 --2- 172.21.15.59:0/3583533934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1e4270 0x55adff5a4340 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde080069a0 tx=0x7fde08004680 comp rx=0 tx=0).stop 2024-04-25T15:47:02.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.007+0000 7fde21014740 1 -- 172.21.15.59:0/3583533934 shutdown_connections 2024-04-25T15:47:02.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.007+0000 7fde21014740 1 --2- 172.21.15.59:0/3583533934 >> [v2:172.21.15.59:6838/4162601241,v1:172.21.15.59:6839/4162601241] conn(0x55adff1a2e40 0x55adff5ad050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.007+0000 7fde21014740 1 --2- 172.21.15.59:0/3583533934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1e4270 0x55adff5a4340 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.007+0000 7fde21014740 1 --2- 172.21.15.59:0/3583533934 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1c3590 0x55adff5daf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.007+0000 7fde21014740 1 --2- 172.21.15.59:0/3583533934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1bb3b0 0x55adff5ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.007+0000 7fddf27fc640 0 client.4519 ms_handle_reset on v2:172.21.15.59:6838/4162601241 2024-04-25T15:47:02.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.007+0000 7fde21014740 1 -- 172.21.15.59:0/3583533934 >> 172.21.15.59:0/3583533934 conn(0x55adff1d83c0 msgr2=0x55adff57fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:02.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.007+0000 7fde21014740 1 -- 172.21.15.59:0/3583533934 shutdown_connections 2024-04-25T15:47:02.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.007+0000 7fde21014740 1 -- 172.21.15.59:0/3583533934 wait complete. 2024-04-25T15:47:02.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.007+0000 7fde21014740 20 client.4519 trim_cache size 0 max 16384 2024-04-25T15:47:02.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.031+0000 7fde21014740 1 Processor -- start 2024-04-25T15:47:02.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.032+0000 7fde21014740 1 -- start start 2024-04-25T15:47:02.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.033+0000 7fde21014740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1bb3b0 0x55adff5eadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.033+0000 7fde21014740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1c3590 0x55adff5c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.033+0000 7fde21014740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1e4270 0x55adff5c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.033+0000 7fde21014740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fde141f6570 con 0x55adff1bb3b0 2024-04-25T15:47:02.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.033+0000 7fde21014740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55adff471fe0 con 0x55adff1c3590 2024-04-25T15:47:02.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.033+0000 7fde21014740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55adff5bdab0 con 0x55adff1e4270 2024-04-25T15:47:02.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.033+0000 7fde12ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1c3590 0x55adff5c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.034+0000 7fde13fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1e4270 0x55adff5c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.034+0000 7fde137fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1bb3b0 0x55adff5eadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.034+0000 7fde13fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1e4270 0x55adff5c7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:45574/0 (socket says 172.21.15.59:45574) 2024-04-25T15:47:02.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.034+0000 7fde13fff640 1 -- 172.21.15.59:0/3714375924 learned_addr learned my addr 172.21.15.59:0/3714375924 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:47:02.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.036+0000 7fde137fe640 1 -- 172.21.15.59:0/3714375924 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1e4270 msgr2=0x55adff5c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:02.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.036+0000 7fde137fe640 1 --2- 172.21.15.59:0/3714375924 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1e4270 0x55adff5c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.036+0000 7fde137fe640 1 -- 172.21.15.59:0/3714375924 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1c3590 msgr2=0x55adff5c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:02.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.036+0000 7fde137fe640 1 --2- 172.21.15.59:0/3714375924 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1c3590 0x55adff5c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.037+0000 7fde137fe640 1 -- 172.21.15.59:0/3714375924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adff57afa0 con 0x55adff1bb3b0 2024-04-25T15:47:02.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.038+0000 7fde137fe640 1 --2- 172.21.15.59:0/3714375924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1bb3b0 0x55adff5eadd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fde040b45e0 tx=0x7fde040b44e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0993611531ec56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:02.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.042+0000 7fddf8ff9640 1 -- 172.21.15.59:0/3714375924 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0404b040 con 0x55adff1bb3b0 2024-04-25T15:47:02.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.042+0000 7fddf8ff9640 1 -- 172.21.15.59:0/3714375924 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde040807a0 con 0x55adff1bb3b0 2024-04-25T15:47:02.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.042+0000 7fddf8ff9640 1 -- 172.21.15.59:0/3714375924 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde04088ea0 con 0x55adff1bb3b0 2024-04-25T15:47:02.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.043+0000 7fde21014740 1 -- 172.21.15.59:0/3714375924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1bb3b0 msgr2=0x55adff5eadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.043+0000 7fde21014740 1 --2- 172.21.15.59:0/3714375924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1bb3b0 0x55adff5eadd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fde040b45e0 tx=0x7fde040b44e0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.043+0000 7fde21014740 1 -- 172.21.15.59:0/3714375924 shutdown_connections 2024-04-25T15:47:02.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.043+0000 7fde21014740 1 --2- 172.21.15.59:0/3714375924 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1e4270 0x55adff5c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.043+0000 7fde21014740 1 --2- 172.21.15.59:0/3714375924 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1c3590 0x55adff5c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.043+0000 7fde21014740 1 --2- 172.21.15.59:0/3714375924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1bb3b0 0x55adff5eadd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.043+0000 7fde21014740 1 -- 172.21.15.59:0/3714375924 >> 172.21.15.59:0/3714375924 conn(0x55adff1d83c0 msgr2=0x55adff5bdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:02.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.043+0000 7fde21014740 1 -- 172.21.15.59:0/3714375924 shutdown_connections 2024-04-25T15:47:02.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.043+0000 7fde21014740 1 -- 172.21.15.59:0/3714375924 wait complete. 2024-04-25T15:47:02.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.044+0000 7fde21014740 1 -- start start 2024-04-25T15:47:02.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.044+0000 7fde21014740 1 Processor -- start 2024-04-25T15:47:02.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.046+0000 7fde21014740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1bb3b0 0x55adff63f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.046+0000 7fde21014740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1c3590 0x55adff5c2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.046+0000 7fde21014740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1e4270 0x55adff5c3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.046+0000 7fde21014740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55adff5bd600 con 0x55adff1e4270 2024-04-25T15:47:02.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.046+0000 7fde21014740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x55adff5ab750 con 0x55adff1c3590 2024-04-25T15:47:02.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.046+0000 7fde21014740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x55adff5c6670 con 0x55adff1bb3b0 2024-04-25T15:47:02.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.046+0000 7fde21014740 10 client.0 _ll_register_callbacks cb 0x7fde0c001c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:47:02.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.046+0000 7fde13fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1e4270 0x55adff5c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.046+0000 7fde137fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1bb3b0 0x55adff63f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.046+0000 7fde12ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1c3590 0x55adff5c2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.047+0000 7fde137fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1bb3b0 0x55adff63f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:45588/0 (socket says 172.21.15.59:45588) 2024-04-25T15:47:02.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.047+0000 7fde137fe640 1 -- 172.21.15.59:0/1589632653 learned_addr learned my addr 172.21.15.59:0/1589632653 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:47:02.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.050+0000 7fde137fe640 1 -- 172.21.15.59:0/1589632653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1c3590 msgr2=0x55adff5c2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:02.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.050+0000 7fde137fe640 1 --2- 172.21.15.59:0/1589632653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1c3590 0x55adff5c2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.050+0000 7fde137fe640 1 -- 172.21.15.59:0/1589632653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1e4270 msgr2=0x55adff5c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:02.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.050+0000 7fde137fe640 1 --2- 172.21.15.59:0/1589632653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1e4270 0x55adff5c3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.050+0000 7fde137fe640 1 -- 172.21.15.59:0/1589632653 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55adff580350 con 0x55adff1bb3b0 2024-04-25T15:47:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.053+0000 7fde137fe640 1 --2- 172.21.15.59:0/1589632653 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1bb3b0 0x55adff63f6d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fde040b45e0 tx=0x7fde04009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d65103afe8518d33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.053+0000 7fddf27fc640 10 client.0 ms_handle_connect on v2:172.21.15.64:3301/0 2024-04-25T15:47:02.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.058+0000 7fddf27fc640 1 -- 172.21.15.59:0/1589632653 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde040b2060 con 0x55adff1bb3b0 2024-04-25T15:47:02.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.058+0000 7fddf27fc640 1 -- 172.21.15.59:0/1589632653 <== mon.2 v2:172.21.15.64:3301/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fde04084350 con 0x55adff1bb3b0 2024-04-25T15:47:02.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.058+0000 7fde21014740 1 -- 172.21.15.59:0/1589632653 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde040807a0 con 0x55adff1bb3b0 2024-04-25T15:47:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.060+0000 7fddf27fc640 1 -- 172.21.15.59:0/1589632653 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fde0404b070 con 0x55adff1bb3b0 2024-04-25T15:47:02.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.060+0000 7fde21014740 10 client.4472 fetch_fsmap learned FSMap version 13 2024-04-25T15:47:02.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.060+0000 7fde21014740 1 -- 172.21.15.59:0/1589632653 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55adff59fbc0 con 0x55adff1bb3b0 2024-04-25T15:47:02.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.076+0000 7fddf27fc640 1 -- 172.21.15.59:0/1589632653 <== mon.2 v2:172.21.15.64:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde040807a0 con 0x55adff1bb3b0 2024-04-25T15:47:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.076+0000 7fddf27fc640 1 -- 172.21.15.59:0/1589632653 <== mon.2 v2:172.21.15.64:3301/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7fde0407f5a0 con 0x55adff1bb3b0 2024-04-25T15:47:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.076+0000 7fde21014740 10 client.4472 fetch_fsmap finished waiting for FSMap version 13 2024-04-25T15:47:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.076+0000 7fde21014740 10 client.4472 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T15:47:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.076+0000 7fde21014740 20 client.4472 populate_metadata read hostname 'smithi059' 2024-04-25T15:47:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.076+0000 7fde21014740 1 --2- 172.21.15.59:0/1589632653 >> [v2:172.21.15.59:6838/4162601241,v1:172.21.15.59:6839/4162601241] conn(0x55adff5bc520 0x55adff5bc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.076+0000 7fde21014740 4 client.4472 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T15:47:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.076+0000 7fde21014740 1 -- 172.21.15.59:0/1589632653 --> [v2:172.21.15.59:6838/4162601241,v1:172.21.15.59:6839/4162601241] -- command(tid 0: {"prefix": "status"}) -- 0x55adff4f21c0 con 0x55adff5bc520 2024-04-25T15:47:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.076+0000 7fde12ffd640 1 --2- 172.21.15.59:0/1589632653 >> [v2:172.21.15.59:6838/4162601241,v1:172.21.15.59:6839/4162601241] conn(0x55adff5bc520 0x55adff5bc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.080+0000 7fde12ffd640 1 --2- 172.21.15.59:0/1589632653 >> [v2:172.21.15.59:6838/4162601241,v1:172.21.15.59:6839/4162601241] conn(0x55adff5bc520 0x55adff5bc930 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c297057c8779a394 server_cookie=6a0edd40c385ab2d in_seq=0 out_seq=0 2024-04-25T15:47:02.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.080+0000 7fddf27fc640 10 client.4472 ms_handle_connect on v2:172.21.15.59:6838/4162601241 2024-04-25T15:47:02.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.100+0000 7fddf27fc640 1 -- 172.21.15.59:0/1589632653 <== mds.1 v2:172.21.15.59:6838/4162601241 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55adff4f21c0 con 0x55adff5bc520 2024-04-25T15:47:02.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.100+0000 7fddf27fc640 10 client.4472 handle_command_reply: tid=0 2024-04-25T15:47:02.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.100+0000 7fde21014740 1 client.4472 shutdown 2024-04-25T15:47:02.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.100+0000 7fde21014740 1 -- 172.21.15.59:0/1589632653 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1bb3b0 msgr2=0x55adff63f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.100+0000 7fde21014740 1 --2- 172.21.15.59:0/1589632653 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1bb3b0 0x55adff63f6d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fde040b45e0 tx=0x7fde04009040 comp rx=0 tx=0).stop 2024-04-25T15:47:02.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.100+0000 7fde21014740 1 -- 172.21.15.59:0/1589632653 shutdown_connections 2024-04-25T15:47:02.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.100+0000 7fde21014740 1 --2- 172.21.15.59:0/1589632653 >> [v2:172.21.15.59:6838/4162601241,v1:172.21.15.59:6839/4162601241] conn(0x55adff5bc520 0x55adff5bc930 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.100+0000 7fde21014740 1 --2- 172.21.15.59:0/1589632653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55adff1e4270 0x55adff5c3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.100+0000 7fde21014740 1 --2- 172.21.15.59:0/1589632653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55adff1c3590 0x55adff5c2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.100+0000 7fde21014740 1 --2- 172.21.15.59:0/1589632653 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x55adff1bb3b0 0x55adff63f6d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.100+0000 7fddf27fc640 0 client.4472 ms_handle_reset on v2:172.21.15.59:6838/4162601241 2024-04-25T15:47:02.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.100+0000 7fde21014740 1 -- 172.21.15.59:0/1589632653 >> 172.21.15.59:0/1589632653 conn(0x55adff1d83c0 msgr2=0x55adff583c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:02.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.100+0000 7fde21014740 1 -- 172.21.15.59:0/1589632653 shutdown_connections 2024-04-25T15:47:02.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.100+0000 7fde21014740 1 -- 172.21.15.59:0/1589632653 wait complete. 2024-04-25T15:47:02.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.101+0000 7fde21014740 20 client.4472 trim_cache size 0 max 16384 2024-04-25T15:47:02.103 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T15:47:02.103 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "9bb5d7ca-5217-467b-882c-0a18cd57f08f", 2024-04-25T15:47:02.103 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 1, 2024-04-25T15:47:02.103 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4281, 2024-04-25T15:47:02.103 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-04-25T15:47:02.103 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-04-25T15:47:02.104 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-04-25T15:47:02.104 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 23.798808718, 2024-04-25T15:47:02.104 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 13, 2024-04-25T15:47:02.104 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 22, 2024-04-25T15:47:02.104 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 22, 2024-04-25T15:47:02.104 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 37.728819741999999 2024-04-25T15:47:02.104 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T15:47:02.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.101+0000 7fde1a164640 1 -- 172.21.15.59:0/214261835 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fde00074410 msgr2=0x7fde00076920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.101+0000 7fde1a164640 1 --2- 172.21.15.59:0/214261835 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fde00074410 0x7fde00076920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fde0c0012e0 tx=0x7fde0c001630 comp rx=0 tx=0).stop 2024-04-25T15:47:02.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.101+0000 7fde1a164640 1 -- 172.21.15.59:0/214261835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde140c90f0 msgr2=0x7fde141f39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.101+0000 7fde1a164640 1 --2- 172.21.15.59:0/214261835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde140c90f0 0x7fde141f39a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fde04000c00 tx=0x7fde040046c0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.101+0000 7fde1a164640 1 -- 172.21.15.59:0/214261835 shutdown_connections 2024-04-25T15:47:02.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.101+0000 7fde1a164640 1 --2- 172.21.15.59:0/214261835 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fde00074410 0x7fde00076920 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.101+0000 7fde1a164640 1 --2- 172.21.15.59:0/214261835 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde1415ffc0 0x7fde140cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.101+0000 7fde1a164640 1 --2- 172.21.15.59:0/214261835 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fde140ca020 0x7fde140cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.101+0000 7fde1a164640 1 --2- 172.21.15.59:0/214261835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde140c90f0 0x7fde141f39a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.101+0000 7fde1a164640 1 -- 172.21.15.59:0/214261835 >> 172.21.15.59:0/214261835 conn(0x7fde14071f60 msgr2=0x7fde14150400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:02.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.101+0000 7fde1a164640 1 -- 172.21.15.59:0/214261835 shutdown_connections 2024-04-25T15:47:02.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.101+0000 7fde1a164640 1 -- 172.21.15.59:0/214261835 wait complete. 2024-04-25T15:47:02.115 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T15:47:02.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.227+0000 7f56adbf3640 1 Processor -- start 2024-04-25T15:47:02.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.227+0000 7f56adbf3640 1 -- start start 2024-04-25T15:47:02.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.228+0000 7f56adbf3640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f56a8160730 0x7f56a80ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.228+0000 7f56adbf3640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56a815c8c0 con 0x7f56a80b47a0 2024-04-25T15:47:02.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.228+0000 7f56adbf3640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56a815cba0 con 0x7f56a80ce8e0 2024-04-25T15:47:02.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.228+0000 7f56adbf3640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f56a80b4bb0 con 0x7f56a8160730 2024-04-25T15:47:02.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.229+0000 7f56a77fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f56a80b47a0 0x7f56a80cc960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41612/0 (socket says 172.21.15.59:41612) 2024-04-25T15:47:02.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.229+0000 7f56a77fe640 1 -- 172.21.15.59:0/652318850 learned_addr learned my addr 172.21.15.59:0/652318850 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T15:47:02.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.229+0000 7f56a6ffd640 1 --2- 172.21.15.59:0/652318850 >> v2:172.21.15.64:3300/0 conn(0x7f56a8160730 0x7f56a80ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.232+0000 7f56a67fc640 1 -- 172.21.15.59:0/652318850 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3314700390 0 0) 0x7f56a815c8c0 con 0x7f56a80b47a0 2024-04-25T15:47:02.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.232+0000 7f56a67fc640 1 -- 172.21.15.59:0/652318850 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5690003520 con 0x7f56a80b47a0 2024-04-25T15:47:02.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.232+0000 7f56a6ffd640 1 -- 172.21.15.59:0/652318850 >> v1:172.21.15.64:6789/0 conn(0x7f56a80ce8e0 legacy=0x7f56a80b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:02.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.232+0000 7f56a6ffd640 1 -- 172.21.15.59:0/652318850 >> v1:172.21.15.59:6789/0 conn(0x7f56a80b47a0 legacy=0x7f56a80cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.232+0000 7f56a6ffd640 1 -- 172.21.15.59:0/652318850 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a815ce80 con 0x7f56a8160730 2024-04-25T15:47:02.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.236+0000 7f56a6ffd640 1 --2- 172.21.15.59:0/652318850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56a8160730 0x7f56a80ce3a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f569c0097a0 tx=0x7f569c02a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bce4ed1bbf9b3e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:02.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.240+0000 7f56a67fc640 1 -- 172.21.15.59:0/652318850 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c037070 con 0x7f56a8160730 2024-04-25T15:47:02.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.240+0000 7f56a67fc640 1 -- 172.21.15.59:0/652318850 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f569c02ae50 con 0x7f56a8160730 2024-04-25T15:47:02.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.240+0000 7f56a67fc640 1 -- 172.21.15.59:0/652318850 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c032660 con 0x7f56a8160730 2024-04-25T15:47:02.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.241+0000 7f56adbf3640 1 -- 172.21.15.59:0/652318850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56a8160730 msgr2=0x7f56a80ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.241+0000 7f56adbf3640 1 --2- 172.21.15.59:0/652318850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56a8160730 0x7f56a80ce3a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f569c0097a0 tx=0x7f569c02a140 comp rx=0 tx=0).stop 2024-04-25T15:47:02.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.241+0000 7f56adbf3640 1 -- 172.21.15.59:0/652318850 shutdown_connections 2024-04-25T15:47:02.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.241+0000 7f56adbf3640 1 --2- 172.21.15.59:0/652318850 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56a8160730 0x7f56a80ce3a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.241+0000 7f56adbf3640 1 -- 172.21.15.59:0/652318850 >> 172.21.15.59:0/652318850 conn(0x7f56a80684e0 msgr2=0x7f56a80688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:02.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.241+0000 7f56adbf3640 1 -- 172.21.15.59:0/652318850 shutdown_connections 2024-04-25T15:47:02.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.241+0000 7f56adbf3640 1 -- 172.21.15.59:0/652318850 wait complete. 2024-04-25T15:47:02.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.243+0000 7f56adbf3640 1 Processor -- start 2024-04-25T15:47:02.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.243+0000 7f56adbf3640 1 -- start start 2024-04-25T15:47:02.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.245+0000 7f56adbf3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a80b47a0 0x7f56a80ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.245+0000 7f56adbf3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56a80ce8e0 0x7f56a80ad340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.245+0000 7f56adbf3640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f56a8160730 0x7f56a80c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.245+0000 7f56adbf3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f56a815d440 con 0x7f56a80b47a0 2024-04-25T15:47:02.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.245+0000 7f56adbf3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f56a80cd070 con 0x7f56a80ce8e0 2024-04-25T15:47:02.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.245+0000 7f56adbf3640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f56a8160b40 con 0x7f56a8160730 2024-04-25T15:47:02.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.245+0000 7f56a6ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56a80ce8e0 0x7f56a80ad340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.245+0000 7f56a77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a80b47a0 0x7f56a80ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.245+0000 7f56a7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f56a8160730 0x7f56a80c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.246+0000 7f56a6ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56a80ce8e0 0x7f56a80ad340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:44934/0 (socket says 172.21.15.59:44934) 2024-04-25T15:47:02.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.246+0000 7f56a6ffd640 1 -- 172.21.15.59:0/2158810255 learned_addr learned my addr 172.21.15.59:0/2158810255 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:47:02.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.249+0000 7f56a6ffd640 1 -- 172.21.15.59:0/2158810255 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f56a8160730 msgr2=0x7f56a80c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.249+0000 7f56a6ffd640 1 --2- 172.21.15.59:0/2158810255 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f56a8160730 0x7f56a80c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.249+0000 7f56a6ffd640 1 -- 172.21.15.59:0/2158810255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a80b47a0 msgr2=0x7f56a80ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.249+0000 7f56a6ffd640 1 --2- 172.21.15.59:0/2158810255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a80b47a0 0x7f56a80ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.249+0000 7f56a6ffd640 1 -- 172.21.15.59:0/2158810255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a80ca7e0 con 0x7f56a80ce8e0 2024-04-25T15:47:02.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.252+0000 7f56a6ffd640 1 --2- 172.21.15.59:0/2158810255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56a80ce8e0 0x7f56a80ad340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f569c0098c0 tx=0x7f569c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:02.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.256+0000 7f568ffff640 1 -- 172.21.15.59:0/2158810255 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c042020 con 0x7f56a80ce8e0 2024-04-25T15:47:02.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.256+0000 7f568ffff640 1 -- 172.21.15.59:0/2158810255 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f569c03d470 con 0x7f56a80ce8e0 2024-04-25T15:47:02.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.256+0000 7f568ffff640 1 -- 172.21.15.59:0/2158810255 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c037040 con 0x7f56a80ce8e0 2024-04-25T15:47:02.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.256+0000 7f56adbf3640 1 -- 172.21.15.59:0/2158810255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56a80caac0 con 0x7f56a80ce8e0 2024-04-25T15:47:02.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.256+0000 7f56adbf3640 1 -- 172.21.15.59:0/2158810255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56a80cb0f0 con 0x7f56a80ce8e0 2024-04-25T15:47:02.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.259+0000 7f56b4b7e740 1 Processor -- start 2024-04-25T15:47:02.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.259+0000 7f56b4b7e740 1 -- start start 2024-04-25T15:47:02.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.261+0000 7f56b4b7e740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae5629270 0x555ae59cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.261+0000 7f56b4b7e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ae56003b0 0x555ae59c5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.261+0000 7f56b4b7e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5608590 0x555ae59c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.261+0000 7f56b4b7e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555ae592f740 con 0x555ae5608590 2024-04-25T15:47:02.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.261+0000 7f56b4b7e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555ae58cb3a0 con 0x555ae56003b0 2024-04-25T15:47:02.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.261+0000 7f56b4b7e740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x555ae592b700 con 0x555ae5629270 2024-04-25T15:47:02.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.261+0000 7f56a6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5608590 0x555ae59c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.261+0000 7f56a7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae5629270 0x555ae59cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.262+0000 7f56a6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5608590 0x555ae59c5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40124/0 (socket says 172.21.15.59:40124) 2024-04-25T15:47:02.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.262+0000 7f56a7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae5629270 0x555ae59cb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:45610/0 (socket says 172.21.15.59:45610) 2024-04-25T15:47:02.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.262+0000 7f56a6ffd640 1 -- 172.21.15.59:0/2138683741 learned_addr learned my addr 172.21.15.59:0/2138683741 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:47:02.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.264+0000 7f56a6ffd640 1 -- 172.21.15.59:0/2138683741 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae5629270 msgr2=0x555ae59cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:02.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.264+0000 7f56a6ffd640 1 --2- 172.21.15.59:0/2138683741 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae5629270 0x555ae59cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.264+0000 7f56a6ffd640 1 -- 172.21.15.59:0/2138683741 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ae56003b0 msgr2=0x555ae59c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:02.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.264+0000 7f56a6ffd640 1 --2- 172.21.15.59:0/2138683741 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ae56003b0 0x555ae59c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.264+0000 7f56a6ffd640 1 -- 172.21.15.59:0/2138683741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ae58e7750 con 0x555ae5608590 2024-04-25T15:47:02.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.264+0000 7f56a7fff640 1 --2- 172.21.15.59:0/2138683741 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae5629270 0x555ae59cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:47:02.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.266+0000 7f56a6ffd640 1 --2- 172.21.15.59:0/2138683741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5608590 0x555ae59c5dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f569c009890 tx=0x7f569c03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44dcb005d5deff52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:02.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.270+0000 7f568d7fa640 1 -- 172.21.15.59:0/2138683741 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c03e830 con 0x555ae5608590 2024-04-25T15:47:02.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.270+0000 7f568d7fa640 1 -- 172.21.15.59:0/2138683741 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f569c054070 con 0x555ae5608590 2024-04-25T15:47:02.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.270+0000 7f568d7fa640 1 -- 172.21.15.59:0/2138683741 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c03ebd0 con 0x555ae5608590 2024-04-25T15:47:02.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.271+0000 7f56b4b7e740 1 -- 172.21.15.59:0/2138683741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5608590 msgr2=0x555ae59c5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:02.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.271+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/2138683741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5608590 0x555ae59c5dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f569c009890 tx=0x7f569c03e000 comp rx=0 tx=0).stop 2024-04-25T15:47:02.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.271+0000 7f56b4b7e740 1 -- 172.21.15.59:0/2138683741 shutdown_connections 2024-04-25T15:47:02.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.271+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/2138683741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5608590 0x555ae59c5dc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.271+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/2138683741 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ae56003b0 0x555ae59c5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.271+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/2138683741 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae5629270 0x555ae59cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.271+0000 7f56b4b7e740 1 -- 172.21.15.59:0/2138683741 >> 172.21.15.59:0/2138683741 conn(0x555ae561d3c0 msgr2=0x555ae59c9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.271+0000 7f56b4b7e740 1 -- 172.21.15.59:0/2138683741 shutdown_connections 2024-04-25T15:47:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.271+0000 7f56b4b7e740 1 -- 172.21.15.59:0/2138683741 wait complete. 2024-04-25T15:47:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.273+0000 7f56b4b7e740 1 -- start start 2024-04-25T15:47:02.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.273+0000 7f56b4b7e740 1 Processor -- start 2024-04-25T15:47:02.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.274+0000 7f56b4b7e740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae56003b0 0x555ae5a0b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.274+0000 7f56b4b7e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ae5608590 0x555ae59e6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.274+0000 7f56b4b7e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5629270 0x555ae59e7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.274+0000 7f56b4b7e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555ae5a09d00 con 0x555ae5629270 2024-04-25T15:47:02.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.274+0000 7f56b4b7e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555ae58b6fe0 con 0x555ae5608590 2024-04-25T15:47:02.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.274+0000 7f56b4b7e740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x555ae59c9be0 con 0x555ae56003b0 2024-04-25T15:47:02.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.274+0000 7f56b4b7e740 10 client.0 _ll_register_callbacks cb 0x555ae58cd150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:47:02.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.274+0000 7f56a7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae56003b0 0x555ae5a0b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.274+0000 7f56a6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5629270 0x555ae59e7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.275+0000 7f56a7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae56003b0 0x555ae5a0b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:45612/0 (socket says 172.21.15.59:45612) 2024-04-25T15:47:02.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.275+0000 7f56a7fff640 1 -- 172.21.15.59:0/4085258523 learned_addr learned my addr 172.21.15.59:0/4085258523 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:47:02.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.278+0000 7f56a7fff640 1 -- 172.21.15.59:0/4085258523 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ae5608590 msgr2=0x555ae59e6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:02.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.278+0000 7f56a7fff640 1 --2- 172.21.15.59:0/4085258523 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ae5608590 0x555ae59e6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.278+0000 7f56a7fff640 1 -- 172.21.15.59:0/4085258523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5629270 msgr2=0x555ae59e7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:02.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.278+0000 7f56a7fff640 1 --2- 172.21.15.59:0/4085258523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5629270 0x555ae59e7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:02.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.278+0000 7f56a7fff640 1 -- 172.21.15.59:0/4085258523 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x555ae56412d0 con 0x555ae56003b0 2024-04-25T15:47:02.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.278+0000 7f56a6ffd640 1 --2- 172.21.15.59:0/4085258523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5629270 0x555ae59e7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:47:02.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.281+0000 7f56a7fff640 1 --2- 172.21.15.59:0/4085258523 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae56003b0 0x555ae5a0b2d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f56a000baf0 tx=0x7f56a000a3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c445a490df5add15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:02.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.281+0000 7f56867fc640 10 client.0 ms_handle_connect on v2:172.21.15.64:3301/0 2024-04-25T15:47:02.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.286+0000 7f56867fc640 1 -- 172.21.15.59:0/4085258523 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a001a030 con 0x555ae56003b0 2024-04-25T15:47:02.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.286+0000 7f56867fc640 1 -- 172.21.15.59:0/4085258523 <== mon.2 v2:172.21.15.64:3301/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f56a0003970 con 0x555ae56003b0 2024-04-25T15:47:02.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.286+0000 7f56b4b7e740 1 -- 172.21.15.59:0/4085258523 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f569c054070 con 0x555ae56003b0 2024-04-25T15:47:02.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.288+0000 7f56867fc640 1 -- 172.21.15.59:0/4085258523 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f56a0023050 con 0x555ae56003b0 2024-04-25T15:47:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.288+0000 7f568ffff640 1 -- 172.21.15.59:0/2158810255 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f569c045020 con 0x7f56a80ce8e0 2024-04-25T15:47:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.288+0000 7f56b4b7e740 10 client.4481 fetch_fsmap learned FSMap version 13 2024-04-25T15:47:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.288+0000 7f56b4b7e740 1 -- 172.21.15.59:0/4085258523 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x555ae570b6b0 con 0x555ae56003b0 2024-04-25T15:47:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.288+0000 7f568ffff640 1 --2- 172.21.15.59:0/2158810255 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5694074460 0x7f5694076970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.288+0000 7f568ffff640 1 -- 172.21.15.59:0/2158810255 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f569c0b7b30 con 0x7f56a80ce8e0 2024-04-25T15:47:02.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.288+0000 7f56a77fe640 1 --2- 172.21.15.59:0/2158810255 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5694074460 0x7f5694076970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:02.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.289+0000 7f56a77fe640 1 --2- 172.21.15.59:0/2158810255 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5694074460 0x7f5694076970 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x555ae5a090b0 tx=0x7f5698009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.293+0000 7f56867fc640 1 -- 172.21.15.59:0/4085258523 <== mon.2 v2:172.21.15.64:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f569c054070 con 0x555ae56003b0 2024-04-25T15:47:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.293+0000 7f56867fc640 1 -- 172.21.15.59:0/4085258523 <== mon.2 v2:172.21.15.64:3301/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7f56a0026020 con 0x555ae56003b0 2024-04-25T15:47:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.293+0000 7f56b4b7e740 10 client.4481 fetch_fsmap finished waiting for FSMap version 13 2024-04-25T15:47:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.293+0000 7f56b4b7e740 10 client.4481 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T15:47:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.293+0000 7f56b4b7e740 20 client.4481 populate_metadata read hostname 'smithi059' 2024-04-25T15:47:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.293+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/4085258523 >> [v2:172.21.15.64:6836/2368752795,v1:172.21.15.64:6837/2368752795] conn(0x555ae55e7e40 0x555ae5a2a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.293+0000 7f56b4b7e740 4 client.4481 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:47:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.293+0000 7f56b4b7e740 1 -- 172.21.15.59:0/4085258523 --> [v2:172.21.15.64:6836/2368752795,v1:172.21.15.64:6837/2368752795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ae593d350 con 0x555ae55e7e40 2024-04-25T15:47:02.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:02.871+0000 7f56a6ffd640 1 --2- 172.21.15.59:0/4085258523 >> [v2:172.21.15.64:6836/2368752795,v1:172.21.15.64:6837/2368752795] conn(0x555ae55e7e40 0x555ae5a2a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:03.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:03.969+0000 7f56a6ffd640 1 --2- 172.21.15.59:0/4085258523 >> [v2:172.21.15.64:6836/2368752795,v1:172.21.15.64:6837/2368752795] conn(0x555ae55e7e40 0x555ae5a2a1f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf9be963ab8274a4 server_cookie=b7652a3c47ddf44c in_seq=0 out_seq=0 2024-04-25T15:47:03.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:03.969+0000 7f56867fc640 10 client.4481 ms_handle_connect on v2:172.21.15.64:6836/2368752795 2024-04-25T15:47:08.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.201+0000 7f56867fc640 1 -- 172.21.15.59:0/4085258523 <== mds.0 v2:172.21.15.64:6836/2368752795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555ae593d350 con 0x555ae55e7e40 2024-04-25T15:47:08.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.201+0000 7f56867fc640 10 client.4481 handle_command_reply: tid=0 2024-04-25T15:47:08.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.201+0000 7f56b4b7e740 1 client.4481 shutdown 2024-04-25T15:47:08.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.201+0000 7f56b4b7e740 1 -- 172.21.15.59:0/4085258523 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae56003b0 msgr2=0x555ae5a0b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.201+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/4085258523 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae56003b0 0x555ae5a0b2d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f56a000baf0 tx=0x7f56a000a3e0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.201+0000 7f56b4b7e740 1 -- 172.21.15.59:0/4085258523 shutdown_connections 2024-04-25T15:47:08.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.201+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/4085258523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5629270 0x555ae59e7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.201+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/4085258523 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ae5608590 0x555ae59e6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.201+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/4085258523 >> [v2:172.21.15.64:6836/2368752795,v1:172.21.15.64:6837/2368752795] conn(0x555ae55e7e40 0x555ae5a2a1f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.201+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/4085258523 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae56003b0 0x555ae5a0b2d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.201+0000 7f56867fc640 0 client.4481 ms_handle_reset on v2:172.21.15.64:6836/2368752795 2024-04-25T15:47:08.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.201+0000 7f56b4b7e740 1 -- 172.21.15.59:0/4085258523 >> 172.21.15.59:0/4085258523 conn(0x555ae561d3c0 msgr2=0x555ae59c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:08.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.201+0000 7f56b4b7e740 1 -- 172.21.15.59:0/4085258523 shutdown_connections 2024-04-25T15:47:08.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.201+0000 7f56b4b7e740 1 -- 172.21.15.59:0/4085258523 wait complete. 2024-04-25T15:47:08.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.202+0000 7f56b4b7e740 20 client.4481 trim_cache size 0 max 16384 2024-04-25T15:47:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.221+0000 7f56b4b7e740 1 Processor -- start 2024-04-25T15:47:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.221+0000 7f56b4b7e740 1 -- start start 2024-04-25T15:47:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.222+0000 7f56b4b7e740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae56003b0 0x555ae5a1bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.222+0000 7f56b4b7e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ae5608590 0x555ae59cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.222+0000 7f56b4b7e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5629270 0x555ae59cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.222+0000 7f56b4b7e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f56a81f2c70 con 0x555ae5629270 2024-04-25T15:47:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.222+0000 7f56b4b7e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555ae59ebed0 con 0x555ae5608590 2024-04-25T15:47:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.222+0000 7f56b4b7e740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x555ae5a1ba50 con 0x555ae56003b0 2024-04-25T15:47:08.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.223+0000 7f56a77fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae56003b0 0x555ae5a1bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.223+0000 7f56a7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5629270 0x555ae59cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.223+0000 7f56a6ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ae5608590 0x555ae59cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.223+0000 7f56a77fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae56003b0 0x555ae5a1bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:49298/0 (socket says 172.21.15.59:49298) 2024-04-25T15:47:08.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.223+0000 7f56a77fe640 1 -- 172.21.15.59:0/3334589346 learned_addr learned my addr 172.21.15.59:0/3334589346 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:47:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.226+0000 7f56a7fff640 1 -- 172.21.15.59:0/3334589346 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae56003b0 msgr2=0x555ae5a1bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.226+0000 7f56a7fff640 1 --2- 172.21.15.59:0/3334589346 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae56003b0 0x555ae5a1bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.226+0000 7f56a7fff640 1 -- 172.21.15.59:0/3334589346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ae5608590 msgr2=0x555ae59cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.226+0000 7f56a7fff640 1 --2- 172.21.15.59:0/3334589346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ae5608590 0x555ae59cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.226+0000 7f56a7fff640 1 -- 172.21.15.59:0/3334589346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ae5a0b7d0 con 0x555ae5629270 2024-04-25T15:47:08.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.228+0000 7f56a7fff640 1 --2- 172.21.15.59:0/3334589346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5629270 0x555ae59cb670 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f56a000baf0 tx=0x7f56a0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450aa287e63f9f15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.232+0000 7f568cff9640 1 -- 172.21.15.59:0/3334589346 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a002b070 con 0x555ae5629270 2024-04-25T15:47:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.233+0000 7f568cff9640 1 -- 172.21.15.59:0/3334589346 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a0003c40 con 0x555ae5629270 2024-04-25T15:47:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.233+0000 7f568cff9640 1 -- 172.21.15.59:0/3334589346 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a001a070 con 0x555ae5629270 2024-04-25T15:47:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.233+0000 7f56b4b7e740 1 -- 172.21.15.59:0/3334589346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5629270 msgr2=0x555ae59cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.233+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/3334589346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5629270 0x555ae59cb670 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f56a000baf0 tx=0x7f56a0015000 comp rx=0 tx=0).stop 2024-04-25T15:47:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.234+0000 7f56b4b7e740 1 -- 172.21.15.59:0/3334589346 shutdown_connections 2024-04-25T15:47:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.234+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/3334589346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae5629270 0x555ae59cb670 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.234+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/3334589346 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ae5608590 0x555ae59cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.234+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/3334589346 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae56003b0 0x555ae5a1bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.234+0000 7f56b4b7e740 1 -- 172.21.15.59:0/3334589346 >> 172.21.15.59:0/3334589346 conn(0x555ae561d3c0 msgr2=0x555ae59c7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.234+0000 7f56b4b7e740 1 -- 172.21.15.59:0/3334589346 shutdown_connections 2024-04-25T15:47:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.234+0000 7f56b4b7e740 1 -- 172.21.15.59:0/3334589346 wait complete. 2024-04-25T15:47:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.234+0000 7f56b4b7e740 1 -- start start 2024-04-25T15:47:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.235+0000 7f56b4b7e740 1 Processor -- start 2024-04-25T15:47:08.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.236+0000 7f56b4b7e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae56003b0 0x555ae59cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.236+0000 7f56b4b7e740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ae5608590 0x555ae59e3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.236+0000 7f56b4b7e740 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae5629270 0x555ae5a83b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.236+0000 7f56b4b7e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555ae5a0c5f0 con 0x555ae56003b0 2024-04-25T15:47:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.236+0000 7f56b4b7e740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x555ae5a1b640 con 0x555ae5608590 2024-04-25T15:47:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.236+0000 7f56b4b7e740 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x555ae5a1ec00 con 0x555ae5629270 2024-04-25T15:47:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.236+0000 7f56b4b7e740 10 client.0 _ll_register_callbacks cb 0x7f56a0009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:47:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.236+0000 7f56a77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae56003b0 0x555ae59cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.236+0000 7f56a7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae5629270 0x555ae5a83b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.237+0000 7f56a6ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ae5608590 0x555ae59e3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.237+0000 7f56a7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae5629270 0x555ae5a83b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:49308/0 (socket says 172.21.15.59:49308) 2024-04-25T15:47:08.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.237+0000 7f56a7fff640 1 -- 172.21.15.59:0/2325230836 learned_addr learned my addr 172.21.15.59:0/2325230836 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:47:08.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.240+0000 7f56a77fe640 1 -- 172.21.15.59:0/2325230836 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae5629270 msgr2=0x555ae5a83b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:08.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.240+0000 7f56a77fe640 1 --2- 172.21.15.59:0/2325230836 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae5629270 0x555ae5a83b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.240+0000 7f56a77fe640 1 -- 172.21.15.59:0/2325230836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ae5608590 msgr2=0x555ae59e3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:08.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.240+0000 7f56a77fe640 1 --2- 172.21.15.59:0/2325230836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ae5608590 0x555ae59e3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:08.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.240+0000 7f56a77fe640 1 -- 172.21.15.59:0/2325230836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ae5a1e9e0 con 0x555ae56003b0 2024-04-25T15:47:08.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.243+0000 7f56a77fe640 1 --2- 172.21.15.59:0/2325230836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae56003b0 0x555ae59cb530 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5698005880 tx=0x7f5698000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fd4ffe432ad4fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:08.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.243+0000 7f56867fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T15:47:08.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.246+0000 7f56867fc640 1 -- 172.21.15.59:0/2325230836 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5698025020 con 0x555ae56003b0 2024-04-25T15:47:08.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.247+0000 7f56867fc640 1 -- 172.21.15.59:0/2325230836 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f5698021400 con 0x555ae56003b0 2024-04-25T15:47:08.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.247+0000 7f56b4b7e740 1 -- 172.21.15.59:0/2325230836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56a0003c40 con 0x555ae56003b0 2024-04-25T15:47:08.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.248+0000 7f56867fc640 1 -- 172.21.15.59:0/2325230836 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f569802f050 con 0x555ae56003b0 2024-04-25T15:47:08.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.248+0000 7f56b4b7e740 10 client.4596 fetch_fsmap learned FSMap version 13 2024-04-25T15:47:08.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.248+0000 7f56b4b7e740 1 -- 172.21.15.59:0/2325230836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x555ae5a8a040 con 0x555ae56003b0 2024-04-25T15:47:08.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.253+0000 7f56867fc640 1 -- 172.21.15.59:0/2325230836 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a0003c40 con 0x555ae56003b0 2024-04-25T15:47:08.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.253+0000 7f56867fc640 1 -- 172.21.15.59:0/2325230836 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7f5698032020 con 0x555ae56003b0 2024-04-25T15:47:08.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.253+0000 7f56b4b7e740 10 client.4596 fetch_fsmap finished waiting for FSMap version 13 2024-04-25T15:47:08.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.253+0000 7f56b4b7e740 10 client.4596 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T15:47:08.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.253+0000 7f56b4b7e740 20 client.4596 populate_metadata read hostname 'smithi059' 2024-04-25T15:47:08.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.253+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/2325230836 >> [v2:172.21.15.64:6836/2368752795,v1:172.21.15.64:6837/2368752795] conn(0x555ae5a18b00 0x555ae5a96660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:08.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.253+0000 7f56b4b7e740 4 client.4596 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T15:47:08.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:08.253+0000 7f56b4b7e740 1 -- 172.21.15.59:0/2325230836 --> [v2:172.21.15.64:6836/2368752795,v1:172.21.15.64:6837/2368752795] -- command(tid 0: {"prefix": "status"}) -- 0x555ae59371c0 con 0x555ae5a18b00 2024-04-25T15:47:09.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:09.214+0000 7f56a6ffd640 1 --2- 172.21.15.59:0/2325230836 >> [v2:172.21.15.64:6836/2368752795,v1:172.21.15.64:6837/2368752795] conn(0x555ae5a18b00 0x555ae5a96660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:11.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:11.234+0000 7f56a6ffd640 1 --2- 172.21.15.59:0/2325230836 >> [v2:172.21.15.64:6836/2368752795,v1:172.21.15.64:6837/2368752795] conn(0x555ae5a18b00 0x555ae5a96660 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9793d84e786f1937 server_cookie=1bd2b0a65b4ca1d2 in_seq=0 out_seq=0 2024-04-25T15:47:11.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:11.234+0000 7f56867fc640 10 client.4596 ms_handle_connect on v2:172.21.15.64:6836/2368752795 2024-04-25T15:47:11.239 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:47:11.241 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:47:16.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.308+0000 7f56867fc640 1 -- 172.21.15.59:0/2325230836 <== mds.0 v2:172.21.15.64:6836/2368752795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x555ae59371c0 con 0x555ae5a18b00 2024-04-25T15:47:16.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.308+0000 7f56867fc640 10 client.4596 handle_command_reply: tid=0 2024-04-25T15:47:16.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.308+0000 7f56b4b7e740 1 client.4596 shutdown 2024-04-25T15:47:16.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.308+0000 7f56b4b7e740 1 -- 172.21.15.59:0/2325230836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae56003b0 msgr2=0x555ae59cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:16.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.308+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/2325230836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae56003b0 0x555ae59cb530 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5698005880 tx=0x7f5698000bc0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.308+0000 7f56b4b7e740 1 -- 172.21.15.59:0/2325230836 shutdown_connections 2024-04-25T15:47:16.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.308+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/2325230836 >> [v2:172.21.15.64:6836/2368752795,v1:172.21.15.64:6837/2368752795] conn(0x555ae5a18b00 0x555ae5a96660 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.308+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/2325230836 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x555ae5629270 0x555ae5a83b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.308+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/2325230836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x555ae5608590 0x555ae59e3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.308+0000 7f56b4b7e740 1 --2- 172.21.15.59:0/2325230836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555ae56003b0 0x555ae59cb530 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.308+0000 7f56867fc640 0 client.4596 ms_handle_reset on v2:172.21.15.64:6836/2368752795 2024-04-25T15:47:16.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.308+0000 7f56b4b7e740 1 -- 172.21.15.59:0/2325230836 >> 172.21.15.59:0/2325230836 conn(0x555ae561d3c0 msgr2=0x555ae5a1bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:16.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.308+0000 7f56b4b7e740 1 -- 172.21.15.59:0/2325230836 shutdown_connections 2024-04-25T15:47:16.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.308+0000 7f56b4b7e740 1 -- 172.21.15.59:0/2325230836 wait complete. 2024-04-25T15:47:16.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.309+0000 7f56b4b7e740 20 client.4596 trim_cache size 0 max 16384 2024-04-25T15:47:16.311 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T15:47:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "9bb5d7ca-5217-467b-882c-0a18cd57f08f", 2024-04-25T15:47:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-04-25T15:47:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4284, 2024-04-25T15:47:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-04-25T15:47:16.311 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-04-25T15:47:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-04-25T15:47:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 42.960002947, 2024-04-25T15:47:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 13, 2024-04-25T15:47:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 24, 2024-04-25T15:47:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 22, 2024-04-25T15:47:16.312 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 51.541556454000002 2024-04-25T15:47:16.312 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T15:47:16.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.309+0000 7f56adbf3640 1 -- 172.21.15.59:0/2158810255 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5694074460 msgr2=0x7f5694076970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:16.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.309+0000 7f56adbf3640 1 --2- 172.21.15.59:0/2158810255 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5694074460 0x7f5694076970 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x555ae5a090b0 tx=0x7f5698009040 comp rx=0 tx=0).stop 2024-04-25T15:47:16.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.309+0000 7f56adbf3640 1 -- 172.21.15.59:0/2158810255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56a80ce8e0 msgr2=0x7f56a80ad340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:16.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.309+0000 7f56adbf3640 1 --2- 172.21.15.59:0/2158810255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56a80ce8e0 0x7f56a80ad340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f569c0098c0 tx=0x7f569c0046c0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.309+0000 7f56adbf3640 1 -- 172.21.15.59:0/2158810255 shutdown_connections 2024-04-25T15:47:16.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.309+0000 7f56adbf3640 1 --2- 172.21.15.59:0/2158810255 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5694074460 0x7f5694076970 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.309+0000 7f56adbf3640 1 --2- 172.21.15.59:0/2158810255 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f56a8160730 0x7f56a80c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.309+0000 7f56adbf3640 1 --2- 172.21.15.59:0/2158810255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f56a80ce8e0 0x7f56a80ad340 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.309+0000 7f56adbf3640 1 --2- 172.21.15.59:0/2158810255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a80b47a0 0x7f56a80ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.309+0000 7f56adbf3640 1 -- 172.21.15.59:0/2158810255 >> 172.21.15.59:0/2158810255 conn(0x7f56a80684e0 msgr2=0x7f56a815a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.310+0000 7f56adbf3640 1 -- 172.21.15.59:0/2158810255 shutdown_connections 2024-04-25T15:47:16.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.310+0000 7f56adbf3640 1 -- 172.21.15.59:0/2158810255 wait complete. 2024-04-25T15:47:16.326 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T15:47:16.337 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T15:47:16.337 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T15:47:16.338 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T15:47:16.338 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T15:47:16.367 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T15:47:16.367 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-25T15:47:16.367 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-04-25T15:47:16.368 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T15:47:16.368 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:16.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:16.368 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T15:47:16.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:16.390 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2024-04-25T15:47:16.456 INFO:teuthology.orchestra.run.smithi059.stderr:Cannot find device "ceph-brx" 2024-04-25T15:47:16.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:47:16.457 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T15:47:16.458 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T15:47:16.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.612+0000 7fbed7c51640 1 Processor -- start 2024-04-25T15:47:16.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.613+0000 7fbed7c51640 1 -- start start 2024-04-25T15:47:16.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.614+0000 7fbed7c51640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbed015c1b0 0x7fbed015c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:16.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.614+0000 7fbed7c51640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbed00ce540 0x7fbed00ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:16.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.614+0000 7fbed7c51640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbed015cd60 con 0x7fbed00b41c0 2024-04-25T15:47:16.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.614+0000 7fbed7c51640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbed015cb00 con 0x7fbed015c1b0 2024-04-25T15:47:16.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.614+0000 7fbed7c51640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fbed015d040 con 0x7fbed00ce540 2024-04-25T15:47:16.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.654+0000 7fbed51ec640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbed015c1b0 0x7fbed015c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:16.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.655+0000 7fbed51ec640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbed015c1b0 0x7fbed015c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59474/0 (socket says 172.21.15.59:59474) 2024-04-25T15:47:16.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.655+0000 7fbed51ec640 1 -- 172.21.15.59:0/1859492338 learned_addr learned my addr 172.21.15.59:0/1859492338 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:47:16.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.656+0000 7fbed61ee640 1 --2- 172.21.15.59:0/1859492338 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbed00ce540 0x7fbed00ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:16.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.658+0000 7fbed51ec640 1 -- 172.21.15.59:0/1859492338 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbed00ce540 msgr2=0x7fbed00ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:16.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.658+0000 7fbed51ec640 1 --2- 172.21.15.59:0/1859492338 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbed00ce540 0x7fbed00ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.658+0000 7fbed51ec640 1 -- 172.21.15.59:0/1859492338 >> v1:172.21.15.64:6789/0 conn(0x7fbed00b41c0 legacy=0x7fbed00cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:47:16.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.658+0000 7fbed51ec640 1 -- 172.21.15.59:0/1859492338 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed015d320 con 0x7fbed015c1b0 2024-04-25T15:47:16.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.660+0000 7fbed51ec640 1 --2- 172.21.15.59:0/1859492338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbed015c1b0 0x7fbed015c5c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbec0009870 tx=0x7fbec002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af733664ac2ac71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:16.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.664+0000 7fbed49eb640 1 -- 172.21.15.59:0/1859492338 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec0037070 con 0x7fbed015c1b0 2024-04-25T15:47:16.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.664+0000 7fbed49eb640 1 -- 172.21.15.59:0/1859492338 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec0032440 con 0x7fbed015c1b0 2024-04-25T15:47:16.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.664+0000 7fbed49eb640 1 -- 172.21.15.59:0/1859492338 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec0032810 con 0x7fbed015c1b0 2024-04-25T15:47:16.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.664+0000 7fbed7c51640 1 -- 172.21.15.59:0/1859492338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbed015c1b0 msgr2=0x7fbed015c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:16.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.664+0000 7fbed7c51640 1 --2- 172.21.15.59:0/1859492338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbed015c1b0 0x7fbed015c5c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbec0009870 tx=0x7fbec002a210 comp rx=0 tx=0).stop 2024-04-25T15:47:16.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.665+0000 7fbed7c51640 1 -- 172.21.15.59:0/1859492338 shutdown_connections 2024-04-25T15:47:16.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.665+0000 7fbed7c51640 1 --2- 172.21.15.59:0/1859492338 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbed00ce540 0x7fbed00ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.665+0000 7fbed7c51640 1 --2- 172.21.15.59:0/1859492338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbed015c1b0 0x7fbed015c5c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.665+0000 7fbed7c51640 1 -- 172.21.15.59:0/1859492338 >> 172.21.15.59:0/1859492338 conn(0x7fbed006ed70 msgr2=0x7fbed006f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:16.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.665+0000 7fbed7c51640 1 -- 172.21.15.59:0/1859492338 shutdown_connections 2024-04-25T15:47:16.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.665+0000 7fbed7c51640 1 -- 172.21.15.59:0/1859492338 wait complete. 2024-04-25T15:47:16.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.667+0000 7fbed7c51640 1 Processor -- start 2024-04-25T15:47:16.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.667+0000 7fbed7c51640 1 -- start start 2024-04-25T15:47:16.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.668+0000 7fbed7c51640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbed00b41c0 0x7fbed01539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:16.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.668+0000 7fbed7c51640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbed00ce540 0x7fbed01f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:16.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.668+0000 7fbed7c51640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbed015c1b0 0x7fbed0158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:16.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.668+0000 7fbed7c51640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbed00b78a0 con 0x7fbed00b41c0 2024-04-25T15:47:16.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.668+0000 7fbed7c51640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbed00ce020 con 0x7fbed015c1b0 2024-04-25T15:47:16.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.668+0000 7fbed7c51640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fbed00cee90 con 0x7fbed00ce540 2024-04-25T15:47:16.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.669+0000 7fbed51ec640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbed00ce540 0x7fbed01f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:16.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.669+0000 7fbed51ec640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbed00ce540 0x7fbed01f37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:39588/0 (socket says 172.21.15.59:39588) 2024-04-25T15:47:16.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.669+0000 7fbed51ec640 1 -- 172.21.15.59:0/377924820 learned_addr learned my addr 172.21.15.59:0/377924820 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T15:47:16.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.671+0000 7fbed61ee640 1 --2- 172.21.15.59:0/377924820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbed015c1b0 0x7fbed0158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:16.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.674+0000 7fbed59ed640 1 --2- 172.21.15.59:0/377924820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbed00b41c0 0x7fbed01539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:16.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.675+0000 7fbed51ec640 1 -- 172.21.15.59:0/377924820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbed015c1b0 msgr2=0x7fbed0158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:16.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.675+0000 7fbed51ec640 1 --2- 172.21.15.59:0/377924820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbed015c1b0 0x7fbed0158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.675+0000 7fbed51ec640 1 -- 172.21.15.59:0/377924820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbed00b41c0 msgr2=0x7fbed01539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:16.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.675+0000 7fbed51ec640 1 --2- 172.21.15.59:0/377924820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbed00b41c0 0x7fbed01539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:16.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.675+0000 7fbed51ec640 1 -- 172.21.15.59:0/377924820 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed01e8500 con 0x7fbed00ce540 2024-04-25T15:47:16.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.679+0000 7fbed51ec640 1 --2- 172.21.15.59:0/377924820 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbed00ce540 0x7fbed01f37f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbec0000c00 tx=0x7fbec00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.686+0000 7fbec67fc640 1 -- 172.21.15.59:0/377924820 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec0041070 con 0x7fbed00ce540 2024-04-25T15:47:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.686+0000 7fbec67fc640 1 -- 172.21.15.59:0/377924820 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec003c870 con 0x7fbed00ce540 2024-04-25T15:47:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.686+0000 7fbec67fc640 1 -- 172.21.15.59:0/377924820 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec0037040 con 0x7fbed00ce540 2024-04-25T15:47:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.686+0000 7fbed7c51640 1 -- 172.21.15.59:0/377924820 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed01e8aa0 con 0x7fbed00ce540 2024-04-25T15:47:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.686+0000 7fbed7c51640 1 -- 172.21.15.59:0/377924820 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed01f2ff0 con 0x7fbed00ce540 2024-04-25T15:47:16.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.687+0000 7fbed7c51640 1 -- 172.21.15.59:0/377924820 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed00698a0 con 0x7fbed00ce540 2024-04-25T15:47:16.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.992+0000 7fbec67fc640 1 -- 172.21.15.59:0/377924820 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbec0044070 con 0x7fbed00ce540 2024-04-25T15:47:16.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.993+0000 7fbec67fc640 1 --2- 172.21.15.59:0/377924820 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbeb4074500 0x7fbeb4076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:47:16.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.993+0000 7fbed59ed640 1 --2- 172.21.15.59:0/377924820 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbeb4074500 0x7fbeb4076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:47:16.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.994+0000 7fbed59ed640 1 --2- 172.21.15.59:0/377924820 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbeb4074500 0x7fbeb4076a10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00a730 tx=0x7fbecc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:47:16.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:16.997+0000 7fbec67fc640 1 -- 172.21.15.59:0/377924820 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fbec007c850 con 0x7fbed00ce540 2024-04-25T15:47:17.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17.010+0000 7fbec67fc640 1 -- 172.21.15.59:0/377924820 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbec00805c0 con 0x7fbed00ce540 2024-04-25T15:47:17.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17.233+0000 7fbed7c51640 1 -- 172.21.15.59:0/377924820 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbed00b6240 con 0x7fbed00ce540 2024-04-25T15:47:17.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17.240+0000 7fbec67fc640 1 -- 172.21.15.59:0/377924820 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+73 (secure 0 0 0) 0x7fbec00848c0 con 0x7fbed00ce540 2024-04-25T15:47:17.241 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T15:47:17.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17.242+0000 7fbed7c51640 1 -- 172.21.15.59:0/377924820 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbeb4074500 msgr2=0x7fbeb4076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:17.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17.242+0000 7fbed7c51640 1 --2- 172.21.15.59:0/377924820 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbeb4074500 0x7fbeb4076a10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00a730 tx=0x7fbecc008040 comp rx=0 tx=0).stop 2024-04-25T15:47:17.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17.242+0000 7fbed7c51640 1 -- 172.21.15.59:0/377924820 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbed00ce540 msgr2=0x7fbed01f37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:47:17.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17.242+0000 7fbed7c51640 1 --2- 172.21.15.59:0/377924820 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbed00ce540 0x7fbed01f37f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbec0000c00 tx=0x7fbec00046c0 comp rx=0 tx=0).stop 2024-04-25T15:47:17.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17.242+0000 7fbed7c51640 1 -- 172.21.15.59:0/377924820 shutdown_connections 2024-04-25T15:47:17.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17.242+0000 7fbed7c51640 1 --2- 172.21.15.59:0/377924820 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbeb4074500 0x7fbeb4076a10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:17.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17.242+0000 7fbed7c51640 1 --2- 172.21.15.59:0/377924820 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbed015c1b0 0x7fbed0158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:17.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17.242+0000 7fbed7c51640 1 --2- 172.21.15.59:0/377924820 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbed00ce540 0x7fbed01f37f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:17.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17.242+0000 7fbed7c51640 1 --2- 172.21.15.59:0/377924820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbed00b41c0 0x7fbed01539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:47:17.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17.242+0000 7fbed7c51640 1 -- 172.21.15.59:0/377924820 >> 172.21.15.59:0/377924820 conn(0x7fbed006ed70 msgr2=0x7fbed015a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:47:17.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17.242+0000 7fbed7c51640 1 -- 172.21.15.59:0/377924820 shutdown_connections 2024-04-25T15:47:17.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17.242+0000 7fbed7c51640 1 -- 172.21.15.59:0/377924820 wait complete. 2024-04-25T15:47:17.255 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T15:47:17.255 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T15:47:17.255 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T15:47:17.255 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T15:47:17.255 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:17.255 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T15:47:17.255 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T15:47:17.255 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T15:47:17.255 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:47:17.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:17.255 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T15:47:17.271 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T15:47:17.271 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T15:47:17.271 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T15:47:17.271 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:17.271 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T15:47:17.271 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:17.271 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:47:17.272 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:17.272 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T15:47:17.272 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:47:17.272 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:17.272 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T15:47:17.272 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T15:47:17.272 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:17.272 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T15:47:17.272 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T15:47:17.272 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42235sec preferred_lft 42235sec 2024-04-25T15:47:17.272 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link noprefixroute 2024-04-25T15:47:17.272 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T15:47:17.272 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T15:47:17.272 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T15:47:17.273 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T15:47:17.273 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T15:47:17.273 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:47:17.273 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T15:47:17.273 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add name ceph-brx type bridge 2024-04-25T15:47:17.273 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr flush dev ceph-brx 2024-04-25T15:47:17.273 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set ceph-brx up 2024-04-25T15:47:17.273 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T15:47:17.274 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T15:47:17.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:47:17.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:47:17.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:17.470 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T15:47:17.494 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T15:47:17.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:17.496 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T15:47:17.563 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T15:47:17.564 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T15:47:17.564 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T15:47:17.564 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T15:47:17.564 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T15:47:17.564 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:47:17.564 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T15:47:17.565 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T15:47:17.565 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T15:47:17.565 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T15:47:17.565 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T15:47:17.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:47:17.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:47:17.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:17.830 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T15:47:17.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:17.845 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list-id 2024-04-25T15:47:17.901 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:47:17.901 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T15:47:17.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:17.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T15:47:17.901 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T15:47:17.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:47:18.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:47:18.020 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T15:47:18.021 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:47:18.021 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T15:47:18.021 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T15:47:18.021 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T15:47:18.021 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T15:47:18.021 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T15:47:18.021 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T15:47:18.021 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T15:47:18.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:47:18.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:47:18.143 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T15:47:18.143 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T15:47:18.143 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-04-25T15:47:18.143 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T15:47:18.143 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T15:47:18.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T15:47:18.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:47:18.220 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-04-25T15:47:18.220 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:47:18.220 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:18.236 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T15:47:18.236 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T15:47:18.236 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:18.292 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-25T15:47:18.292 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-04-25T15:47:18.357 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:47:18.414 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-04-25T15:47:18.414 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-04-25T15:47:18.414 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-04-25T15:47:18.414 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-04-25T15:47:18.414 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-04-25T15:47:18.414 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-04-25T15:47:18.414 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-04-25T15:47:18.414 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-04-25T15:47:18.414 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-04-25T15:47:18.415 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-04-25T15:47:18.415 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-04-25T15:47:18.415 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/selinux 2024-04-25T15:47:18.415 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:47:18.415 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-04-25T15:47:18.415 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-04-25T15:47:18.415 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-04-25T15:47:18.415 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-04-25T15:47:18.415 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T15:47:18.415 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-04-25T15:47:18.415 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-04-25T15:47:18.416 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T15:47:18.416 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T15:47:18.416 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T15:47:18.416 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T15:47:18.416 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-04-25T15:47:18.416 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-04-25T15:47:18.416 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T15:47:18.416 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T15:47:18.416 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T15:47:18.416 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T15:47:18.416 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-04-25T15:47:18.416 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:18.417 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:18.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:18.417 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-04-25T15:47:18.470 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T15:47:18.470 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-25T15:47:18.512 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-04-25T15:47:18.536 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:47:18.593 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-04-25T15:47:18.593 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-04-25T15:47:18.593 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-04-25T15:47:18.593 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-04-25T15:47:18.594 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-04-25T15:47:18.594 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-04-25T15:47:18.594 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-04-25T15:47:18.594 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-04-25T15:47:18.594 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-04-25T15:47:18.594 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-04-25T15:47:18.594 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-04-25T15:47:18.594 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/selinux 2024-04-25T15:47:18.594 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:47:18.594 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-04-25T15:47:18.594 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-04-25T15:47:18.594 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-04-25T15:47:18.595 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-04-25T15:47:18.595 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T15:47:18.595 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-04-25T15:47:18.595 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-04-25T15:47:18.595 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T15:47:18.595 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T15:47:18.595 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T15:47:18.595 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T15:47:18.595 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-04-25T15:47:18.595 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-04-25T15:47:18.595 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T15:47:18.595 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T15:47:18.595 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T15:47:18.595 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T15:47:18.596 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-04-25T15:47:18.596 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:18.596 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:18.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:18.596 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-04-25T15:47:19.750 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-04-25T15:47:19.776 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:47:19.835 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-04-25T15:47:19.835 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-04-25T15:47:19.835 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-04-25T15:47:19.835 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-04-25T15:47:19.835 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-04-25T15:47:19.835 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-04-25T15:47:19.835 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-04-25T15:47:19.836 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-04-25T15:47:19.836 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-04-25T15:47:19.836 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-04-25T15:47:19.836 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-04-25T15:47:19.836 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/selinux 2024-04-25T15:47:19.836 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:47:19.836 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-04-25T15:47:19.836 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-04-25T15:47:19.836 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-04-25T15:47:19.836 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-04-25T15:47:19.836 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T15:47:19.836 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-04-25T15:47:19.836 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-04-25T15:47:19.837 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T15:47:19.837 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T15:47:19.837 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T15:47:19.837 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T15:47:19.837 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-04-25T15:47:19.837 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-04-25T15:47:19.837 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T15:47:19.837 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T15:47:19.837 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T15:47:19.838 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T15:47:19.838 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-04-25T15:47:19.838 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:19.838 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:19.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:19.838 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-04-25T15:47:20.992 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-04-25T15:47:21.017 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:47:21.073 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-04-25T15:47:21.073 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-04-25T15:47:21.074 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-04-25T15:47:21.074 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-04-25T15:47:21.074 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-04-25T15:47:21.074 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-04-25T15:47:21.074 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-04-25T15:47:21.074 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-04-25T15:47:21.074 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-04-25T15:47:21.074 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-04-25T15:47:21.074 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-04-25T15:47:21.074 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/selinux 2024-04-25T15:47:21.074 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:47:21.074 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-04-25T15:47:21.074 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-04-25T15:47:21.075 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-04-25T15:47:21.075 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-04-25T15:47:21.075 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T15:47:21.075 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-04-25T15:47:21.075 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-04-25T15:47:21.075 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T15:47:21.075 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T15:47:21.075 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T15:47:21.075 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T15:47:21.075 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-04-25T15:47:21.075 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-04-25T15:47:21.075 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T15:47:21.075 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T15:47:21.075 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T15:47:21.076 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T15:47:21.076 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-04-25T15:47:21.076 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:21.076 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:21.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:21.076 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-04-25T15:47:22.230 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-04-25T15:47:22.256 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:47:22.312 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-04-25T15:47:22.313 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-04-25T15:47:22.313 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-04-25T15:47:22.313 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-04-25T15:47:22.313 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-04-25T15:47:22.313 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-04-25T15:47:22.313 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-04-25T15:47:22.313 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-04-25T15:47:22.313 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-04-25T15:47:22.313 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-04-25T15:47:22.313 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-04-25T15:47:22.313 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/selinux 2024-04-25T15:47:22.313 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:47:22.313 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-04-25T15:47:22.313 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-04-25T15:47:22.314 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-04-25T15:47:22.314 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-04-25T15:47:22.314 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T15:47:22.314 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-04-25T15:47:22.314 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-04-25T15:47:22.314 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T15:47:22.314 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T15:47:22.314 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T15:47:22.314 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T15:47:22.314 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-04-25T15:47:22.314 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-04-25T15:47:22.314 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T15:47:22.314 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T15:47:22.314 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T15:47:22.315 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T15:47:22.315 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-04-25T15:47:22.315 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:22.315 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:22.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:22.315 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-04-25T15:47:23.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-04-25T15:47:23.495 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:47:23.552 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-04-25T15:47:23.552 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-04-25T15:47:23.552 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-04-25T15:47:23.552 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-04-25T15:47:23.552 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-04-25T15:47:23.553 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-04-25T15:47:23.553 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-04-25T15:47:23.553 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-04-25T15:47:23.553 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-04-25T15:47:23.553 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-04-25T15:47:23.553 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-04-25T15:47:23.553 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/selinux 2024-04-25T15:47:23.553 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:47:23.553 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-04-25T15:47:23.554 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-04-25T15:47:23.554 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-04-25T15:47:23.554 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-04-25T15:47:23.554 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T15:47:23.554 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-04-25T15:47:23.554 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-04-25T15:47:23.554 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T15:47:23.554 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T15:47:23.555 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T15:47:23.555 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T15:47:23.555 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-04-25T15:47:23.555 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-04-25T15:47:23.555 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T15:47:23.555 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T15:47:23.555 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T15:47:23.555 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T15:47:23.555 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-04-25T15:47:23.556 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:23.556 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:23.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:23.557 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-04-25T15:47:24.708 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-04-25T15:47:24.735 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:47:24.793 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-04-25T15:47:24.794 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-04-25T15:47:24.794 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-04-25T15:47:24.794 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-04-25T15:47:24.794 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-04-25T15:47:24.794 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-04-25T15:47:24.794 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-04-25T15:47:24.794 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-04-25T15:47:24.794 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-04-25T15:47:24.794 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-04-25T15:47:24.794 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-04-25T15:47:24.794 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/selinux 2024-04-25T15:47:24.794 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:47:24.794 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-04-25T15:47:24.795 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-04-25T15:47:24.795 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-04-25T15:47:24.795 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-04-25T15:47:24.795 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T15:47:24.795 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-04-25T15:47:24.795 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-04-25T15:47:24.795 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T15:47:24.795 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T15:47:24.795 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T15:47:24.795 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T15:47:24.795 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-04-25T15:47:24.795 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-04-25T15:47:24.795 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T15:47:24.795 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T15:47:24.796 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T15:47:24.796 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T15:47:24.796 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-04-25T15:47:24.796 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:24.796 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:24.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:24.796 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-04-25T15:47:25.090 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[43254]: starting ceph client 2024-04-25T15:47:25.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:2024-04-25T15:47:24.970+0000 6780280 -1 init, newargv = 0xbcf7220 newargc=15 2024-04-25T15:47:25.950 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-04-25T15:47:25.976 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T15:47:26.033 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-04-25T15:47:26.033 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-04-25T15:47:26.034 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-04-25T15:47:26.034 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-04-25T15:47:26.034 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-04-25T15:47:26.034 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-04-25T15:47:26.034 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-04-25T15:47:26.035 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-04-25T15:47:26.035 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-04-25T15:47:26.035 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-04-25T15:47:26.035 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-04-25T15:47:26.035 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/selinux 2024-04-25T15:47:26.035 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T15:47:26.036 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-04-25T15:47:26.036 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-04-25T15:47:26.036 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-04-25T15:47:26.036 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-04-25T15:47:26.036 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T15:47:26.036 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-04-25T15:47:26.037 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-04-25T15:47:26.037 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T15:47:26.037 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T15:47:26.037 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T15:47:26.037 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T15:47:26.037 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-04-25T15:47:26.037 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-04-25T15:47:26.038 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T15:47:26.038 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T15:47:26.038 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T15:47:26.038 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T15:47:26.038 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-04-25T15:47:26.039 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:26.039 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T15:47:26.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:26.040 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-04-25T15:47:26.070 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[43254]: starting fuse 2024-04-25T15:47:26.086 INFO:teuthology.orchestra.run.smithi059.stdout:42 2024-04-25T15:47:26.086 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-04-25T15:47:26.086 DEBUG:teuthology.orchestra.run.smithi059:> sudo stdin-killer -- python3 -c ' 2024-04-25T15:47:26.086 DEBUG:teuthology.orchestra.run.smithi059:> import glob 2024-04-25T15:47:26.086 DEBUG:teuthology.orchestra.run.smithi059:> import re 2024-04-25T15:47:26.087 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T15:47:26.087 DEBUG:teuthology.orchestra.run.smithi059:> import subprocess 2024-04-25T15:47:26.087 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T15:47:26.087 DEBUG:teuthology.orchestra.run.smithi059:> def _find_admin_socket(client_name): 2024-04-25T15:47:26.087 DEBUG:teuthology.orchestra.run.smithi059:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T15:47:26.087 DEBUG:teuthology.orchestra.run.smithi059:> files = glob.glob(asok_path) 2024-04-25T15:47:26.087 DEBUG:teuthology.orchestra.run.smithi059:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T15:47:26.087 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T15:47:26.087 DEBUG:teuthology.orchestra.run.smithi059:> # Given a non-glob path, it better be there 2024-04-25T15:47:26.087 DEBUG:teuthology.orchestra.run.smithi059:> if "*" not in asok_path: 2024-04-25T15:47:26.087 DEBUG:teuthology.orchestra.run.smithi059:> assert(len(files) == 1) 2024-04-25T15:47:26.087 DEBUG:teuthology.orchestra.run.smithi059:> return files[0] 2024-04-25T15:47:26.087 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T15:47:26.087 DEBUG:teuthology.orchestra.run.smithi059:> for f in files: 2024-04-25T15:47:26.087 DEBUG:teuthology.orchestra.run.smithi059:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T15:47:26.087 DEBUG:teuthology.orchestra.run.smithi059:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T15:47:26.088 DEBUG:teuthology.orchestra.run.smithi059:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T15:47:26.088 DEBUG:teuthology.orchestra.run.smithi059:> contents = proc_f.read() 2024-04-25T15:47:26.088 DEBUG:teuthology.orchestra.run.smithi059:> if mountpoint in contents: 2024-04-25T15:47:26.088 DEBUG:teuthology.orchestra.run.smithi059:> return f 2024-04-25T15:47:26.088 DEBUG:teuthology.orchestra.run.smithi059:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T15:47:26.088 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T15:47:26.088 DEBUG:teuthology.orchestra.run.smithi059:> print(_find_admin_socket("client.0")) 2024-04-25T15:47:26.088 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T15:47:26.211 INFO:teuthology.orchestra.run.smithi059.stdout:/var/run/ceph/ceph-client.0.43254.asok 2024-04-25T15:47:26.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T15:47:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T15:47:26.222 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43254.asok 2024-04-25T15:47:26.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:26.223 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43254.asok status 2024-04-25T15:47:26.545 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T15:47:26.546 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": { 2024-04-25T15:47:26.546 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_sha1": "994e2f20102a20fa9a27966c14b625cc01884df8", 2024-04-25T15:47:26.546 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)", 2024-04-25T15:47:26.546 INFO:teuthology.orchestra.run.smithi059.stdout: "entity_id": "0", 2024-04-25T15:47:26.546 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": "smithi059", 2024-04-25T15:47:26.547 INFO:teuthology.orchestra.run.smithi059.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T15:47:26.547 INFO:teuthology.orchestra.run.smithi059.stdout: "pid": "43254", 2024-04-25T15:47:26.547 INFO:teuthology.orchestra.run.smithi059.stdout: "root": "/" 2024-04-25T15:47:26.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T15:47:26.547 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_count": 0, 2024-04-25T15:47:26.547 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_pinned_count": 0, 2024-04-25T15:47:26.548 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4546, 2024-04-25T15:47:26.548 INFO:teuthology.orchestra.run.smithi059.stdout: "inst": { 2024-04-25T15:47:26.548 INFO:teuthology.orchestra.run.smithi059.stdout: "name": { 2024-04-25T15:47:26.548 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "client", 2024-04-25T15:47:26.548 INFO:teuthology.orchestra.run.smithi059.stdout: "num": 4546 2024-04-25T15:47:26.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T15:47:26.549 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-04-25T15:47:26.549 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-04-25T15:47:26.549 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:0", 2024-04-25T15:47:26.549 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3916716274 2024-04-25T15:47:26.549 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T15:47:26.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T15:47:26.549 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-04-25T15:47:26.550 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-04-25T15:47:26.550 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:0", 2024-04-25T15:47:26.550 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3916716274 2024-04-25T15:47:26.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T15:47:26.550 INFO:teuthology.orchestra.run.smithi059.stdout: "inst_str": "client.4546 172.21.15.59:0/3916716274", 2024-04-25T15:47:26.550 INFO:teuthology.orchestra.run.smithi059.stdout: "addr_str": "172.21.15.59:0/3916716274", 2024-04-25T15:47:26.551 INFO:teuthology.orchestra.run.smithi059.stdout: "inode_count": 1, 2024-04-25T15:47:26.551 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_epoch": 13, 2024-04-25T15:47:26.551 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch": 24, 2024-04-25T15:47:26.551 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch_barrier": 0, 2024-04-25T15:47:26.551 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklisted": false, 2024-04-25T15:47:26.552 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs" 2024-04-25T15:47:26.552 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T15:47:26.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:26.555 DEBUG:teuthology.orchestra.run.smithi059:> stat --file-system '--printf=%T 2024-04-25T15:47:26.555 DEBUG:teuthology.orchestra.run.smithi059:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:26.731 INFO:teuthology.orchestra.run.smithi059.stdout:fuseblk 2024-04-25T15:47:26.731 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:26.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T15:47:26.731 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:27.208 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T15:47:27.221 INFO:tasks.workunit:Pulling workunits from ref 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:47:27.222 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T15:47:27.222 INFO:tasks.workunit:timeout=6h 2024-04-25T15:47:27.222 INFO:tasks.workunit:cleanup=True 2024-04-25T15:47:27.222 DEBUG:teuthology.orchestra.run.smithi059:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:27.321 INFO:teuthology.orchestra.run.smithi059.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:27.321 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-25T15:47:27.322 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 2ah/42d Inode: 1 Links: 2 2024-04-25T15:47:27.322 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:47:27.322 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-25T15:47:27.322 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T15:47:27.322 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-04-25 15:46:33.694657946 +0000 2024-04-25T15:47:27.322 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-04-25 15:47:26.782203108 +0000 2024-04-25T15:47:27.322 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2024-04-25T15:47:27.322 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T15:47:27.322 DEBUG:teuthology.orchestra.run.smithi059:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T15:47:28.033 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:47:28.049 INFO:tasks.workunit.client.0.smithi059.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T15:47:41.311 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:47:41.315 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:48:11.372 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:48:11.375 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:48:41.432 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:48:41.439 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:48:54.410 INFO:tasks.workunit.client.0.smithi059.stderr:Updating files: 92% (11292/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-25T15:48:55.078 INFO:tasks.workunit.client.0.smithi059.stderr:Note: switching to '994e2f20102a20fa9a27966c14b625cc01884df8'. 2024-04-25T15:48:55.079 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-04-25T15:48:55.079 INFO:tasks.workunit.client.0.smithi059.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T15:48:55.079 INFO:tasks.workunit.client.0.smithi059.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T15:48:55.079 INFO:tasks.workunit.client.0.smithi059.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T15:48:55.079 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-04-25T15:48:55.079 INFO:tasks.workunit.client.0.smithi059.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T15:48:55.079 INFO:tasks.workunit.client.0.smithi059.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T15:48:55.079 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-04-25T15:48:55.079 INFO:tasks.workunit.client.0.smithi059.stderr: git switch -c 2024-04-25T15:48:55.079 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-04-25T15:48:55.079 INFO:tasks.workunit.client.0.smithi059.stderr:Or undo this operation with: 2024-04-25T15:48:55.080 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-04-25T15:48:55.080 INFO:tasks.workunit.client.0.smithi059.stderr: git switch - 2024-04-25T15:48:55.080 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-04-25T15:48:55.080 INFO:tasks.workunit.client.0.smithi059.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T15:48:55.080 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-04-25T15:48:55.080 INFO:tasks.workunit.client.0.smithi059.stderr:HEAD is now at 994e2f20102 Merge PR #56810 into wip-pdonnell-testing-20240425.015853-debug 2024-04-25T15:48:55.084 DEBUG:teuthology.orchestra.run.smithi059:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T15:48:55.109 INFO:tasks.workunit.client.0.smithi059.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T15:48:55.111 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T15:48:55.111 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T15:48:55.650 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T15:48:55.706 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T15:48:55.747 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T15:48:55.749 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T15:48:55.749 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T15:48:55.788 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T15:48:55.792 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T15:48:55.792 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T15:48:55.848 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-25T15:48:55.851 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-25T15:48:55.851 DEBUG:teuthology.orchestra.run.smithi059:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=994e2f20102a20fa9a27966c14b625cc01884df8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-25T15:48:56.144 INFO:tasks.workunit.client.0.smithi059.stderr:+ mkdir -p fsstress 2024-04-25T15:48:56.219 INFO:tasks.workunit.client.0.smithi059.stderr:+ pushd fsstress 2024-04-25T15:48:56.238 INFO:tasks.workunit.client.0.smithi059.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T15:48:56.239 INFO:tasks.workunit.client.0.smithi059.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-25T15:49:04.818 INFO:tasks.workunit.client.0.smithi059.stderr:+ tar xzf ltp-full.tgz 2024-04-25T15:49:11.501 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:49:11.504 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:49:41.581 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:49:41.585 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:50:11.656 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:50:11.659 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:50:41.737 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:50:41.741 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:51:11.793 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:51:11.795 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:51:41.849 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:51:41.855 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:52:11.913 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:52:11.916 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:52:41.974 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:52:41.977 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:53:12.030 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:53:12.033 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:53:42.098 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:53:42.101 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:54:12.238 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:54:12.241 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:54:42.293 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:54:42.296 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:54:44.198 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:08:56.802 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T15:54:44.262 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:08:56.866 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T15:54:44.316 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:08:56.879 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T15:54:44.326 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:08:56.890 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T15:54:44.383 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:08:56.947 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T15:54:44.389 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:08:56.952 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T15:54:44.679 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:08:57.283 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T15:54:44.804 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:08:57.368 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T15:54:44.813 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:08:57.377 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T15:55:12.347 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:55:12.350 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:55:42.412 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:55:42.415 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:56:12.462 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:56:12.465 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:56:42.543 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:56:42.546 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:57:12.599 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:57:12.601 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:57:28.732 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:11:41.336 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T15:57:28.738 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:11:41.342 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T15:57:28.756 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:11:41.319 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T15:57:28.757 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:11:41.321 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T15:57:28.759 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:11:41.323 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T15:57:28.760 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:11:41.324 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T15:57:28.855 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:11:41.459 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T15:57:28.857 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:11:41.420 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T15:57:28.891 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:11:41.455 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T15:57:42.655 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:57:42.659 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:58:12.712 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:58:12.714 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:58:42.776 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:58:42.779 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:59:12.832 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:59:12.835 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:59:42.888 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:59:42.891 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:00:12.944 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:00:12.947 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:00:43.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:00:43.004 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:01:13.064 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:01:13.067 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:01:39.076 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:15:51.680 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:01:39.084 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:15:51.689 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:01:39.166 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:15:51.730 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:01:39.170 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:15:51.734 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:01:39.185 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:15:51.790 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:01:39.192 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:15:51.756 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:01:39.194 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:15:51.757 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:01:39.288 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:15:51.851 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:01:39.316 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:15:51.879 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:01:43.146 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:01:43.150 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:02:13.206 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:02:13.209 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:02:43.262 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:02:43.265 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:03:06.016 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:17:18.620 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:03:06.022 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:17:18.627 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:03:06.060 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:17:18.665 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:03:06.117 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:17:18.680 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:03:06.121 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:17:18.685 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:03:06.135 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:17:18.698 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:03:06.140 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:17:18.704 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:03:06.166 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:17:18.729 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:03:06.181 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:17:18.744 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:03:13.323 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:03:13.325 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:03:43.398 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:03:43.401 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:04:13.477 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:04:13.480 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:04:43.541 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:04:43.543 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:05:13.614 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:05:13.617 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:05:43.671 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:05:43.674 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:05:47.324 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:19:59.929 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:05:47.329 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:19:59.933 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:05:47.405 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:20:00.009 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:05:47.410 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:19:59.973 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:05:47.412 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:19:59.975 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:05:47.423 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:19:59.986 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:05:47.424 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:19:59.988 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:05:47.498 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:20:00.062 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:05:47.520 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:20:00.083 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:06:13.726 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:06:13.729 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:06:43.775 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:06:43.778 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:07:13.830 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:07:13.834 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:07:43.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:07:43.888 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:08:13.943 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:08:13.946 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:08:44.007 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:08:44.010 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:09:14.088 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:09:14.090 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:09:44.135 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:09:44.139 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:10:14.192 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:10:14.196 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:10:22.682 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:24:35.286 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:10:22.685 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:24:35.290 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:10:22.705 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:24:35.268 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:10:22.713 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:24:35.276 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:10:22.768 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:24:35.331 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:10:22.770 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:24:35.333 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:10:22.823 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:24:35.428 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:10:22.877 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:24:35.440 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:10:22.937 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:24:35.500 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:10:44.256 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:10:44.259 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:11:14.321 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:11:14.324 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:11:27.948 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:25:40.553 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:11:27.951 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:25:40.555 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:11:27.982 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:25:40.587 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:11:28.030 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:25:40.593 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:11:28.033 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:25:40.596 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:11:28.033 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:25:40.597 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:11:28.036 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:25:40.599 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:11:28.067 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:25:40.630 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:11:28.072 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:25:40.636 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:11:44.384 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:11:44.387 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:12:14.465 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:12:14.469 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:12:44.524 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:12:44.527 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:13:14.590 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:13:14.593 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:13:44.654 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:13:44.657 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:14:02.279 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:28:14.883 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:14:02.281 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:28:14.885 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:14:02.294 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:28:14.857 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:14:02.295 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:28:14.858 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:14:02.297 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:28:14.860 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:14:02.317 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:28:14.880 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:14:02.361 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:28:14.965 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:14:02.375 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:28:14.938 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:14:02.405 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:28:14.968 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:14:14.715 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:14:14.717 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:14:21.322 INFO:tasks.workunit.client.0.smithi059.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-25T16:14:21.434 INFO:tasks.workunit.client.0.smithi059.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T16:14:21.435 INFO:tasks.workunit.client.0.smithi059.stderr:+ make 2024-04-25T16:14:23.234 INFO:tasks.workunit.client.0.smithi059.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-25T16:14:26.500 INFO:tasks.workunit.client.0.smithi059.stderr:++ readlink -f fsstress 2024-04-25T16:14:26.517 INFO:tasks.workunit.client.0.smithi059.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-25T16:14:26.518 INFO:tasks.workunit.client.0.smithi059.stderr:+ popd 2024-04-25T16:14:26.536 INFO:tasks.workunit.client.0.smithi059.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T16:14:26.537 INFO:tasks.workunit.client.0.smithi059.stderr:+ popd 2024-04-25T16:14:26.548 INFO:tasks.workunit.client.0.smithi059.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-25T16:14:26.548 INFO:tasks.workunit.client.0.smithi059.stderr:++ mktemp -d -p . 2024-04-25T16:14:26.601 INFO:tasks.workunit.client.0.smithi059.stderr:+ T=./tmp.Q8bC7cbqvS 2024-04-25T16:14:26.601 INFO:tasks.workunit.client.0.smithi059.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.Q8bC7cbqvS -l 1 -n 1000 -p 10 -v 2024-04-25T16:14:26.718 INFO:tasks.workunit.client.0.smithi059.stdout:seed = 1713403002 2024-04-25T16:14:26.982 INFO:tasks.workunit.client.0.smithi059.stdout:0/0: readlink - no filename 2024-04-25T16:14:26.982 INFO:tasks.workunit.client.0.smithi059.stdout:0/1: fdatasync - no filename 2024-04-25T16:14:26.982 INFO:tasks.workunit.client.0.smithi059.stdout:0/2: fdatasync - no filename 2024-04-25T16:14:26.982 INFO:tasks.workunit.client.0.smithi059.stdout:0/3: truncate - no filename 2024-04-25T16:14:26.982 INFO:tasks.workunit.client.0.smithi059.stdout:0/4: rename - no filename 2024-04-25T16:14:26.983 INFO:tasks.workunit.client.0.smithi059.stdout:0/5: chown . 16491 1 2024-04-25T16:14:26.983 INFO:tasks.workunit.client.0.smithi059.stdout:0/6: dwrite - no filename 2024-04-25T16:14:26.983 INFO:tasks.workunit.client.0.smithi059.stdout:0/7: fdatasync - no filename 2024-04-25T16:14:27.082 INFO:tasks.workunit.client.0.smithi059.stdout:2/0: rename - no filename 2024-04-25T16:14:27.105 INFO:tasks.workunit.client.0.smithi059.stdout:0/8: symlink l0 0 2024-04-25T16:14:27.106 INFO:tasks.workunit.client.0.smithi059.stdout:0/9: rmdir - no directory 2024-04-25T16:14:27.152 INFO:tasks.workunit.client.0.smithi059.stdout:3/0: rmdir - no directory 2024-04-25T16:14:27.166 INFO:tasks.workunit.client.0.smithi059.stdout:1/0: symlink l0 0 2024-04-25T16:14:27.166 INFO:tasks.workunit.client.0.smithi059.stdout:1/1: fdatasync - no filename 2024-04-25T16:14:27.166 INFO:tasks.workunit.client.0.smithi059.stdout:1/2: truncate - no filename 2024-04-25T16:14:27.166 INFO:tasks.workunit.client.0.smithi059.stdout:1/3: dwrite - no filename 2024-04-25T16:14:27.270 INFO:tasks.workunit.client.0.smithi059.stdout:0/10: rename l0 to l1 0 2024-04-25T16:14:27.271 INFO:tasks.workunit.client.0.smithi059.stdout:0/11: rmdir - no directory 2024-04-25T16:14:27.277 INFO:tasks.workunit.client.0.smithi059.stdout:2/1: symlink l0 0 2024-04-25T16:14:27.387 INFO:tasks.workunit.client.0.smithi059.stdout:2/2: creat f1 x:0 0 0 2024-04-25T16:14:27.389 INFO:tasks.workunit.client.0.smithi059.stdout:4/0: write - no filename 2024-04-25T16:14:27.389 INFO:tasks.workunit.client.0.smithi059.stdout:4/1: dwrite - no filename 2024-04-25T16:14:27.398 INFO:tasks.workunit.client.0.smithi059.stdout:3/1: mkdir d0 0 2024-04-25T16:14:27.398 INFO:tasks.workunit.client.0.smithi059.stdout:3/2: read - no filename 2024-04-25T16:14:27.411 INFO:tasks.workunit.client.0.smithi059.stdout:2/3: chown f1 8587 1 2024-04-25T16:14:27.420 INFO:tasks.workunit.client.0.smithi059.stdout:2/4: dread - f1 zero size 2024-04-25T16:14:27.527 INFO:tasks.workunit.client.0.smithi059.stdout:2/5: dwrite f1 [0,4194304] 0 2024-04-25T16:14:27.684 INFO:tasks.workunit.client.0.smithi059.stdout:5/0: dwrite - no filename 2024-04-25T16:14:27.684 INFO:tasks.workunit.client.0.smithi059.stdout:5/1: write - no filename 2024-04-25T16:14:27.684 INFO:tasks.workunit.client.0.smithi059.stdout:5/2: truncate - no filename 2024-04-25T16:14:28.121 INFO:tasks.workunit.client.0.smithi059.stdout:2/6: creat f2 x:0 0 0 2024-04-25T16:14:28.177 INFO:tasks.workunit.client.0.smithi059.stdout:0/12: rename l1 to l2 0 2024-04-25T16:14:28.177 INFO:tasks.workunit.client.0.smithi059.stdout:0/13: write - no filename 2024-04-25T16:14:28.177 INFO:tasks.workunit.client.0.smithi059.stdout:6/0: truncate - no filename 2024-04-25T16:14:28.177 INFO:tasks.workunit.client.0.smithi059.stdout:6/1: read - no filename 2024-04-25T16:14:28.453 INFO:tasks.workunit.client.0.smithi059.stdout:4/2: mkdir d0 0 2024-04-25T16:14:28.453 INFO:tasks.workunit.client.0.smithi059.stdout:4/3: fsync - no filename 2024-04-25T16:14:28.453 INFO:tasks.workunit.client.0.smithi059.stdout:4/4: dwrite - no filename 2024-04-25T16:14:28.454 INFO:tasks.workunit.client.0.smithi059.stdout:1/4: getdents . 0 2024-04-25T16:14:28.459 INFO:tasks.workunit.client.0.smithi059.stdout:3/3: symlink d0/l1 0 2024-04-25T16:14:28.466 INFO:tasks.workunit.client.0.smithi059.stdout:5/3: symlink l0 0 2024-04-25T16:14:28.480 INFO:tasks.workunit.client.0.smithi059.stdout:2/7: mknod c3 0 2024-04-25T16:14:28.494 INFO:tasks.workunit.client.0.smithi059.stdout:3/4: stat d0/l1 0 2024-04-25T16:14:28.517 INFO:tasks.workunit.client.0.smithi059.stdout:3/5: chown d0 100174 1 2024-04-25T16:14:28.517 INFO:tasks.workunit.client.0.smithi059.stdout:3/6: dwrite - no filename 2024-04-25T16:14:28.573 INFO:tasks.workunit.client.0.smithi059.stdout:7/0: write - no filename 2024-04-25T16:14:28.573 INFO:tasks.workunit.client.0.smithi059.stdout:7/1: dread - no filename 2024-04-25T16:14:28.573 INFO:tasks.workunit.client.0.smithi059.stdout:7/2: write - no filename 2024-04-25T16:14:28.573 INFO:tasks.workunit.client.0.smithi059.stdout:7/3: dread - no filename 2024-04-25T16:14:28.688 INFO:tasks.workunit.client.0.smithi059.stdout:5/4: mkdir d1 0 2024-04-25T16:14:28.697 INFO:tasks.workunit.client.0.smithi059.stdout:6/2: creat f0 x:0 0 0 2024-04-25T16:14:28.710 INFO:tasks.workunit.client.0.smithi059.stdout:1/5: creat f1 x:0 0 0 2024-04-25T16:14:28.736 INFO:tasks.workunit.client.0.smithi059.stdout:2/8: creat f4 x:0 0 0 2024-04-25T16:14:28.754 INFO:tasks.workunit.client.0.smithi059.stdout:5/5: chown l0 31 1 2024-04-25T16:14:28.754 INFO:tasks.workunit.client.0.smithi059.stdout:5/6: truncate - no filename 2024-04-25T16:14:28.776 INFO:tasks.workunit.client.0.smithi059.stdout:1/6: chown f1 3981667 1 2024-04-25T16:14:28.779 INFO:tasks.workunit.client.0.smithi059.stdout:6/3: write f0 [723755,89383] 0 2024-04-25T16:14:28.872 INFO:tasks.workunit.client.0.smithi059.stdout:3/7: rename d0/l1 to d0/l2 0 2024-04-25T16:14:28.931 INFO:tasks.workunit.client.0.smithi059.stdout:4/5: mknod d0/c1 0 2024-04-25T16:14:28.931 INFO:tasks.workunit.client.0.smithi059.stdout:4/6: write - no filename 2024-04-25T16:14:28.937 INFO:tasks.workunit.client.0.smithi059.stdout:4/7: chown d0 824 1 2024-04-25T16:14:29.253 INFO:tasks.workunit.client.0.smithi059.stdout:1/7: creat f2 x:0 0 0 2024-04-25T16:14:29.266 INFO:tasks.workunit.client.0.smithi059.stdout:6/4: creat f1 x:0 0 0 2024-04-25T16:14:29.270 INFO:tasks.workunit.client.0.smithi059.stdout:7/4: mkdir d0 0 2024-04-25T16:14:29.270 INFO:tasks.workunit.client.0.smithi059.stdout:7/5: dwrite - no filename 2024-04-25T16:14:29.288 INFO:tasks.workunit.client.0.smithi059.stdout:3/8: mknod d0/c3 0 2024-04-25T16:14:29.288 INFO:tasks.workunit.client.0.smithi059.stdout:3/9: dwrite - no filename 2024-04-25T16:14:29.309 INFO:tasks.workunit.client.0.smithi059.stdout:7/6: chown d0 3532 1 2024-04-25T16:14:29.309 INFO:tasks.workunit.client.0.smithi059.stdout:7/7: fsync - no filename 2024-04-25T16:14:29.310 INFO:tasks.workunit.client.0.smithi059.stdout:4/8: creat d0/f2 x:0 0 0 2024-04-25T16:14:29.318 INFO:tasks.workunit.client.0.smithi059.stdout:0/14: getdents . 0 2024-04-25T16:14:29.318 INFO:tasks.workunit.client.0.smithi059.stdout:0/15: write - no filename 2024-04-25T16:14:29.326 INFO:tasks.workunit.client.0.smithi059.stdout:2/9: link f4 f5 0 2024-04-25T16:14:29.346 INFO:tasks.workunit.client.0.smithi059.stdout:5/7: creat d1/f2 x:0 0 0 2024-04-25T16:14:29.350 INFO:tasks.workunit.client.0.smithi059.stdout:6/5: write f1 [126277,43331] 0 2024-04-25T16:14:29.370 INFO:tasks.workunit.client.0.smithi059.stdout:8/0: getdents . 0 2024-04-25T16:14:29.370 INFO:tasks.workunit.client.0.smithi059.stdout:8/1: write - no filename 2024-04-25T16:14:29.386 INFO:tasks.workunit.client.0.smithi059.stdout:1/8: symlink l3 0 2024-04-25T16:14:29.400 INFO:tasks.workunit.client.0.smithi059.stdout:2/10: mkdir d6 0 2024-04-25T16:14:29.421 INFO:tasks.workunit.client.0.smithi059.stdout:5/8: write d1/f2 [800627,31256] 0 2024-04-25T16:14:29.427 INFO:tasks.workunit.client.0.smithi059.stdout:2/11: chown c3 0 1 2024-04-25T16:14:29.432 INFO:tasks.workunit.client.0.smithi059.stdout:2/12: chown d6 398305668 1 2024-04-25T16:14:29.459 INFO:tasks.workunit.client.0.smithi059.stdout:0/16: symlink l3 0 2024-04-25T16:14:29.553 INFO:tasks.workunit.client.0.smithi059.stdout:4/9: sync 2024-04-25T16:14:29.553 INFO:tasks.workunit.client.0.smithi059.stdout:9/0: sync 2024-04-25T16:14:29.553 INFO:tasks.workunit.client.0.smithi059.stdout:9/1: link - no file 2024-04-25T16:14:29.553 INFO:tasks.workunit.client.0.smithi059.stdout:9/2: rmdir - no directory 2024-04-25T16:14:29.553 INFO:tasks.workunit.client.0.smithi059.stdout:9/3: unlink - no file 2024-04-25T16:14:29.553 INFO:tasks.workunit.client.0.smithi059.stdout:9/4: write - no filename 2024-04-25T16:14:29.553 INFO:tasks.workunit.client.0.smithi059.stdout:9/5: dwrite - no filename 2024-04-25T16:14:29.553 INFO:tasks.workunit.client.0.smithi059.stdout:9/6: rename - no filename 2024-04-25T16:14:29.582 INFO:tasks.workunit.client.0.smithi059.stdout:1/9: symlink l4 0 2024-04-25T16:14:29.589 INFO:tasks.workunit.client.0.smithi059.stdout:6/6: rename f1 to f2 0 2024-04-25T16:14:29.610 INFO:tasks.workunit.client.0.smithi059.stdout:0/17: creat f4 x:0 0 0 2024-04-25T16:14:29.624 INFO:tasks.workunit.client.0.smithi059.stdout:1/10: write f2 [294240,41611] 0 2024-04-25T16:14:29.634 INFO:tasks.workunit.client.0.smithi059.stdout:5/9: sync 2024-04-25T16:14:29.641 INFO:tasks.workunit.client.0.smithi059.stdout:6/7: dread f2 [0,4194304] 0 2024-04-25T16:14:29.688 INFO:tasks.workunit.client.0.smithi059.stdout:5/10: write d1/f2 [1429457,92372] 0 2024-04-25T16:14:29.800 INFO:tasks.workunit.client.0.smithi059.stdout:4/10: unlink d0/c1 0 2024-04-25T16:14:29.839 INFO:tasks.workunit.client.0.smithi059.stdout:8/2: mknod c0 0 2024-04-25T16:14:29.840 INFO:tasks.workunit.client.0.smithi059.stdout:7/8: creat d0/f1 x:0 0 0 2024-04-25T16:14:29.858 INFO:tasks.workunit.client.0.smithi059.stdout:0/18: symlink l5 0 2024-04-25T16:14:29.883 INFO:tasks.workunit.client.0.smithi059.stdout:4/11: rename d0 to d0/d3 22 2024-04-25T16:14:29.904 INFO:tasks.workunit.client.0.smithi059.stdout:1/11: dwrite f1 [0,4194304] 0 2024-04-25T16:14:29.983 INFO:tasks.workunit.client.0.smithi059.stdout:5/11: dread d1/f2 [0,4194304] 0 2024-04-25T16:14:29.987 INFO:tasks.workunit.client.0.smithi059.stdout:8/3: chown c0 671271 1 2024-04-25T16:14:29.987 INFO:tasks.workunit.client.0.smithi059.stdout:8/4: dwrite - no filename 2024-04-25T16:14:29.987 INFO:tasks.workunit.client.0.smithi059.stdout:8/5: rmdir - no directory 2024-04-25T16:14:29.987 INFO:tasks.workunit.client.0.smithi059.stdout:8/6: dread - no filename 2024-04-25T16:14:29.988 INFO:tasks.workunit.client.0.smithi059.stdout:8/7: fdatasync - no filename 2024-04-25T16:14:30.015 INFO:tasks.workunit.client.0.smithi059.stdout:9/7: creat f0 x:0 0 0 2024-04-25T16:14:30.019 INFO:tasks.workunit.client.0.smithi059.stdout:3/10: link d0/c3 d0/c4 0 2024-04-25T16:14:30.019 INFO:tasks.workunit.client.0.smithi059.stdout:3/11: dread - no filename 2024-04-25T16:14:30.360 INFO:tasks.workunit.client.0.smithi059.stdout:2/13: rmdir d6 0 2024-04-25T16:14:30.379 INFO:tasks.workunit.client.0.smithi059.stdout:0/19: creat f6 x:0 0 0 2024-04-25T16:14:30.407 INFO:tasks.workunit.client.0.smithi059.stdout:6/8: dwrite f2 [0,4194304] 0 2024-04-25T16:14:30.496 INFO:tasks.workunit.client.0.smithi059.stdout:4/12: dwrite d0/f2 [0,4194304] 0 2024-04-25T16:14:30.541 INFO:tasks.workunit.client.0.smithi059.stdout:9/8: dwrite f0 [0,4194304] 0 2024-04-25T16:14:30.658 INFO:tasks.workunit.client.0.smithi059.stdout:2/14: read - f4 zero size 2024-04-25T16:14:30.663 INFO:tasks.workunit.client.0.smithi059.stdout:2/15: rmdir - no directory 2024-04-25T16:14:30.681 INFO:tasks.workunit.client.0.smithi059.stdout:9/9: stat f0 0 2024-04-25T16:14:30.689 INFO:tasks.workunit.client.0.smithi059.stdout:2/16: read f1 [2587930,116206] 0 2024-04-25T16:14:30.796 INFO:tasks.workunit.client.0.smithi059.stdout:4/13: dwrite d0/f2 [0,4194304] 0 2024-04-25T16:14:30.800 INFO:tasks.workunit.client.0.smithi059.stdout:1/12: unlink l4 0 2024-04-25T16:14:30.806 INFO:tasks.workunit.client.0.smithi059.stdout:8/8: mknod c1 0 2024-04-25T16:14:30.806 INFO:tasks.workunit.client.0.smithi059.stdout:8/9: dread - no filename 2024-04-25T16:14:30.877 INFO:tasks.workunit.client.0.smithi059.stdout:8/10: sync 2024-04-25T16:14:30.877 INFO:tasks.workunit.client.0.smithi059.stdout:8/11: dread - no filename 2024-04-25T16:14:30.894 INFO:tasks.workunit.client.0.smithi059.stdout:5/12: creat d1/f3 x:0 0 0 2024-04-25T16:14:30.902 INFO:tasks.workunit.client.0.smithi059.stdout:0/20: rename l2 to l7 0 2024-04-25T16:14:30.921 INFO:tasks.workunit.client.0.smithi059.stdout:6/9: creat f3 x:0 0 0 2024-04-25T16:14:30.921 INFO:tasks.workunit.client.0.smithi059.stdout:6/10: readlink - no filename 2024-04-25T16:14:30.953 INFO:tasks.workunit.client.0.smithi059.stdout:6/11: dread - f3 zero size 2024-04-25T16:14:31.001 INFO:tasks.workunit.client.0.smithi059.stdout:6/12: write f0 [367338,13189] 0 2024-04-25T16:14:31.043 INFO:tasks.workunit.client.0.smithi059.stdout:9/10: fsync f0 0 2024-04-25T16:14:31.081 INFO:tasks.workunit.client.0.smithi059.stdout:9/11: fdatasync f0 0 2024-04-25T16:14:31.092 INFO:tasks.workunit.client.0.smithi059.stdout:0/21: dwrite f6 [0,4194304] 0 2024-04-25T16:14:31.169 INFO:tasks.workunit.client.0.smithi059.stdout:9/12: write f0 [1695624,79672] 0 2024-04-25T16:14:31.180 INFO:tasks.workunit.client.0.smithi059.stdout:9/13: stat f0 0 2024-04-25T16:14:31.209 INFO:tasks.workunit.client.0.smithi059.stdout:2/17: creat f7 x:0 0 0 2024-04-25T16:14:31.340 INFO:tasks.workunit.client.0.smithi059.stdout:7/9: unlink d0/f1 0 2024-04-25T16:14:31.345 INFO:tasks.workunit.client.0.smithi059.stdout:7/10: chown d0 26474 1 2024-04-25T16:14:31.428 INFO:tasks.workunit.client.0.smithi059.stdout:1/13: symlink l5 0 2024-04-25T16:14:31.455 INFO:tasks.workunit.client.0.smithi059.stdout:8/12: mknod c2 0 2024-04-25T16:14:31.455 INFO:tasks.workunit.client.0.smithi059.stdout:8/13: dwrite - no filename 2024-04-25T16:14:31.455 INFO:tasks.workunit.client.0.smithi059.stdout:8/14: truncate - no filename 2024-04-25T16:14:31.455 INFO:tasks.workunit.client.0.smithi059.stdout:8/15: read - no filename 2024-04-25T16:14:31.458 INFO:tasks.workunit.client.0.smithi059.stdout:3/12: rename d0/c4 to d0/c5 0 2024-04-25T16:14:31.458 INFO:tasks.workunit.client.0.smithi059.stdout:3/13: dread - no filename 2024-04-25T16:14:31.471 INFO:tasks.workunit.client.0.smithi059.stdout:1/14: dread f2 [0,4194304] 0 2024-04-25T16:14:31.483 INFO:tasks.workunit.client.0.smithi059.stdout:5/13: write d1/f2 [1038498,71520] 0 2024-04-25T16:14:31.519 INFO:tasks.workunit.client.0.smithi059.stdout:3/14: sync 2024-04-25T16:14:31.626 INFO:tasks.workunit.client.0.smithi059.stdout:6/13: creat f4 x:0 0 0 2024-04-25T16:14:31.702 INFO:tasks.workunit.client.0.smithi059.stdout:6/14: dread - f4 zero size 2024-04-25T16:14:31.704 INFO:tasks.workunit.client.0.smithi059.stdout:1/15: dwrite f2 [0,4194304] 0 2024-04-25T16:14:31.791 INFO:tasks.workunit.client.0.smithi059.stdout:1/16: readlink l0 0 2024-04-25T16:14:31.810 INFO:tasks.workunit.client.0.smithi059.stdout:5/14: dwrite d1/f2 [0,4194304] 0 2024-04-25T16:14:31.936 INFO:tasks.workunit.client.0.smithi059.stdout:7/11: creat d0/f2 x:0 0 0 2024-04-25T16:14:31.947 INFO:tasks.workunit.client.0.smithi059.stdout:6/15: write f2 [2971336,6314] 0 2024-04-25T16:14:31.973 INFO:tasks.workunit.client.0.smithi059.stdout:0/22: rename l7 to l8 0 2024-04-25T16:14:31.979 INFO:tasks.workunit.client.0.smithi059.stdout:1/17: write f1 [2760265,96749] 0 2024-04-25T16:14:32.010 INFO:tasks.workunit.client.0.smithi059.stdout:5/15: chown d1/f3 17823 1 2024-04-25T16:14:32.028 INFO:tasks.workunit.client.0.smithi059.stdout:0/23: write f6 [238011,11953] 0 2024-04-25T16:14:32.062 INFO:tasks.workunit.client.0.smithi059.stdout:0/24: fsync f6 0 2024-04-25T16:14:32.096 INFO:tasks.workunit.client.0.smithi059.stdout:0/25: stat f6 0 2024-04-25T16:14:32.142 INFO:tasks.workunit.client.0.smithi059.stdout:0/26: read f6 [3900535,72487] 0 2024-04-25T16:14:32.169 INFO:tasks.workunit.client.0.smithi059.stdout:5/16: dread d1/f2 [0,4194304] 0 2024-04-25T16:14:32.177 INFO:tasks.workunit.client.0.smithi059.stdout:0/27: readlink l3 0 2024-04-25T16:14:32.182 INFO:tasks.workunit.client.0.smithi059.stdout:6/16: dwrite f2 [0,4194304] 0 2024-04-25T16:14:32.275 INFO:tasks.workunit.client.0.smithi059.stdout:7/12: unlink d0/f2 0 2024-04-25T16:14:32.275 INFO:tasks.workunit.client.0.smithi059.stdout:7/13: read - no filename 2024-04-25T16:14:32.275 INFO:tasks.workunit.client.0.smithi059.stdout:7/14: fdatasync - no filename 2024-04-25T16:14:32.275 INFO:tasks.workunit.client.0.smithi059.stdout:7/15: link - no file 2024-04-25T16:14:32.275 INFO:tasks.workunit.client.0.smithi059.stdout:5/17: dread - d1/f3 zero size 2024-04-25T16:14:32.290 INFO:tasks.workunit.client.0.smithi059.stdout:6/17: chown f0 27735 1 2024-04-25T16:14:32.351 INFO:tasks.workunit.client.0.smithi059.stdout:1/18: dread f2 [0,4194304] 0 2024-04-25T16:14:32.391 INFO:tasks.workunit.client.0.smithi059.stdout:2/18: truncate f1 4922215 0 2024-04-25T16:14:32.422 INFO:tasks.workunit.client.0.smithi059.stdout:1/19: dread f2 [0,4194304] 0 2024-04-25T16:14:32.429 INFO:tasks.workunit.client.0.smithi059.stdout:1/20: chown l0 404 1 2024-04-25T16:14:32.494 INFO:tasks.workunit.client.0.smithi059.stdout:0/28: creat f9 x:0 0 0 2024-04-25T16:14:32.532 INFO:tasks.workunit.client.0.smithi059.stdout:4/14: truncate d0/f2 264189 0 2024-04-25T16:14:32.543 INFO:tasks.workunit.client.0.smithi059.stdout:9/14: truncate f0 1361914 0 2024-04-25T16:14:32.596 INFO:tasks.workunit.client.0.smithi059.stdout:7/16: mknod d0/c3 0 2024-04-25T16:14:32.606 INFO:tasks.workunit.client.0.smithi059.stdout:5/18: symlink d1/l4 0 2024-04-25T16:14:32.633 INFO:tasks.workunit.client.0.smithi059.stdout:7/17: rename d0 to d0/d4 22 2024-04-25T16:14:32.661 INFO:tasks.workunit.client.0.smithi059.stdout:0/29: dwrite f9 [0,4194304] 0 2024-04-25T16:14:32.750 INFO:tasks.workunit.client.0.smithi059.stdout:8/16: getdents . 0 2024-04-25T16:14:32.861 INFO:tasks.workunit.client.0.smithi059.stdout:0/30: dwrite f4 [0,4194304] 0 2024-04-25T16:14:32.934 INFO:tasks.workunit.client.0.smithi059.stdout:2/19: mknod c8 0 2024-04-25T16:14:32.944 INFO:tasks.workunit.client.0.smithi059.stdout:3/15: getdents d0 0 2024-04-25T16:14:32.981 INFO:tasks.workunit.client.0.smithi059.stdout:5/19: rmdir d1 39 2024-04-25T16:14:33.065 INFO:tasks.workunit.client.0.smithi059.stdout:0/31: dwrite f4 [0,4194304] 0 2024-04-25T16:14:33.136 INFO:tasks.workunit.client.0.smithi059.stdout:7/18: rename d0/c3 to d0/c5 0 2024-04-25T16:14:33.136 INFO:tasks.workunit.client.0.smithi059.stdout:7/19: fdatasync - no filename 2024-04-25T16:14:33.136 INFO:tasks.workunit.client.0.smithi059.stdout:7/20: dread - no filename 2024-04-25T16:14:33.146 INFO:tasks.workunit.client.0.smithi059.stdout:0/32: truncate f4 4358125 0 2024-04-25T16:14:33.220 INFO:tasks.workunit.client.0.smithi059.stdout:8/17: creat f3 x:0 0 0 2024-04-25T16:14:33.220 INFO:tasks.workunit.client.0.smithi059.stdout:8/18: rmdir - no directory 2024-04-25T16:14:33.229 INFO:tasks.workunit.client.0.smithi059.stdout:8/19: truncate f3 177441 0 2024-04-25T16:14:33.433 INFO:tasks.workunit.client.0.smithi059.stdout:2/20: rename f5 to f9 0 2024-04-25T16:14:33.487 INFO:tasks.workunit.client.0.smithi059.stdout:1/21: write f2 [2097689,43730] 0 2024-04-25T16:14:33.503 INFO:tasks.workunit.client.0.smithi059.stdout:1/22: chown l0 900 1 2024-04-25T16:14:33.546 INFO:tasks.workunit.client.0.smithi059.stdout:3/16: creat d0/f6 x:0 0 0 2024-04-25T16:14:33.566 INFO:tasks.workunit.client.0.smithi059.stdout:1/23: dread f1 [0,4194304] 0 2024-04-25T16:14:33.571 INFO:tasks.workunit.client.0.smithi059.stdout:1/24: readlink l3 0 2024-04-25T16:14:33.615 INFO:tasks.workunit.client.0.smithi059.stdout:6/18: truncate f2 1318389 0 2024-04-25T16:14:33.624 INFO:tasks.workunit.client.0.smithi059.stdout:0/33: chown l8 32317715 1 2024-04-25T16:14:33.624 INFO:tasks.workunit.client.0.smithi059.stdout:6/19: dread - f3 zero size 2024-04-25T16:14:33.646 INFO:tasks.workunit.client.0.smithi059.stdout:0/34: write f9 [1062900,109851] 0 2024-04-25T16:14:33.661 INFO:tasks.workunit.client.0.smithi059.stdout:0/35: read f9 [591815,74568] 0 2024-04-25T16:14:33.725 INFO:tasks.workunit.client.0.smithi059.stdout:9/15: write f0 [1357356,30630] 0 2024-04-25T16:14:33.819 INFO:tasks.workunit.client.0.smithi059.stdout:2/21: symlink la 0 2024-04-25T16:14:33.871 INFO:tasks.workunit.client.0.smithi059.stdout:4/15: dwrite d0/f2 [0,4194304] 0 2024-04-25T16:14:33.933 INFO:tasks.workunit.client.0.smithi059.stdout:5/20: unlink d1/f2 0 2024-04-25T16:14:33.949 INFO:tasks.workunit.client.0.smithi059.stdout:4/16: fdatasync d0/f2 0 2024-04-25T16:14:33.961 INFO:tasks.workunit.client.0.smithi059.stdout:5/21: fsync d1/f3 0 2024-04-25T16:14:33.985 INFO:tasks.workunit.client.0.smithi059.stdout:3/17: chown d0/c5 88 1 2024-04-25T16:14:33.991 INFO:tasks.workunit.client.0.smithi059.stdout:5/22: write d1/f3 [261520,100632] 0 2024-04-25T16:14:34.005 INFO:tasks.workunit.client.0.smithi059.stdout:1/25: mknod c6 0 2024-04-25T16:14:34.018 INFO:tasks.workunit.client.0.smithi059.stdout:5/23: rename d1 to d1/d5 22 2024-04-25T16:14:34.025 INFO:tasks.workunit.client.0.smithi059.stdout:3/18: chown d0/c3 43 1 2024-04-25T16:14:34.142 INFO:tasks.workunit.client.0.smithi059.stdout:6/20: unlink f4 0 2024-04-25T16:14:34.225 INFO:tasks.workunit.client.0.smithi059.stdout:8/20: mknod c4 0 2024-04-25T16:14:34.319 INFO:tasks.workunit.client.0.smithi059.stdout:8/21: sync 2024-04-25T16:14:34.340 INFO:tasks.workunit.client.0.smithi059.stdout:8/22: dread f3 [0,4194304] 0 2024-04-25T16:14:34.365 INFO:tasks.workunit.client.0.smithi059.stdout:9/16: creat f1 x:0 0 0 2024-04-25T16:14:34.470 INFO:tasks.workunit.client.0.smithi059.stdout:9/17: dwrite f0 [0,4194304] 0 2024-04-25T16:14:34.852 INFO:tasks.workunit.client.0.smithi059.stdout:4/17: mkdir d0/d4 0 2024-04-25T16:14:34.860 INFO:tasks.workunit.client.0.smithi059.stdout:5/24: mknod d1/c6 0 2024-04-25T16:14:34.875 INFO:tasks.workunit.client.0.smithi059.stdout:6/21: mknod c5 0 2024-04-25T16:14:34.876 INFO:tasks.workunit.client.0.smithi059.stdout:3/19: creat d0/f7 x:0 0 0 2024-04-25T16:14:34.908 INFO:tasks.workunit.client.0.smithi059.stdout:0/36: rename f4 to fa 0 2024-04-25T16:14:34.908 INFO:tasks.workunit.client.0.smithi059.stdout:0/37: rmdir - no directory 2024-04-25T16:14:34.995 INFO:tasks.workunit.client.0.smithi059.stdout:3/20: write d0/f6 [1013508,123974] 0 2024-04-25T16:14:35.030 INFO:tasks.workunit.client.0.smithi059.stdout:4/18: symlink d0/l5 0 2024-04-25T16:14:35.037 INFO:tasks.workunit.client.0.smithi059.stdout:1/26: dread f1 [0,4194304] 0 2024-04-25T16:14:35.046 INFO:tasks.workunit.client.0.smithi059.stdout:6/22: dread f0 [0,4194304] 0 2024-04-25T16:14:35.162 INFO:tasks.workunit.client.0.smithi059.stdout:7/21: link d0/c5 d0/c6 0 2024-04-25T16:14:35.162 INFO:tasks.workunit.client.0.smithi059.stdout:7/22: dwrite - no filename 2024-04-25T16:14:35.252 INFO:tasks.workunit.client.0.smithi059.stdout:9/18: link f0 f2 0 2024-04-25T16:14:35.260 INFO:tasks.workunit.client.0.smithi059.stdout:9/19: chown f0 911 1 2024-04-25T16:14:35.344 INFO:tasks.workunit.client.0.smithi059.stdout:3/21: symlink d0/l8 0 2024-04-25T16:14:35.351 INFO:tasks.workunit.client.0.smithi059.stdout:3/22: chown d0/l2 4 1 2024-04-25T16:14:35.358 INFO:tasks.workunit.client.0.smithi059.stdout:3/23: chown d0/f6 3024 1 2024-04-25T16:14:35.382 INFO:tasks.workunit.client.0.smithi059.stdout:1/27: mkdir d7 0 2024-04-25T16:14:35.385 INFO:tasks.workunit.client.0.smithi059.stdout:1/28: readlink l5 0 2024-04-25T16:14:35.429 INFO:tasks.workunit.client.0.smithi059.stdout:6/23: creat f6 x:0 0 0 2024-04-25T16:14:35.436 INFO:tasks.workunit.client.0.smithi059.stdout:6/24: chown f0 675 1 2024-04-25T16:14:35.444 INFO:tasks.workunit.client.0.smithi059.stdout:6/25: truncate f3 376412 0 2024-04-25T16:14:35.477 INFO:tasks.workunit.client.0.smithi059.stdout:4/19: rename d0/l5 to d0/l6 0 2024-04-25T16:14:35.755 INFO:tasks.workunit.client.0.smithi059.stdout:7/23: mkdir d0/d7 0 2024-04-25T16:14:35.755 INFO:tasks.workunit.client.0.smithi059.stdout:7/24: write - no filename 2024-04-25T16:14:35.755 INFO:tasks.workunit.client.0.smithi059.stdout:7/25: fdatasync - no filename 2024-04-25T16:14:35.766 INFO:tasks.workunit.client.0.smithi059.stdout:9/20: mknod c3 0 2024-04-25T16:14:35.824 INFO:tasks.workunit.client.0.smithi059.stdout:3/24: symlink d0/l9 0 2024-04-25T16:14:35.875 INFO:tasks.workunit.client.0.smithi059.stdout:3/25: read d0/f6 [759579,47443] 0 2024-04-25T16:14:35.951 INFO:tasks.workunit.client.0.smithi059.stdout:3/26: dwrite d0/f6 [0,4194304] 0 2024-04-25T16:14:36.046 INFO:tasks.workunit.client.0.smithi059.stdout:8/23: rename c1 to c5 0 2024-04-25T16:14:36.062 INFO:tasks.workunit.client.0.smithi059.stdout:5/25: link d1/l4 d1/l7 0 2024-04-25T16:14:36.062 INFO:tasks.workunit.client.0.smithi059.stdout:0/38: link l3 lb 0 2024-04-25T16:14:36.161 INFO:tasks.workunit.client.0.smithi059.stdout:1/29: symlink d7/l8 0 2024-04-25T16:14:36.175 INFO:tasks.workunit.client.0.smithi059.stdout:4/20: symlink d0/d4/l7 0 2024-04-25T16:14:36.178 INFO:tasks.workunit.client.0.smithi059.stdout:5/26: write d1/f3 [904528,52249] 0 2024-04-25T16:14:36.191 INFO:tasks.workunit.client.0.smithi059.stdout:3/27: creat d0/fa x:0 0 0 2024-04-25T16:14:36.253 INFO:tasks.workunit.client.0.smithi059.stdout:1/30: read f1 [2870172,67236] 0 2024-04-25T16:14:36.315 INFO:tasks.workunit.client.0.smithi059.stdout:2/22: dwrite f9 [0,4194304] 0 2024-04-25T16:14:36.393 INFO:tasks.workunit.client.0.smithi059.stdout:2/23: stat f9 0 2024-04-25T16:14:36.393 INFO:tasks.workunit.client.0.smithi059.stdout:2/24: rmdir - no directory 2024-04-25T16:14:36.395 INFO:tasks.workunit.client.0.smithi059.stdout:9/21: dwrite f2 [0,4194304] 0 2024-04-25T16:14:36.480 INFO:tasks.workunit.client.0.smithi059.stdout:9/22: chown f0 127 1 2024-04-25T16:14:36.499 INFO:tasks.workunit.client.0.smithi059.stdout:6/26: truncate f0 1219428 0 2024-04-25T16:14:36.560 INFO:tasks.workunit.client.0.smithi059.stdout:3/28: mkdir d0/db 0 2024-04-25T16:14:36.607 INFO:tasks.workunit.client.0.smithi059.stdout:9/23: dwrite f1 [0,4194304] 0 2024-04-25T16:14:36.614 INFO:tasks.workunit.client.0.smithi059.stdout:4/21: creat d0/d4/f8 x:0 0 0 2024-04-25T16:14:36.615 INFO:tasks.workunit.client.0.smithi059.stdout:3/29: chown d0/l2 6388 1 2024-04-25T16:14:36.687 INFO:tasks.workunit.client.0.smithi059.stdout:5/27: creat d1/f8 x:0 0 0 2024-04-25T16:14:36.706 INFO:tasks.workunit.client.0.smithi059.stdout:4/22: fdatasync d0/d4/f8 0 2024-04-25T16:14:36.721 INFO:tasks.workunit.client.0.smithi059.stdout:5/28: truncate d1/f3 1693358 0 2024-04-25T16:14:36.727 INFO:tasks.workunit.client.0.smithi059.stdout:3/30: sync 2024-04-25T16:14:36.735 INFO:tasks.workunit.client.0.smithi059.stdout:4/23: dread - d0/d4/f8 zero size 2024-04-25T16:14:36.783 INFO:tasks.workunit.client.0.smithi059.stdout:7/26: link d0/c5 d0/d7/c8 0 2024-04-25T16:14:36.819 INFO:tasks.workunit.client.0.smithi059.stdout:4/24: sync 2024-04-25T16:14:36.849 INFO:tasks.workunit.client.0.smithi059.stdout:0/39: truncate fa 3163283 0 2024-04-25T16:14:36.913 INFO:tasks.workunit.client.0.smithi059.stdout:6/27: dread f2 [0,4194304] 0 2024-04-25T16:14:37.072 INFO:tasks.workunit.client.0.smithi059.stdout:5/29: mknod d1/c9 0 2024-04-25T16:14:37.080 INFO:tasks.workunit.client.0.smithi059.stdout:3/31: mknod d0/cc 0 2024-04-25T16:14:37.088 INFO:tasks.workunit.client.0.smithi059.stdout:5/30: dread - d1/f8 zero size 2024-04-25T16:14:37.114 INFO:tasks.workunit.client.0.smithi059.stdout:5/31: write d1/f8 [889242,99196] 0 2024-04-25T16:14:37.128 INFO:tasks.workunit.client.0.smithi059.stdout:7/27: rmdir d0 39 2024-04-25T16:14:37.128 INFO:tasks.workunit.client.0.smithi059.stdout:7/28: write - no filename 2024-04-25T16:14:37.153 INFO:tasks.workunit.client.0.smithi059.stdout:3/32: sync 2024-04-25T16:14:37.159 INFO:tasks.workunit.client.0.smithi059.stdout:3/33: chown d0/l9 98182 1 2024-04-25T16:14:37.258 INFO:tasks.workunit.client.0.smithi059.stdout:4/25: mkdir d0/d9 0 2024-04-25T16:14:37.303 INFO:tasks.workunit.client.0.smithi059.stdout:4/26: dread d0/f2 [0,4194304] 0 2024-04-25T16:14:37.327 INFO:tasks.workunit.client.0.smithi059.stdout:6/28: symlink l7 0 2024-04-25T16:14:37.370 INFO:tasks.workunit.client.0.smithi059.stdout:0/40: dread f9 [0,4194304] 0 2024-04-25T16:14:37.420 INFO:tasks.workunit.client.0.smithi059.stdout:8/24: rename c2 to c6 0 2024-04-25T16:14:37.435 INFO:tasks.workunit.client.0.smithi059.stdout:8/25: stat c4 0 2024-04-25T16:14:37.487 INFO:tasks.workunit.client.0.smithi059.stdout:5/32: creat d1/fa x:0 0 0 2024-04-25T16:14:37.503 INFO:tasks.workunit.client.0.smithi059.stdout:2/25: write f2 [547557,43871] 0 2024-04-25T16:14:37.526 INFO:tasks.workunit.client.0.smithi059.stdout:7/29: chown d0/d7 7990 1 2024-04-25T16:14:37.526 INFO:tasks.workunit.client.0.smithi059.stdout:7/30: write - no filename 2024-04-25T16:14:37.553 INFO:tasks.workunit.client.0.smithi059.stdout:5/33: chown d1/fa 119170154 1 2024-04-25T16:14:37.576 INFO:tasks.workunit.client.0.smithi059.stdout:1/31: dwrite f1 [4194304,4194304] 0 2024-04-25T16:14:37.653 INFO:tasks.workunit.client.0.smithi059.stdout:5/34: chown l0 11 1 2024-04-25T16:14:37.659 INFO:tasks.workunit.client.0.smithi059.stdout:1/32: chown l0 97872647 1 2024-04-25T16:14:37.666 INFO:tasks.workunit.client.0.smithi059.stdout:1/33: readlink l5 0 2024-04-25T16:14:37.671 INFO:tasks.workunit.client.0.smithi059.stdout:1/34: stat d7 0 2024-04-25T16:14:37.718 INFO:tasks.workunit.client.0.smithi059.stdout:1/35: dread f1 [0,4194304] 0 2024-04-25T16:14:37.733 INFO:tasks.workunit.client.0.smithi059.stdout:0/41: mkdir dc 0 2024-04-25T16:14:37.757 INFO:tasks.workunit.client.0.smithi059.stdout:8/26: dread f3 [0,4194304] 0 2024-04-25T16:14:37.789 INFO:tasks.workunit.client.0.smithi059.stdout:1/36: dread f2 [0,4194304] 0 2024-04-25T16:14:37.812 INFO:tasks.workunit.client.0.smithi059.stdout:2/26: creat fb x:0 0 0 2024-04-25T16:14:37.820 INFO:tasks.workunit.client.0.smithi059.stdout:2/27: fsync f2 0 2024-04-25T16:14:37.989 INFO:tasks.workunit.client.0.smithi059.stdout:5/35: mknod d1/cb 0 2024-04-25T16:14:38.074 INFO:tasks.workunit.client.0.smithi059.stdout:6/29: dwrite f2 [0,4194304] 0 2024-04-25T16:14:38.167 INFO:tasks.workunit.client.0.smithi059.stdout:9/24: getdents . 0 2024-04-25T16:14:38.263 INFO:tasks.workunit.client.0.smithi059.stdout:5/36: dwrite d1/f8 [0,4194304] 0 2024-04-25T16:14:38.329 INFO:tasks.workunit.client.0.smithi059.stdout:3/34: link d0/c3 d0/cd 0 2024-04-25T16:14:38.403 INFO:tasks.workunit.client.0.smithi059.stdout:3/35: sync 2024-04-25T16:14:38.491 INFO:tasks.workunit.client.0.smithi059.stdout:7/31: creat d0/d7/f9 x:0 0 0 2024-04-25T16:14:38.530 INFO:tasks.workunit.client.0.smithi059.stdout:4/27: rmdir d0/d9 0 2024-04-25T16:14:38.544 INFO:tasks.workunit.client.0.smithi059.stdout:4/28: write d0/f2 [1345281,92769] 0 2024-04-25T16:14:38.612 INFO:tasks.workunit.client.0.smithi059.stdout:4/29: sync 2024-04-25T16:14:38.739 INFO:tasks.workunit.client.0.smithi059.stdout:9/25: symlink l4 0 2024-04-25T16:14:38.744 INFO:tasks.workunit.client.0.smithi059.stdout:6/30: creat f8 x:0 0 0 2024-04-25T16:14:38.754 INFO:tasks.workunit.client.0.smithi059.stdout:8/27: mkdir d7 0 2024-04-25T16:14:38.757 INFO:tasks.workunit.client.0.smithi059.stdout:1/37: unlink f1 0 2024-04-25T16:14:38.799 INFO:tasks.workunit.client.0.smithi059.stdout:6/31: write f6 [176274,118474] 0 2024-04-25T16:14:38.858 INFO:tasks.workunit.client.0.smithi059.stdout:9/26: dread f2 [0,4194304] 0 2024-04-25T16:14:38.877 INFO:tasks.workunit.client.0.smithi059.stdout:9/27: fdatasync f2 0 2024-04-25T16:14:38.889 INFO:tasks.workunit.client.0.smithi059.stdout:3/36: read d0/f6 [3329919,10870] 0 2024-04-25T16:14:38.906 INFO:tasks.workunit.client.0.smithi059.stdout:3/37: write d0/fa [182899,11926] 0 2024-04-25T16:14:38.934 INFO:tasks.workunit.client.0.smithi059.stdout:7/32: creat d0/d7/fa x:0 0 0 2024-04-25T16:14:38.983 INFO:tasks.workunit.client.0.smithi059.stdout:7/33: dread - d0/d7/f9 zero size 2024-04-25T16:14:39.053 INFO:tasks.workunit.client.0.smithi059.stdout:3/38: dwrite d0/fa [0,4194304] 0 2024-04-25T16:14:39.131 INFO:tasks.workunit.client.0.smithi059.stdout:4/30: unlink d0/d4/l7 0 2024-04-25T16:14:39.136 INFO:tasks.workunit.client.0.smithi059.stdout:1/38: fdatasync f2 0 2024-04-25T16:14:39.150 INFO:tasks.workunit.client.0.smithi059.stdout:3/39: write d0/fa [1523087,53943] 0 2024-04-25T16:14:39.176 INFO:tasks.workunit.client.0.smithi059.stdout:1/39: write f2 [1686021,38077] 0 2024-04-25T16:14:39.184 INFO:tasks.workunit.client.0.smithi059.stdout:8/28: truncate f3 842851 0 2024-04-25T16:14:39.190 INFO:tasks.workunit.client.0.smithi059.stdout:4/31: write d0/f2 [2650731,119447] 0 2024-04-25T16:14:39.227 INFO:tasks.workunit.client.0.smithi059.stdout:6/32: mkdir d9 0 2024-04-25T16:14:39.286 INFO:tasks.workunit.client.0.smithi059.stdout:2/28: link c8 cc 0 2024-04-25T16:14:39.334 INFO:tasks.workunit.client.0.smithi059.stdout:9/28: symlink l5 0 2024-04-25T16:14:39.339 INFO:tasks.workunit.client.0.smithi059.stdout:9/29: chown c3 12 1 2024-04-25T16:14:39.426 INFO:tasks.workunit.client.0.smithi059.stdout:7/34: symlink d0/d7/lb 0 2024-04-25T16:14:39.434 INFO:tasks.workunit.client.0.smithi059.stdout:7/35: dread - d0/d7/fa zero size 2024-04-25T16:14:39.544 INFO:tasks.workunit.client.0.smithi059.stdout:7/36: dwrite d0/d7/fa [0,4194304] 0 2024-04-25T16:14:39.629 INFO:tasks.workunit.client.0.smithi059.stdout:7/37: fsync d0/d7/fa 0 2024-04-25T16:14:39.693 INFO:tasks.workunit.client.0.smithi059.stdout:4/32: chown d0/l6 551185833 1 2024-04-25T16:14:39.752 INFO:tasks.workunit.client.0.smithi059.stdout:6/33: dread f0 [0,4194304] 0 2024-04-25T16:14:39.779 INFO:tasks.workunit.client.0.smithi059.stdout:4/33: dread d0/f2 [0,4194304] 0 2024-04-25T16:14:39.793 INFO:tasks.workunit.client.0.smithi059.stdout:4/34: chown d0/d4 906422404 1 2024-04-25T16:14:39.812 INFO:tasks.workunit.client.0.smithi059.stdout:0/42: write fa [3414873,14214] 0 2024-04-25T16:14:39.875 INFO:tasks.workunit.client.0.smithi059.stdout:2/29: creat fd x:0 0 0 2024-04-25T16:14:39.890 INFO:tasks.workunit.client.0.smithi059.stdout:9/30: write f2 [3306999,96934] 0 2024-04-25T16:14:40.063 INFO:tasks.workunit.client.0.smithi059.stdout:3/40: write d0/fa [4352213,106701] 0 2024-04-25T16:14:40.271 INFO:tasks.workunit.client.0.smithi059.stdout:6/34: rename f0 to d9/fa 0 2024-04-25T16:14:40.347 INFO:tasks.workunit.client.0.smithi059.stdout:5/37: link d1/l7 d1/lc 0 2024-04-25T16:14:40.352 INFO:tasks.workunit.client.0.smithi059.stdout:1/40: truncate f2 3578467 0 2024-04-25T16:14:40.367 INFO:tasks.workunit.client.0.smithi059.stdout:5/38: truncate d1/fa 93834 0 2024-04-25T16:14:40.451 INFO:tasks.workunit.client.0.smithi059.stdout:2/30: mkdir de 0 2024-04-25T16:14:40.458 INFO:tasks.workunit.client.0.smithi059.stdout:9/31: mkdir d6 0 2024-04-25T16:14:40.464 INFO:tasks.workunit.client.0.smithi059.stdout:8/29: read f3 [135765,72425] 0 2024-04-25T16:14:40.546 INFO:tasks.workunit.client.0.smithi059.stdout:9/32: sync 2024-04-25T16:14:40.611 INFO:tasks.workunit.client.0.smithi059.stdout:3/41: rename d0/cd to d0/ce 0 2024-04-25T16:14:40.618 INFO:tasks.workunit.client.0.smithi059.stdout:4/35: unlink d0/f2 0 2024-04-25T16:14:40.631 INFO:tasks.workunit.client.0.smithi059.stdout:0/43: mkdir dc/dd 0 2024-04-25T16:14:40.643 INFO:tasks.workunit.client.0.smithi059.stdout:5/39: mkdir d1/dd 0 2024-04-25T16:14:40.668 INFO:tasks.workunit.client.0.smithi059.stdout:5/40: read d1/f8 [985376,96147] 0 2024-04-25T16:14:40.878 INFO:tasks.workunit.client.0.smithi059.stdout:3/42: fdatasync d0/f6 0 2024-04-25T16:14:40.899 INFO:tasks.workunit.client.0.smithi059.stdout:3/43: read d0/fa [4379774,103032] 0 2024-04-25T16:14:40.923 INFO:tasks.workunit.client.0.smithi059.stdout:4/36: creat d0/d4/fa x:0 0 0 2024-04-25T16:14:41.142 INFO:tasks.workunit.client.0.smithi059.stdout:5/41: rename d1/c9 to d1/ce 0 2024-04-25T16:14:41.304 INFO:tasks.workunit.client.0.smithi059.stdout:2/31: mknod de/cf 0 2024-04-25T16:14:41.309 INFO:tasks.workunit.client.0.smithi059.stdout:7/38: getdents d0 0 2024-04-25T16:14:41.314 INFO:tasks.workunit.client.0.smithi059.stdout:8/30: symlink d7/l8 0 2024-04-25T16:14:41.320 INFO:tasks.workunit.client.0.smithi059.stdout:9/33: creat d6/f7 x:0 0 0 2024-04-25T16:14:41.327 INFO:tasks.workunit.client.0.smithi059.stdout:6/35: unlink d9/fa 0 2024-04-25T16:14:41.341 INFO:tasks.workunit.client.0.smithi059.stdout:3/44: dread - d0/f7 zero size 2024-04-25T16:14:41.355 INFO:tasks.workunit.client.0.smithi059.stdout:1/41: write f2 [3062964,42896] 0 2024-04-25T16:14:41.371 INFO:tasks.workunit.client.0.smithi059.stdout:4/37: mknod d0/cb 0 2024-04-25T16:14:41.384 INFO:tasks.workunit.client.0.smithi059.stdout:2/32: write fb [304497,76220] 0 2024-04-25T16:14:41.388 INFO:tasks.workunit.client.0.smithi059.stdout:6/36: dread - f8 zero size 2024-04-25T16:14:41.407 INFO:tasks.workunit.client.0.smithi059.stdout:9/34: chown d6/f7 30 1 2024-04-25T16:14:41.420 INFO:tasks.workunit.client.0.smithi059.stdout:1/42: readlink d7/l8 0 2024-04-25T16:14:41.431 INFO:tasks.workunit.client.0.smithi059.stdout:9/35: chown d6 1219496 1 2024-04-25T16:14:41.440 INFO:tasks.workunit.client.0.smithi059.stdout:0/44: mknod dc/dd/ce 0 2024-04-25T16:14:41.446 INFO:tasks.workunit.client.0.smithi059.stdout:6/37: dread - f8 zero size 2024-04-25T16:14:41.465 INFO:tasks.workunit.client.0.smithi059.stdout:2/33: truncate f9 4211101 0 2024-04-25T16:14:41.478 INFO:tasks.workunit.client.0.smithi059.stdout:1/43: write f2 [1416143,97888] 0 2024-04-25T16:14:41.543 INFO:tasks.workunit.client.0.smithi059.stdout:0/45: dread f9 [0,4194304] 0 2024-04-25T16:14:41.553 INFO:tasks.workunit.client.0.smithi059.stdout:7/39: rmdir d0/d7 39 2024-04-25T16:14:41.633 INFO:tasks.workunit.client.0.smithi059.stdout:0/46: dwrite fa [0,4194304] 0 2024-04-25T16:14:41.777 INFO:tasks.workunit.client.0.smithi059.stdout:8/31: truncate f3 1328121 0 2024-04-25T16:14:41.789 INFO:tasks.workunit.client.0.smithi059.stdout:5/42: creat d1/dd/ff x:0 0 0 2024-04-25T16:14:41.791 INFO:tasks.workunit.client.0.smithi059.stdout:4/38: creat d0/fc x:0 0 0 2024-04-25T16:14:41.819 INFO:tasks.workunit.client.0.smithi059.stdout:4/39: dread - d0/d4/fa zero size 2024-04-25T16:14:41.834 INFO:tasks.workunit.client.0.smithi059.stdout:4/40: write d0/fc [927935,33854] 0 2024-04-25T16:14:41.844 INFO:tasks.workunit.client.0.smithi059.stdout:4/41: stat d0/l6 0 2024-04-25T16:14:41.852 INFO:tasks.workunit.client.0.smithi059.stdout:4/42: read - d0/d4/f8 zero size 2024-04-25T16:14:41.962 INFO:tasks.workunit.client.0.smithi059.stdout:2/34: creat de/f10 x:0 0 0 2024-04-25T16:14:41.972 INFO:tasks.workunit.client.0.smithi059.stdout:1/44: creat d7/f9 x:0 0 0 2024-04-25T16:14:42.002 INFO:tasks.workunit.client.0.smithi059.stdout:1/45: write d7/f9 [430623,43347] 0 2024-04-25T16:14:42.043 INFO:tasks.workunit.client.0.smithi059.stdout:3/45: truncate d0/f7 686932 0 2024-04-25T16:14:42.138 INFO:tasks.workunit.client.0.smithi059.stdout:2/35: dwrite f2 [0,4194304] 0 2024-04-25T16:14:42.203 INFO:tasks.workunit.client.0.smithi059.stdout:0/47: mkdir dc/df 0 2024-04-25T16:14:42.226 INFO:tasks.workunit.client.0.smithi059.stdout:5/43: creat d1/f10 x:0 0 0 2024-04-25T16:14:42.229 INFO:tasks.workunit.client.0.smithi059.stdout:4/43: mknod d0/d4/cd 0 2024-04-25T16:14:42.229 INFO:tasks.workunit.client.0.smithi059.stdout:8/32: creat d7/f9 x:0 0 0 2024-04-25T16:14:42.233 INFO:tasks.workunit.client.0.smithi059.stdout:2/36: chown l0 380779 1 2024-04-25T16:14:42.442 INFO:tasks.workunit.client.0.smithi059.stdout:7/40: mknod d0/cc 0 2024-04-25T16:14:42.442 INFO:tasks.workunit.client.0.smithi059.stdout:1/46: rename l3 to d7/la 0 2024-04-25T16:14:42.554 INFO:tasks.workunit.client.0.smithi059.stdout:1/47: dwrite f2 [0,4194304] 0 2024-04-25T16:14:42.625 INFO:tasks.workunit.client.0.smithi059.stdout:2/37: stat c8 0 2024-04-25T16:14:42.722 INFO:tasks.workunit.client.0.smithi059.stdout:1/48: dwrite d7/f9 [0,4194304] 0 2024-04-25T16:14:42.816 INFO:tasks.workunit.client.0.smithi059.stdout:9/36: truncate f0 394462 0 2024-04-25T16:14:42.818 INFO:tasks.workunit.client.0.smithi059.stdout:5/44: creat d1/f11 x:0 0 0 2024-04-25T16:14:42.838 INFO:tasks.workunit.client.0.smithi059.stdout:5/45: dread - d1/f11 zero size 2024-04-25T16:14:43.153 INFO:tasks.workunit.client.0.smithi059.stdout:4/44: rename d0/d4/fa to d0/d4/fe 0 2024-04-25T16:14:43.171 INFO:tasks.workunit.client.0.smithi059.stdout:3/46: unlink d0/c5 0 2024-04-25T16:14:43.172 INFO:tasks.workunit.client.0.smithi059.stdout:6/38: getdents d9 0 2024-04-25T16:14:43.175 INFO:tasks.workunit.client.0.smithi059.stdout:8/33: truncate f3 1463244 0 2024-04-25T16:14:43.181 INFO:tasks.workunit.client.0.smithi059.stdout:2/38: symlink de/l11 0 2024-04-25T16:14:43.192 INFO:tasks.workunit.client.0.smithi059.stdout:0/48: creat dc/df/f10 x:0 0 0 2024-04-25T16:14:43.235 INFO:tasks.workunit.client.0.smithi059.stdout:1/49: creat d7/fb x:0 0 0 2024-04-25T16:14:43.247 INFO:tasks.workunit.client.0.smithi059.stdout:7/41: chown d0/c6 1924494 1 2024-04-25T16:14:43.255 INFO:tasks.workunit.client.0.smithi059.stdout:5/46: creat d1/dd/f12 x:0 0 0 2024-04-25T16:14:43.269 INFO:tasks.workunit.client.0.smithi059.stdout:6/39: dread - f8 zero size 2024-04-25T16:14:43.274 INFO:tasks.workunit.client.0.smithi059.stdout:8/34: write d7/f9 [117486,84861] 0 2024-04-25T16:14:43.293 INFO:tasks.workunit.client.0.smithi059.stdout:2/39: write fb [408725,90054] 0 2024-04-25T16:14:43.378 INFO:tasks.workunit.client.0.smithi059.stdout:2/40: write fd [338457,93001] 0 2024-04-25T16:14:43.395 INFO:tasks.workunit.client.0.smithi059.stdout:8/35: sync 2024-04-25T16:14:43.423 INFO:tasks.workunit.client.0.smithi059.stdout:6/40: dread f6 [0,4194304] 0 2024-04-25T16:14:43.510 INFO:tasks.workunit.client.0.smithi059.stdout:4/45: dwrite d0/fc [0,4194304] 0 2024-04-25T16:14:43.687 INFO:tasks.workunit.client.0.smithi059.stdout:5/47: dwrite d1/f10 [0,4194304] 0 2024-04-25T16:14:43.827 INFO:tasks.workunit.client.0.smithi059.stdout:8/36: unlink d7/l8 0 2024-04-25T16:14:43.838 INFO:tasks.workunit.client.0.smithi059.stdout:6/41: mknod d9/cb 0 2024-04-25T16:14:43.841 INFO:tasks.workunit.client.0.smithi059.stdout:2/41: dwrite f9 [4194304,4194304] 0 2024-04-25T16:14:43.844 INFO:tasks.workunit.client.0.smithi059.stdout:1/50: creat d7/fc x:0 0 0 2024-04-25T16:14:43.904 INFO:tasks.workunit.client.0.smithi059.stdout:8/37: sync 2024-04-25T16:14:43.949 INFO:tasks.workunit.client.0.smithi059.stdout:7/42: chown d0/d7/c8 1979323 1 2024-04-25T16:14:44.008 INFO:tasks.workunit.client.0.smithi059.stdout:7/43: write d0/d7/fa [2746263,94480] 0 2024-04-25T16:14:44.027 INFO:tasks.workunit.client.0.smithi059.stdout:5/48: rmdir d1/dd 39 2024-04-25T16:14:44.098 INFO:tasks.workunit.client.0.smithi059.stdout:1/51: dwrite d7/fb [0,4194304] 0 2024-04-25T16:14:44.183 INFO:tasks.workunit.client.0.smithi059.stdout:3/47: write d0/f6 [4653117,120385] 0 2024-04-25T16:14:44.211 INFO:tasks.workunit.client.0.smithi059.stdout:1/52: write d7/fb [2485142,70971] 0 2024-04-25T16:14:44.299 INFO:tasks.workunit.client.0.smithi059.stdout:2/42: creat de/f12 x:0 0 0 2024-04-25T16:14:44.315 INFO:tasks.workunit.client.0.smithi059.stdout:8/38: creat d7/fa x:0 0 0 2024-04-25T16:14:44.318 INFO:tasks.workunit.client.0.smithi059.stdout:6/42: read f3 [255840,62881] 0 2024-04-25T16:14:44.338 INFO:tasks.workunit.client.0.smithi059.stdout:6/43: dread - f8 zero size 2024-04-25T16:14:44.355 INFO:tasks.workunit.client.0.smithi059.stdout:6/44: dread f3 [0,4194304] 0 2024-04-25T16:14:44.359 INFO:tasks.workunit.client.0.smithi059.stdout:6/45: readlink l7 0 2024-04-25T16:14:44.453 INFO:tasks.workunit.client.0.smithi059.stdout:9/37: dread f2 [0,4194304] 0 2024-04-25T16:14:44.488 INFO:tasks.workunit.client.0.smithi059.stdout:3/48: creat d0/ff x:0 0 0 2024-04-25T16:14:44.559 INFO:tasks.workunit.client.0.smithi059.stdout:4/46: truncate d0/fc 1458420 0 2024-04-25T16:14:44.566 INFO:tasks.workunit.client.0.smithi059.stdout:1/53: creat d7/fd x:0 0 0 2024-04-25T16:14:44.626 INFO:tasks.workunit.client.0.smithi059.stdout:1/54: dread d7/fb [0,4194304] 0 2024-04-25T16:14:44.649 INFO:tasks.workunit.client.0.smithi059.stdout:0/49: getdents dc 0 2024-04-25T16:14:44.694 INFO:tasks.workunit.client.0.smithi059.stdout:8/39: creat d7/fb x:0 0 0 2024-04-25T16:14:44.714 INFO:tasks.workunit.client.0.smithi059.stdout:6/46: mknod d9/cc 0 2024-04-25T16:14:44.787 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:14:44.788 INFO:tasks.workunit.client.0.smithi059.stdout:6/47: sync 2024-04-25T16:14:44.791 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:14:44.969 INFO:tasks.workunit.client.0.smithi059.stdout:9/38: rename l5 to d6/l8 0 2024-04-25T16:14:44.969 INFO:tasks.workunit.client.0.smithi059.stdout:5/49: creat d1/dd/f13 x:0 0 0 2024-04-25T16:14:44.984 INFO:tasks.workunit.client.0.smithi059.stdout:4/47: mkdir d0/d4/df 0 2024-04-25T16:14:44.991 INFO:tasks.workunit.client.0.smithi059.stdout:1/55: mknod d7/ce 0 2024-04-25T16:14:45.004 INFO:tasks.workunit.client.0.smithi059.stdout:2/43: unlink de/f12 0 2024-04-25T16:14:45.040 INFO:tasks.workunit.client.0.smithi059.stdout:2/44: stat f4 0 2024-04-25T16:14:45.137 INFO:tasks.workunit.client.0.smithi059.stdout:7/44: creat d0/fd x:0 0 0 2024-04-25T16:14:45.199 INFO:tasks.workunit.client.0.smithi059.stdout:3/49: dread d0/fa [0,4194304] 0 2024-04-25T16:14:45.238 INFO:tasks.workunit.client.0.smithi059.stdout:0/50: dread f6 [0,4194304] 0 2024-04-25T16:14:45.246 INFO:tasks.workunit.client.0.smithi059.stdout:8/40: link d7/fb d7/fc 0 2024-04-25T16:14:45.261 INFO:tasks.workunit.client.0.smithi059.stdout:1/56: symlink d7/lf 0 2024-04-25T16:14:45.273 INFO:tasks.workunit.client.0.smithi059.stdout:4/48: symlink d0/d4/l10 0 2024-04-25T16:14:45.383 INFO:tasks.workunit.client.0.smithi059.stdout:0/51: write fa [3960540,5729] 0 2024-04-25T16:14:45.385 INFO:tasks.workunit.client.0.smithi059.stdout:5/50: dwrite d1/dd/f13 [0,4194304] 0 2024-04-25T16:14:45.463 INFO:tasks.workunit.client.0.smithi059.stdout:8/41: write d7/fa [210534,48712] 0 2024-04-25T16:14:45.477 INFO:tasks.workunit.client.0.smithi059.stdout:6/48: link f2 d9/fd 0 2024-04-25T16:14:45.492 INFO:tasks.workunit.client.0.smithi059.stdout:9/39: dwrite d6/f7 [0,4194304] 0 2024-04-25T16:14:45.671 INFO:tasks.workunit.client.0.smithi059.stdout:0/52: dread fa [0,4194304] 0 2024-04-25T16:14:45.700 INFO:tasks.workunit.client.0.smithi059.stdout:1/57: creat d7/f10 x:0 0 0 2024-04-25T16:14:45.751 INFO:tasks.workunit.client.0.smithi059.stdout:5/51: dwrite d1/dd/f13 [0,4194304] 0 2024-04-25T16:14:45.815 INFO:tasks.workunit.client.0.smithi059.stdout:7/45: mknod d0/ce 0 2024-04-25T16:14:45.831 INFO:tasks.workunit.client.0.smithi059.stdout:7/46: stat d0/d7/fa 0 2024-04-25T16:14:45.837 INFO:tasks.workunit.client.0.smithi059.stdout:7/47: stat d0/c5 0 2024-04-25T16:14:45.849 INFO:tasks.workunit.client.0.smithi059.stdout:8/42: mkdir d7/dd 0 2024-04-25T16:14:45.850 INFO:tasks.workunit.client.0.smithi059.stdout:7/48: stat d0 0 2024-04-25T16:14:45.892 INFO:tasks.workunit.client.0.smithi059.stdout:6/49: creat d9/fe x:0 0 0 2024-04-25T16:14:45.958 INFO:tasks.workunit.client.0.smithi059.stdout:9/40: fdatasync f0 0 2024-04-25T16:14:46.184 INFO:tasks.workunit.client.0.smithi059.stdout:1/58: unlink d7/l8 0 2024-04-25T16:14:46.189 INFO:tasks.workunit.client.0.smithi059.stdout:0/53: symlink dc/dd/l11 0 2024-04-25T16:14:46.206 INFO:tasks.workunit.client.0.smithi059.stdout:1/59: read - d7/f10 zero size 2024-04-25T16:14:46.271 INFO:tasks.workunit.client.0.smithi059.stdout:5/52: dread d1/f8 [0,4194304] 0 2024-04-25T16:14:46.390 INFO:tasks.workunit.client.0.smithi059.stdout:5/53: dwrite d1/dd/f12 [0,4194304] 0 2024-04-25T16:14:46.394 INFO:tasks.workunit.client.0.smithi059.stdout:2/45: truncate f9 7302041 0 2024-04-25T16:14:46.531 INFO:tasks.workunit.client.0.smithi059.stdout:9/41: mknod d6/c9 0 2024-04-25T16:14:46.535 INFO:tasks.workunit.client.0.smithi059.stdout:9/42: stat d6/c9 0 2024-04-25T16:14:46.646 INFO:tasks.workunit.client.0.smithi059.stdout:3/50: link d0/l8 d0/l10 0 2024-04-25T16:14:46.650 INFO:tasks.workunit.client.0.smithi059.stdout:3/51: stat d0/db 0 2024-04-25T16:14:46.658 INFO:tasks.workunit.client.0.smithi059.stdout:3/52: read d0/fa [4090308,102805] 0 2024-04-25T16:14:46.672 INFO:tasks.workunit.client.0.smithi059.stdout:0/54: fsync f6 0 2024-04-25T16:14:46.682 INFO:tasks.workunit.client.0.smithi059.stdout:1/60: read d7/fb [424299,116851] 0 2024-04-25T16:14:46.704 INFO:tasks.workunit.client.0.smithi059.stdout:1/61: write f2 [1271491,33641] 0 2024-04-25T16:14:46.796 INFO:tasks.workunit.client.0.smithi059.stdout:8/43: symlink d7/dd/le 0 2024-04-25T16:14:46.810 INFO:tasks.workunit.client.0.smithi059.stdout:8/44: write d7/fa [715754,6010] 0 2024-04-25T16:14:46.844 INFO:tasks.workunit.client.0.smithi059.stdout:7/49: write d0/d7/f9 [345131,71995] 0 2024-04-25T16:14:46.956 INFO:tasks.workunit.client.0.smithi059.stdout:2/46: symlink de/l13 0 2024-04-25T16:14:46.964 INFO:tasks.workunit.client.0.smithi059.stdout:5/54: symlink d1/dd/l14 0 2024-04-25T16:14:47.011 INFO:tasks.workunit.client.0.smithi059.stdout:4/49: link d0/d4/cd d0/d4/df/c11 0 2024-04-25T16:14:47.013 INFO:tasks.workunit.client.0.smithi059.stdout:5/55: write d1/dd/f12 [1121979,27545] 0 2024-04-25T16:14:47.026 INFO:tasks.workunit.client.0.smithi059.stdout:2/47: dread fb [0,4194304] 0 2024-04-25T16:14:47.079 INFO:tasks.workunit.client.0.smithi059.stdout:3/53: mknod d0/c11 0 2024-04-25T16:14:47.144 INFO:tasks.workunit.client.0.smithi059.stdout:0/55: fsync fa 0 2024-04-25T16:14:47.221 INFO:tasks.workunit.client.0.smithi059.stdout:1/62: symlink d7/l11 0 2024-04-25T16:14:47.306 INFO:tasks.workunit.client.0.smithi059.stdout:8/45: unlink d7/fc 0 2024-04-25T16:14:47.337 INFO:tasks.workunit.client.0.smithi059.stdout:7/50: rmdir d0/d7 39 2024-04-25T16:14:47.352 INFO:tasks.workunit.client.0.smithi059.stdout:6/50: write f2 [3232758,74396] 0 2024-04-25T16:14:47.371 INFO:tasks.workunit.client.0.smithi059.stdout:6/51: dread f3 [0,4194304] 0 2024-04-25T16:14:47.425 INFO:tasks.workunit.client.0.smithi059.stdout:6/52: dread d9/fd [0,4194304] 0 2024-04-25T16:14:47.790 INFO:tasks.workunit.client.0.smithi059.stdout:2/48: symlink de/l14 0 2024-04-25T16:14:47.796 INFO:tasks.workunit.client.0.smithi059.stdout:3/54: mknod d0/c12 0 2024-04-25T16:14:47.805 INFO:tasks.workunit.client.0.smithi059.stdout:0/56: symlink dc/df/l12 0 2024-04-25T16:14:47.812 INFO:tasks.workunit.client.0.smithi059.stdout:1/63: rename d7/f10 to d7/f12 0 2024-04-25T16:14:47.855 INFO:tasks.workunit.client.0.smithi059.stdout:8/46: creat d7/dd/ff x:0 0 0 2024-04-25T16:14:47.866 INFO:tasks.workunit.client.0.smithi059.stdout:6/53: rename d9/cc to d9/cf 0 2024-04-25T16:14:47.927 INFO:tasks.workunit.client.0.smithi059.stdout:8/47: stat d7/dd 0 2024-04-25T16:14:47.939 INFO:tasks.workunit.client.0.smithi059.stdout:3/55: dread - d0/ff zero size 2024-04-25T16:14:47.941 INFO:tasks.workunit.client.0.smithi059.stdout:5/56: dread d1/f3 [0,4194304] 0 2024-04-25T16:14:47.984 INFO:tasks.workunit.client.0.smithi059.stdout:4/50: creat d0/d4/df/f12 x:0 0 0 2024-04-25T16:14:47.997 INFO:tasks.workunit.client.0.smithi059.stdout:5/57: chown d1/dd 3 1 2024-04-25T16:14:48.314 INFO:tasks.workunit.client.0.smithi059.stdout:9/43: truncate d6/f7 298756 0 2024-04-25T16:14:48.326 INFO:tasks.workunit.client.0.smithi059.stdout:9/44: chown d6/c9 1662462637 1 2024-04-25T16:14:48.660 INFO:tasks.workunit.client.0.smithi059.stdout:2/49: rename de/l13 to de/l15 0 2024-04-25T16:14:48.672 INFO:tasks.workunit.client.0.smithi059.stdout:6/54: creat d9/f10 x:0 0 0 2024-04-25T16:14:48.727 INFO:tasks.workunit.client.0.smithi059.stdout:4/51: read d0/fc [794521,104868] 0 2024-04-25T16:14:48.779 INFO:tasks.workunit.client.0.smithi059.stdout:9/45: mknod d6/ca 0 2024-04-25T16:14:48.803 INFO:tasks.workunit.client.0.smithi059.stdout:4/52: stat d0/fc 0 2024-04-25T16:14:48.879 INFO:tasks.workunit.client.0.smithi059.stdout:0/57: dwrite f6 [0,4194304] 0 2024-04-25T16:14:48.952 INFO:tasks.workunit.client.0.smithi059.stdout:1/64: dwrite d7/f12 [0,4194304] 0 2024-04-25T16:14:49.375 INFO:tasks.workunit.client.0.smithi059.stdout:9/46: fdatasync f2 0 2024-04-25T16:14:49.479 INFO:tasks.workunit.client.0.smithi059.stdout:6/55: dwrite f6 [0,4194304] 0 2024-04-25T16:14:49.554 INFO:tasks.workunit.client.0.smithi059.stdout:8/48: link d7/dd/le d7/l10 0 2024-04-25T16:14:49.562 INFO:tasks.workunit.client.0.smithi059.stdout:1/65: mkdir d7/d13 0 2024-04-25T16:14:49.684 INFO:tasks.workunit.client.0.smithi059.stdout:6/56: dwrite d9/fe [0,4194304] 0 2024-04-25T16:14:49.744 INFO:tasks.workunit.client.0.smithi059.stdout:7/51: rename d0/d7/lb to d0/lf 0 2024-04-25T16:14:49.763 INFO:tasks.workunit.client.0.smithi059.stdout:9/47: truncate f1 4206847 0 2024-04-25T16:14:49.763 INFO:tasks.workunit.client.0.smithi059.stdout:5/58: creat d1/f15 x:0 0 0 2024-04-25T16:14:49.805 INFO:tasks.workunit.client.0.smithi059.stdout:6/57: write d9/f10 [546093,53734] 0 2024-04-25T16:14:49.807 INFO:tasks.workunit.client.0.smithi059.stdout:5/59: read d1/f8 [1929839,41000] 0 2024-04-25T16:14:49.824 INFO:tasks.workunit.client.0.smithi059.stdout:8/49: mknod d7/dd/c11 0 2024-04-25T16:14:49.857 INFO:tasks.workunit.client.0.smithi059.stdout:7/52: dread d0/d7/f9 [0,4194304] 0 2024-04-25T16:14:49.957 INFO:tasks.workunit.client.0.smithi059.stdout:5/60: dwrite d1/f15 [0,4194304] 0 2024-04-25T16:14:50.037 INFO:tasks.workunit.client.0.smithi059.stdout:3/56: rename d0/c11 to d0/db/c13 0 2024-04-25T16:14:50.050 INFO:tasks.workunit.client.0.smithi059.stdout:4/53: rename d0 to d0/d4/df/d13 22 2024-04-25T16:14:50.055 INFO:tasks.workunit.client.0.smithi059.stdout:3/57: read - d0/ff zero size 2024-04-25T16:14:50.078 INFO:tasks.workunit.client.0.smithi059.stdout:3/58: dread - d0/ff zero size 2024-04-25T16:14:50.185 INFO:tasks.workunit.client.0.smithi059.stdout:2/50: write f9 [3549891,80398] 0 2024-04-25T16:14:50.188 INFO:tasks.workunit.client.0.smithi059.stdout:6/58: fsync f2 0 2024-04-25T16:14:50.189 INFO:tasks.workunit.client.0.smithi059.stdout:0/58: write fa [1117979,24854] 0 2024-04-25T16:14:50.215 INFO:tasks.workunit.client.0.smithi059.stdout:6/59: readlink l7 0 2024-04-25T16:14:50.222 INFO:tasks.workunit.client.0.smithi059.stdout:2/51: chown f9 23572700 1 2024-04-25T16:14:50.260 INFO:tasks.workunit.client.0.smithi059.stdout:6/60: truncate d9/fe 4452562 0 2024-04-25T16:14:50.288 INFO:tasks.workunit.client.0.smithi059.stdout:7/53: readlink d0/lf 0 2024-04-25T16:14:50.337 INFO:tasks.workunit.client.0.smithi059.stdout:2/52: dread f9 [0,4194304] 0 2024-04-25T16:14:50.350 INFO:tasks.workunit.client.0.smithi059.stdout:2/53: write f4 [556145,45443] 0 2024-04-25T16:14:50.523 INFO:tasks.workunit.client.0.smithi059.stdout:1/66: rename d7/fd to d7/d13/f14 0 2024-04-25T16:14:50.526 INFO:tasks.workunit.client.0.smithi059.stdout:4/54: creat d0/d4/df/f14 x:0 0 0 2024-04-25T16:14:50.541 INFO:tasks.workunit.client.0.smithi059.stdout:0/59: symlink dc/l13 0 2024-04-25T16:14:50.557 INFO:tasks.workunit.client.0.smithi059.stdout:1/67: chown l0 140449967 1 2024-04-25T16:14:50.571 INFO:tasks.workunit.client.0.smithi059.stdout:1/68: chown d7/d13/f14 7668 1 2024-04-25T16:14:50.740 INFO:tasks.workunit.client.0.smithi059.stdout:9/48: fsync d6/f7 0 2024-04-25T16:14:50.758 INFO:tasks.workunit.client.0.smithi059.stdout:5/61: mknod d1/c16 0 2024-04-25T16:14:50.761 INFO:tasks.workunit.client.0.smithi059.stdout:7/54: fdatasync d0/d7/f9 0 2024-04-25T16:14:50.846 INFO:tasks.workunit.client.0.smithi059.stdout:0/60: rmdir dc/df 39 2024-04-25T16:14:50.875 INFO:tasks.workunit.client.0.smithi059.stdout:2/54: dread f2 [0,4194304] 0 2024-04-25T16:14:50.892 INFO:tasks.workunit.client.0.smithi059.stdout:4/55: symlink d0/d4/df/l15 0 2024-04-25T16:14:50.924 INFO:tasks.workunit.client.0.smithi059.stdout:1/69: rmdir d7 39 2024-04-25T16:14:50.959 INFO:tasks.workunit.client.0.smithi059.stdout:5/62: dwrite d1/dd/f12 [0,4194304] 0 2024-04-25T16:14:51.066 INFO:tasks.workunit.client.0.smithi059.stdout:6/61: rename d9/cf to d9/c11 0 2024-04-25T16:14:51.073 INFO:tasks.workunit.client.0.smithi059.stdout:6/62: chown d9/fd 1815013 1 2024-04-25T16:14:51.213 INFO:tasks.workunit.client.0.smithi059.stdout:8/50: dwrite f3 [0,4194304] 0 2024-04-25T16:14:51.495 INFO:tasks.workunit.client.0.smithi059.stdout:2/55: fdatasync fb 0 2024-04-25T16:14:51.497 INFO:tasks.workunit.client.0.smithi059.stdout:4/56: symlink d0/d4/l16 0 2024-04-25T16:14:51.507 INFO:tasks.workunit.client.0.smithi059.stdout:1/70: unlink c6 0 2024-04-25T16:14:51.539 INFO:tasks.workunit.client.0.smithi059.stdout:6/63: mknod d9/c12 0 2024-04-25T16:14:51.546 INFO:tasks.workunit.client.0.smithi059.stdout:3/59: getdents d0 0 2024-04-25T16:14:51.556 INFO:tasks.workunit.client.0.smithi059.stdout:7/55: rename d0/d7/f9 to d0/d7/f10 0 2024-04-25T16:14:51.641 INFO:tasks.workunit.client.0.smithi059.stdout:1/71: dread f2 [0,4194304] 0 2024-04-25T16:14:51.648 INFO:tasks.workunit.client.0.smithi059.stdout:8/51: unlink d7/dd/le 0 2024-04-25T16:14:51.877 INFO:tasks.workunit.client.0.smithi059.stdout:2/56: mkdir de/d16 0 2024-04-25T16:14:51.878 INFO:tasks.workunit.client.0.smithi059.stdout:4/57: dread - d0/d4/f8 zero size 2024-04-25T16:14:51.883 INFO:tasks.workunit.client.0.smithi059.stdout:6/64: mknod d9/c13 0 2024-04-25T16:14:51.891 INFO:tasks.workunit.client.0.smithi059.stdout:3/60: creat d0/db/f14 x:0 0 0 2024-04-25T16:14:51.951 INFO:tasks.workunit.client.0.smithi059.stdout:7/56: rename d0/d7/c8 to d0/d7/c11 0 2024-04-25T16:14:52.095 INFO:tasks.workunit.client.0.smithi059.stdout:5/63: write d1/dd/ff [105824,22997] 0 2024-04-25T16:14:52.120 INFO:tasks.workunit.client.0.smithi059.stdout:9/49: getdents d6 0 2024-04-25T16:14:52.144 INFO:tasks.workunit.client.0.smithi059.stdout:9/50: chown d6/f7 5577 1 2024-04-25T16:14:52.149 INFO:tasks.workunit.client.0.smithi059.stdout:9/51: chown f0 0 1 2024-04-25T16:14:52.161 INFO:tasks.workunit.client.0.smithi059.stdout:9/52: dread f0 [0,4194304] 0 2024-04-25T16:14:52.200 INFO:tasks.workunit.client.0.smithi059.stdout:6/65: fdatasync f8 0 2024-04-25T16:14:52.347 INFO:tasks.workunit.client.0.smithi059.stdout:6/66: sync 2024-04-25T16:14:52.360 INFO:tasks.workunit.client.0.smithi059.stdout:3/61: mknod d0/c15 0 2024-04-25T16:14:52.376 INFO:tasks.workunit.client.0.smithi059.stdout:0/61: write dc/df/f10 [938320,20234] 0 2024-04-25T16:14:52.417 INFO:tasks.workunit.client.0.smithi059.stdout:3/62: read d0/fa [2920727,49374] 0 2024-04-25T16:14:52.439 INFO:tasks.workunit.client.0.smithi059.stdout:7/57: fsync d0/fd 0 2024-04-25T16:14:52.506 INFO:tasks.workunit.client.0.smithi059.stdout:6/67: dwrite d9/fe [0,4194304] 0 2024-04-25T16:14:52.574 INFO:tasks.workunit.client.0.smithi059.stdout:1/72: mkdir d7/d15 0 2024-04-25T16:14:52.648 INFO:tasks.workunit.client.0.smithi059.stdout:5/64: rename d1/c6 to d1/dd/c17 0 2024-04-25T16:14:52.736 INFO:tasks.workunit.client.0.smithi059.stdout:9/53: creat d6/fb x:0 0 0 2024-04-25T16:14:52.750 INFO:tasks.workunit.client.0.smithi059.stdout:2/57: symlink de/d16/l17 0 2024-04-25T16:14:52.801 INFO:tasks.workunit.client.0.smithi059.stdout:4/58: write d0/d4/f8 [870212,130915] 0 2024-04-25T16:14:52.932 INFO:tasks.workunit.client.0.smithi059.stdout:8/52: write d7/fb [914175,22987] 0 2024-04-25T16:14:53.130 INFO:tasks.workunit.client.0.smithi059.stdout:3/63: creat d0/db/f16 x:0 0 0 2024-04-25T16:14:53.139 INFO:tasks.workunit.client.0.smithi059.stdout:6/68: creat d9/f14 x:0 0 0 2024-04-25T16:14:53.143 INFO:tasks.workunit.client.0.smithi059.stdout:1/73: mkdir d7/d13/d16 0 2024-04-25T16:14:53.158 INFO:tasks.workunit.client.0.smithi059.stdout:7/58: read d0/d7/fa [493213,108818] 0 2024-04-25T16:14:53.165 INFO:tasks.workunit.client.0.smithi059.stdout:5/65: fdatasync d1/f3 0 2024-04-25T16:14:53.177 INFO:tasks.workunit.client.0.smithi059.stdout:9/54: stat f1 0 2024-04-25T16:14:53.208 INFO:tasks.workunit.client.0.smithi059.stdout:4/59: symlink d0/l17 0 2024-04-25T16:14:53.211 INFO:tasks.workunit.client.0.smithi059.stdout:6/69: dread - d9/f14 zero size 2024-04-25T16:14:53.238 INFO:tasks.workunit.client.0.smithi059.stdout:6/70: chown d9/fe 50658 1 2024-04-25T16:14:53.786 INFO:tasks.workunit.client.0.smithi059.stdout:1/74: symlink d7/d13/l17 0 2024-04-25T16:14:53.826 INFO:tasks.workunit.client.0.smithi059.stdout:5/66: mkdir d1/dd/d18 0 2024-04-25T16:14:53.916 INFO:tasks.workunit.client.0.smithi059.stdout:6/71: symlink d9/l15 0 2024-04-25T16:14:54.148 INFO:tasks.workunit.client.0.smithi059.stdout:3/64: write d0/fa [4769644,60648] 0 2024-04-25T16:14:54.163 INFO:tasks.workunit.client.0.smithi059.stdout:3/65: chown d0/db/f14 862965 1 2024-04-25T16:14:54.178 INFO:tasks.workunit.client.0.smithi059.stdout:9/55: write f2 [743891,92232] 0 2024-04-25T16:14:54.193 INFO:tasks.workunit.client.0.smithi059.stdout:9/56: fdatasync f0 0 2024-04-25T16:14:54.212 INFO:tasks.workunit.client.0.smithi059.stdout:1/75: symlink d7/d13/l18 0 2024-04-25T16:14:54.245 INFO:tasks.workunit.client.0.smithi059.stdout:5/67: symlink d1/dd/l19 0 2024-04-25T16:14:54.331 INFO:tasks.workunit.client.0.smithi059.stdout:7/59: dwrite d0/fd [0,4194304] 0 2024-04-25T16:14:54.393 INFO:tasks.workunit.client.0.smithi059.stdout:0/62: link dc/dd/ce dc/c14 0 2024-04-25T16:14:54.426 INFO:tasks.workunit.client.0.smithi059.stdout:8/53: symlink d7/l12 0 2024-04-25T16:14:54.465 INFO:tasks.workunit.client.0.smithi059.stdout:4/60: dwrite d0/d4/df/f12 [0,4194304] 0 2024-04-25T16:14:54.466 INFO:tasks.workunit.client.0.smithi059.stdout:2/58: getdents de/d16 0 2024-04-25T16:14:54.578 INFO:tasks.workunit.client.0.smithi059.stdout:3/66: symlink d0/db/l17 0 2024-04-25T16:14:54.605 INFO:tasks.workunit.client.0.smithi059.stdout:3/67: readlink d0/l9 0 2024-04-25T16:14:54.623 INFO:tasks.workunit.client.0.smithi059.stdout:7/60: dread d0/d7/fa [0,4194304] 0 2024-04-25T16:14:54.653 INFO:tasks.workunit.client.0.smithi059.stdout:4/61: dread d0/d4/f8 [0,4194304] 0 2024-04-25T16:14:54.654 INFO:tasks.workunit.client.0.smithi059.stdout:9/57: creat d6/fc x:0 0 0 2024-04-25T16:14:54.674 INFO:tasks.workunit.client.0.smithi059.stdout:1/76: mknod d7/c19 0 2024-04-25T16:14:54.755 INFO:tasks.workunit.client.0.smithi059.stdout:1/77: dread d7/fb [0,4194304] 0 2024-04-25T16:14:54.780 INFO:tasks.workunit.client.0.smithi059.stdout:5/68: dread d1/f10 [0,4194304] 0 2024-04-25T16:14:54.886 INFO:tasks.workunit.client.0.smithi059.stdout:0/63: mknod dc/dd/c15 0 2024-04-25T16:14:54.891 INFO:tasks.workunit.client.0.smithi059.stdout:2/59: rename l0 to de/l18 0 2024-04-25T16:14:54.970 INFO:tasks.workunit.client.0.smithi059.stdout:3/68: unlink d0/c15 0 2024-04-25T16:14:54.983 INFO:tasks.workunit.client.0.smithi059.stdout:4/62: mkdir d0/d4/df/d18 0 2024-04-25T16:14:55.025 INFO:tasks.workunit.client.0.smithi059.stdout:1/78: rmdir d7/d13 39 2024-04-25T16:14:55.064 INFO:tasks.workunit.client.0.smithi059.stdout:5/69: symlink d1/dd/l1a 0 2024-04-25T16:14:55.073 INFO:tasks.workunit.client.0.smithi059.stdout:5/70: chown d1/dd/d18 224040 1 2024-04-25T16:14:55.169 INFO:tasks.workunit.client.0.smithi059.stdout:2/60: fsync fb 0 2024-04-25T16:14:55.232 INFO:tasks.workunit.client.0.smithi059.stdout:0/64: creat dc/df/f16 x:0 0 0 2024-04-25T16:14:55.236 INFO:tasks.workunit.client.0.smithi059.stdout:0/65: chown dc 157998 1 2024-04-25T16:14:55.243 INFO:tasks.workunit.client.0.smithi059.stdout:0/66: readlink dc/dd/l11 0 2024-04-25T16:14:55.576 INFO:tasks.workunit.client.0.smithi059.stdout:9/58: write f1 [1309097,64832] 0 2024-04-25T16:14:55.589 INFO:tasks.workunit.client.0.smithi059.stdout:9/59: read - d6/fc zero size 2024-04-25T16:14:55.596 INFO:tasks.workunit.client.0.smithi059.stdout:9/60: chown f1 641 1 2024-04-25T16:14:55.607 INFO:tasks.workunit.client.0.smithi059.stdout:9/61: write f0 [502457,104880] 0 2024-04-25T16:14:55.620 INFO:tasks.workunit.client.0.smithi059.stdout:9/62: chown d6/f7 7 1 2024-04-25T16:14:55.672 INFO:tasks.workunit.client.0.smithi059.stdout:3/69: creat d0/f18 x:0 0 0 2024-04-25T16:14:55.680 INFO:tasks.workunit.client.0.smithi059.stdout:4/63: creat d0/d4/df/f19 x:0 0 0 2024-04-25T16:14:55.797 INFO:tasks.workunit.client.0.smithi059.stdout:6/72: getdents d9 0 2024-04-25T16:14:55.799 INFO:tasks.workunit.client.0.smithi059.stdout:2/61: fsync fb 0 2024-04-25T16:14:55.905 INFO:tasks.workunit.client.0.smithi059.stdout:7/61: creat d0/f12 x:0 0 0 2024-04-25T16:14:55.924 INFO:tasks.workunit.client.0.smithi059.stdout:3/70: creat d0/db/f19 x:0 0 0 2024-04-25T16:14:55.959 INFO:tasks.workunit.client.0.smithi059.stdout:1/79: dwrite f2 [4194304,4194304] 0 2024-04-25T16:14:56.040 INFO:tasks.workunit.client.0.smithi059.stdout:4/64: dread d0/d4/f8 [0,4194304] 0 2024-04-25T16:14:56.072 INFO:tasks.workunit.client.0.smithi059.stdout:2/62: stat de/l15 0 2024-04-25T16:14:56.088 INFO:tasks.workunit.client.0.smithi059.stdout:4/65: stat d0/d4/l10 0 2024-04-25T16:14:56.128 INFO:tasks.workunit.client.0.smithi059.stdout:7/62: dread d0/fd [0,4194304] 0 2024-04-25T16:14:56.129 INFO:tasks.workunit.client.0.smithi059.stdout:4/66: chown d0/d4/df 14586 1 2024-04-25T16:14:56.142 INFO:tasks.workunit.client.0.smithi059.stdout:6/73: mkdir d9/d16 0 2024-04-25T16:14:56.162 INFO:tasks.workunit.client.0.smithi059.stdout:9/63: truncate f0 127567 0 2024-04-25T16:14:56.169 INFO:tasks.workunit.client.0.smithi059.stdout:6/74: chown d9 26974887 1 2024-04-25T16:14:56.230 INFO:tasks.workunit.client.0.smithi059.stdout:0/67: rename dc/dd/ce to dc/df/c17 0 2024-04-25T16:14:56.251 INFO:tasks.workunit.client.0.smithi059.stdout:9/64: dread f1 [0,4194304] 0 2024-04-25T16:14:56.263 INFO:tasks.workunit.client.0.smithi059.stdout:0/68: read f9 [912004,123366] 0 2024-04-25T16:14:56.354 INFO:tasks.workunit.client.0.smithi059.stdout:9/65: sync 2024-04-25T16:14:56.378 INFO:tasks.workunit.client.0.smithi059.stdout:3/71: creat d0/db/f1a x:0 0 0 2024-04-25T16:14:56.387 INFO:tasks.workunit.client.0.smithi059.stdout:5/71: rmdir d1/dd/d18 0 2024-04-25T16:14:56.393 INFO:tasks.workunit.client.0.smithi059.stdout:1/80: readlink d7/la 0 2024-04-25T16:14:56.394 INFO:tasks.workunit.client.0.smithi059.stdout:8/54: getdents d7 0 2024-04-25T16:14:56.405 INFO:tasks.workunit.client.0.smithi059.stdout:2/63: unlink c3 0 2024-04-25T16:14:56.682 INFO:tasks.workunit.client.0.smithi059.stdout:7/63: truncate d0/d7/fa 2891103 0 2024-04-25T16:14:56.814 INFO:tasks.workunit.client.0.smithi059.stdout:4/67: rename d0/d4/df/l15 to d0/l1a 0 2024-04-25T16:14:57.071 INFO:tasks.workunit.client.0.smithi059.stdout:0/69: dwrite fa [0,4194304] 0 2024-04-25T16:14:57.153 INFO:tasks.workunit.client.0.smithi059.stdout:8/55: mknod d7/dd/c13 0 2024-04-25T16:14:57.172 INFO:tasks.workunit.client.0.smithi059.stdout:6/75: creat d9/d16/f17 x:0 0 0 2024-04-25T16:14:57.172 INFO:tasks.workunit.client.0.smithi059.stdout:2/64: creat de/d16/f19 x:0 0 0 2024-04-25T16:14:57.180 INFO:tasks.workunit.client.0.smithi059.stdout:7/64: symlink d0/d7/l13 0 2024-04-25T16:14:57.196 INFO:tasks.workunit.client.0.smithi059.stdout:0/70: fsync dc/df/f10 0 2024-04-25T16:14:57.311 INFO:tasks.workunit.client.0.smithi059.stdout:0/71: dwrite dc/df/f10 [0,4194304] 0 2024-04-25T16:14:57.385 INFO:tasks.workunit.client.0.smithi059.stdout:4/68: creat d0/d4/f1b x:0 0 0 2024-04-25T16:14:57.414 INFO:tasks.workunit.client.0.smithi059.stdout:4/69: write d0/d4/df/f19 [928521,69469] 0 2024-04-25T16:14:57.491 INFO:tasks.workunit.client.0.smithi059.stdout:9/66: write d6/f7 [102119,105649] 0 2024-04-25T16:14:57.494 INFO:tasks.workunit.client.0.smithi059.stdout:5/72: write d1/fa [236314,12592] 0 2024-04-25T16:14:57.749 INFO:tasks.workunit.client.0.smithi059.stdout:2/65: rmdir de/d16 39 2024-04-25T16:14:57.768 INFO:tasks.workunit.client.0.smithi059.stdout:1/81: creat d7/d13/d16/f1a x:0 0 0 2024-04-25T16:14:57.779 INFO:tasks.workunit.client.0.smithi059.stdout:4/70: unlink d0/cb 0 2024-04-25T16:14:57.870 INFO:tasks.workunit.client.0.smithi059.stdout:4/71: chown d0/d4/df/f19 538695 1 2024-04-25T16:14:57.880 INFO:tasks.workunit.client.0.smithi059.stdout:0/72: dread f6 [0,4194304] 0 2024-04-25T16:14:57.890 INFO:tasks.workunit.client.0.smithi059.stdout:8/56: dread f3 [0,4194304] 0 2024-04-25T16:14:57.913 INFO:tasks.workunit.client.0.smithi059.stdout:9/67: rename d6/f7 to d6/fd 0 2024-04-25T16:14:57.940 INFO:tasks.workunit.client.0.smithi059.stdout:3/72: getdents d0/db 0 2024-04-25T16:14:57.962 INFO:tasks.workunit.client.0.smithi059.stdout:8/57: dread d7/f9 [0,4194304] 0 2024-04-25T16:14:58.004 INFO:tasks.workunit.client.0.smithi059.stdout:2/66: truncate f4 213905 0 2024-04-25T16:14:58.014 INFO:tasks.workunit.client.0.smithi059.stdout:1/82: rename d7/d13/d16/f1a to d7/d13/f1b 0 2024-04-25T16:14:58.132 INFO:tasks.workunit.client.0.smithi059.stdout:4/72: mkdir d0/d4/df/d1c 0 2024-04-25T16:14:58.260 INFO:tasks.workunit.client.0.smithi059.stdout:9/68: fdatasync d6/fd 0 2024-04-25T16:14:58.295 INFO:tasks.workunit.client.0.smithi059.stdout:4/73: dwrite d0/d4/df/f19 [0,4194304] 0 2024-04-25T16:14:58.370 INFO:tasks.workunit.client.0.smithi059.stdout:3/73: chown d0/ce 18201836 1 2024-04-25T16:14:58.371 INFO:tasks.workunit.client.0.smithi059.stdout:9/69: chown d6 3 1 2024-04-25T16:14:58.396 INFO:tasks.workunit.client.0.smithi059.stdout:4/74: sync 2024-04-25T16:14:58.534 INFO:tasks.workunit.client.0.smithi059.stdout:1/83: unlink l0 0 2024-04-25T16:14:58.536 INFO:tasks.workunit.client.0.smithi059.stdout:6/76: dwrite f8 [0,4194304] 0 2024-04-25T16:14:58.588 INFO:tasks.workunit.client.0.smithi059.stdout:6/77: sync 2024-04-25T16:14:58.668 INFO:tasks.workunit.client.0.smithi059.stdout:5/73: dwrite d1/f3 [0,4194304] 0 2024-04-25T16:14:58.957 INFO:tasks.workunit.client.0.smithi059.stdout:8/58: dwrite d7/fa [0,4194304] 0 2024-04-25T16:14:59.044 INFO:tasks.workunit.client.0.smithi059.stdout:7/65: dread d0/d7/fa [0,4194304] 0 2024-04-25T16:14:59.091 INFO:tasks.workunit.client.0.smithi059.stdout:9/70: symlink d6/le 0 2024-04-25T16:14:59.091 INFO:tasks.workunit.client.0.smithi059.stdout:2/67: creat de/d16/f1a x:0 0 0 2024-04-25T16:14:59.110 INFO:tasks.workunit.client.0.smithi059.stdout:9/71: truncate d6/fc 992389 0 2024-04-25T16:14:59.287 INFO:tasks.workunit.client.0.smithi059.stdout:1/84: truncate d7/f12 1417970 0 2024-04-25T16:14:59.308 INFO:tasks.workunit.client.0.smithi059.stdout:6/78: truncate f2 5001775 0 2024-04-25T16:14:59.622 INFO:tasks.workunit.client.0.smithi059.stdout:0/73: rename l5 to dc/l18 0 2024-04-25T16:14:59.628 INFO:tasks.workunit.client.0.smithi059.stdout:4/75: getdents d0/d4/df/d18 0 2024-04-25T16:14:59.639 INFO:tasks.workunit.client.0.smithi059.stdout:2/68: read f1 [876679,7628] 0 2024-04-25T16:14:59.717 INFO:tasks.workunit.client.0.smithi059.stdout:0/74: dread f9 [0,4194304] 0 2024-04-25T16:14:59.731 INFO:tasks.workunit.client.0.smithi059.stdout:6/79: symlink d9/d16/l18 0 2024-04-25T16:14:59.735 INFO:tasks.workunit.client.0.smithi059.stdout:3/74: link d0/db/l17 d0/db/l1b 0 2024-04-25T16:14:59.751 INFO:tasks.workunit.client.0.smithi059.stdout:3/75: fdatasync d0/db/f19 0 2024-04-25T16:14:59.771 INFO:tasks.workunit.client.0.smithi059.stdout:5/74: symlink d1/l1b 0 2024-04-25T16:14:59.775 INFO:tasks.workunit.client.0.smithi059.stdout:6/80: truncate d9/d16/f17 623833 0 2024-04-25T16:14:59.796 INFO:tasks.workunit.client.0.smithi059.stdout:0/75: sync 2024-04-25T16:14:59.802 INFO:tasks.workunit.client.0.smithi059.stdout:6/81: truncate d9/d16/f17 1130558 0 2024-04-25T16:14:59.836 INFO:tasks.workunit.client.0.smithi059.stdout:7/66: unlink d0/c5 0 2024-04-25T16:14:59.857 INFO:tasks.workunit.client.0.smithi059.stdout:7/67: dread - d0/f12 zero size 2024-04-25T16:14:59.858 INFO:tasks.workunit.client.0.smithi059.stdout:0/76: dread f6 [0,4194304] 0 2024-04-25T16:14:59.980 INFO:tasks.workunit.client.0.smithi059.stdout:8/59: rename d7/fb to d7/dd/f14 0 2024-04-25T16:15:00.034 INFO:tasks.workunit.client.0.smithi059.stdout:4/76: truncate d0/d4/df/f14 235622 0 2024-04-25T16:15:00.092 INFO:tasks.workunit.client.0.smithi059.stdout:3/76: dread - d0/db/f16 zero size 2024-04-25T16:15:00.101 INFO:tasks.workunit.client.0.smithi059.stdout:3/77: stat d0/db/c13 0 2024-04-25T16:15:00.155 INFO:tasks.workunit.client.0.smithi059.stdout:3/78: sync 2024-04-25T16:15:00.253 INFO:tasks.workunit.client.0.smithi059.stdout:7/68: rmdir d0 39 2024-04-25T16:15:00.259 INFO:tasks.workunit.client.0.smithi059.stdout:0/77: truncate f9 4986260 0 2024-04-25T16:15:00.363 INFO:tasks.workunit.client.0.smithi059.stdout:0/78: sync 2024-04-25T16:15:00.425 INFO:tasks.workunit.client.0.smithi059.stdout:6/82: read d9/fd [358492,7852] 0 2024-04-25T16:15:00.461 INFO:tasks.workunit.client.0.smithi059.stdout:0/79: dwrite fa [0,4194304] 0 2024-04-25T16:15:00.554 INFO:tasks.workunit.client.0.smithi059.stdout:3/79: creat d0/db/f1c x:0 0 0 2024-04-25T16:15:00.711 INFO:tasks.workunit.client.0.smithi059.stdout:9/72: dwrite f1 [0,4194304] 0 2024-04-25T16:15:00.782 INFO:tasks.workunit.client.0.smithi059.stdout:6/83: dwrite f8 [4194304,4194304] 0 2024-04-25T16:15:00.798 INFO:tasks.workunit.client.0.smithi059.stdout:1/85: mknod d7/c1c 0 2024-04-25T16:15:00.894 INFO:tasks.workunit.client.0.smithi059.stdout:2/69: write f7 [1040904,109779] 0 2024-04-25T16:15:00.901 INFO:tasks.workunit.client.0.smithi059.stdout:1/86: fsync f2 0 2024-04-25T16:15:01.035 INFO:tasks.workunit.client.0.smithi059.stdout:3/80: rename d0/db/c13 to d0/c1d 0 2024-04-25T16:15:01.044 INFO:tasks.workunit.client.0.smithi059.stdout:5/75: write d1/dd/f13 [1057150,9351] 0 2024-04-25T16:15:01.066 INFO:tasks.workunit.client.0.smithi059.stdout:4/77: write d0/fc [1952451,68728] 0 2024-04-25T16:15:01.071 INFO:tasks.workunit.client.0.smithi059.stdout:7/69: chown d0/lf 19 1 2024-04-25T16:15:01.076 INFO:tasks.workunit.client.0.smithi059.stdout:6/84: rename d9/d16 to d9/d16/d19 22 2024-04-25T16:15:01.104 INFO:tasks.workunit.client.0.smithi059.stdout:4/78: fdatasync d0/fc 0 2024-04-25T16:15:01.112 INFO:tasks.workunit.client.0.smithi059.stdout:3/81: read - d0/db/f19 zero size 2024-04-25T16:15:01.131 INFO:tasks.workunit.client.0.smithi059.stdout:3/82: read - d0/db/f14 zero size 2024-04-25T16:15:01.203 INFO:tasks.workunit.client.0.smithi059.stdout:9/73: creat d6/ff x:0 0 0 2024-04-25T16:15:01.235 INFO:tasks.workunit.client.0.smithi059.stdout:9/74: chown d6/ff 0 1 2024-04-25T16:15:01.268 INFO:tasks.workunit.client.0.smithi059.stdout:8/60: dread d7/fa [0,4194304] 0 2024-04-25T16:15:01.479 INFO:tasks.workunit.client.0.smithi059.stdout:5/76: rmdir d1/dd 39 2024-04-25T16:15:01.487 INFO:tasks.workunit.client.0.smithi059.stdout:6/85: symlink d9/l1a 0 2024-04-25T16:15:01.889 INFO:tasks.workunit.client.0.smithi059.stdout:1/87: link f2 d7/d13/d16/f1d 0 2024-04-25T16:15:01.925 INFO:tasks.workunit.client.0.smithi059.stdout:9/75: stat f0 0 2024-04-25T16:15:01.971 INFO:tasks.workunit.client.0.smithi059.stdout:8/61: chown c0 110796708 1 2024-04-25T16:15:01.988 INFO:tasks.workunit.client.0.smithi059.stdout:6/86: read d9/fe [2870118,74543] 0 2024-04-25T16:15:02.152 INFO:tasks.workunit.client.0.smithi059.stdout:4/79: dwrite d0/d4/f8 [0,4194304] 0 2024-04-25T16:15:02.193 INFO:tasks.workunit.client.0.smithi059.stdout:9/76: mknod d6/c10 0 2024-04-25T16:15:02.246 INFO:tasks.workunit.client.0.smithi059.stdout:2/70: getdents de 0 2024-04-25T16:15:02.260 INFO:tasks.workunit.client.0.smithi059.stdout:6/87: chown d9/f10 10487 1 2024-04-25T16:15:02.292 INFO:tasks.workunit.client.0.smithi059.stdout:3/83: dwrite d0/ff [0,4194304] 0 2024-04-25T16:15:02.305 INFO:tasks.workunit.client.0.smithi059.stdout:0/80: dwrite f9 [0,4194304] 0 2024-04-25T16:15:02.306 INFO:tasks.workunit.client.0.smithi059.stdout:9/77: chown f1 8623188 1 2024-04-25T16:15:02.447 INFO:tasks.workunit.client.0.smithi059.stdout:5/77: creat d1/f1c x:0 0 0 2024-04-25T16:15:02.467 INFO:tasks.workunit.client.0.smithi059.stdout:0/81: fsync f9 0 2024-04-25T16:15:02.481 INFO:tasks.workunit.client.0.smithi059.stdout:9/78: chown d6 1560220 1 2024-04-25T16:15:02.503 INFO:tasks.workunit.client.0.smithi059.stdout:2/71: mknod de/c1b 0 2024-04-25T16:15:02.536 INFO:tasks.workunit.client.0.smithi059.stdout:6/88: mkdir d9/d1b 0 2024-04-25T16:15:02.538 INFO:tasks.workunit.client.0.smithi059.stdout:7/70: write d0/d7/f10 [697593,18169] 0 2024-04-25T16:15:02.539 INFO:tasks.workunit.client.0.smithi059.stdout:5/78: fdatasync d1/f3 0 2024-04-25T16:15:02.576 INFO:tasks.workunit.client.0.smithi059.stdout:9/79: chown f1 1391 1 2024-04-25T16:15:02.583 INFO:tasks.workunit.client.0.smithi059.stdout:3/84: mkdir d0/d1e 0 2024-04-25T16:15:02.732 INFO:tasks.workunit.client.0.smithi059.stdout:1/88: dwrite d7/f12 [0,4194304] 0 2024-04-25T16:15:02.808 INFO:tasks.workunit.client.0.smithi059.stdout:0/82: dwrite fa [0,4194304] 0 2024-04-25T16:15:02.873 INFO:tasks.workunit.client.0.smithi059.stdout:6/89: rmdir d9/d16 39 2024-04-25T16:15:02.889 INFO:tasks.workunit.client.0.smithi059.stdout:7/71: creat d0/d7/f14 x:0 0 0 2024-04-25T16:15:02.919 INFO:tasks.workunit.client.0.smithi059.stdout:7/72: chown d0/d7/l13 3 1 2024-04-25T16:15:02.942 INFO:tasks.workunit.client.0.smithi059.stdout:9/80: mknod d6/c11 0 2024-04-25T16:15:02.944 INFO:tasks.workunit.client.0.smithi059.stdout:4/80: truncate d0/d4/df/f12 233790 0 2024-04-25T16:15:03.143 INFO:tasks.workunit.client.0.smithi059.stdout:8/62: link d7/f9 d7/f15 0 2024-04-25T16:15:03.233 INFO:tasks.workunit.client.0.smithi059.stdout:5/79: dwrite d1/f15 [0,4194304] 0 2024-04-25T16:15:03.316 INFO:tasks.workunit.client.0.smithi059.stdout:3/85: write d0/f6 [2662590,90773] 0 2024-04-25T16:15:03.318 INFO:tasks.workunit.client.0.smithi059.stdout:5/80: readlink l0 0 2024-04-25T16:15:03.353 INFO:tasks.workunit.client.0.smithi059.stdout:3/86: stat d0/fa 0 2024-04-25T16:15:03.410 INFO:tasks.workunit.client.0.smithi059.stdout:9/81: unlink d6/l8 0 2024-04-25T16:15:03.599 INFO:tasks.workunit.client.0.smithi059.stdout:1/89: dwrite d7/f9 [4194304,4194304] 0 2024-04-25T16:15:03.708 INFO:tasks.workunit.client.0.smithi059.stdout:0/83: dwrite f6 [4194304,4194304] 0 2024-04-25T16:15:03.799 INFO:tasks.workunit.client.0.smithi059.stdout:3/87: rename d0/f18 to d0/d1e/f1f 0 2024-04-25T16:15:03.857 INFO:tasks.workunit.client.0.smithi059.stdout:7/73: write d0/fd [3778977,27097] 0 2024-04-25T16:15:03.922 INFO:tasks.workunit.client.0.smithi059.stdout:6/90: dwrite d9/fd [0,4194304] 0 2024-04-25T16:15:04.004 INFO:tasks.workunit.client.0.smithi059.stdout:8/63: mkdir d7/d16 0 2024-04-25T16:15:04.026 INFO:tasks.workunit.client.0.smithi059.stdout:1/90: dread f2 [4194304,4194304] 0 2024-04-25T16:15:04.052 INFO:tasks.workunit.client.0.smithi059.stdout:6/91: write d9/fd [4275314,109273] 0 2024-04-25T16:15:04.112 INFO:tasks.workunit.client.0.smithi059.stdout:2/72: creat de/f1c x:0 0 0 2024-04-25T16:15:04.119 INFO:tasks.workunit.client.0.smithi059.stdout:2/73: chown f1 16756572 1 2024-04-25T16:15:04.194 INFO:tasks.workunit.client.0.smithi059.stdout:5/81: creat d1/dd/f1d x:0 0 0 2024-04-25T16:15:04.346 INFO:tasks.workunit.client.0.smithi059.stdout:7/74: symlink d0/d7/l15 0 2024-04-25T16:15:04.386 INFO:tasks.workunit.client.0.smithi059.stdout:0/84: truncate dc/df/f16 748481 0 2024-04-25T16:15:04.424 INFO:tasks.workunit.client.0.smithi059.stdout:7/75: dread d0/fd [0,4194304] 0 2024-04-25T16:15:04.508 INFO:tasks.workunit.client.0.smithi059.stdout:8/64: dread d7/f9 [0,4194304] 0 2024-04-25T16:15:04.589 INFO:tasks.workunit.client.0.smithi059.stdout:2/74: dread fb [0,4194304] 0 2024-04-25T16:15:04.604 INFO:tasks.workunit.client.0.smithi059.stdout:4/81: link d0/l1a d0/d4/df/d18/l1d 0 2024-04-25T16:15:04.863 INFO:tasks.workunit.client.0.smithi059.stdout:3/88: write d0/f7 [586635,117900] 0 2024-04-25T16:15:04.890 INFO:tasks.workunit.client.0.smithi059.stdout:0/85: symlink dc/dd/l19 0 2024-04-25T16:15:04.939 INFO:tasks.workunit.client.0.smithi059.stdout:7/76: mkdir d0/d7/d16 0 2024-04-25T16:15:05.118 INFO:tasks.workunit.client.0.smithi059.stdout:4/82: chown d0/l1a 33 1 2024-04-25T16:15:05.173 INFO:tasks.workunit.client.0.smithi059.stdout:5/82: dwrite d1/f10 [0,4194304] 0 2024-04-25T16:15:05.266 INFO:tasks.workunit.client.0.smithi059.stdout:9/82: getdents d6 0 2024-04-25T16:15:05.272 INFO:tasks.workunit.client.0.smithi059.stdout:5/83: fdatasync d1/f15 0 2024-04-25T16:15:05.309 INFO:tasks.workunit.client.0.smithi059.stdout:3/89: dread - d0/db/f1a zero size 2024-04-25T16:15:05.322 INFO:tasks.workunit.client.0.smithi059.stdout:6/92: creat d9/f1c x:0 0 0 2024-04-25T16:15:05.333 INFO:tasks.workunit.client.0.smithi059.stdout:5/84: readlink d1/dd/l19 0 2024-04-25T16:15:05.349 INFO:tasks.workunit.client.0.smithi059.stdout:7/77: chown d0/f12 988427010 1 2024-04-25T16:15:05.357 INFO:tasks.workunit.client.0.smithi059.stdout:9/83: truncate d6/fd 467911 0 2024-04-25T16:15:05.359 INFO:tasks.workunit.client.0.smithi059.stdout:4/83: stat d0/d4/cd 0 2024-04-25T16:15:05.402 INFO:tasks.workunit.client.0.smithi059.stdout:1/91: getdents d7/d13 0 2024-04-25T16:15:05.450 INFO:tasks.workunit.client.0.smithi059.stdout:4/84: write d0/fc [449092,51663] 0 2024-04-25T16:15:05.467 INFO:tasks.workunit.client.0.smithi059.stdout:0/86: mknod dc/c1a 0 2024-04-25T16:15:05.488 INFO:tasks.workunit.client.0.smithi059.stdout:8/65: fsync d7/dd/f14 0 2024-04-25T16:15:05.505 INFO:tasks.workunit.client.0.smithi059.stdout:2/75: rename de/f1c to de/f1d 0 2024-04-25T16:15:05.527 INFO:tasks.workunit.client.0.smithi059.stdout:6/93: unlink c5 0 2024-04-25T16:15:05.559 INFO:tasks.workunit.client.0.smithi059.stdout:3/90: dwrite d0/ff [0,4194304] 0 2024-04-25T16:15:05.625 INFO:tasks.workunit.client.0.smithi059.stdout:9/84: symlink d6/l12 0 2024-04-25T16:15:05.642 INFO:tasks.workunit.client.0.smithi059.stdout:3/91: dread - d0/db/f14 zero size 2024-04-25T16:15:05.726 INFO:tasks.workunit.client.0.smithi059.stdout:9/85: dwrite f1 [0,4194304] 0 2024-04-25T16:15:05.731 INFO:tasks.workunit.client.0.smithi059.stdout:7/78: rename d0/d7/l15 to d0/d7/l17 0 2024-04-25T16:15:05.794 INFO:tasks.workunit.client.0.smithi059.stdout:1/92: creat d7/d13/d16/f1e x:0 0 0 2024-04-25T16:15:05.889 INFO:tasks.workunit.client.0.smithi059.stdout:5/85: mkdir d1/d1e 0 2024-04-25T16:15:06.002 INFO:tasks.workunit.client.0.smithi059.stdout:4/85: dwrite d0/d4/fe [0,4194304] 0 2024-04-25T16:15:06.079 INFO:tasks.workunit.client.0.smithi059.stdout:8/66: dread - d7/dd/ff zero size 2024-04-25T16:15:06.241 INFO:tasks.workunit.client.0.smithi059.stdout:3/92: write d0/db/f16 [747335,55013] 0 2024-04-25T16:15:06.543 INFO:tasks.workunit.client.0.smithi059.stdout:0/87: symlink dc/l1b 0 2024-04-25T16:15:06.563 INFO:tasks.workunit.client.0.smithi059.stdout:2/76: mkdir de/d16/d1e 0 2024-04-25T16:15:06.610 INFO:tasks.workunit.client.0.smithi059.stdout:4/86: truncate d0/d4/df/f19 4405138 0 2024-04-25T16:15:06.669 INFO:tasks.workunit.client.0.smithi059.stdout:4/87: chown d0/d4/fe 185565532 1 2024-04-25T16:15:06.715 INFO:tasks.workunit.client.0.smithi059.stdout:1/93: dwrite d7/d13/f1b [0,4194304] 0 2024-04-25T16:15:06.716 INFO:tasks.workunit.client.0.smithi059.stdout:4/88: chown d0/d4/df/d1c 1289794 1 2024-04-25T16:15:06.797 INFO:tasks.workunit.client.0.smithi059.stdout:5/86: symlink d1/l1f 0 2024-04-25T16:15:06.814 INFO:tasks.workunit.client.0.smithi059.stdout:4/89: readlink d0/d4/l10 0 2024-04-25T16:15:06.814 INFO:tasks.workunit.client.0.smithi059.stdout:3/93: creat d0/db/f20 x:0 0 0 2024-04-25T16:15:06.863 INFO:tasks.workunit.client.0.smithi059.stdout:1/94: write d7/f12 [4233610,32226] 0 2024-04-25T16:15:06.864 INFO:tasks.workunit.client.0.smithi059.stdout:5/87: fsync d1/dd/f1d 0 2024-04-25T16:15:06.881 INFO:tasks.workunit.client.0.smithi059.stdout:5/88: readlink d1/l1f 0 2024-04-25T16:15:06.885 INFO:tasks.workunit.client.0.smithi059.stdout:1/95: chown d7/fb 648427 1 2024-04-25T16:15:06.997 INFO:tasks.workunit.client.0.smithi059.stdout:1/96: sync 2024-04-25T16:15:07.001 INFO:tasks.workunit.client.0.smithi059.stdout:1/97: chown l5 60730 1 2024-04-25T16:15:07.034 INFO:tasks.workunit.client.0.smithi059.stdout:2/77: creat de/d16/d1e/f1f x:0 0 0 2024-04-25T16:15:07.036 INFO:tasks.workunit.client.0.smithi059.stdout:8/67: write f3 [897576,6281] 0 2024-04-25T16:15:07.038 INFO:tasks.workunit.client.0.smithi059.stdout:7/79: write d0/d7/fa [2984346,60626] 0 2024-04-25T16:15:07.057 INFO:tasks.workunit.client.0.smithi059.stdout:6/94: write d9/d16/f17 [1647336,22632] 0 2024-04-25T16:15:07.082 INFO:tasks.workunit.client.0.smithi059.stdout:3/94: rmdir d0 39 2024-04-25T16:15:07.084 INFO:tasks.workunit.client.0.smithi059.stdout:0/88: fdatasync dc/df/f16 0 2024-04-25T16:15:07.088 INFO:tasks.workunit.client.0.smithi059.stdout:4/90: rmdir d0/d4 39 2024-04-25T16:15:07.158 INFO:tasks.workunit.client.0.smithi059.stdout:2/78: chown f2 4971970 1 2024-04-25T16:15:07.237 INFO:tasks.workunit.client.0.smithi059.stdout:1/98: dread f2 [0,4194304] 0 2024-04-25T16:15:07.275 INFO:tasks.workunit.client.0.smithi059.stdout:5/89: creat d1/d1e/f20 x:0 0 0 2024-04-25T16:15:07.324 INFO:tasks.workunit.client.0.smithi059.stdout:9/86: dwrite f0 [0,4194304] 0 2024-04-25T16:15:07.416 INFO:tasks.workunit.client.0.smithi059.stdout:6/95: symlink d9/d16/l1d 0 2024-04-25T16:15:07.417 INFO:tasks.workunit.client.0.smithi059.stdout:8/68: fsync d7/dd/f14 0 2024-04-25T16:15:07.437 INFO:tasks.workunit.client.0.smithi059.stdout:0/89: symlink dc/df/l1c 0 2024-04-25T16:15:07.458 INFO:tasks.workunit.client.0.smithi059.stdout:7/80: read d0/fd [2221786,104438] 0 2024-04-25T16:15:07.519 INFO:tasks.workunit.client.0.smithi059.stdout:6/96: chown d9/l1a 1 1 2024-04-25T16:15:07.534 INFO:tasks.workunit.client.0.smithi059.stdout:0/90: readlink dc/dd/l19 0 2024-04-25T16:15:07.537 INFO:tasks.workunit.client.0.smithi059.stdout:7/81: chown d0/d7 406 1 2024-04-25T16:15:07.589 INFO:tasks.workunit.client.0.smithi059.stdout:6/97: readlink d9/l15 0 2024-04-25T16:15:07.614 INFO:tasks.workunit.client.0.smithi059.stdout:0/91: readlink dc/df/l12 0 2024-04-25T16:15:07.628 INFO:tasks.workunit.client.0.smithi059.stdout:2/79: dwrite de/d16/d1e/f1f [0,4194304] 0 2024-04-25T16:15:07.734 INFO:tasks.workunit.client.0.smithi059.stdout:9/87: dwrite f0 [0,4194304] 0 2024-04-25T16:15:07.814 INFO:tasks.workunit.client.0.smithi059.stdout:5/90: fdatasync d1/f8 0 2024-04-25T16:15:07.836 INFO:tasks.workunit.client.0.smithi059.stdout:3/95: creat d0/d1e/f21 x:0 0 0 2024-04-25T16:15:07.871 INFO:tasks.workunit.client.0.smithi059.stdout:9/88: chown f2 7761 1 2024-04-25T16:15:07.874 INFO:tasks.workunit.client.0.smithi059.stdout:5/91: chown l0 688777857 1 2024-04-25T16:15:07.950 INFO:tasks.workunit.client.0.smithi059.stdout:6/98: mknod d9/d16/c1e 0 2024-04-25T16:15:07.963 INFO:tasks.workunit.client.0.smithi059.stdout:4/91: fsync d0/d4/df/f14 0 2024-04-25T16:15:08.000 INFO:tasks.workunit.client.0.smithi059.stdout:0/92: truncate dc/df/f16 811672 0 2024-04-25T16:15:08.001 INFO:tasks.workunit.client.0.smithi059.stdout:8/69: fdatasync d7/fa 0 2024-04-25T16:15:08.069 INFO:tasks.workunit.client.0.smithi059.stdout:3/96: rmdir d0/d1e 39 2024-04-25T16:15:08.078 INFO:tasks.workunit.client.0.smithi059.stdout:9/89: fdatasync d6/fb 0 2024-04-25T16:15:08.091 INFO:tasks.workunit.client.0.smithi059.stdout:9/90: stat f0 0 2024-04-25T16:15:08.152 INFO:tasks.workunit.client.0.smithi059.stdout:7/82: symlink d0/l18 0 2024-04-25T16:15:08.157 INFO:tasks.workunit.client.0.smithi059.stdout:2/80: mkdir de/d20 0 2024-04-25T16:15:08.169 INFO:tasks.workunit.client.0.smithi059.stdout:7/83: chown d0/l18 15343 1 2024-04-25T16:15:08.228 INFO:tasks.workunit.client.0.smithi059.stdout:2/81: dread de/d16/d1e/f1f [0,4194304] 0 2024-04-25T16:15:08.242 INFO:tasks.workunit.client.0.smithi059.stdout:2/82: dread fb [0,4194304] 0 2024-04-25T16:15:08.339 INFO:tasks.workunit.client.0.smithi059.stdout:6/99: rename f2 to d9/d16/f1f 0 2024-04-25T16:15:08.346 INFO:tasks.workunit.client.0.smithi059.stdout:4/92: unlink d0/d4/cd 0 2024-04-25T16:15:08.352 INFO:tasks.workunit.client.0.smithi059.stdout:1/99: rename d7/l11 to d7/l1f 0 2024-04-25T16:15:08.384 INFO:tasks.workunit.client.0.smithi059.stdout:6/100: chown d9/d16/f17 818 1 2024-04-25T16:15:08.390 INFO:tasks.workunit.client.0.smithi059.stdout:6/101: chown d9/cb 444279195 1 2024-04-25T16:15:08.417 INFO:tasks.workunit.client.0.smithi059.stdout:0/93: creat dc/df/f1d x:0 0 0 2024-04-25T16:15:08.500 INFO:tasks.workunit.client.0.smithi059.stdout:8/70: mkdir d7/dd/d17 0 2024-04-25T16:15:08.694 INFO:tasks.workunit.client.0.smithi059.stdout:9/91: creat d6/f13 x:0 0 0 2024-04-25T16:15:08.746 INFO:tasks.workunit.client.0.smithi059.stdout:9/92: dread f0 [0,4194304] 0 2024-04-25T16:15:08.781 INFO:tasks.workunit.client.0.smithi059.stdout:5/92: write d1/fa [379138,105714] 0 2024-04-25T16:15:08.848 INFO:tasks.workunit.client.0.smithi059.stdout:9/93: sync 2024-04-25T16:15:09.252 INFO:tasks.workunit.client.0.smithi059.stdout:4/93: symlink d0/d4/df/l1e 0 2024-04-25T16:15:09.260 INFO:tasks.workunit.client.0.smithi059.stdout:4/94: chown d0/d4 13717 1 2024-04-25T16:15:09.458 INFO:tasks.workunit.client.0.smithi059.stdout:8/71: readlink d7/l10 0 2024-04-25T16:15:09.506 INFO:tasks.workunit.client.0.smithi059.stdout:3/97: mkdir d0/d22 0 2024-04-25T16:15:09.726 INFO:tasks.workunit.client.0.smithi059.stdout:5/93: mkdir d1/d1e/d21 0 2024-04-25T16:15:10.269 INFO:tasks.workunit.client.0.smithi059.stdout:2/83: link de/c1b de/d16/c21 0 2024-04-25T16:15:10.422 INFO:tasks.workunit.client.0.smithi059.stdout:1/100: dwrite d7/d13/d16/f1d [0,4194304] 0 2024-04-25T16:15:10.484 INFO:tasks.workunit.client.0.smithi059.stdout:1/101: chown d7/lf 24441 1 2024-04-25T16:15:10.682 INFO:tasks.workunit.client.0.smithi059.stdout:2/84: creat de/d16/f22 x:0 0 0 2024-04-25T16:15:10.690 INFO:tasks.workunit.client.0.smithi059.stdout:5/94: rmdir d1/dd 39 2024-04-25T16:15:10.699 INFO:tasks.workunit.client.0.smithi059.stdout:9/94: write d6/ff [588606,93831] 0 2024-04-25T16:15:10.701 INFO:tasks.workunit.client.0.smithi059.stdout:0/94: write dc/df/f10 [678350,55717] 0 2024-04-25T16:15:10.722 INFO:tasks.workunit.client.0.smithi059.stdout:6/102: truncate d9/fd 492466 0 2024-04-25T16:15:10.728 INFO:tasks.workunit.client.0.smithi059.stdout:8/72: write d7/dd/f14 [16308,57728] 0 2024-04-25T16:15:10.773 INFO:tasks.workunit.client.0.smithi059.stdout:6/103: stat d9/c11 0 2024-04-25T16:15:10.802 INFO:tasks.workunit.client.0.smithi059.stdout:8/73: write d7/dd/f14 [350371,74620] 0 2024-04-25T16:15:10.874 INFO:tasks.workunit.client.0.smithi059.stdout:1/102: dread - d7/fc zero size 2024-04-25T16:15:10.880 INFO:tasks.workunit.client.0.smithi059.stdout:8/74: sync 2024-04-25T16:15:10.930 INFO:tasks.workunit.client.0.smithi059.stdout:7/84: link d0/d7/c11 d0/d7/c19 0 2024-04-25T16:15:10.964 INFO:tasks.workunit.client.0.smithi059.stdout:9/95: symlink d6/l14 0 2024-04-25T16:15:10.989 INFO:tasks.workunit.client.0.smithi059.stdout:9/96: read f1 [2473001,127078] 0 2024-04-25T16:15:11.003 INFO:tasks.workunit.client.0.smithi059.stdout:7/85: dread d0/d7/fa [0,4194304] 0 2024-04-25T16:15:11.025 INFO:tasks.workunit.client.0.smithi059.stdout:2/85: symlink de/d16/d1e/l23 0 2024-04-25T16:15:11.100 INFO:tasks.workunit.client.0.smithi059.stdout:6/104: unlink d9/f1c 0 2024-04-25T16:15:11.258 INFO:tasks.workunit.client.0.smithi059.stdout:3/98: link d0/cc d0/c23 0 2024-04-25T16:15:11.261 INFO:tasks.workunit.client.0.smithi059.stdout:1/103: rmdir d7/d13 39 2024-04-25T16:15:11.267 INFO:tasks.workunit.client.0.smithi059.stdout:8/75: fsync d7/f15 0 2024-04-25T16:15:11.283 INFO:tasks.workunit.client.0.smithi059.stdout:8/76: readlink d7/l12 0 2024-04-25T16:15:11.560 INFO:tasks.workunit.client.0.smithi059.stdout:5/95: creat d1/d1e/d21/f22 x:0 0 0 2024-04-25T16:15:11.566 INFO:tasks.workunit.client.0.smithi059.stdout:9/97: rename d6/c9 to d6/c15 0 2024-04-25T16:15:11.619 INFO:tasks.workunit.client.0.smithi059.stdout:7/86: write d0/f12 [868177,107917] 0 2024-04-25T16:15:11.731 INFO:tasks.workunit.client.0.smithi059.stdout:0/95: dwrite f6 [4194304,4194304] 0 2024-04-25T16:15:11.863 INFO:tasks.workunit.client.0.smithi059.stdout:3/99: mknod d0/db/c24 0 2024-04-25T16:15:11.882 INFO:tasks.workunit.client.0.smithi059.stdout:7/87: dwrite d0/f12 [0,4194304] 0 2024-04-25T16:15:11.966 INFO:tasks.workunit.client.0.smithi059.stdout:1/104: readlink d7/d13/l18 0 2024-04-25T16:15:12.007 INFO:tasks.workunit.client.0.smithi059.stdout:1/105: chown d7/d15 534 1 2024-04-25T16:15:12.087 INFO:tasks.workunit.client.0.smithi059.stdout:9/98: symlink d6/l16 0 2024-04-25T16:15:12.130 INFO:tasks.workunit.client.0.smithi059.stdout:5/96: creat d1/d1e/d21/f23 x:0 0 0 2024-04-25T16:15:12.132 INFO:tasks.workunit.client.0.smithi059.stdout:4/95: dwrite d0/d4/df/f14 [0,4194304] 0 2024-04-25T16:15:12.289 INFO:tasks.workunit.client.0.smithi059.stdout:6/105: dwrite f6 [0,4194304] 0 2024-04-25T16:15:12.289 INFO:tasks.workunit.client.0.smithi059.stdout:8/77: symlink d7/l18 0 2024-04-25T16:15:12.412 INFO:tasks.workunit.client.0.smithi059.stdout:8/78: stat d7/dd/c11 0 2024-04-25T16:15:12.635 INFO:tasks.workunit.client.0.smithi059.stdout:2/86: write de/f10 [926085,1215] 0 2024-04-25T16:15:12.637 INFO:tasks.workunit.client.0.smithi059.stdout:9/99: symlink d6/l17 0 2024-04-25T16:15:12.639 INFO:tasks.workunit.client.0.smithi059.stdout:5/97: rmdir d1 39 2024-04-25T16:15:12.773 INFO:tasks.workunit.client.0.smithi059.stdout:7/88: mknod d0/c1a 0 2024-04-25T16:15:12.879 INFO:tasks.workunit.client.0.smithi059.stdout:0/96: dwrite dc/df/f16 [0,4194304] 0 2024-04-25T16:15:12.965 INFO:tasks.workunit.client.0.smithi059.stdout:2/87: dwrite de/d16/f22 [0,4194304] 0 2024-04-25T16:15:13.032 INFO:tasks.workunit.client.0.smithi059.stdout:6/106: mkdir d9/d16/d20 0 2024-04-25T16:15:13.052 INFO:tasks.workunit.client.0.smithi059.stdout:9/100: rename d6/fd to d6/f18 0 2024-04-25T16:15:13.073 INFO:tasks.workunit.client.0.smithi059.stdout:9/101: stat d6/c10 0 2024-04-25T16:15:13.248 INFO:tasks.workunit.client.0.smithi059.stdout:3/100: rename d0/cc to d0/d1e/c25 0 2024-04-25T16:15:13.304 INFO:tasks.workunit.client.0.smithi059.stdout:1/106: truncate d7/d13/d16/f1d 1059448 0 2024-04-25T16:15:13.558 INFO:tasks.workunit.client.0.smithi059.stdout:8/79: mknod d7/d16/c19 0 2024-04-25T16:15:13.563 INFO:tasks.workunit.client.0.smithi059.stdout:2/88: symlink de/d16/l24 0 2024-04-25T16:15:13.569 INFO:tasks.workunit.client.0.smithi059.stdout:6/107: fsync d9/fe 0 2024-04-25T16:15:13.592 INFO:tasks.workunit.client.0.smithi059.stdout:5/98: mkdir d1/d1e/d21/d24 0 2024-04-25T16:15:13.610 INFO:tasks.workunit.client.0.smithi059.stdout:7/89: rename d0/d7/f14 to d0/d7/d16/f1b 0 2024-04-25T16:15:13.826 INFO:tasks.workunit.client.0.smithi059.stdout:2/89: chown f9 28357 1 2024-04-25T16:15:13.878 INFO:tasks.workunit.client.0.smithi059.stdout:8/80: dread d7/fa [0,4194304] 0 2024-04-25T16:15:14.153 INFO:tasks.workunit.client.0.smithi059.stdout:4/96: truncate d0/d4/df/f14 1854975 0 2024-04-25T16:15:14.214 INFO:tasks.workunit.client.0.smithi059.stdout:8/81: rename d7/dd/f14 to d7/dd/d17/f1a 0 2024-04-25T16:15:14.307 INFO:tasks.workunit.client.0.smithi059.stdout:2/90: creat de/d20/f25 x:0 0 0 2024-04-25T16:15:14.357 INFO:tasks.workunit.client.0.smithi059.stdout:6/108: link f3 d9/f21 0 2024-04-25T16:15:14.493 INFO:tasks.workunit.client.0.smithi059.stdout:9/102: dwrite d6/fb [0,4194304] 0 2024-04-25T16:15:14.590 INFO:tasks.workunit.client.0.smithi059.stdout:7/90: getdents d0 0 2024-04-25T16:15:14.595 INFO:tasks.workunit.client.0.smithi059.stdout:2/91: creat de/d20/f26 x:0 0 0 2024-04-25T16:15:14.657 INFO:tasks.workunit.client.0.smithi059.stdout:6/109: creat d9/d16/f22 x:0 0 0 2024-04-25T16:15:14.669 INFO:tasks.workunit.client.0.smithi059.stdout:7/91: write d0/f12 [2098077,15512] 0 2024-04-25T16:15:14.714 INFO:tasks.workunit.client.0.smithi059.stdout:2/92: chown de/d20/f26 2 1 2024-04-25T16:15:14.734 INFO:tasks.workunit.client.0.smithi059.stdout:0/97: creat dc/f1e x:0 0 0 2024-04-25T16:15:14.794 INFO:tasks.workunit.client.0.smithi059.stdout:1/107: write d7/fc [411657,7531] 0 2024-04-25T16:15:14.822 INFO:tasks.workunit.client.0.smithi059.stdout:7/92: chown d0/d7/f10 1130355 1 2024-04-25T16:15:14.826 INFO:tasks.workunit.client.0.smithi059.stdout:8/82: dwrite d7/dd/d17/f1a [0,4194304] 0 2024-04-25T16:15:14.847 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:15:14.850 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:15:14.855 INFO:tasks.workunit.client.0.smithi059.stdout:2/93: sync 2024-04-25T16:15:14.895 INFO:tasks.workunit.client.0.smithi059.stdout:3/101: dwrite d0/fa [0,4194304] 0 2024-04-25T16:15:14.976 INFO:tasks.workunit.client.0.smithi059.stdout:5/99: write d1/dd/f13 [4078161,99862] 0 2024-04-25T16:15:15.056 INFO:tasks.workunit.client.0.smithi059.stdout:5/100: readlink d1/dd/l1a 0 2024-04-25T16:15:15.138 INFO:tasks.workunit.client.0.smithi059.stdout:9/103: dwrite d6/f13 [0,4194304] 0 2024-04-25T16:15:15.198 INFO:tasks.workunit.client.0.smithi059.stdout:9/104: readlink d6/le 0 2024-04-25T16:15:15.443 INFO:tasks.workunit.client.0.smithi059.stdout:4/97: dwrite d0/d4/fe [0,4194304] 0 2024-04-25T16:15:15.709 INFO:tasks.workunit.client.0.smithi059.stdout:7/93: symlink d0/l1c 0 2024-04-25T16:15:15.710 INFO:tasks.workunit.client.0.smithi059.stdout:1/108: creat d7/d13/f20 x:0 0 0 2024-04-25T16:15:15.729 INFO:tasks.workunit.client.0.smithi059.stdout:8/83: symlink d7/dd/d17/l1b 0 2024-04-25T16:15:15.772 INFO:tasks.workunit.client.0.smithi059.stdout:1/109: write d7/fc [354429,105228] 0 2024-04-25T16:15:15.792 INFO:tasks.workunit.client.0.smithi059.stdout:8/84: chown d7/dd/c11 1071 1 2024-04-25T16:15:15.801 INFO:tasks.workunit.client.0.smithi059.stdout:9/105: dread d6/f18 [0,4194304] 0 2024-04-25T16:15:16.000 INFO:tasks.workunit.client.0.smithi059.stdout:6/110: creat d9/f23 x:0 0 0 2024-04-25T16:15:16.023 INFO:tasks.workunit.client.0.smithi059.stdout:0/98: creat dc/f1f x:0 0 0 2024-04-25T16:15:16.125 INFO:tasks.workunit.client.0.smithi059.stdout:2/94: creat de/f27 x:0 0 0 2024-04-25T16:15:16.163 INFO:tasks.workunit.client.0.smithi059.stdout:3/102: dwrite d0/db/f1a [0,4194304] 0 2024-04-25T16:15:16.167 INFO:tasks.workunit.client.0.smithi059.stdout:1/110: mkdir d7/d21 0 2024-04-25T16:15:16.348 INFO:tasks.workunit.client.0.smithi059.stdout:0/99: rmdir dc/df 39 2024-04-25T16:15:16.357 INFO:tasks.workunit.client.0.smithi059.stdout:5/101: rename d1/dd/c17 to d1/c25 0 2024-04-25T16:15:16.390 INFO:tasks.workunit.client.0.smithi059.stdout:9/106: write f1 [2180032,69263] 0 2024-04-25T16:15:16.401 INFO:tasks.workunit.client.0.smithi059.stdout:4/98: rename d0/d4 to d0/d4/d1f 22 2024-04-25T16:15:16.423 INFO:tasks.workunit.client.0.smithi059.stdout:5/102: rename d1/d1e to d1/d1e/d21/d26 22 2024-04-25T16:15:16.456 INFO:tasks.workunit.client.0.smithi059.stdout:7/94: fsync d0/fd 0 2024-04-25T16:15:16.486 INFO:tasks.workunit.client.0.smithi059.stdout:2/95: fsync de/d16/f1a 0 2024-04-25T16:15:16.816 INFO:tasks.workunit.client.0.smithi059.stdout:8/85: creat d7/f1c x:0 0 0 2024-04-25T16:15:16.883 INFO:tasks.workunit.client.0.smithi059.stdout:6/111: getdents d9/d1b 0 2024-04-25T16:15:16.892 INFO:tasks.workunit.client.0.smithi059.stdout:0/100: creat dc/dd/f20 x:0 0 0 2024-04-25T16:15:16.893 INFO:tasks.workunit.client.0.smithi059.stdout:4/99: creat d0/d4/f20 x:0 0 0 2024-04-25T16:15:16.899 INFO:tasks.workunit.client.0.smithi059.stdout:9/107: rename d6/fc to d6/f19 0 2024-04-25T16:15:16.923 INFO:tasks.workunit.client.0.smithi059.stdout:8/86: sync 2024-04-25T16:15:16.929 INFO:tasks.workunit.client.0.smithi059.stdout:7/95: rmdir d0 39 2024-04-25T16:15:16.935 INFO:tasks.workunit.client.0.smithi059.stdout:5/103: truncate d1/f1c 115212 0 2024-04-25T16:15:16.945 INFO:tasks.workunit.client.0.smithi059.stdout:2/96: unlink f9 0 2024-04-25T16:15:16.966 INFO:tasks.workunit.client.0.smithi059.stdout:3/103: creat d0/d22/f26 x:0 0 0 2024-04-25T16:15:16.976 INFO:tasks.workunit.client.0.smithi059.stdout:0/101: write dc/dd/f20 [24186,75434] 0 2024-04-25T16:15:17.024 INFO:tasks.workunit.client.0.smithi059.stdout:5/104: write d1/d1e/d21/f23 [163812,76312] 0 2024-04-25T16:15:17.097 INFO:tasks.workunit.client.0.smithi059.stdout:6/112: mkdir d9/d16/d24 0 2024-04-25T16:15:17.195 INFO:tasks.workunit.client.0.smithi059.stdout:4/100: creat d0/d4/f21 x:0 0 0 2024-04-25T16:15:17.277 INFO:tasks.workunit.client.0.smithi059.stdout:2/97: unlink cc 0 2024-04-25T16:15:17.348 INFO:tasks.workunit.client.0.smithi059.stdout:1/111: dwrite f2 [0,4194304] 0 2024-04-25T16:15:17.447 INFO:tasks.workunit.client.0.smithi059.stdout:9/108: write f0 [83430,55505] 0 2024-04-25T16:15:17.553 INFO:tasks.workunit.client.0.smithi059.stdout:9/109: dread f0 [0,4194304] 0 2024-04-25T16:15:17.585 INFO:tasks.workunit.client.0.smithi059.stdout:4/101: symlink d0/d4/l22 0 2024-04-25T16:15:17.696 INFO:tasks.workunit.client.0.smithi059.stdout:8/87: symlink d7/l1d 0 2024-04-25T16:15:17.753 INFO:tasks.workunit.client.0.smithi059.stdout:5/105: write d1/dd/ff [242508,10858] 0 2024-04-25T16:15:17.754 INFO:tasks.workunit.client.0.smithi059.stdout:2/98: creat de/d20/f28 x:0 0 0 2024-04-25T16:15:17.784 INFO:tasks.workunit.client.0.smithi059.stdout:3/104: dwrite d0/db/f20 [0,4194304] 0 2024-04-25T16:15:17.792 INFO:tasks.workunit.client.0.smithi059.stdout:0/102: mknod dc/df/c21 0 2024-04-25T16:15:17.873 INFO:tasks.workunit.client.0.smithi059.stdout:5/106: readlink d1/lc 0 2024-04-25T16:15:17.988 INFO:tasks.workunit.client.0.smithi059.stdout:9/110: creat d6/f1a x:0 0 0 2024-04-25T16:15:18.002 INFO:tasks.workunit.client.0.smithi059.stdout:5/107: chown d1/dd/f12 148771473 1 2024-04-25T16:15:18.063 INFO:tasks.workunit.client.0.smithi059.stdout:8/88: dread d7/dd/d17/f1a [0,4194304] 0 2024-04-25T16:15:18.076 INFO:tasks.workunit.client.0.smithi059.stdout:6/113: dwrite d9/f10 [0,4194304] 0 2024-04-25T16:15:18.158 INFO:tasks.workunit.client.0.smithi059.stdout:0/103: mknod dc/df/c22 0 2024-04-25T16:15:18.173 INFO:tasks.workunit.client.0.smithi059.stdout:2/99: dread - de/d16/f19 zero size 2024-04-25T16:15:18.221 INFO:tasks.workunit.client.0.smithi059.stdout:9/111: unlink d6/c11 0 2024-04-25T16:15:18.232 INFO:tasks.workunit.client.0.smithi059.stdout:5/108: fsync d1/fa 0 2024-04-25T16:15:18.245 INFO:tasks.workunit.client.0.smithi059.stdout:4/102: dread d0/d4/df/f14 [0,4194304] 0 2024-04-25T16:15:18.262 INFO:tasks.workunit.client.0.smithi059.stdout:9/112: readlink d6/l16 0 2024-04-25T16:15:18.389 INFO:tasks.workunit.client.0.smithi059.stdout:2/100: dwrite de/f27 [0,4194304] 0 2024-04-25T16:15:18.510 INFO:tasks.workunit.client.0.smithi059.stdout:1/112: rename f2 to d7/f22 0 2024-04-25T16:15:18.575 INFO:tasks.workunit.client.0.smithi059.stdout:8/89: fsync d7/fa 0 2024-04-25T16:15:18.621 INFO:tasks.workunit.client.0.smithi059.stdout:7/96: dwrite d0/d7/fa [0,4194304] 0 2024-04-25T16:15:18.907 INFO:tasks.workunit.client.0.smithi059.stdout:5/109: dread - d1/d1e/f20 zero size 2024-04-25T16:15:18.962 INFO:tasks.workunit.client.0.smithi059.stdout:9/113: creat d6/f1b x:0 0 0 2024-04-25T16:15:18.991 INFO:tasks.workunit.client.0.smithi059.stdout:9/114: fsync f1 0 2024-04-25T16:15:18.993 INFO:tasks.workunit.client.0.smithi059.stdout:3/105: dwrite d0/db/f14 [0,4194304] 0 2024-04-25T16:15:19.281 INFO:tasks.workunit.client.0.smithi059.stdout:2/101: rename de/f27 to de/d16/d1e/f29 0 2024-04-25T16:15:19.362 INFO:tasks.workunit.client.0.smithi059.stdout:8/90: mknod d7/dd/c1e 0 2024-04-25T16:15:19.365 INFO:tasks.workunit.client.0.smithi059.stdout:2/102: sync 2024-04-25T16:15:19.393 INFO:tasks.workunit.client.0.smithi059.stdout:7/97: creat d0/d7/f1d x:0 0 0 2024-04-25T16:15:19.425 INFO:tasks.workunit.client.0.smithi059.stdout:0/104: dwrite dc/df/f1d [0,4194304] 0 2024-04-25T16:15:19.427 INFO:tasks.workunit.client.0.smithi059.stdout:6/114: getdents d9/d16/d24 0 2024-04-25T16:15:19.567 INFO:tasks.workunit.client.0.smithi059.stdout:5/110: mkdir d1/d1e/d27 0 2024-04-25T16:15:19.716 INFO:tasks.workunit.client.0.smithi059.stdout:1/113: creat d7/d21/f23 x:0 0 0 2024-04-25T16:15:19.908 INFO:tasks.workunit.client.0.smithi059.stdout:7/98: dread - d0/d7/d16/f1b zero size 2024-04-25T16:15:20.014 INFO:tasks.workunit.client.0.smithi059.stdout:4/103: creat d0/d4/df/d1c/f23 x:0 0 0 2024-04-25T16:15:20.022 INFO:tasks.workunit.client.0.smithi059.stdout:2/103: truncate f2 590614 0 2024-04-25T16:15:20.089 INFO:tasks.workunit.client.0.smithi059.stdout:2/104: sync 2024-04-25T16:15:20.105 INFO:tasks.workunit.client.0.smithi059.stdout:6/115: read d9/d16/f1f [81803,53135] 0 2024-04-25T16:15:20.119 INFO:tasks.workunit.client.0.smithi059.stdout:5/111: symlink d1/d1e/l28 0 2024-04-25T16:15:20.121 INFO:tasks.workunit.client.0.smithi059.stdout:6/116: dread - d9/f23 zero size 2024-04-25T16:15:20.153 INFO:tasks.workunit.client.0.smithi059.stdout:1/114: creat d7/d13/d16/f24 x:0 0 0 2024-04-25T16:15:20.194 INFO:tasks.workunit.client.0.smithi059.stdout:6/117: dread d9/f10 [0,4194304] 0 2024-04-25T16:15:20.195 INFO:tasks.workunit.client.0.smithi059.stdout:1/115: chown d7/d13/d16/f1e 101126657 1 2024-04-25T16:15:20.224 INFO:tasks.workunit.client.0.smithi059.stdout:1/116: read - d7/d13/d16/f24 zero size 2024-04-25T16:15:20.233 INFO:tasks.workunit.client.0.smithi059.stdout:1/117: chown d7/d13/d16 230800 1 2024-04-25T16:15:20.253 INFO:tasks.workunit.client.0.smithi059.stdout:7/99: creat d0/d7/d16/f1e x:0 0 0 2024-04-25T16:15:20.301 INFO:tasks.workunit.client.0.smithi059.stdout:1/118: dread d7/f22 [0,4194304] 0 2024-04-25T16:15:20.398 INFO:tasks.workunit.client.0.smithi059.stdout:9/115: rmdir d6 39 2024-04-25T16:15:20.429 INFO:tasks.workunit.client.0.smithi059.stdout:6/118: dread f3 [0,4194304] 0 2024-04-25T16:15:20.480 INFO:tasks.workunit.client.0.smithi059.stdout:3/106: rename d0/d1e/f21 to d0/f27 0 2024-04-25T16:15:20.649 INFO:tasks.workunit.client.0.smithi059.stdout:8/91: creat d7/f1f x:0 0 0 2024-04-25T16:15:20.688 INFO:tasks.workunit.client.0.smithi059.stdout:2/105: mkdir de/d2a 0 2024-04-25T16:15:20.749 INFO:tasks.workunit.client.0.smithi059.stdout:1/119: unlink d7/ce 0 2024-04-25T16:15:20.876 INFO:tasks.workunit.client.0.smithi059.stdout:6/119: fdatasync d9/d16/f1f 0 2024-04-25T16:15:21.047 INFO:tasks.workunit.client.0.smithi059.stdout:0/105: rename dc/f1e to dc/dd/f23 0 2024-04-25T16:15:21.053 INFO:tasks.workunit.client.0.smithi059.stdout:3/107: readlink d0/l8 0 2024-04-25T16:15:21.100 INFO:tasks.workunit.client.0.smithi059.stdout:4/104: write d0/d4/df/f14 [2720417,107371] 0 2024-04-25T16:15:21.213 INFO:tasks.workunit.client.0.smithi059.stdout:0/106: dwrite dc/df/f1d [0,4194304] 0 2024-04-25T16:15:21.296 INFO:tasks.workunit.client.0.smithi059.stdout:7/100: write d0/d7/d16/f1b [998639,72091] 0 2024-04-25T16:15:21.357 INFO:tasks.workunit.client.0.smithi059.stdout:5/112: dwrite d1/fa [0,4194304] 0 2024-04-25T16:15:21.425 INFO:tasks.workunit.client.0.smithi059.stdout:9/116: write f2 [885098,11923] 0 2024-04-25T16:15:21.468 INFO:tasks.workunit.client.0.smithi059.stdout:5/113: write d1/d1e/d21/f23 [503314,92828] 0 2024-04-25T16:15:21.644 INFO:tasks.workunit.client.0.smithi059.stdout:1/120: dwrite d7/d13/d16/f1d [4194304,4194304] 0 2024-04-25T16:15:21.736 INFO:tasks.workunit.client.0.smithi059.stdout:7/101: creat d0/d7/f1f x:0 0 0 2024-04-25T16:15:21.767 INFO:tasks.workunit.client.0.smithi059.stdout:4/105: write d0/d4/fe [3354797,76389] 0 2024-04-25T16:15:21.833 INFO:tasks.workunit.client.0.smithi059.stdout:2/106: unlink de/l14 0 2024-04-25T16:15:22.186 INFO:tasks.workunit.client.0.smithi059.stdout:8/92: creat d7/f20 x:0 0 0 2024-04-25T16:15:22.254 INFO:tasks.workunit.client.0.smithi059.stdout:9/117: unlink d6/le 0 2024-04-25T16:15:22.277 INFO:tasks.workunit.client.0.smithi059.stdout:0/107: write f6 [7707705,72696] 0 2024-04-25T16:15:22.279 INFO:tasks.workunit.client.0.smithi059.stdout:9/118: fdatasync f2 0 2024-04-25T16:15:22.285 INFO:tasks.workunit.client.0.smithi059.stdout:3/108: dwrite d0/f6 [0,4194304] 0 2024-04-25T16:15:22.297 INFO:tasks.workunit.client.0.smithi059.stdout:7/102: mkdir d0/d7/d16/d20 0 2024-04-25T16:15:22.471 INFO:tasks.workunit.client.0.smithi059.stdout:6/120: creat d9/f25 x:0 0 0 2024-04-25T16:15:22.473 INFO:tasks.workunit.client.0.smithi059.stdout:1/121: creat d7/d15/f25 x:0 0 0 2024-04-25T16:15:22.498 INFO:tasks.workunit.client.0.smithi059.stdout:1/122: truncate d7/d13/f14 827555 0 2024-04-25T16:15:22.507 INFO:tasks.workunit.client.0.smithi059.stdout:1/123: read - d7/d15/f25 zero size 2024-04-25T16:15:22.650 INFO:tasks.workunit.client.0.smithi059.stdout:5/114: creat d1/f29 x:0 0 0 2024-04-25T16:15:22.670 INFO:tasks.workunit.client.0.smithi059.stdout:2/107: mknod de/d2a/c2b 0 2024-04-25T16:15:22.747 INFO:tasks.workunit.client.0.smithi059.stdout:3/109: read - d0/db/f1c zero size 2024-04-25T16:15:22.792 INFO:tasks.workunit.client.0.smithi059.stdout:9/119: truncate d6/ff 615211 0 2024-04-25T16:15:22.805 INFO:tasks.workunit.client.0.smithi059.stdout:9/120: write f2 [1436094,91817] 0 2024-04-25T16:15:22.826 INFO:tasks.workunit.client.0.smithi059.stdout:9/121: dread d6/f18 [0,4194304] 0 2024-04-25T16:15:22.991 INFO:tasks.workunit.client.0.smithi059.stdout:8/93: write d7/dd/ff [790173,104577] 0 2024-04-25T16:15:23.015 INFO:tasks.workunit.client.0.smithi059.stdout:8/94: write d7/dd/ff [760618,114127] 0 2024-04-25T16:15:23.174 INFO:tasks.workunit.client.0.smithi059.stdout:0/108: dwrite f9 [4194304,4194304] 0 2024-04-25T16:15:23.276 INFO:tasks.workunit.client.0.smithi059.stdout:2/108: mkdir de/d20/d2c 0 2024-04-25T16:15:23.289 INFO:tasks.workunit.client.0.smithi059.stdout:1/124: write d7/d13/f20 [351940,99695] 0 2024-04-25T16:15:23.419 INFO:tasks.workunit.client.0.smithi059.stdout:4/106: dwrite d0/d4/df/f12 [0,4194304] 0 2024-04-25T16:15:23.427 INFO:tasks.workunit.client.0.smithi059.stdout:0/109: truncate dc/df/f1d 4636431 0 2024-04-25T16:15:23.499 INFO:tasks.workunit.client.0.smithi059.stdout:1/125: write d7/d13/d16/f24 [977779,8669] 0 2024-04-25T16:15:23.585 INFO:tasks.workunit.client.0.smithi059.stdout:6/121: dwrite d9/d16/f1f [0,4194304] 0 2024-04-25T16:15:23.664 INFO:tasks.workunit.client.0.smithi059.stdout:0/110: truncate dc/dd/f23 894635 0 2024-04-25T16:15:23.676 INFO:tasks.workunit.client.0.smithi059.stdout:9/122: rmdir d6 39 2024-04-25T16:15:23.681 INFO:tasks.workunit.client.0.smithi059.stdout:7/103: symlink d0/d7/d16/d20/l21 0 2024-04-25T16:15:23.810 INFO:tasks.workunit.client.0.smithi059.stdout:8/95: write d7/f15 [238176,64632] 0 2024-04-25T16:15:23.812 INFO:tasks.workunit.client.0.smithi059.stdout:5/115: write d1/dd/f12 [966850,101633] 0 2024-04-25T16:15:23.912 INFO:tasks.workunit.client.0.smithi059.stdout:2/109: dwrite f1 [0,4194304] 0 2024-04-25T16:15:24.201 INFO:tasks.workunit.client.0.smithi059.stdout:6/122: creat d9/d16/f26 x:0 0 0 2024-04-25T16:15:24.463 INFO:tasks.workunit.client.0.smithi059.stdout:2/110: dread f4 [0,4194304] 0 2024-04-25T16:15:24.474 INFO:tasks.workunit.client.0.smithi059.stdout:2/111: dread f4 [0,4194304] 0 2024-04-25T16:15:24.494 INFO:tasks.workunit.client.0.smithi059.stdout:3/110: creat d0/f28 x:0 0 0 2024-04-25T16:15:24.546 INFO:tasks.workunit.client.0.smithi059.stdout:9/123: creat d6/f1c x:0 0 0 2024-04-25T16:15:24.550 INFO:tasks.workunit.client.0.smithi059.stdout:9/124: stat c3 0 2024-04-25T16:15:24.605 INFO:tasks.workunit.client.0.smithi059.stdout:4/107: write d0/d4/f8 [234407,41097] 0 2024-04-25T16:15:24.606 INFO:tasks.workunit.client.0.smithi059.stdout:3/111: sync 2024-04-25T16:15:24.723 INFO:tasks.workunit.client.0.smithi059.stdout:1/126: rename d7/d13/f14 to d7/f26 0 2024-04-25T16:15:24.767 INFO:tasks.workunit.client.0.smithi059.stdout:5/116: mknod d1/c2a 0 2024-04-25T16:15:24.866 INFO:tasks.workunit.client.0.smithi059.stdout:2/112: unlink de/d16/d1e/f29 0 2024-04-25T16:15:24.877 INFO:tasks.workunit.client.0.smithi059.stdout:9/125: dread - d6/f1a zero size 2024-04-25T16:15:24.880 INFO:tasks.workunit.client.0.smithi059.stdout:0/111: write dc/dd/f20 [802602,104545] 0 2024-04-25T16:15:24.909 INFO:tasks.workunit.client.0.smithi059.stdout:2/113: dread fb [0,4194304] 0 2024-04-25T16:15:25.066 INFO:tasks.workunit.client.0.smithi059.stdout:7/104: truncate d0/d7/d16/f1b 290919 0 2024-04-25T16:15:25.081 INFO:tasks.workunit.client.0.smithi059.stdout:7/105: write d0/d7/f1f [917554,19386] 0 2024-04-25T16:15:25.127 INFO:tasks.workunit.client.0.smithi059.stdout:3/112: symlink d0/db/l29 0 2024-04-25T16:15:25.388 INFO:tasks.workunit.client.0.smithi059.stdout:4/108: mknod d0/d4/df/d1c/c24 0 2024-04-25T16:15:25.397 INFO:tasks.workunit.client.0.smithi059.stdout:8/96: creat d7/f21 x:0 0 0 2024-04-25T16:15:25.413 INFO:tasks.workunit.client.0.smithi059.stdout:9/126: mkdir d6/d1d 0 2024-04-25T16:15:25.422 INFO:tasks.workunit.client.0.smithi059.stdout:0/112: mkdir dc/df/d24 0 2024-04-25T16:15:25.477 INFO:tasks.workunit.client.0.smithi059.stdout:4/109: write d0/d4/f8 [4966010,37519] 0 2024-04-25T16:15:25.490 INFO:tasks.workunit.client.0.smithi059.stdout:9/127: sync 2024-04-25T16:15:25.605 INFO:tasks.workunit.client.0.smithi059.stdout:7/106: dwrite d0/d7/f1d [0,4194304] 0 2024-04-25T16:15:25.690 INFO:tasks.workunit.client.0.smithi059.stdout:7/107: write d0/d7/f1f [472348,27081] 0 2024-04-25T16:15:25.938 INFO:tasks.workunit.client.0.smithi059.stdout:1/127: write d7/f26 [614879,59634] 0 2024-04-25T16:15:25.967 INFO:tasks.workunit.client.0.smithi059.stdout:5/117: mkdir d1/d1e/d21/d24/d2b 0 2024-04-25T16:15:25.982 INFO:tasks.workunit.client.0.smithi059.stdout:3/113: write d0/db/f16 [1453742,79077] 0 2024-04-25T16:15:26.048 INFO:tasks.workunit.client.0.smithi059.stdout:9/128: symlink d6/l1e 0 2024-04-25T16:15:26.108 INFO:tasks.workunit.client.0.smithi059.stdout:8/97: write d7/fa [4640817,18703] 0 2024-04-25T16:15:26.229 INFO:tasks.workunit.client.0.smithi059.stdout:3/114: dwrite d0/f6 [0,4194304] 0 2024-04-25T16:15:26.310 INFO:tasks.workunit.client.0.smithi059.stdout:5/118: dwrite d1/fa [0,4194304] 0 2024-04-25T16:15:26.374 INFO:tasks.workunit.client.0.smithi059.stdout:4/110: dread d0/fc [0,4194304] 0 2024-04-25T16:15:26.405 INFO:tasks.workunit.client.0.smithi059.stdout:6/123: rename d9/d16/d20 to d9/d27 0 2024-04-25T16:15:26.414 INFO:tasks.workunit.client.0.smithi059.stdout:0/113: link f6 dc/df/d24/f25 0 2024-04-25T16:15:26.440 INFO:tasks.workunit.client.0.smithi059.stdout:0/114: stat f6 0 2024-04-25T16:15:26.455 INFO:tasks.workunit.client.0.smithi059.stdout:3/115: write d0/db/f16 [1761732,33904] 0 2024-04-25T16:15:26.461 INFO:tasks.workunit.client.0.smithi059.stdout:8/98: chown d7/l12 329771306 1 2024-04-25T16:15:26.504 INFO:tasks.workunit.client.0.smithi059.stdout:6/124: write d9/d16/f26 [215239,63272] 0 2024-04-25T16:15:26.522 INFO:tasks.workunit.client.0.smithi059.stdout:8/99: write d7/fa [4944166,96865] 0 2024-04-25T16:15:26.628 INFO:tasks.workunit.client.0.smithi059.stdout:0/115: dwrite f9 [4194304,4194304] 0 2024-04-25T16:15:26.713 INFO:tasks.workunit.client.0.smithi059.stdout:7/108: write d0/d7/fa [2847659,81740] 0 2024-04-25T16:15:26.731 INFO:tasks.workunit.client.0.smithi059.stdout:2/114: getdents de/d20 0 2024-04-25T16:15:26.812 INFO:tasks.workunit.client.0.smithi059.stdout:9/129: creat d6/d1d/f1f x:0 0 0 2024-04-25T16:15:26.818 INFO:tasks.workunit.client.0.smithi059.stdout:5/119: creat d1/dd/f2c x:0 0 0 2024-04-25T16:15:26.869 INFO:tasks.workunit.client.0.smithi059.stdout:1/128: dwrite d7/f12 [0,4194304] 0 2024-04-25T16:15:26.886 INFO:tasks.workunit.client.0.smithi059.stdout:4/111: write d0/d4/df/d1c/f23 [250406,64872] 0 2024-04-25T16:15:26.981 INFO:tasks.workunit.client.0.smithi059.stdout:0/116: mknod dc/df/c26 0 2024-04-25T16:15:27.155 INFO:tasks.workunit.client.0.smithi059.stdout:5/120: creat d1/d1e/f2d x:0 0 0 2024-04-25T16:15:27.162 INFO:tasks.workunit.client.0.smithi059.stdout:4/112: dwrite d0/d4/f8 [0,4194304] 0 2024-04-25T16:15:27.174 INFO:tasks.workunit.client.0.smithi059.stdout:0/117: dwrite f9 [4194304,4194304] 0 2024-04-25T16:15:27.291 INFO:tasks.workunit.client.0.smithi059.stdout:6/125: mknod d9/d16/d24/c28 0 2024-04-25T16:15:27.329 INFO:tasks.workunit.client.0.smithi059.stdout:8/100: rename c5 to d7/dd/c22 0 2024-04-25T16:15:27.333 INFO:tasks.workunit.client.0.smithi059.stdout:3/116: truncate d0/d1e/f1f 112732 0 2024-04-25T16:15:27.372 INFO:tasks.workunit.client.0.smithi059.stdout:2/115: write de/d16/f1a [757650,74596] 0 2024-04-25T16:15:27.509 INFO:tasks.workunit.client.0.smithi059.stdout:7/109: unlink d0/d7/d16/f1b 0 2024-04-25T16:15:27.516 INFO:tasks.workunit.client.0.smithi059.stdout:9/130: write d6/f1b [885154,83256] 0 2024-04-25T16:15:27.523 INFO:tasks.workunit.client.0.smithi059.stdout:1/129: mknod d7/c27 0 2024-04-25T16:15:27.644 INFO:tasks.workunit.client.0.smithi059.stdout:8/101: mkdir d7/dd/d17/d23 0 2024-04-25T16:15:27.645 INFO:tasks.workunit.client.0.smithi059.stdout:4/113: read - d0/d4/f20 zero size 2024-04-25T16:15:27.751 INFO:tasks.workunit.client.0.smithi059.stdout:6/126: dread d9/d16/f17 [0,4194304] 0 2024-04-25T16:15:27.821 INFO:tasks.workunit.client.0.smithi059.stdout:3/117: write d0/db/f14 [2219578,106934] 0 2024-04-25T16:15:27.852 INFO:tasks.workunit.client.0.smithi059.stdout:8/102: dwrite d7/f9 [0,4194304] 0 2024-04-25T16:15:27.963 INFO:tasks.workunit.client.0.smithi059.stdout:9/131: creat d6/d1d/f20 x:0 0 0 2024-04-25T16:15:28.114 INFO:tasks.workunit.client.0.smithi059.stdout:0/118: mknod dc/c27 0 2024-04-25T16:15:28.115 INFO:tasks.workunit.client.0.smithi059.stdout:4/114: rmdir d0/d4 39 2024-04-25T16:15:28.128 INFO:tasks.workunit.client.0.smithi059.stdout:0/119: chown dc/df/f10 8080408 1 2024-04-25T16:15:28.171 INFO:tasks.workunit.client.0.smithi059.stdout:3/118: symlink d0/d1e/l2a 0 2024-04-25T16:15:28.176 INFO:tasks.workunit.client.0.smithi059.stdout:8/103: unlink c4 0 2024-04-25T16:15:28.186 INFO:tasks.workunit.client.0.smithi059.stdout:3/119: stat d0/d1e 0 2024-04-25T16:15:28.332 INFO:tasks.workunit.client.0.smithi059.stdout:7/110: dwrite d0/d7/f10 [0,4194304] 0 2024-04-25T16:15:28.402 INFO:tasks.workunit.client.0.smithi059.stdout:5/121: rmdir d1/d1e/d21/d24/d2b 0 2024-04-25T16:15:28.443 INFO:tasks.workunit.client.0.smithi059.stdout:7/111: write d0/d7/f1d [696945,95867] 0 2024-04-25T16:15:28.466 INFO:tasks.workunit.client.0.smithi059.stdout:3/120: creat d0/d22/f2b x:0 0 0 2024-04-25T16:15:28.469 INFO:tasks.workunit.client.0.smithi059.stdout:0/120: dread - dc/f1f zero size 2024-04-25T16:15:28.922 INFO:tasks.workunit.client.0.smithi059.stdout:2/116: creat de/f2d x:0 0 0 2024-04-25T16:15:28.926 INFO:tasks.workunit.client.0.smithi059.stdout:1/130: link d7/d15/f25 d7/f28 0 2024-04-25T16:15:29.114 INFO:tasks.workunit.client.0.smithi059.stdout:4/115: symlink d0/d4/df/d1c/l25 0 2024-04-25T16:15:29.261 INFO:tasks.workunit.client.0.smithi059.stdout:8/104: symlink d7/dd/d17/d23/l24 0 2024-04-25T16:15:29.351 INFO:tasks.workunit.client.0.smithi059.stdout:3/121: creat d0/db/f2c x:0 0 0 2024-04-25T16:15:29.497 INFO:tasks.workunit.client.0.smithi059.stdout:0/121: dwrite dc/dd/f23 [0,4194304] 0 2024-04-25T16:15:29.562 INFO:tasks.workunit.client.0.smithi059.stdout:6/127: creat d9/f29 x:0 0 0 2024-04-25T16:15:29.572 INFO:tasks.workunit.client.0.smithi059.stdout:0/122: chown f6 8 1 2024-04-25T16:15:29.577 INFO:tasks.workunit.client.0.smithi059.stdout:6/128: chown d9/d16/d24 27781 1 2024-04-25T16:15:29.583 INFO:tasks.workunit.client.0.smithi059.stdout:6/129: stat d9 0 2024-04-25T16:15:29.831 INFO:tasks.workunit.client.0.smithi059.stdout:2/117: rename de/d16/d1e to de/d2a/d2e 0 2024-04-25T16:15:29.992 INFO:tasks.workunit.client.0.smithi059.stdout:8/105: truncate d7/dd/d17/f1a 1427958 0 2024-04-25T16:15:30.118 INFO:tasks.workunit.client.0.smithi059.stdout:5/122: dwrite d1/d1e/d21/f23 [0,4194304] 0 2024-04-25T16:15:30.242 INFO:tasks.workunit.client.0.smithi059.stdout:5/123: fsync d1/fa 0 2024-04-25T16:15:30.247 INFO:tasks.workunit.client.0.smithi059.stdout:3/122: dread d0/f7 [0,4194304] 0 2024-04-25T16:15:30.252 INFO:tasks.workunit.client.0.smithi059.stdout:4/116: dread d0/d4/df/f19 [0,4194304] 0 2024-04-25T16:15:30.290 INFO:tasks.workunit.client.0.smithi059.stdout:9/132: getdents d6 0 2024-04-25T16:15:30.319 INFO:tasks.workunit.client.0.smithi059.stdout:2/118: truncate de/d20/f25 809941 0 2024-04-25T16:15:30.346 INFO:tasks.workunit.client.0.smithi059.stdout:0/123: dread dc/df/f1d [0,4194304] 0 2024-04-25T16:15:30.348 INFO:tasks.workunit.client.0.smithi059.stdout:4/117: stat d0/d4/l10 0 2024-04-25T16:15:30.389 INFO:tasks.workunit.client.0.smithi059.stdout:5/124: sync 2024-04-25T16:15:30.439 INFO:tasks.workunit.client.0.smithi059.stdout:0/124: sync 2024-04-25T16:15:30.563 INFO:tasks.workunit.client.0.smithi059.stdout:7/112: dwrite d0/f12 [0,4194304] 0 2024-04-25T16:15:30.634 INFO:tasks.workunit.client.0.smithi059.stdout:1/131: creat d7/f29 x:0 0 0 2024-04-25T16:15:30.654 INFO:tasks.workunit.client.0.smithi059.stdout:6/130: write d9/f21 [1036688,20410] 0 2024-04-25T16:15:30.688 INFO:tasks.workunit.client.0.smithi059.stdout:2/119: symlink de/d20/l2f 0 2024-04-25T16:15:30.708 INFO:tasks.workunit.client.0.smithi059.stdout:1/132: fsync d7/f26 0 2024-04-25T16:15:30.719 INFO:tasks.workunit.client.0.smithi059.stdout:6/131: stat d9/d16/f22 0 2024-04-25T16:15:30.789 INFO:tasks.workunit.client.0.smithi059.stdout:5/125: dread - d1/f11 zero size 2024-04-25T16:15:30.871 INFO:tasks.workunit.client.0.smithi059.stdout:0/125: mkdir dc/df/d28 0 2024-04-25T16:15:30.879 INFO:tasks.workunit.client.0.smithi059.stdout:0/126: chown dc/df/l1c 0 1 2024-04-25T16:15:30.909 INFO:tasks.workunit.client.0.smithi059.stdout:3/123: fsync d0/d1e/f1f 0 2024-04-25T16:15:30.917 INFO:tasks.workunit.client.0.smithi059.stdout:3/124: readlink d0/l10 0 2024-04-25T16:15:30.933 INFO:tasks.workunit.client.0.smithi059.stdout:3/125: dread d0/d1e/f1f [0,4194304] 0 2024-04-25T16:15:31.057 INFO:tasks.workunit.client.0.smithi059.stdout:7/113: creat d0/d7/f22 x:0 0 0 2024-04-25T16:15:31.068 INFO:tasks.workunit.client.0.smithi059.stdout:7/114: fdatasync d0/d7/f1d 0 2024-04-25T16:15:31.424 INFO:tasks.workunit.client.0.smithi059.stdout:6/132: symlink d9/d16/l2a 0 2024-04-25T16:15:31.442 INFO:tasks.workunit.client.0.smithi059.stdout:2/120: write de/d2a/d2e/f1f [3634475,14496] 0 2024-04-25T16:15:31.472 INFO:tasks.workunit.client.0.smithi059.stdout:5/126: creat d1/d1e/d21/f2e x:0 0 0 2024-04-25T16:15:31.483 INFO:tasks.workunit.client.0.smithi059.stdout:3/126: truncate d0/f7 272207 0 2024-04-25T16:15:31.498 INFO:tasks.workunit.client.0.smithi059.stdout:7/115: creat d0/d7/f23 x:0 0 0 2024-04-25T16:15:31.504 INFO:tasks.workunit.client.0.smithi059.stdout:2/121: dread - de/f1d zero size 2024-04-25T16:15:31.514 INFO:tasks.workunit.client.0.smithi059.stdout:3/127: chown d0/d22 6306 1 2024-04-25T16:15:31.527 INFO:tasks.workunit.client.0.smithi059.stdout:4/118: creat d0/f26 x:0 0 0 2024-04-25T16:15:31.541 INFO:tasks.workunit.client.0.smithi059.stdout:4/119: readlink d0/l6 0 2024-04-25T16:15:31.753 INFO:tasks.workunit.client.0.smithi059.stdout:9/133: link d6/l17 d6/d1d/l21 0 2024-04-25T16:15:31.760 INFO:tasks.workunit.client.0.smithi059.stdout:8/106: link d7/dd/d17/l1b d7/l25 0 2024-04-25T16:15:31.761 INFO:tasks.workunit.client.0.smithi059.stdout:6/133: fdatasync d9/f14 0 2024-04-25T16:15:31.881 INFO:tasks.workunit.client.0.smithi059.stdout:7/116: readlink d0/d7/l17 0 2024-04-25T16:15:31.915 INFO:tasks.workunit.client.0.smithi059.stdout:1/133: dwrite d7/f9 [0,4194304] 0 2024-04-25T16:15:31.989 INFO:tasks.workunit.client.0.smithi059.stdout:2/122: rename de/d2a/d2e/f1f to de/d2a/d2e/f30 0 2024-04-25T16:15:32.003 INFO:tasks.workunit.client.0.smithi059.stdout:4/120: truncate d0/d4/df/f14 1256183 0 2024-04-25T16:15:32.091 INFO:tasks.workunit.client.0.smithi059.stdout:9/134: dwrite d6/d1d/f1f [0,4194304] 0 2024-04-25T16:15:32.213 INFO:tasks.workunit.client.0.smithi059.stdout:8/107: dread - d7/f1c zero size 2024-04-25T16:15:32.221 INFO:tasks.workunit.client.0.smithi059.stdout:8/108: chown d7/dd/d17 20401189 1 2024-04-25T16:15:32.268 INFO:tasks.workunit.client.0.smithi059.stdout:6/134: creat d9/d16/d24/f2b x:0 0 0 2024-04-25T16:15:32.284 INFO:tasks.workunit.client.0.smithi059.stdout:6/135: write f3 [1918342,105435] 0 2024-04-25T16:15:32.329 INFO:tasks.workunit.client.0.smithi059.stdout:0/127: creat dc/f29 x:0 0 0 2024-04-25T16:15:32.494 INFO:tasks.workunit.client.0.smithi059.stdout:3/128: fsync d0/f27 0 2024-04-25T16:15:32.617 INFO:tasks.workunit.client.0.smithi059.stdout:7/117: symlink d0/d7/d16/l24 0 2024-04-25T16:15:32.626 INFO:tasks.workunit.client.0.smithi059.stdout:2/123: creat de/d16/f31 x:0 0 0 2024-04-25T16:15:32.766 INFO:tasks.workunit.client.0.smithi059.stdout:9/135: mknod d6/c22 0 2024-04-25T16:15:32.807 INFO:tasks.workunit.client.0.smithi059.stdout:8/109: dread d7/dd/d17/f1a [0,4194304] 0 2024-04-25T16:15:33.072 INFO:tasks.workunit.client.0.smithi059.stdout:5/127: dwrite d1/f1c [0,4194304] 0 2024-04-25T16:15:33.136 INFO:tasks.workunit.client.0.smithi059.stdout:7/118: symlink d0/d7/l25 0 2024-04-25T16:15:33.254 INFO:tasks.workunit.client.0.smithi059.stdout:7/119: dwrite d0/f12 [4194304,4194304] 0 2024-04-25T16:15:33.263 INFO:tasks.workunit.client.0.smithi059.stdout:1/134: write d7/d13/d16/f24 [149128,115969] 0 2024-04-25T16:15:33.338 INFO:tasks.workunit.client.0.smithi059.stdout:0/128: write f6 [5959153,12429] 0 2024-04-25T16:15:33.422 INFO:tasks.workunit.client.0.smithi059.stdout:3/129: write d0/db/f19 [600241,47943] 0 2024-04-25T16:15:33.441 INFO:tasks.workunit.client.0.smithi059.stdout:3/130: write d0/d22/f2b [484418,39408] 0 2024-04-25T16:15:33.603 INFO:tasks.workunit.client.0.smithi059.stdout:9/136: rename d6/c10 to d6/d1d/c23 0 2024-04-25T16:15:33.604 INFO:tasks.workunit.client.0.smithi059.stdout:2/124: write fb [772727,20217] 0 2024-04-25T16:15:33.617 INFO:tasks.workunit.client.0.smithi059.stdout:6/136: creat d9/d1b/f2c x:0 0 0 2024-04-25T16:15:33.663 INFO:tasks.workunit.client.0.smithi059.stdout:5/128: dread d1/dd/ff [0,4194304] 0 2024-04-25T16:15:33.767 INFO:tasks.workunit.client.0.smithi059.stdout:7/120: truncate d0/fd 2128688 0 2024-04-25T16:15:33.793 INFO:tasks.workunit.client.0.smithi059.stdout:5/129: dwrite d1/f1c [0,4194304] 0 2024-04-25T16:15:33.865 INFO:tasks.workunit.client.0.smithi059.stdout:4/121: creat d0/d4/df/d18/f27 x:0 0 0 2024-04-25T16:15:33.932 INFO:tasks.workunit.client.0.smithi059.stdout:3/131: fdatasync d0/fa 0 2024-04-25T16:15:34.034 INFO:tasks.workunit.client.0.smithi059.stdout:6/137: rmdir d9 39 2024-04-25T16:15:34.302 INFO:tasks.workunit.client.0.smithi059.stdout:2/125: dwrite de/f1d [0,4194304] 0 2024-04-25T16:15:34.385 INFO:tasks.workunit.client.0.smithi059.stdout:1/135: write d7/d15/f25 [970570,91594] 0 2024-04-25T16:15:34.391 INFO:tasks.workunit.client.0.smithi059.stdout:0/129: write dc/dd/f20 [290673,6563] 0 2024-04-25T16:15:34.428 INFO:tasks.workunit.client.0.smithi059.stdout:1/136: write d7/f9 [3473141,13845] 0 2024-04-25T16:15:34.440 INFO:tasks.workunit.client.0.smithi059.stdout:1/137: readlink d7/d13/l18 0 2024-04-25T16:15:34.447 INFO:tasks.workunit.client.0.smithi059.stdout:1/138: read - d7/f29 zero size 2024-04-25T16:15:34.565 INFO:tasks.workunit.client.0.smithi059.stdout:3/132: mkdir d0/db/d2d 0 2024-04-25T16:15:34.580 INFO:tasks.workunit.client.0.smithi059.stdout:3/133: write d0/d22/f2b [16159,31733] 0 2024-04-25T16:15:34.594 INFO:tasks.workunit.client.0.smithi059.stdout:3/134: chown d0/db/f20 6 1 2024-04-25T16:15:35.078 INFO:tasks.workunit.client.0.smithi059.stdout:1/139: dread d7/d13/d16/f1d [0,4194304] 0 2024-04-25T16:15:35.190 INFO:tasks.workunit.client.0.smithi059.stdout:5/130: dwrite d1/f8 [0,4194304] 0 2024-04-25T16:15:35.293 INFO:tasks.workunit.client.0.smithi059.stdout:8/110: creat d7/f26 x:0 0 0 2024-04-25T16:15:35.307 INFO:tasks.workunit.client.0.smithi059.stdout:5/131: sync 2024-04-25T16:15:35.353 INFO:tasks.workunit.client.0.smithi059.stdout:6/138: mknod d9/d16/c2d 0 2024-04-25T16:15:35.361 INFO:tasks.workunit.client.0.smithi059.stdout:4/122: mknod d0/c28 0 2024-04-25T16:15:35.388 INFO:tasks.workunit.client.0.smithi059.stdout:2/126: rmdir de 39 2024-04-25T16:15:35.450 INFO:tasks.workunit.client.0.smithi059.stdout:9/137: unlink d6/ff 0 2024-04-25T16:15:35.478 INFO:tasks.workunit.client.0.smithi059.stdout:5/132: dwrite d1/d1e/d21/f2e [0,4194304] 0 2024-04-25T16:15:35.492 INFO:tasks.workunit.client.0.smithi059.stdout:2/127: dread f4 [0,4194304] 0 2024-04-25T16:15:35.625 INFO:tasks.workunit.client.0.smithi059.stdout:7/121: symlink d0/l26 0 2024-04-25T16:15:35.629 INFO:tasks.workunit.client.0.smithi059.stdout:5/133: chown d1/d1e/f20 43075077 1 2024-04-25T16:15:35.668 INFO:tasks.workunit.client.0.smithi059.stdout:1/140: mkdir d7/d2a 0 2024-04-25T16:15:35.685 INFO:tasks.workunit.client.0.smithi059.stdout:4/123: dwrite d0/f26 [0,4194304] 0 2024-04-25T16:15:35.771 INFO:tasks.workunit.client.0.smithi059.stdout:6/139: mkdir d9/d2e 0 2024-04-25T16:15:35.804 INFO:tasks.workunit.client.0.smithi059.stdout:0/130: getdents dc 0 2024-04-25T16:15:35.825 INFO:tasks.workunit.client.0.smithi059.stdout:9/138: dread - d6/d1d/f20 zero size 2024-04-25T16:15:35.879 INFO:tasks.workunit.client.0.smithi059.stdout:2/128: dread fd [0,4194304] 0 2024-04-25T16:15:35.948 INFO:tasks.workunit.client.0.smithi059.stdout:2/129: sync 2024-04-25T16:15:35.973 INFO:tasks.workunit.client.0.smithi059.stdout:3/135: getdents d0 0 2024-04-25T16:15:35.992 INFO:tasks.workunit.client.0.smithi059.stdout:3/136: read - d0/f27 zero size 2024-04-25T16:15:36.008 INFO:tasks.workunit.client.0.smithi059.stdout:5/134: symlink d1/d1e/l2f 0 2024-04-25T16:15:36.087 INFO:tasks.workunit.client.0.smithi059.stdout:8/111: link d7/d16/c19 d7/dd/c27 0 2024-04-25T16:15:36.178 INFO:tasks.workunit.client.0.smithi059.stdout:1/141: symlink d7/d13/l2b 0 2024-04-25T16:15:36.198 INFO:tasks.workunit.client.0.smithi059.stdout:8/112: dwrite d7/f26 [0,4194304] 0 2024-04-25T16:15:36.271 INFO:tasks.workunit.client.0.smithi059.stdout:6/140: symlink d9/d16/l2f 0 2024-04-25T16:15:36.276 INFO:tasks.workunit.client.0.smithi059.stdout:1/142: chown d7/lf 15850 1 2024-04-25T16:15:36.285 INFO:tasks.workunit.client.0.smithi059.stdout:6/141: chown f6 6290 1 2024-04-25T16:15:36.436 INFO:tasks.workunit.client.0.smithi059.stdout:3/137: dread - d0/d22/f26 zero size 2024-04-25T16:15:36.616 INFO:tasks.workunit.client.0.smithi059.stdout:1/143: creat d7/d21/f2c x:0 0 0 2024-04-25T16:15:36.621 INFO:tasks.workunit.client.0.smithi059.stdout:6/142: rmdir d9 39 2024-04-25T16:15:36.694 INFO:tasks.workunit.client.0.smithi059.stdout:1/144: fsync d7/f9 0 2024-04-25T16:15:36.757 INFO:tasks.workunit.client.0.smithi059.stdout:2/130: rmdir de/d20 39 2024-04-25T16:15:36.804 INFO:tasks.workunit.client.0.smithi059.stdout:7/122: creat d0/f27 x:0 0 0 2024-04-25T16:15:36.843 INFO:tasks.workunit.client.0.smithi059.stdout:2/131: readlink la 0 2024-04-25T16:15:37.059 INFO:tasks.workunit.client.0.smithi059.stdout:5/135: dwrite d1/f3 [4194304,4194304] 0 2024-04-25T16:15:37.133 INFO:tasks.workunit.client.0.smithi059.stdout:9/139: dwrite d6/f1a [0,4194304] 0 2024-04-25T16:15:37.143 INFO:tasks.workunit.client.0.smithi059.stdout:0/131: truncate dc/dd/f20 864063 0 2024-04-25T16:15:37.151 INFO:tasks.workunit.client.0.smithi059.stdout:4/124: dwrite d0/d4/df/f12 [0,4194304] 0 2024-04-25T16:15:37.169 INFO:tasks.workunit.client.0.smithi059.stdout:1/145: mkdir d7/d13/d2d 0 2024-04-25T16:15:37.199 INFO:tasks.workunit.client.0.smithi059.stdout:6/143: fdatasync f6 0 2024-04-25T16:15:37.216 INFO:tasks.workunit.client.0.smithi059.stdout:2/132: write de/d16/f31 [754843,37354] 0 2024-04-25T16:15:37.216 INFO:tasks.workunit.client.0.smithi059.stdout:7/123: creat d0/d7/f28 x:0 0 0 2024-04-25T16:15:37.308 INFO:tasks.workunit.client.0.smithi059.stdout:3/138: dread d0/db/f14 [0,4194304] 0 2024-04-25T16:15:37.317 INFO:tasks.workunit.client.0.smithi059.stdout:8/113: getdents d7 0 2024-04-25T16:15:37.345 INFO:tasks.workunit.client.0.smithi059.stdout:9/140: truncate f0 5238313 0 2024-04-25T16:15:37.354 INFO:tasks.workunit.client.0.smithi059.stdout:5/136: read d1/dd/f12 [1201618,40763] 0 2024-04-25T16:15:37.380 INFO:tasks.workunit.client.0.smithi059.stdout:5/137: readlink d1/lc 0 2024-04-25T16:15:37.456 INFO:tasks.workunit.client.0.smithi059.stdout:7/124: rmdir d0/d7/d16 39 2024-04-25T16:15:37.457 INFO:tasks.workunit.client.0.smithi059.stdout:1/146: creat d7/d15/f2e x:0 0 0 2024-04-25T16:15:37.488 INFO:tasks.workunit.client.0.smithi059.stdout:8/114: symlink d7/dd/l28 0 2024-04-25T16:15:37.530 INFO:tasks.workunit.client.0.smithi059.stdout:7/125: write d0/d7/f28 [146040,52853] 0 2024-04-25T16:15:37.556 INFO:tasks.workunit.client.0.smithi059.stdout:9/141: mknod d6/d1d/c24 0 2024-04-25T16:15:37.582 INFO:tasks.workunit.client.0.smithi059.stdout:0/132: dread dc/df/f16 [0,4194304] 0 2024-04-25T16:15:37.605 INFO:tasks.workunit.client.0.smithi059.stdout:3/139: truncate d0/db/f1a 3194583 0 2024-04-25T16:15:37.640 INFO:tasks.workunit.client.0.smithi059.stdout:3/140: dread d0/fa [4194304,4194304] 0 2024-04-25T16:15:37.651 INFO:tasks.workunit.client.0.smithi059.stdout:5/138: fdatasync d1/dd/f13 0 2024-04-25T16:15:37.674 INFO:tasks.workunit.client.0.smithi059.stdout:2/133: write de/d16/f22 [5183455,62015] 0 2024-04-25T16:15:37.675 INFO:tasks.workunit.client.0.smithi059.stdout:5/139: fdatasync d1/f3 0 2024-04-25T16:15:37.698 INFO:tasks.workunit.client.0.smithi059.stdout:5/140: readlink d1/dd/l1a 0 2024-04-25T16:15:37.817 INFO:tasks.workunit.client.0.smithi059.stdout:8/115: mknod d7/d16/c29 0 2024-04-25T16:15:37.823 INFO:tasks.workunit.client.0.smithi059.stdout:4/125: rename d0/d4/df/c11 to d0/d4/df/d18/c29 0 2024-04-25T16:15:37.839 INFO:tasks.workunit.client.0.smithi059.stdout:8/116: read d7/fa [3263201,63068] 0 2024-04-25T16:15:37.907 INFO:tasks.workunit.client.0.smithi059.stdout:7/126: dread - d0/d7/f23 zero size 2024-04-25T16:15:38.191 INFO:tasks.workunit.client.0.smithi059.stdout:5/141: truncate d1/d1e/f20 127541 0 2024-04-25T16:15:38.225 INFO:tasks.workunit.client.0.smithi059.stdout:5/142: chown d1/f3 203411704 1 2024-04-25T16:15:38.264 INFO:tasks.workunit.client.0.smithi059.stdout:3/141: write d0/db/f2c [930519,89010] 0 2024-04-25T16:15:38.268 INFO:tasks.workunit.client.0.smithi059.stdout:5/143: chown d1/f10 3 1 2024-04-25T16:15:38.293 INFO:tasks.workunit.client.0.smithi059.stdout:0/133: dwrite dc/dd/f23 [0,4194304] 0 2024-04-25T16:15:38.437 INFO:tasks.workunit.client.0.smithi059.stdout:3/142: stat d0/ff 0 2024-04-25T16:15:38.437 INFO:tasks.workunit.client.0.smithi059.stdout:5/144: readlink d1/d1e/l28 0 2024-04-25T16:15:38.437 INFO:tasks.workunit.client.0.smithi059.stdout:3/143: readlink d0/l8 0 2024-04-25T16:15:38.543 INFO:tasks.workunit.client.0.smithi059.stdout:8/117: creat d7/dd/d17/d23/f2a x:0 0 0 2024-04-25T16:15:38.545 INFO:tasks.workunit.client.0.smithi059.stdout:4/126: read - d0/d4/f1b zero size 2024-04-25T16:15:38.552 INFO:tasks.workunit.client.0.smithi059.stdout:9/142: unlink d6/l17 0 2024-04-25T16:15:38.828 INFO:tasks.workunit.client.0.smithi059.stdout:0/134: creat dc/f2a x:0 0 0 2024-04-25T16:15:39.015 INFO:tasks.workunit.client.0.smithi059.stdout:1/147: link d7/fb d7/d13/f2f 0 2024-04-25T16:15:39.023 INFO:tasks.workunit.client.0.smithi059.stdout:6/144: getdents d9/d1b 0 2024-04-25T16:15:39.028 INFO:tasks.workunit.client.0.smithi059.stdout:2/134: link de/f10 de/d16/f32 0 2024-04-25T16:15:39.079 INFO:tasks.workunit.client.0.smithi059.stdout:1/148: write d7/f9 [4163050,93864] 0 2024-04-25T16:15:39.083 INFO:tasks.workunit.client.0.smithi059.stdout:8/118: chown d7/dd/d17/l1b 3935 1 2024-04-25T16:15:39.118 INFO:tasks.workunit.client.0.smithi059.stdout:2/135: write de/d16/f22 [2442776,112393] 0 2024-04-25T16:15:39.225 INFO:tasks.workunit.client.0.smithi059.stdout:7/127: dwrite d0/d7/f23 [0,4194304] 0 2024-04-25T16:15:39.306 INFO:tasks.workunit.client.0.smithi059.stdout:5/145: write d1/f15 [2153905,91684] 0 2024-04-25T16:15:39.392 INFO:tasks.workunit.client.0.smithi059.stdout:5/146: chown d1/l1f 226212853 1 2024-04-25T16:15:39.430 INFO:tasks.workunit.client.0.smithi059.stdout:4/127: write d0/d4/f21 [692097,35133] 0 2024-04-25T16:15:39.514 INFO:tasks.workunit.client.0.smithi059.stdout:3/144: dwrite d0/db/f1c [0,4194304] 0 2024-04-25T16:15:39.597 INFO:tasks.workunit.client.0.smithi059.stdout:9/143: dwrite d6/f19 [0,4194304] 0 2024-04-25T16:15:39.747 INFO:tasks.workunit.client.0.smithi059.stdout:6/145: creat d9/d27/f30 x:0 0 0 2024-04-25T16:15:39.753 INFO:tasks.workunit.client.0.smithi059.stdout:6/146: readlink d9/l15 0 2024-04-25T16:15:39.913 INFO:tasks.workunit.client.0.smithi059.stdout:8/119: symlink d7/d16/l2b 0 2024-04-25T16:15:40.320 INFO:tasks.workunit.client.0.smithi059.stdout:3/145: creat d0/d22/f2e x:0 0 0 2024-04-25T16:15:40.328 INFO:tasks.workunit.client.0.smithi059.stdout:0/135: chown dc/l1b 65 1 2024-04-25T16:15:40.374 INFO:tasks.workunit.client.0.smithi059.stdout:9/144: mknod d6/c25 0 2024-04-25T16:15:40.594 INFO:tasks.workunit.client.0.smithi059.stdout:2/136: write de/f2d [981954,80009] 0 2024-04-25T16:15:40.768 INFO:tasks.workunit.client.0.smithi059.stdout:5/147: creat d1/d1e/d27/f30 x:0 0 0 2024-04-25T16:15:40.890 INFO:tasks.workunit.client.0.smithi059.stdout:4/128: dwrite d0/d4/fe [0,4194304] 0 2024-04-25T16:15:40.954 INFO:tasks.workunit.client.0.smithi059.stdout:1/149: creat d7/f30 x:0 0 0 2024-04-25T16:15:40.983 INFO:tasks.workunit.client.0.smithi059.stdout:1/150: fdatasync d7/f30 0 2024-04-25T16:15:41.002 INFO:tasks.workunit.client.0.smithi059.stdout:8/120: rename d7/dd/c22 to d7/dd/d17/c2c 0 2024-04-25T16:15:41.007 INFO:tasks.workunit.client.0.smithi059.stdout:6/147: write f8 [841977,30801] 0 2024-04-25T16:15:41.015 INFO:tasks.workunit.client.0.smithi059.stdout:3/146: rename d0/db to d0/db/d2d/d2f 22 2024-04-25T16:15:41.052 INFO:tasks.workunit.client.0.smithi059.stdout:7/128: creat d0/d7/f29 x:0 0 0 2024-04-25T16:15:41.202 INFO:tasks.workunit.client.0.smithi059.stdout:0/136: creat dc/dd/f2b x:0 0 0 2024-04-25T16:15:41.243 INFO:tasks.workunit.client.0.smithi059.stdout:2/137: read de/d20/f25 [241658,65060] 0 2024-04-25T16:15:41.277 INFO:tasks.workunit.client.0.smithi059.stdout:5/148: dread d1/f1c [0,4194304] 0 2024-04-25T16:15:41.298 INFO:tasks.workunit.client.0.smithi059.stdout:5/149: truncate d1/d1e/d27/f30 717044 0 2024-04-25T16:15:41.363 INFO:tasks.workunit.client.0.smithi059.stdout:1/151: symlink d7/d15/l31 0 2024-04-25T16:15:41.372 INFO:tasks.workunit.client.0.smithi059.stdout:8/121: unlink c0 0 2024-04-25T16:15:41.557 INFO:tasks.workunit.client.0.smithi059.stdout:2/138: mkdir de/d2a/d33 0 2024-04-25T16:15:41.688 INFO:tasks.workunit.client.0.smithi059.stdout:5/150: mknod d1/d1e/c31 0 2024-04-25T16:15:41.719 INFO:tasks.workunit.client.0.smithi059.stdout:1/152: mknod d7/d21/c32 0 2024-04-25T16:15:41.720 INFO:tasks.workunit.client.0.smithi059.stdout:5/151: readlink d1/dd/l1a 0 2024-04-25T16:15:41.961 INFO:tasks.workunit.client.0.smithi059.stdout:2/139: rename de/d20/l2f to de/d2a/d33/l34 0 2024-04-25T16:15:41.978 INFO:tasks.workunit.client.0.smithi059.stdout:3/147: link d0/d1e/f1f d0/db/f30 0 2024-04-25T16:15:41.987 INFO:tasks.workunit.client.0.smithi059.stdout:3/148: chown d0/d22/f2b 3811257 1 2024-04-25T16:15:41.994 INFO:tasks.workunit.client.0.smithi059.stdout:3/149: chown d0/l10 28 1 2024-04-25T16:15:41.999 INFO:tasks.workunit.client.0.smithi059.stdout:3/150: stat d0/db 0 2024-04-25T16:15:42.084 INFO:tasks.workunit.client.0.smithi059.stdout:5/152: symlink d1/d1e/l32 0 2024-04-25T16:15:42.216 INFO:tasks.workunit.client.0.smithi059.stdout:9/145: write d6/d1d/f1f [1548434,94421] 0 2024-04-25T16:15:42.223 INFO:tasks.workunit.client.0.smithi059.stdout:6/148: dwrite d9/d16/f22 [0,4194304] 0 2024-04-25T16:15:42.317 INFO:tasks.workunit.client.0.smithi059.stdout:6/149: stat d9/f10 0 2024-04-25T16:15:42.385 INFO:tasks.workunit.client.0.smithi059.stdout:7/129: dwrite d0/d7/f1d [0,4194304] 0 2024-04-25T16:15:42.489 INFO:tasks.workunit.client.0.smithi059.stdout:9/146: truncate d6/d1d/f1f 5222853 0 2024-04-25T16:15:42.517 INFO:tasks.workunit.client.0.smithi059.stdout:3/151: dread d0/db/f30 [0,4194304] 0 2024-04-25T16:15:42.578 INFO:tasks.workunit.client.0.smithi059.stdout:0/137: getdents dc 0 2024-04-25T16:15:42.598 INFO:tasks.workunit.client.0.smithi059.stdout:6/150: rmdir d9/d27 39 2024-04-25T16:15:42.678 INFO:tasks.workunit.client.0.smithi059.stdout:1/153: rename d7/d13/f2f to d7/d13/d16/f33 0 2024-04-25T16:15:42.728 INFO:tasks.workunit.client.0.smithi059.stdout:4/129: dwrite d0/d4/df/d1c/f23 [0,4194304] 0 2024-04-25T16:15:42.785 INFO:tasks.workunit.client.0.smithi059.stdout:8/122: dwrite d7/f1f [0,4194304] 0 2024-04-25T16:15:42.914 INFO:tasks.workunit.client.0.smithi059.stdout:3/152: mkdir d0/d1e/d31 0 2024-04-25T16:15:42.919 INFO:tasks.workunit.client.0.smithi059.stdout:9/147: fsync f1 0 2024-04-25T16:15:42.993 INFO:tasks.workunit.client.0.smithi059.stdout:4/130: chown d0/d4/f20 73 1 2024-04-25T16:15:43.071 INFO:tasks.workunit.client.0.smithi059.stdout:2/140: dwrite fb [0,4194304] 0 2024-04-25T16:15:43.144 INFO:tasks.workunit.client.0.smithi059.stdout:6/151: write d9/f14 [1011527,82947] 0 2024-04-25T16:15:43.253 INFO:tasks.workunit.client.0.smithi059.stdout:0/138: dwrite dc/df/f10 [4194304,4194304] 0 2024-04-25T16:15:43.376 INFO:tasks.workunit.client.0.smithi059.stdout:5/153: getdents d1 0 2024-04-25T16:15:43.423 INFO:tasks.workunit.client.0.smithi059.stdout:7/130: creat d0/d7/d16/f2a x:0 0 0 2024-04-25T16:15:43.430 INFO:tasks.workunit.client.0.smithi059.stdout:1/154: rename d7/d21/f2c to d7/d15/f34 0 2024-04-25T16:15:43.449 INFO:tasks.workunit.client.0.smithi059.stdout:9/148: readlink d6/d1d/l21 0 2024-04-25T16:15:43.462 INFO:tasks.workunit.client.0.smithi059.stdout:0/139: mknod dc/c2c 0 2024-04-25T16:15:43.473 INFO:tasks.workunit.client.0.smithi059.stdout:2/141: write de/d2a/d2e/f30 [5029929,33748] 0 2024-04-25T16:15:43.506 INFO:tasks.workunit.client.0.smithi059.stdout:5/154: fsync d1/d1e/f2d 0 2024-04-25T16:15:43.539 INFO:tasks.workunit.client.0.smithi059.stdout:7/131: sync 2024-04-25T16:15:43.606 INFO:tasks.workunit.client.0.smithi059.stdout:7/132: sync 2024-04-25T16:15:43.688 INFO:tasks.workunit.client.0.smithi059.stdout:1/155: symlink d7/d21/l35 0 2024-04-25T16:15:43.702 INFO:tasks.workunit.client.0.smithi059.stdout:7/133: dwrite d0/d7/f1d [0,4194304] 0 2024-04-25T16:15:43.907 INFO:tasks.workunit.client.0.smithi059.stdout:5/155: symlink d1/l33 0 2024-04-25T16:15:43.913 INFO:tasks.workunit.client.0.smithi059.stdout:8/123: link d7/dd/l28 d7/d16/l2d 0 2024-04-25T16:15:43.948 INFO:tasks.workunit.client.0.smithi059.stdout:3/153: link d0/db/f30 d0/d1e/f32 0 2024-04-25T16:15:43.951 INFO:tasks.workunit.client.0.smithi059.stdout:6/152: dwrite d9/f10 [0,4194304] 0 2024-04-25T16:15:44.076 INFO:tasks.workunit.client.0.smithi059.stdout:4/131: creat d0/f2a x:0 0 0 2024-04-25T16:15:44.129 INFO:tasks.workunit.client.0.smithi059.stdout:7/134: mkdir d0/d7/d16/d20/d2b 0 2024-04-25T16:15:44.156 INFO:tasks.workunit.client.0.smithi059.stdout:2/142: write fd [1022049,115974] 0 2024-04-25T16:15:44.171 INFO:tasks.workunit.client.0.smithi059.stdout:2/143: chown de/d16/f1a 595228 1 2024-04-25T16:15:44.179 INFO:tasks.workunit.client.0.smithi059.stdout:2/144: read - de/d20/f26 zero size 2024-04-25T16:15:44.408 INFO:tasks.workunit.client.0.smithi059.stdout:3/154: symlink d0/l33 0 2024-04-25T16:15:44.414 INFO:tasks.workunit.client.0.smithi059.stdout:8/124: dread - d7/dd/d17/d23/f2a zero size 2024-04-25T16:15:44.535 INFO:tasks.workunit.client.0.smithi059.stdout:1/156: mkdir d7/d2a/d36 0 2024-04-25T16:15:44.577 INFO:tasks.workunit.client.0.smithi059.stdout:7/135: chown d0/d7/c11 53159 1 2024-04-25T16:15:44.684 INFO:tasks.workunit.client.0.smithi059.stdout:0/140: fsync dc/dd/f23 0 2024-04-25T16:15:44.915 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:15:44.918 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:15:44.951 INFO:tasks.workunit.client.0.smithi059.stdout:9/149: getdents d6/d1d 0 2024-04-25T16:15:45.337 INFO:tasks.workunit.client.0.smithi059.stdout:6/153: write d9/f21 [1179007,74954] 0 2024-04-25T16:15:45.462 INFO:tasks.workunit.client.0.smithi059.stdout:9/150: mkdir d6/d1d/d26 0 2024-04-25T16:15:45.528 INFO:tasks.workunit.client.0.smithi059.stdout:4/132: dwrite d0/d4/f20 [0,4194304] 0 2024-04-25T16:15:45.576 INFO:tasks.workunit.client.0.smithi059.stdout:9/151: sync 2024-04-25T16:15:45.594 INFO:tasks.workunit.client.0.smithi059.stdout:5/156: unlink d1/d1e/c31 0 2024-04-25T16:15:45.707 INFO:tasks.workunit.client.0.smithi059.stdout:5/157: sync 2024-04-25T16:15:45.730 INFO:tasks.workunit.client.0.smithi059.stdout:6/154: truncate d9/fe 5274846 0 2024-04-25T16:15:45.764 INFO:tasks.workunit.client.0.smithi059.stdout:8/125: dwrite d7/f21 [0,4194304] 0 2024-04-25T16:15:45.842 INFO:tasks.workunit.client.0.smithi059.stdout:1/157: write d7/d13/d16/f1e [590846,119173] 0 2024-04-25T16:15:45.855 INFO:tasks.workunit.client.0.smithi059.stdout:4/133: dread d0/d4/f20 [0,4194304] 0 2024-04-25T16:15:45.905 INFO:tasks.workunit.client.0.smithi059.stdout:8/126: read d7/dd/d17/f1a [1131171,70439] 0 2024-04-25T16:15:45.909 INFO:tasks.workunit.client.0.smithi059.stdout:1/158: sync 2024-04-25T16:15:45.945 INFO:tasks.workunit.client.0.smithi059.stdout:2/145: write f2 [831821,50504] 0 2024-04-25T16:15:45.976 INFO:tasks.workunit.client.0.smithi059.stdout:3/155: readlink d0/db/l17 0 2024-04-25T16:15:45.987 INFO:tasks.workunit.client.0.smithi059.stdout:1/159: stat d7/lf 0 2024-04-25T16:15:46.034 INFO:tasks.workunit.client.0.smithi059.stdout:2/146: stat de/d20 0 2024-04-25T16:15:46.044 INFO:tasks.workunit.client.0.smithi059.stdout:6/155: rename d9 to d9/d27/d31 22 2024-04-25T16:15:46.062 INFO:tasks.workunit.client.0.smithi059.stdout:5/158: dwrite d1/d1e/d27/f30 [0,4194304] 0 2024-04-25T16:15:46.407 INFO:tasks.workunit.client.0.smithi059.stdout:7/136: write d0/fd [812108,41963] 0 2024-04-25T16:15:46.468 INFO:tasks.workunit.client.0.smithi059.stdout:4/134: symlink d0/d4/df/d1c/l2b 0 2024-04-25T16:15:46.514 INFO:tasks.workunit.client.0.smithi059.stdout:8/127: truncate d7/f1c 158290 0 2024-04-25T16:15:46.546 INFO:tasks.workunit.client.0.smithi059.stdout:2/147: creat de/d2a/f35 x:0 0 0 2024-04-25T16:15:46.573 INFO:tasks.workunit.client.0.smithi059.stdout:0/141: dwrite dc/f1f [0,4194304] 0 2024-04-25T16:15:46.575 INFO:tasks.workunit.client.0.smithi059.stdout:8/128: sync 2024-04-25T16:15:46.666 INFO:tasks.workunit.client.0.smithi059.stdout:2/148: fsync de/d2a/d2e/f30 0 2024-04-25T16:15:46.759 INFO:tasks.workunit.client.0.smithi059.stdout:9/152: rename d6/c15 to d6/d1d/d26/c27 0 2024-04-25T16:15:46.785 INFO:tasks.workunit.client.0.smithi059.stdout:7/137: fsync d0/d7/f23 0 2024-04-25T16:15:46.787 INFO:tasks.workunit.client.0.smithi059.stdout:1/160: creat d7/d13/d2d/f37 x:0 0 0 2024-04-25T16:15:46.888 INFO:tasks.workunit.client.0.smithi059.stdout:4/135: unlink d0/d4/l10 0 2024-04-25T16:15:46.900 INFO:tasks.workunit.client.0.smithi059.stdout:4/136: dread - d0/f2a zero size 2024-04-25T16:15:46.957 INFO:tasks.workunit.client.0.smithi059.stdout:6/156: write d9/f29 [228262,751] 0 2024-04-25T16:15:46.981 INFO:tasks.workunit.client.0.smithi059.stdout:6/157: truncate f3 2394803 0 2024-04-25T16:15:47.192 INFO:tasks.workunit.client.0.smithi059.stdout:2/149: rename de/d20 to de/d2a/d2e/d36 0 2024-04-25T16:15:47.247 INFO:tasks.workunit.client.0.smithi059.stdout:8/129: write d7/dd/ff [1074880,120541] 0 2024-04-25T16:15:47.340 INFO:tasks.workunit.client.0.smithi059.stdout:5/159: dwrite d1/dd/f1d [0,4194304] 0 2024-04-25T16:15:47.436 INFO:tasks.workunit.client.0.smithi059.stdout:3/156: symlink d0/d1e/d31/l34 0 2024-04-25T16:15:47.440 INFO:tasks.workunit.client.0.smithi059.stdout:7/138: dread - d0/f27 zero size 2024-04-25T16:15:47.465 INFO:tasks.workunit.client.0.smithi059.stdout:7/139: write d0/fd [2392097,10271] 0 2024-04-25T16:15:47.531 INFO:tasks.workunit.client.0.smithi059.stdout:9/153: mkdir d6/d1d/d28 0 2024-04-25T16:15:47.541 INFO:tasks.workunit.client.0.smithi059.stdout:2/150: symlink de/d2a/d2e/l37 0 2024-04-25T16:15:47.776 INFO:tasks.workunit.client.0.smithi059.stdout:6/158: write d9/fd [938037,2809] 0 2024-04-25T16:15:47.784 INFO:tasks.workunit.client.0.smithi059.stdout:5/160: creat d1/dd/f34 x:0 0 0 2024-04-25T16:15:47.798 INFO:tasks.workunit.client.0.smithi059.stdout:7/140: truncate d0/f27 127070 0 2024-04-25T16:15:47.806 INFO:tasks.workunit.client.0.smithi059.stdout:9/154: rmdir d6 39 2024-04-25T16:15:47.809 INFO:tasks.workunit.client.0.smithi059.stdout:0/142: creat dc/f2d x:0 0 0 2024-04-25T16:15:47.837 INFO:tasks.workunit.client.0.smithi059.stdout:3/157: dread - d0/d22/f26 zero size 2024-04-25T16:15:47.897 INFO:tasks.workunit.client.0.smithi059.stdout:1/161: rename d7/l1f to d7/d21/l38 0 2024-04-25T16:15:47.967 INFO:tasks.workunit.client.0.smithi059.stdout:2/151: read de/d16/f22 [4203643,1874] 0 2024-04-25T16:15:47.992 INFO:tasks.workunit.client.0.smithi059.stdout:4/137: rename d0/l17 to d0/l2c 0 2024-04-25T16:15:48.000 INFO:tasks.workunit.client.0.smithi059.stdout:4/138: chown d0/l1a 30 1 2024-04-25T16:15:48.336 INFO:tasks.workunit.client.0.smithi059.stdout:6/159: creat d9/d16/d24/f32 x:0 0 0 2024-04-25T16:15:48.365 INFO:tasks.workunit.client.0.smithi059.stdout:8/130: rename d7/f9 to d7/dd/d17/f2e 0 2024-04-25T16:15:48.393 INFO:tasks.workunit.client.0.smithi059.stdout:6/160: dread - d9/d16/d24/f32 zero size 2024-04-25T16:15:48.476 INFO:tasks.workunit.client.0.smithi059.stdout:1/162: mkdir d7/d39 0 2024-04-25T16:15:48.812 INFO:tasks.workunit.client.0.smithi059.stdout:7/141: dwrite d0/d7/f10 [0,4194304] 0 2024-04-25T16:15:48.883 INFO:tasks.workunit.client.0.smithi059.stdout:4/139: truncate d0/d4/df/f12 4782908 0 2024-04-25T16:15:48.890 INFO:tasks.workunit.client.0.smithi059.stdout:1/163: rename d7/la to d7/d2a/l3a 0 2024-04-25T16:15:48.934 INFO:tasks.workunit.client.0.smithi059.stdout:3/158: creat d0/f35 x:0 0 0 2024-04-25T16:15:48.967 INFO:tasks.workunit.client.0.smithi059.stdout:4/140: sync 2024-04-25T16:15:49.024 INFO:tasks.workunit.client.0.smithi059.stdout:0/143: creat dc/df/d24/f2e x:0 0 0 2024-04-25T16:15:49.166 INFO:tasks.workunit.client.0.smithi059.stdout:7/142: read d0/f12 [6432330,94059] 0 2024-04-25T16:15:49.184 INFO:tasks.workunit.client.0.smithi059.stdout:1/164: truncate d7/d13/f20 16965 0 2024-04-25T16:15:49.318 INFO:tasks.workunit.client.0.smithi059.stdout:9/155: dwrite d6/f1c [0,4194304] 0 2024-04-25T16:15:49.402 INFO:tasks.workunit.client.0.smithi059.stdout:5/161: dwrite d1/f29 [0,4194304] 0 2024-04-25T16:15:49.403 INFO:tasks.workunit.client.0.smithi059.stdout:8/131: write f3 [2283276,75493] 0 2024-04-25T16:15:49.558 INFO:tasks.workunit.client.0.smithi059.stdout:8/132: dwrite f3 [0,4194304] 0 2024-04-25T16:15:49.687 INFO:tasks.workunit.client.0.smithi059.stdout:2/152: link de/c1b de/d2a/c38 0 2024-04-25T16:15:49.764 INFO:tasks.workunit.client.0.smithi059.stdout:5/162: dread d1/d1e/f20 [0,4194304] 0 2024-04-25T16:15:49.788 INFO:tasks.workunit.client.0.smithi059.stdout:3/159: dread d0/db/f2c [0,4194304] 0 2024-04-25T16:15:50.294 INFO:tasks.workunit.client.0.smithi059.stdout:6/161: getdents d9/d16/d24 0 2024-04-25T16:15:50.309 INFO:tasks.workunit.client.0.smithi059.stdout:6/162: stat d9/d16/d24/f32 0 2024-04-25T16:15:50.326 INFO:tasks.workunit.client.0.smithi059.stdout:6/163: chown d9/d16/f1f 4 1 2024-04-25T16:15:50.371 INFO:tasks.workunit.client.0.smithi059.stdout:2/153: dread de/d16/f31 [0,4194304] 0 2024-04-25T16:15:50.377 INFO:tasks.workunit.client.0.smithi059.stdout:2/154: stat de 0 2024-04-25T16:15:50.406 INFO:tasks.workunit.client.0.smithi059.stdout:9/156: truncate d6/d1d/f1f 5296314 0 2024-04-25T16:15:50.733 INFO:tasks.workunit.client.0.smithi059.stdout:6/164: read d9/d16/f26 [144811,17110] 0 2024-04-25T16:15:50.881 INFO:tasks.workunit.client.0.smithi059.stdout:6/165: dread d9/fd [0,4194304] 0 2024-04-25T16:15:50.965 INFO:tasks.workunit.client.0.smithi059.stdout:7/143: creat d0/d7/f2c x:0 0 0 2024-04-25T16:15:51.121 INFO:tasks.workunit.client.0.smithi059.stdout:4/141: dwrite d0/d4/df/f19 [0,4194304] 0 2024-04-25T16:15:51.195 INFO:tasks.workunit.client.0.smithi059.stdout:8/133: truncate d7/dd/d17/f2e 3173081 0 2024-04-25T16:15:51.256 INFO:tasks.workunit.client.0.smithi059.stdout:8/134: dread d7/dd/ff [0,4194304] 0 2024-04-25T16:15:51.269 INFO:tasks.workunit.client.0.smithi059.stdout:8/135: read d7/dd/ff [257482,72033] 0 2024-04-25T16:15:51.291 INFO:tasks.workunit.client.0.smithi059.stdout:7/144: fdatasync d0/d7/d16/f1e 0 2024-04-25T16:15:51.339 INFO:tasks.workunit.client.0.smithi059.stdout:0/144: mknod dc/c2f 0 2024-04-25T16:15:51.399 INFO:tasks.workunit.client.0.smithi059.stdout:3/160: link d0/c1d d0/db/c36 0 2024-04-25T16:15:51.468 INFO:tasks.workunit.client.0.smithi059.stdout:9/157: creat d6/d1d/f29 x:0 0 0 2024-04-25T16:15:51.478 INFO:tasks.workunit.client.0.smithi059.stdout:9/158: rename d6 to d6/d1d/d26/d2a 22 2024-04-25T16:15:51.519 INFO:tasks.workunit.client.0.smithi059.stdout:2/155: write fb [2821595,58808] 0 2024-04-25T16:15:51.541 INFO:tasks.workunit.client.0.smithi059.stdout:2/156: chown de/d2a/d2e/d36/f26 20888 1 2024-04-25T16:15:51.577 INFO:tasks.workunit.client.0.smithi059.stdout:5/163: mknod d1/c35 0 2024-04-25T16:15:51.638 INFO:tasks.workunit.client.0.smithi059.stdout:7/145: rmdir d0 39 2024-04-25T16:15:51.674 INFO:tasks.workunit.client.0.smithi059.stdout:0/145: mknod dc/df/c30 0 2024-04-25T16:15:51.810 INFO:tasks.workunit.client.0.smithi059.stdout:6/166: dwrite f6 [0,4194304] 0 2024-04-25T16:15:51.928 INFO:tasks.workunit.client.0.smithi059.stdout:4/142: creat d0/d4/df/d18/f2d x:0 0 0 2024-04-25T16:15:52.221 INFO:tasks.workunit.client.0.smithi059.stdout:8/136: rmdir d7/d16 39 2024-04-25T16:15:52.243 INFO:tasks.workunit.client.0.smithi059.stdout:9/159: symlink d6/d1d/d28/l2b 0 2024-04-25T16:15:52.254 INFO:tasks.workunit.client.0.smithi059.stdout:5/164: read - d1/f11 zero size 2024-04-25T16:15:52.262 INFO:tasks.workunit.client.0.smithi059.stdout:2/157: unlink de/f10 0 2024-04-25T16:15:52.288 INFO:tasks.workunit.client.0.smithi059.stdout:4/143: creat d0/d4/f2e x:0 0 0 2024-04-25T16:15:52.469 INFO:tasks.workunit.client.0.smithi059.stdout:1/165: dread d7/d13/f20 [0,4194304] 0 2024-04-25T16:15:52.484 INFO:tasks.workunit.client.0.smithi059.stdout:1/166: chown d7/d15/f25 155596340 1 2024-04-25T16:15:52.489 INFO:tasks.workunit.client.0.smithi059.stdout:5/165: readlink d1/dd/l19 0 2024-04-25T16:15:52.513 INFO:tasks.workunit.client.0.smithi059.stdout:5/166: dread d1/dd/ff [0,4194304] 0 2024-04-25T16:15:52.579 INFO:tasks.workunit.client.0.smithi059.stdout:2/158: dread - de/d2a/f35 zero size 2024-04-25T16:15:52.637 INFO:tasks.workunit.client.0.smithi059.stdout:4/144: dread d0/d4/df/d1c/f23 [0,4194304] 0 2024-04-25T16:15:52.661 INFO:tasks.workunit.client.0.smithi059.stdout:8/137: unlink d7/f21 0 2024-04-25T16:15:52.745 INFO:tasks.workunit.client.0.smithi059.stdout:7/146: mknod d0/d7/c2d 0 2024-04-25T16:15:52.774 INFO:tasks.workunit.client.0.smithi059.stdout:1/167: truncate d7/f26 291764 0 2024-04-25T16:15:52.801 INFO:tasks.workunit.client.0.smithi059.stdout:5/167: truncate d1/dd/ff 471420 0 2024-04-25T16:15:52.864 INFO:tasks.workunit.client.0.smithi059.stdout:9/160: mknod d6/d1d/c2c 0 2024-04-25T16:15:52.896 INFO:tasks.workunit.client.0.smithi059.stdout:0/146: dwrite f6 [0,4194304] 0 2024-04-25T16:15:52.972 INFO:tasks.workunit.client.0.smithi059.stdout:4/145: rename d0/d4/df to d0/d4/df/d2f 22 2024-04-25T16:15:52.976 INFO:tasks.workunit.client.0.smithi059.stdout:3/161: write d0/db/f30 [572237,17004] 0 2024-04-25T16:15:52.985 INFO:tasks.workunit.client.0.smithi059.stdout:6/167: write d9/f10 [3762869,113023] 0 2024-04-25T16:15:53.036 INFO:tasks.workunit.client.0.smithi059.stdout:4/146: rename d0/d4 to d0/d4/df/d1c/d30 22 2024-04-25T16:15:53.077 INFO:tasks.workunit.client.0.smithi059.stdout:1/168: truncate d7/f29 722968 0 2024-04-25T16:15:53.354 INFO:tasks.workunit.client.0.smithi059.stdout:6/168: creat d9/d1b/f33 x:0 0 0 2024-04-25T16:15:53.388 INFO:tasks.workunit.client.0.smithi059.stdout:1/169: dread - d7/f30 zero size 2024-04-25T16:15:53.393 INFO:tasks.workunit.client.0.smithi059.stdout:3/162: stat d0/d1e/c25 0 2024-04-25T16:15:53.443 INFO:tasks.workunit.client.0.smithi059.stdout:5/168: dread d1/d1e/d21/f23 [0,4194304] 0 2024-04-25T16:15:53.638 INFO:tasks.workunit.client.0.smithi059.stdout:4/147: mknod d0/d4/df/c31 0 2024-04-25T16:15:53.658 INFO:tasks.workunit.client.0.smithi059.stdout:6/169: fdatasync f8 0 2024-04-25T16:15:53.856 INFO:tasks.workunit.client.0.smithi059.stdout:2/159: truncate fb 3290765 0 2024-04-25T16:15:54.021 INFO:tasks.workunit.client.0.smithi059.stdout:8/138: dwrite d7/f26 [4194304,4194304] 0 2024-04-25T16:15:54.107 INFO:tasks.workunit.client.0.smithi059.stdout:9/161: dwrite d6/fb [0,4194304] 0 2024-04-25T16:15:54.192 INFO:tasks.workunit.client.0.smithi059.stdout:5/169: symlink d1/d1e/d27/l36 0 2024-04-25T16:15:54.207 INFO:tasks.workunit.client.0.smithi059.stdout:7/147: getdents d0/d7/d16/d20 0 2024-04-25T16:15:54.271 INFO:tasks.workunit.client.0.smithi059.stdout:2/160: truncate de/d2a/f35 846701 0 2024-04-25T16:15:54.332 INFO:tasks.workunit.client.0.smithi059.stdout:6/170: write f8 [3463629,88870] 0 2024-04-25T16:15:54.402 INFO:tasks.workunit.client.0.smithi059.stdout:2/161: sync 2024-04-25T16:15:54.463 INFO:tasks.workunit.client.0.smithi059.stdout:8/139: chown d7/fa 183407741 1 2024-04-25T16:15:54.478 INFO:tasks.workunit.client.0.smithi059.stdout:8/140: write d7/f26 [4162114,126621] 0 2024-04-25T16:15:54.500 INFO:tasks.workunit.client.0.smithi059.stdout:0/147: link dc/dd/l11 dc/df/l31 0 2024-04-25T16:15:54.663 INFO:tasks.workunit.client.0.smithi059.stdout:5/170: dread d1/f29 [0,4194304] 0 2024-04-25T16:15:54.699 INFO:tasks.workunit.client.0.smithi059.stdout:9/162: fsync d6/f13 0 2024-04-25T16:15:54.885 INFO:tasks.workunit.client.0.smithi059.stdout:7/148: dread d0/d7/f1f [0,4194304] 0 2024-04-25T16:15:54.937 INFO:tasks.workunit.client.0.smithi059.stdout:6/171: creat d9/d27/f34 x:0 0 0 2024-04-25T16:15:54.952 INFO:tasks.workunit.client.0.smithi059.stdout:6/172: readlink d9/d16/l2f 0 2024-04-25T16:15:54.958 INFO:tasks.workunit.client.0.smithi059.stdout:6/173: readlink d9/d16/l18 0 2024-04-25T16:15:54.964 INFO:tasks.workunit.client.0.smithi059.stdout:6/174: chown d9/cb 0 1 2024-04-25T16:15:55.130 INFO:tasks.workunit.client.0.smithi059.stdout:0/148: symlink dc/df/d24/l32 0 2024-04-25T16:15:55.147 INFO:tasks.workunit.client.0.smithi059.stdout:8/141: truncate d7/dd/d17/f1a 1531780 0 2024-04-25T16:15:55.184 INFO:tasks.workunit.client.0.smithi059.stdout:3/163: creat d0/f37 x:0 0 0 2024-04-25T16:15:55.313 INFO:tasks.workunit.client.0.smithi059.stdout:5/171: unlink d1/d1e/d21/f2e 0 2024-04-25T16:15:55.414 INFO:tasks.workunit.client.0.smithi059.stdout:9/163: creat d6/d1d/d26/f2d x:0 0 0 2024-04-25T16:15:55.771 INFO:tasks.workunit.client.0.smithi059.stdout:0/149: dread dc/dd/f23 [0,4194304] 0 2024-04-25T16:15:55.931 INFO:tasks.workunit.client.0.smithi059.stdout:3/164: rename d0/db/f2c to d0/db/d2d/f38 0 2024-04-25T16:15:55.986 INFO:tasks.workunit.client.0.smithi059.stdout:4/148: rename d0/d4/df/l1e to d0/d4/df/l32 0 2024-04-25T16:15:56.197 INFO:tasks.workunit.client.0.smithi059.stdout:9/164: unlink d6/f19 0 2024-04-25T16:15:56.203 INFO:tasks.workunit.client.0.smithi059.stdout:1/170: link d7/d21/l38 d7/d2a/d36/l3b 0 2024-04-25T16:15:56.291 INFO:tasks.workunit.client.0.smithi059.stdout:0/150: dread - dc/f2a zero size 2024-04-25T16:15:56.311 INFO:tasks.workunit.client.0.smithi059.stdout:7/149: write d0/d7/f1d [3522351,19823] 0 2024-04-25T16:15:56.379 INFO:tasks.workunit.client.0.smithi059.stdout:8/142: mkdir d7/d2f 0 2024-04-25T16:15:56.383 INFO:tasks.workunit.client.0.smithi059.stdout:2/162: write de/d2a/f35 [205877,54735] 0 2024-04-25T16:15:56.539 INFO:tasks.workunit.client.0.smithi059.stdout:9/165: dread d6/d1d/f1f [0,4194304] 0 2024-04-25T16:15:56.557 INFO:tasks.workunit.client.0.smithi059.stdout:9/166: write d6/d1d/f29 [344621,84441] 0 2024-04-25T16:15:56.582 INFO:tasks.workunit.client.0.smithi059.stdout:6/175: creat d9/f35 x:0 0 0 2024-04-25T16:15:56.593 INFO:tasks.workunit.client.0.smithi059.stdout:1/171: chown d7/d15/f34 31752 1 2024-04-25T16:15:56.751 INFO:tasks.workunit.client.0.smithi059.stdout:3/165: symlink d0/l39 0 2024-04-25T16:15:56.761 INFO:tasks.workunit.client.0.smithi059.stdout:8/143: readlink d7/l1d 0 2024-04-25T16:15:56.768 INFO:tasks.workunit.client.0.smithi059.stdout:3/166: fdatasync d0/f37 0 2024-04-25T16:15:56.783 INFO:tasks.workunit.client.0.smithi059.stdout:4/149: mkdir d0/d33 0 2024-04-25T16:15:56.876 INFO:tasks.workunit.client.0.smithi059.stdout:4/150: sync 2024-04-25T16:15:56.928 INFO:tasks.workunit.client.0.smithi059.stdout:4/151: dread - d0/d4/f2e zero size 2024-04-25T16:15:56.955 INFO:tasks.workunit.client.0.smithi059.stdout:5/172: dwrite d1/dd/ff [0,4194304] 0 2024-04-25T16:15:57.000 INFO:tasks.workunit.client.0.smithi059.stdout:5/173: sync 2024-04-25T16:15:57.020 INFO:tasks.workunit.client.0.smithi059.stdout:6/176: rmdir d9/d16/d24 39 2024-04-25T16:15:57.028 INFO:tasks.workunit.client.0.smithi059.stdout:1/172: unlink d7/d13/l2b 0 2024-04-25T16:15:57.035 INFO:tasks.workunit.client.0.smithi059.stdout:0/151: mknod dc/c33 0 2024-04-25T16:15:57.106 INFO:tasks.workunit.client.0.smithi059.stdout:7/150: creat d0/d7/d16/d20/d2b/f2e x:0 0 0 2024-04-25T16:15:57.131 INFO:tasks.workunit.client.0.smithi059.stdout:4/152: mkdir d0/d4/d34 0 2024-04-25T16:15:57.182 INFO:tasks.workunit.client.0.smithi059.stdout:9/167: dread d6/f1a [0,4194304] 0 2024-04-25T16:15:57.249 INFO:tasks.workunit.client.0.smithi059.stdout:3/167: dread d0/db/f16 [0,4194304] 0 2024-04-25T16:15:57.480 INFO:tasks.workunit.client.0.smithi059.stdout:1/173: symlink d7/d13/l3c 0 2024-04-25T16:15:57.481 INFO:tasks.workunit.client.0.smithi059.stdout:6/177: dread - d9/f23 zero size 2024-04-25T16:15:57.499 INFO:tasks.workunit.client.0.smithi059.stdout:8/144: truncate d7/dd/d17/f1a 2498603 0 2024-04-25T16:15:57.526 INFO:tasks.workunit.client.0.smithi059.stdout:2/163: link de/d2a/c38 de/d2a/d2e/d36/c39 0 2024-04-25T16:15:57.573 INFO:tasks.workunit.client.0.smithi059.stdout:1/174: chown d7/d13/l3c 119 1 2024-04-25T16:15:57.597 INFO:tasks.workunit.client.0.smithi059.stdout:0/152: dread dc/dd/f20 [0,4194304] 0 2024-04-25T16:15:57.913 INFO:tasks.workunit.client.0.smithi059.stdout:5/174: dwrite d1/dd/f34 [0,4194304] 0 2024-04-25T16:15:57.994 INFO:tasks.workunit.client.0.smithi059.stdout:3/168: truncate d0/f28 638786 0 2024-04-25T16:15:58.112 INFO:tasks.workunit.client.0.smithi059.stdout:0/153: rename dc/df/l12 to dc/df/d24/l34 0 2024-04-25T16:15:58.117 INFO:tasks.workunit.client.0.smithi059.stdout:4/153: link d0/d4/df/f19 d0/d4/f35 0 2024-04-25T16:15:58.117 INFO:tasks.workunit.client.0.smithi059.stdout:1/175: creat d7/d2a/f3d x:0 0 0 2024-04-25T16:15:58.138 INFO:tasks.workunit.client.0.smithi059.stdout:8/145: symlink d7/d2f/l30 0 2024-04-25T16:15:58.140 INFO:tasks.workunit.client.0.smithi059.stdout:7/151: dwrite d0/d7/f22 [0,4194304] 0 2024-04-25T16:15:58.150 INFO:tasks.workunit.client.0.smithi059.stdout:9/168: dwrite f1 [0,4194304] 0 2024-04-25T16:15:58.297 INFO:tasks.workunit.client.0.smithi059.stdout:3/169: creat d0/db/f3a x:0 0 0 2024-04-25T16:15:58.300 INFO:tasks.workunit.client.0.smithi059.stdout:6/178: write d9/d16/f1f [1651828,46268] 0 2024-04-25T16:15:58.578 INFO:tasks.workunit.client.0.smithi059.stdout:5/175: dread d1/dd/f12 [0,4194304] 0 2024-04-25T16:15:58.579 INFO:tasks.workunit.client.0.smithi059.stdout:3/170: chown d0/f6 7560030 1 2024-04-25T16:15:58.630 INFO:tasks.workunit.client.0.smithi059.stdout:8/146: rename f3 to d7/dd/f31 0 2024-04-25T16:15:58.647 INFO:tasks.workunit.client.0.smithi059.stdout:9/169: dread d6/fb [0,4194304] 0 2024-04-25T16:15:58.693 INFO:tasks.workunit.client.0.smithi059.stdout:2/164: dwrite de/d2a/d2e/d36/f26 [0,4194304] 0 2024-04-25T16:15:58.823 INFO:tasks.workunit.client.0.smithi059.stdout:1/176: write d7/d13/d2d/f37 [354353,5991] 0 2024-04-25T16:15:58.881 INFO:tasks.workunit.client.0.smithi059.stdout:4/154: dwrite d0/d4/f2e [0,4194304] 0 2024-04-25T16:15:58.955 INFO:tasks.workunit.client.0.smithi059.stdout:3/171: read d0/d1e/f1f [222516,45263] 0 2024-04-25T16:15:59.026 INFO:tasks.workunit.client.0.smithi059.stdout:9/170: fdatasync d6/f13 0 2024-04-25T16:15:59.034 INFO:tasks.workunit.client.0.smithi059.stdout:6/179: dwrite d9/d16/f1f [0,4194304] 0 2024-04-25T16:15:59.041 INFO:tasks.workunit.client.0.smithi059.stdout:3/172: stat d0/f35 0 2024-04-25T16:15:59.118 INFO:tasks.workunit.client.0.smithi059.stdout:5/176: creat d1/d1e/f37 x:0 0 0 2024-04-25T16:15:59.141 INFO:tasks.workunit.client.0.smithi059.stdout:2/165: mknod de/d2a/d33/c3a 0 2024-04-25T16:15:59.176 INFO:tasks.workunit.client.0.smithi059.stdout:8/147: readlink d7/dd/l28 0 2024-04-25T16:15:59.184 INFO:tasks.workunit.client.0.smithi059.stdout:1/177: chown d7/c1c 2 1 2024-04-25T16:15:59.266 INFO:tasks.workunit.client.0.smithi059.stdout:8/148: sync 2024-04-25T16:15:59.285 INFO:tasks.workunit.client.0.smithi059.stdout:0/154: dwrite fa [0,4194304] 0 2024-04-25T16:15:59.352 INFO:tasks.workunit.client.0.smithi059.stdout:7/152: dwrite d0/d7/f2c [0,4194304] 0 2024-04-25T16:15:59.442 INFO:tasks.workunit.client.0.smithi059.stdout:5/177: readlink d1/l7 0 2024-04-25T16:15:59.460 INFO:tasks.workunit.client.0.smithi059.stdout:5/178: stat d1/dd/ff 0 2024-04-25T16:15:59.551 INFO:tasks.workunit.client.0.smithi059.stdout:6/180: creat d9/d1b/f36 x:0 0 0 2024-04-25T16:15:59.951 INFO:tasks.workunit.client.0.smithi059.stdout:4/155: rmdir d0/d33 0 2024-04-25T16:15:59.968 INFO:tasks.workunit.client.0.smithi059.stdout:3/173: symlink d0/d22/l3b 0 2024-04-25T16:15:59.978 INFO:tasks.workunit.client.0.smithi059.stdout:7/153: symlink d0/d7/d16/l2f 0 2024-04-25T16:15:59.988 INFO:tasks.workunit.client.0.smithi059.stdout:0/155: rename dc/dd/f2b to dc/df/d28/f35 0 2024-04-25T16:16:00.010 INFO:tasks.workunit.client.0.smithi059.stdout:5/179: creat d1/d1e/d21/d24/f38 x:0 0 0 2024-04-25T16:16:00.056 INFO:tasks.workunit.client.0.smithi059.stdout:6/181: chown d9/d16/d24/f32 60185 1 2024-04-25T16:16:00.272 INFO:tasks.workunit.client.0.smithi059.stdout:8/149: creat d7/d16/f32 x:0 0 0 2024-04-25T16:16:00.276 INFO:tasks.workunit.client.0.smithi059.stdout:1/178: rmdir d7/d39 0 2024-04-25T16:16:00.380 INFO:tasks.workunit.client.0.smithi059.stdout:3/174: dread d0/db/f19 [0,4194304] 0 2024-04-25T16:16:00.434 INFO:tasks.workunit.client.0.smithi059.stdout:4/156: symlink d0/d4/df/d1c/l36 0 2024-04-25T16:16:00.787 INFO:tasks.workunit.client.0.smithi059.stdout:2/166: unlink de/d2a/c2b 0 2024-04-25T16:16:00.798 INFO:tasks.workunit.client.0.smithi059.stdout:1/179: fsync d7/d13/d16/f1d 0 2024-04-25T16:16:00.847 INFO:tasks.workunit.client.0.smithi059.stdout:0/156: truncate dc/f1f 3720523 0 2024-04-25T16:16:00.859 INFO:tasks.workunit.client.0.smithi059.stdout:9/171: write f2 [2315463,47331] 0 2024-04-25T16:16:00.942 INFO:tasks.workunit.client.0.smithi059.stdout:1/180: dwrite d7/d13/d2d/f37 [0,4194304] 0 2024-04-25T16:16:01.021 INFO:tasks.workunit.client.0.smithi059.stdout:4/157: truncate d0/d4/fe 1244052 0 2024-04-25T16:16:01.061 INFO:tasks.workunit.client.0.smithi059.stdout:5/180: link d1/d1e/f37 d1/d1e/d21/f39 0 2024-04-25T16:16:01.070 INFO:tasks.workunit.client.0.smithi059.stdout:5/181: stat d1/d1e/d21/f22 0 2024-04-25T16:16:01.325 INFO:tasks.workunit.client.0.smithi059.stdout:1/181: truncate d7/d15/f25 1411876 0 2024-04-25T16:16:01.333 INFO:tasks.workunit.client.0.smithi059.stdout:1/182: chown d7/d2a/d36 22631167 1 2024-04-25T16:16:01.539 INFO:tasks.workunit.client.0.smithi059.stdout:3/175: rename d0/f35 to d0/db/d2d/f3c 0 2024-04-25T16:16:01.544 INFO:tasks.workunit.client.0.smithi059.stdout:9/172: rename d6 to d6/d1d/d28/d2e 22 2024-04-25T16:16:01.643 INFO:tasks.workunit.client.0.smithi059.stdout:7/154: getdents d0/d7/d16/d20/d2b 0 2024-04-25T16:16:01.646 INFO:tasks.workunit.client.0.smithi059.stdout:6/182: write d9/d16/d24/f2b [923050,126629] 0 2024-04-25T16:16:01.724 INFO:tasks.workunit.client.0.smithi059.stdout:8/150: getdents d7/d16 0 2024-04-25T16:16:01.814 INFO:tasks.workunit.client.0.smithi059.stdout:3/176: mknod d0/db/d2d/c3d 0 2024-04-25T16:16:01.869 INFO:tasks.workunit.client.0.smithi059.stdout:0/157: creat dc/f36 x:0 0 0 2024-04-25T16:16:01.894 INFO:tasks.workunit.client.0.smithi059.stdout:1/183: mknod d7/d2a/d36/c3e 0 2024-04-25T16:16:01.975 INFO:tasks.workunit.client.0.smithi059.stdout:4/158: rmdir d0/d4/d34 0 2024-04-25T16:16:02.055 INFO:tasks.workunit.client.0.smithi059.stdout:7/155: read d0/fd [1895935,21784] 0 2024-04-25T16:16:02.242 INFO:tasks.workunit.client.0.smithi059.stdout:8/151: unlink d7/d16/f32 0 2024-04-25T16:16:02.251 INFO:tasks.workunit.client.0.smithi059.stdout:8/152: readlink d7/dd/l28 0 2024-04-25T16:16:02.399 INFO:tasks.workunit.client.0.smithi059.stdout:2/167: dwrite f2 [0,4194304] 0 2024-04-25T16:16:02.462 INFO:tasks.workunit.client.0.smithi059.stdout:1/184: dread d7/fc [0,4194304] 0 2024-04-25T16:16:02.467 INFO:tasks.workunit.client.0.smithi059.stdout:5/182: link d1/cb d1/d1e/d27/c3a 0 2024-04-25T16:16:02.513 INFO:tasks.workunit.client.0.smithi059.stdout:5/183: readlink d1/dd/l14 0 2024-04-25T16:16:02.514 INFO:tasks.workunit.client.0.smithi059.stdout:1/185: chown l5 33 1 2024-04-25T16:16:02.574 INFO:tasks.workunit.client.0.smithi059.stdout:9/173: dwrite d6/f1c [0,4194304] 0 2024-04-25T16:16:03.073 INFO:tasks.workunit.client.0.smithi059.stdout:8/153: mkdir d7/dd/d33 0 2024-04-25T16:16:03.081 INFO:tasks.workunit.client.0.smithi059.stdout:0/158: mkdir dc/d37 0 2024-04-25T16:16:03.138 INFO:tasks.workunit.client.0.smithi059.stdout:1/186: rmdir d7/d13/d16 39 2024-04-25T16:16:03.167 INFO:tasks.workunit.client.0.smithi059.stdout:8/154: sync 2024-04-25T16:16:03.204 INFO:tasks.workunit.client.0.smithi059.stdout:6/183: dwrite d9/d16/f17 [0,4194304] 0 2024-04-25T16:16:03.224 INFO:tasks.workunit.client.0.smithi059.stdout:7/156: creat d0/f30 x:0 0 0 2024-04-25T16:16:03.362 INFO:tasks.workunit.client.0.smithi059.stdout:0/159: read - dc/df/d24/f2e zero size 2024-04-25T16:16:03.392 INFO:tasks.workunit.client.0.smithi059.stdout:3/177: link d0/f6 d0/f3e 0 2024-04-25T16:16:03.425 INFO:tasks.workunit.client.0.smithi059.stdout:0/160: chown dc/f36 3660394 1 2024-04-25T16:16:03.436 INFO:tasks.workunit.client.0.smithi059.stdout:9/174: dwrite d6/d1d/f29 [0,4194304] 0 2024-04-25T16:16:03.524 INFO:tasks.workunit.client.0.smithi059.stdout:9/175: read d6/d1d/f29 [1205112,81363] 0 2024-04-25T16:16:03.627 INFO:tasks.workunit.client.0.smithi059.stdout:8/155: symlink d7/dd/l34 0 2024-04-25T16:16:03.656 INFO:tasks.workunit.client.0.smithi059.stdout:7/157: dread - d0/d7/f29 zero size 2024-04-25T16:16:03.751 INFO:tasks.workunit.client.0.smithi059.stdout:6/184: truncate d9/d16/f22 963999 0 2024-04-25T16:16:03.807 INFO:tasks.workunit.client.0.smithi059.stdout:3/178: mkdir d0/db/d3f 0 2024-04-25T16:16:03.810 INFO:tasks.workunit.client.0.smithi059.stdout:6/185: dread d9/fd [0,4194304] 0 2024-04-25T16:16:03.874 INFO:tasks.workunit.client.0.smithi059.stdout:1/187: rmdir d7/d13/d16 39 2024-04-25T16:16:03.921 INFO:tasks.workunit.client.0.smithi059.stdout:4/159: dwrite d0/d4/df/f12 [0,4194304] 0 2024-04-25T16:16:03.999 INFO:tasks.workunit.client.0.smithi059.stdout:5/184: write d1/dd/f13 [3670087,92812] 0 2024-04-25T16:16:04.022 INFO:tasks.workunit.client.0.smithi059.stdout:9/176: write d6/fb [3798440,103957] 0 2024-04-25T16:16:04.096 INFO:tasks.workunit.client.0.smithi059.stdout:6/186: creat d9/d1b/f37 x:0 0 0 2024-04-25T16:16:04.152 INFO:tasks.workunit.client.0.smithi059.stdout:3/179: creat d0/d1e/d31/f40 x:0 0 0 2024-04-25T16:16:04.245 INFO:tasks.workunit.client.0.smithi059.stdout:7/158: mknod d0/c31 0 2024-04-25T16:16:04.255 INFO:tasks.workunit.client.0.smithi059.stdout:7/159: fdatasync d0/f30 0 2024-04-25T16:16:04.320 INFO:tasks.workunit.client.0.smithi059.stdout:2/168: write de/d16/f22 [864571,118126] 0 2024-04-25T16:16:04.403 INFO:tasks.workunit.client.0.smithi059.stdout:4/160: creat d0/d4/df/d1c/f37 x:0 0 0 2024-04-25T16:16:04.473 INFO:tasks.workunit.client.0.smithi059.stdout:0/161: dwrite f9 [4194304,4194304] 0 2024-04-25T16:16:04.483 INFO:tasks.workunit.client.0.smithi059.stdout:4/161: sync 2024-04-25T16:16:04.538 INFO:tasks.workunit.client.0.smithi059.stdout:0/162: chown f6 19714 1 2024-04-25T16:16:04.738 INFO:tasks.workunit.client.0.smithi059.stdout:8/156: dwrite d7/fa [4194304,4194304] 0 2024-04-25T16:16:04.833 INFO:tasks.workunit.client.0.smithi059.stdout:3/180: rename d0/d22/f2b to d0/d1e/f41 0 2024-04-25T16:16:05.148 INFO:tasks.workunit.client.0.smithi059.stdout:5/185: write d1/d1e/f20 [11613,18143] 0 2024-04-25T16:16:05.409 INFO:tasks.workunit.client.0.smithi059.stdout:7/160: truncate d0/d7/d16/f1e 732222 0 2024-04-25T16:16:05.429 INFO:tasks.workunit.client.0.smithi059.stdout:9/177: mkdir d6/d1d/d2f 0 2024-04-25T16:16:05.451 INFO:tasks.workunit.client.0.smithi059.stdout:6/187: mknod d9/d2e/c38 0 2024-04-25T16:16:05.486 INFO:tasks.workunit.client.0.smithi059.stdout:9/178: chown d6/d1d/c2c 541 1 2024-04-25T16:16:05.620 INFO:tasks.workunit.client.0.smithi059.stdout:5/186: symlink d1/d1e/d27/l3b 0 2024-04-25T16:16:05.831 INFO:tasks.workunit.client.0.smithi059.stdout:4/162: mknod d0/d4/df/c38 0 2024-04-25T16:16:05.873 INFO:tasks.workunit.client.0.smithi059.stdout:8/157: fdatasync d7/f1f 0 2024-04-25T16:16:05.886 INFO:tasks.workunit.client.0.smithi059.stdout:8/158: fdatasync d7/fa 0 2024-04-25T16:16:06.115 INFO:tasks.workunit.client.0.smithi059.stdout:7/161: rename d0/d7/d16/d20/l21 to d0/d7/d16/d20/d2b/l32 0 2024-04-25T16:16:06.125 INFO:tasks.workunit.client.0.smithi059.stdout:1/188: getdents d7/d2a/d36 0 2024-04-25T16:16:06.155 INFO:tasks.workunit.client.0.smithi059.stdout:5/187: readlink d1/l4 0 2024-04-25T16:16:06.329 INFO:tasks.workunit.client.0.smithi059.stdout:2/169: dwrite fd [0,4194304] 0 2024-04-25T16:16:06.404 INFO:tasks.workunit.client.0.smithi059.stdout:9/179: mknod d6/d1d/d2f/c30 0 2024-04-25T16:16:06.497 INFO:tasks.workunit.client.0.smithi059.stdout:0/163: dwrite dc/f2a [0,4194304] 0 2024-04-25T16:16:06.572 INFO:tasks.workunit.client.0.smithi059.stdout:5/188: rmdir d1/d1e/d21 39 2024-04-25T16:16:06.655 INFO:tasks.workunit.client.0.smithi059.stdout:8/159: dread d7/dd/d17/f2e [0,4194304] 0 2024-04-25T16:16:06.664 INFO:tasks.workunit.client.0.smithi059.stdout:8/160: chown d7/dd 14508093 1 2024-04-25T16:16:06.786 INFO:tasks.workunit.client.0.smithi059.stdout:1/189: mknod d7/d13/d16/c3f 0 2024-04-25T16:16:06.795 INFO:tasks.workunit.client.0.smithi059.stdout:4/163: creat d0/f39 x:0 0 0 2024-04-25T16:16:06.835 INFO:tasks.workunit.client.0.smithi059.stdout:9/180: creat d6/d1d/d28/f31 x:0 0 0 2024-04-25T16:16:06.945 INFO:tasks.workunit.client.0.smithi059.stdout:0/164: symlink dc/df/d28/l38 0 2024-04-25T16:16:07.066 INFO:tasks.workunit.client.0.smithi059.stdout:6/188: dwrite d9/f14 [0,4194304] 0 2024-04-25T16:16:07.069 INFO:tasks.workunit.client.0.smithi059.stdout:3/181: dwrite d0/db/d2d/f38 [0,4194304] 0 2024-04-25T16:16:07.189 INFO:tasks.workunit.client.0.smithi059.stdout:1/190: rmdir d7/d21 39 2024-04-25T16:16:07.208 INFO:tasks.workunit.client.0.smithi059.stdout:9/181: mknod d6/c32 0 2024-04-25T16:16:07.229 INFO:tasks.workunit.client.0.smithi059.stdout:6/189: stat f3 0 2024-04-25T16:16:07.229 INFO:tasks.workunit.client.0.smithi059.stdout:5/189: symlink d1/d1e/d21/l3c 0 2024-04-25T16:16:07.309 INFO:tasks.workunit.client.0.smithi059.stdout:0/165: readlink l3 0 2024-04-25T16:16:07.366 INFO:tasks.workunit.client.0.smithi059.stdout:7/162: dwrite d0/d7/f1d [0,4194304] 0 2024-04-25T16:16:07.443 INFO:tasks.workunit.client.0.smithi059.stdout:2/170: write de/f2d [1099510,229] 0 2024-04-25T16:16:07.501 INFO:tasks.workunit.client.0.smithi059.stdout:9/182: creat d6/d1d/d26/f33 x:0 0 0 2024-04-25T16:16:07.592 INFO:tasks.workunit.client.0.smithi059.stdout:6/190: dwrite d9/d1b/f37 [0,4194304] 0 2024-04-25T16:16:07.674 INFO:tasks.workunit.client.0.smithi059.stdout:1/191: write d7/f30 [168313,99568] 0 2024-04-25T16:16:07.675 INFO:tasks.workunit.client.0.smithi059.stdout:8/161: write d7/f20 [102131,20164] 0 2024-04-25T16:16:07.848 INFO:tasks.workunit.client.0.smithi059.stdout:4/164: creat d0/d4/df/f3a x:0 0 0 2024-04-25T16:16:07.870 INFO:tasks.workunit.client.0.smithi059.stdout:2/171: mknod de/d2a/c3b 0 2024-04-25T16:16:07.876 INFO:tasks.workunit.client.0.smithi059.stdout:9/183: mknod d6/d1d/d28/c34 0 2024-04-25T16:16:07.889 INFO:tasks.workunit.client.0.smithi059.stdout:6/191: dread - d9/f35 zero size 2024-04-25T16:16:07.968 INFO:tasks.workunit.client.0.smithi059.stdout:4/165: sync 2024-04-25T16:16:07.975 INFO:tasks.workunit.client.0.smithi059.stdout:1/192: fdatasync d7/d13/d16/f1e 0 2024-04-25T16:16:08.033 INFO:tasks.workunit.client.0.smithi059.stdout:9/184: sync 2024-04-25T16:16:08.070 INFO:tasks.workunit.client.0.smithi059.stdout:6/192: mkdir d9/d27/d39 0 2024-04-25T16:16:08.148 INFO:tasks.workunit.client.0.smithi059.stdout:5/190: getdents d1/d1e/d21/d24 0 2024-04-25T16:16:08.177 INFO:tasks.workunit.client.0.smithi059.stdout:6/193: dwrite d9/f14 [0,4194304] 0 2024-04-25T16:16:08.312 INFO:tasks.workunit.client.0.smithi059.stdout:8/162: fdatasync d7/f15 0 2024-04-25T16:16:08.350 INFO:tasks.workunit.client.0.smithi059.stdout:1/193: rename d7/d13/d16/f1d to d7/d13/d2d/f40 0 2024-04-25T16:16:08.388 INFO:tasks.workunit.client.0.smithi059.stdout:2/172: mknod de/c3c 0 2024-04-25T16:16:08.395 INFO:tasks.workunit.client.0.smithi059.stdout:8/163: chown d7/dd 15695008 1 2024-04-25T16:16:08.433 INFO:tasks.workunit.client.0.smithi059.stdout:9/185: rmdir d6 39 2024-04-25T16:16:08.479 INFO:tasks.workunit.client.0.smithi059.stdout:0/166: truncate dc/f2a 2973992 0 2024-04-25T16:16:08.565 INFO:tasks.workunit.client.0.smithi059.stdout:3/182: dwrite d0/f7 [0,4194304] 0 2024-04-25T16:16:08.629 INFO:tasks.workunit.client.0.smithi059.stdout:8/164: dread - d7/dd/d17/d23/f2a zero size 2024-04-25T16:16:08.644 INFO:tasks.workunit.client.0.smithi059.stdout:7/163: dwrite d0/d7/f23 [0,4194304] 0 2024-04-25T16:16:08.715 INFO:tasks.workunit.client.0.smithi059.stdout:5/191: dwrite d1/dd/f13 [0,4194304] 0 2024-04-25T16:16:08.907 INFO:tasks.workunit.client.0.smithi059.stdout:5/192: dwrite d1/dd/f13 [0,4194304] 0 2024-04-25T16:16:09.009 INFO:tasks.workunit.client.0.smithi059.stdout:4/166: mknod d0/d4/df/c3b 0 2024-04-25T16:16:09.054 INFO:tasks.workunit.client.0.smithi059.stdout:7/164: mkdir d0/d7/d16/d20/d2b/d33 0 2024-04-25T16:16:09.063 INFO:tasks.workunit.client.0.smithi059.stdout:5/193: mkdir d1/d1e/d21/d3d 0 2024-04-25T16:16:09.081 INFO:tasks.workunit.client.0.smithi059.stdout:9/186: readlink d6/d1d/d28/l2b 0 2024-04-25T16:16:09.136 INFO:tasks.workunit.client.0.smithi059.stdout:9/187: stat d6/d1d/d28/f31 0 2024-04-25T16:16:09.254 INFO:tasks.workunit.client.0.smithi059.stdout:1/194: dread d7/f9 [0,4194304] 0 2024-04-25T16:16:09.359 INFO:tasks.workunit.client.0.smithi059.stdout:9/188: dread - d6/d1d/d26/f2d zero size 2024-04-25T16:16:09.485 INFO:tasks.workunit.client.0.smithi059.stdout:1/195: mkdir d7/d13/d2d/d41 0 2024-04-25T16:16:09.658 INFO:tasks.workunit.client.0.smithi059.stdout:2/173: creat de/d16/f3d x:0 0 0 2024-04-25T16:16:09.681 INFO:tasks.workunit.client.0.smithi059.stdout:0/167: link dc/df/f10 dc/df/d24/f39 0 2024-04-25T16:16:09.704 INFO:tasks.workunit.client.0.smithi059.stdout:3/183: link d0/d1e/c25 d0/db/d2d/c42 0 2024-04-25T16:16:09.755 INFO:tasks.workunit.client.0.smithi059.stdout:7/165: mknod d0/c34 0 2024-04-25T16:16:09.849 INFO:tasks.workunit.client.0.smithi059.stdout:4/167: mknod d0/d4/df/c3c 0 2024-04-25T16:16:09.908 INFO:tasks.workunit.client.0.smithi059.stdout:9/189: rename d6/d1d to d6/d35 0 2024-04-25T16:16:09.989 INFO:tasks.workunit.client.0.smithi059.stdout:1/196: truncate d7/f9 4532767 0 2024-04-25T16:16:10.000 INFO:tasks.workunit.client.0.smithi059.stdout:9/190: sync 2024-04-25T16:16:10.249 INFO:tasks.workunit.client.0.smithi059.stdout:6/194: truncate d9/f14 2796166 0 2024-04-25T16:16:10.261 INFO:tasks.workunit.client.0.smithi059.stdout:3/184: fdatasync d0/db/f14 0 2024-04-25T16:16:10.273 INFO:tasks.workunit.client.0.smithi059.stdout:8/165: truncate d7/f20 24373 0 2024-04-25T16:16:10.293 INFO:tasks.workunit.client.0.smithi059.stdout:2/174: mkdir de/d16/d3e 0 2024-04-25T16:16:10.473 INFO:tasks.workunit.client.0.smithi059.stdout:4/168: dread d0/d4/f20 [0,4194304] 0 2024-04-25T16:16:10.502 INFO:tasks.workunit.client.0.smithi059.stdout:5/194: dwrite d1/d1e/d21/d24/f38 [0,4194304] 0 2024-04-25T16:16:10.817 INFO:tasks.workunit.client.0.smithi059.stdout:7/166: rmdir d0/d7/d16 39 2024-04-25T16:16:10.821 INFO:tasks.workunit.client.0.smithi059.stdout:9/191: rmdir d6/d35 39 2024-04-25T16:16:11.118 INFO:tasks.workunit.client.0.smithi059.stdout:3/185: mknod d0/d1e/c43 0 2024-04-25T16:16:11.122 INFO:tasks.workunit.client.0.smithi059.stdout:1/197: dread - d7/d21/f23 zero size 2024-04-25T16:16:11.157 INFO:tasks.workunit.client.0.smithi059.stdout:8/166: truncate d7/f15 1892993 0 2024-04-25T16:16:11.185 INFO:tasks.workunit.client.0.smithi059.stdout:4/169: rename d0/d4/df/d1c/f23 to d0/d4/df/d1c/f3d 0 2024-04-25T16:16:11.201 INFO:tasks.workunit.client.0.smithi059.stdout:5/195: chown d1/l1b 108741145 1 2024-04-25T16:16:11.306 INFO:tasks.workunit.client.0.smithi059.stdout:6/195: symlink d9/d16/l3a 0 2024-04-25T16:16:11.622 INFO:tasks.workunit.client.0.smithi059.stdout:0/168: creat dc/f3a x:0 0 0 2024-04-25T16:16:11.631 INFO:tasks.workunit.client.0.smithi059.stdout:0/169: dread - dc/f3a zero size 2024-04-25T16:16:11.655 INFO:tasks.workunit.client.0.smithi059.stdout:0/170: read dc/df/f16 [970721,128282] 0 2024-04-25T16:16:11.748 INFO:tasks.workunit.client.0.smithi059.stdout:7/167: creat d0/d7/d16/d20/f35 x:0 0 0 2024-04-25T16:16:11.836 INFO:tasks.workunit.client.0.smithi059.stdout:2/175: link f4 de/d2a/d2e/f3f 0 2024-04-25T16:16:11.882 INFO:tasks.workunit.client.0.smithi059.stdout:1/198: symlink d7/d13/d2d/d41/l42 0 2024-04-25T16:16:11.996 INFO:tasks.workunit.client.0.smithi059.stdout:0/171: chown dc/df/c17 128 1 2024-04-25T16:16:12.499 INFO:tasks.workunit.client.0.smithi059.stdout:3/186: link d0/db/l17 d0/d22/l44 0 2024-04-25T16:16:12.503 INFO:tasks.workunit.client.0.smithi059.stdout:0/172: fsync dc/df/f1d 0 2024-04-25T16:16:12.518 INFO:tasks.workunit.client.0.smithi059.stdout:7/168: rename d0/ce to d0/d7/d16/d20/d2b/d33/c36 0 2024-04-25T16:16:12.614 INFO:tasks.workunit.client.0.smithi059.stdout:9/192: dwrite f0 [0,4194304] 0 2024-04-25T16:16:12.694 INFO:tasks.workunit.client.0.smithi059.stdout:8/167: write d7/f1f [4343040,56248] 0 2024-04-25T16:16:12.705 INFO:tasks.workunit.client.0.smithi059.stdout:2/176: mkdir de/d2a/d2e/d36/d2c/d40 0 2024-04-25T16:16:12.888 INFO:tasks.workunit.client.0.smithi059.stdout:6/196: dwrite d9/d16/f26 [0,4194304] 0 2024-04-25T16:16:12.955 INFO:tasks.workunit.client.0.smithi059.stdout:4/170: dwrite d0/d4/f8 [4194304,4194304] 0 2024-04-25T16:16:13.026 INFO:tasks.workunit.client.0.smithi059.stdout:1/199: mknod d7/d13/c43 0 2024-04-25T16:16:13.068 INFO:tasks.workunit.client.0.smithi059.stdout:2/177: creat de/d2a/d33/f41 x:0 0 0 2024-04-25T16:16:13.094 INFO:tasks.workunit.client.0.smithi059.stdout:9/193: chown d6/d35/d2f 9285 1 2024-04-25T16:16:13.241 INFO:tasks.workunit.client.0.smithi059.stdout:0/173: dread f9 [0,4194304] 0 2024-04-25T16:16:13.287 INFO:tasks.workunit.client.0.smithi059.stdout:7/169: write d0/d7/f28 [393453,49852] 0 2024-04-25T16:16:13.400 INFO:tasks.workunit.client.0.smithi059.stdout:7/170: sync 2024-04-25T16:16:13.404 INFO:tasks.workunit.client.0.smithi059.stdout:9/194: dwrite f0 [0,4194304] 0 2024-04-25T16:16:13.543 INFO:tasks.workunit.client.0.smithi059.stdout:3/187: dwrite d0/db/f14 [0,4194304] 0 2024-04-25T16:16:13.615 INFO:tasks.workunit.client.0.smithi059.stdout:5/196: dwrite d1/fa [0,4194304] 0 2024-04-25T16:16:13.701 INFO:tasks.workunit.client.0.smithi059.stdout:2/178: mknod de/d2a/d2e/d36/c42 0 2024-04-25T16:16:13.723 INFO:tasks.workunit.client.0.smithi059.stdout:4/171: chown d0/d4/df/f14 0 1 2024-04-25T16:16:13.738 INFO:tasks.workunit.client.0.smithi059.stdout:4/172: readlink d0/l1a 0 2024-04-25T16:16:13.785 INFO:tasks.workunit.client.0.smithi059.stdout:6/197: write d9/d1b/f33 [1025917,26553] 0 2024-04-25T16:16:13.965 INFO:tasks.workunit.client.0.smithi059.stdout:8/168: dwrite d7/f20 [0,4194304] 0 2024-04-25T16:16:13.974 INFO:tasks.workunit.client.0.smithi059.stdout:0/174: dwrite f9 [0,4194304] 0 2024-04-25T16:16:14.040 INFO:tasks.workunit.client.0.smithi059.stdout:3/188: creat d0/d1e/f45 x:0 0 0 2024-04-25T16:16:14.041 INFO:tasks.workunit.client.0.smithi059.stdout:1/200: fdatasync d7/f29 0 2024-04-25T16:16:14.044 INFO:tasks.workunit.client.0.smithi059.stdout:5/197: mknod d1/dd/c3e 0 2024-04-25T16:16:14.116 INFO:tasks.workunit.client.0.smithi059.stdout:2/179: truncate de/d2a/d2e/d36/f25 1140937 0 2024-04-25T16:16:14.133 INFO:tasks.workunit.client.0.smithi059.stdout:9/195: mkdir d6/d35/d36 0 2024-04-25T16:16:14.149 INFO:tasks.workunit.client.0.smithi059.stdout:2/180: readlink la 0 2024-04-25T16:16:14.159 INFO:tasks.workunit.client.0.smithi059.stdout:6/198: read d9/fd [3243913,51063] 0 2024-04-25T16:16:14.238 INFO:tasks.workunit.client.0.smithi059.stdout:7/171: write d0/fd [1460233,109453] 0 2024-04-25T16:16:14.260 INFO:tasks.workunit.client.0.smithi059.stdout:4/173: write d0/d4/df/f12 [2915692,54482] 0 2024-04-25T16:16:14.519 INFO:tasks.workunit.client.0.smithi059.stdout:8/169: fdatasync d7/f26 0 2024-04-25T16:16:14.525 INFO:tasks.workunit.client.0.smithi059.stdout:2/181: fsync f1 0 2024-04-25T16:16:14.545 INFO:tasks.workunit.client.0.smithi059.stdout:1/201: fdatasync d7/d2a/f3d 0 2024-04-25T16:16:14.549 INFO:tasks.workunit.client.0.smithi059.stdout:9/196: fdatasync d6/f1b 0 2024-04-25T16:16:14.557 INFO:tasks.workunit.client.0.smithi059.stdout:0/175: readlink dc/df/d24/l34 0 2024-04-25T16:16:14.594 INFO:tasks.workunit.client.0.smithi059.stdout:1/202: read d7/fc [286021,6795] 0 2024-04-25T16:16:14.603 INFO:tasks.workunit.client.0.smithi059.stdout:8/170: read d7/f20 [1241634,107402] 0 2024-04-25T16:16:14.637 INFO:tasks.workunit.client.0.smithi059.stdout:1/203: dread d7/fc [0,4194304] 0 2024-04-25T16:16:14.974 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:16:14.977 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:16:15.151 INFO:tasks.workunit.client.0.smithi059.stdout:5/198: symlink d1/d1e/l3f 0 2024-04-25T16:16:15.162 INFO:tasks.workunit.client.0.smithi059.stdout:0/176: mkdir dc/dd/d3b 0 2024-04-25T16:16:15.172 INFO:tasks.workunit.client.0.smithi059.stdout:8/171: mkdir d7/d2f/d35 0 2024-04-25T16:16:15.177 INFO:tasks.workunit.client.0.smithi059.stdout:9/197: dread - d6/d35/d28/f31 zero size 2024-04-25T16:16:15.185 INFO:tasks.workunit.client.0.smithi059.stdout:1/204: fdatasync d7/d13/f1b 0 2024-04-25T16:16:15.200 INFO:tasks.workunit.client.0.smithi059.stdout:4/174: mknod d0/d4/df/c3e 0 2024-04-25T16:16:15.255 INFO:tasks.workunit.client.0.smithi059.stdout:4/175: write d0/d4/f8 [7924491,123573] 0 2024-04-25T16:16:15.634 INFO:tasks.workunit.client.0.smithi059.stdout:3/189: rename d0/d1e/f41 to d0/db/d2d/f46 0 2024-04-25T16:16:15.654 INFO:tasks.workunit.client.0.smithi059.stdout:6/199: link d9/d16/l2f d9/d27/l3b 0 2024-04-25T16:16:15.795 INFO:tasks.workunit.client.0.smithi059.stdout:2/182: write de/f2d [168698,119980] 0 2024-04-25T16:16:15.833 INFO:tasks.workunit.client.0.smithi059.stdout:1/205: mknod d7/d13/d16/c44 0 2024-04-25T16:16:16.028 INFO:tasks.workunit.client.0.smithi059.stdout:9/198: rename d6/d35/d2f/c30 to d6/d35/d36/c37 0 2024-04-25T16:16:16.034 INFO:tasks.workunit.client.0.smithi059.stdout:3/190: rmdir d0/d1e 39 2024-04-25T16:16:16.161 INFO:tasks.workunit.client.0.smithi059.stdout:5/199: creat d1/d1e/d21/d3d/f40 x:0 0 0 2024-04-25T16:16:16.207 INFO:tasks.workunit.client.0.smithi059.stdout:2/183: chown de/d2a/d2e/d36/f25 17 1 2024-04-25T16:16:16.237 INFO:tasks.workunit.client.0.smithi059.stdout:1/206: read - d7/d15/f2e zero size 2024-04-25T16:16:16.248 INFO:tasks.workunit.client.0.smithi059.stdout:1/207: chown d7/d2a/d36/c3e 1260 1 2024-04-25T16:16:16.292 INFO:tasks.workunit.client.0.smithi059.stdout:4/176: mknod d0/d4/c3f 0 2024-04-25T16:16:16.298 INFO:tasks.workunit.client.0.smithi059.stdout:3/191: dread - d0/f37 zero size 2024-04-25T16:16:16.483 INFO:tasks.workunit.client.0.smithi059.stdout:6/200: rename d9/d1b/f37 to d9/d16/d24/f3c 0 2024-04-25T16:16:16.696 INFO:tasks.workunit.client.0.smithi059.stdout:4/177: mknod d0/d4/df/d1c/c40 0 2024-04-25T16:16:16.706 INFO:tasks.workunit.client.0.smithi059.stdout:4/178: chown d0/d4/df/d1c 3848053 1 2024-04-25T16:16:16.778 INFO:tasks.workunit.client.0.smithi059.stdout:0/177: write dc/df/f16 [1832153,49477] 0 2024-04-25T16:16:16.812 INFO:tasks.workunit.client.0.smithi059.stdout:6/201: rmdir d9/d27 39 2024-04-25T16:16:16.873 INFO:tasks.workunit.client.0.smithi059.stdout:8/172: dwrite d7/fa [0,4194304] 0 2024-04-25T16:16:16.957 INFO:tasks.workunit.client.0.smithi059.stdout:5/200: creat d1/d1e/f41 x:0 0 0 2024-04-25T16:16:16.960 INFO:tasks.workunit.client.0.smithi059.stdout:8/173: chown d7/dd/c13 513339930 1 2024-04-25T16:16:17.015 INFO:tasks.workunit.client.0.smithi059.stdout:2/184: creat de/d16/f43 x:0 0 0 2024-04-25T16:16:17.121 INFO:tasks.workunit.client.0.smithi059.stdout:6/202: symlink d9/d16/d24/l3d 0 2024-04-25T16:16:17.125 INFO:tasks.workunit.client.0.smithi059.stdout:8/174: dread d7/f26 [0,4194304] 0 2024-04-25T16:16:17.143 INFO:tasks.workunit.client.0.smithi059.stdout:9/199: getdents d6/d35/d2f 0 2024-04-25T16:16:17.205 INFO:tasks.workunit.client.0.smithi059.stdout:5/201: mkdir d1/d1e/d21/d42 0 2024-04-25T16:16:17.389 INFO:tasks.workunit.client.0.smithi059.stdout:3/192: write d0/f7 [1457011,23828] 0 2024-04-25T16:16:17.548 INFO:tasks.workunit.client.0.smithi059.stdout:8/175: mkdir d7/d16/d36 0 2024-04-25T16:16:17.556 INFO:tasks.workunit.client.0.smithi059.stdout:9/200: creat d6/d35/d36/f38 x:0 0 0 2024-04-25T16:16:17.580 INFO:tasks.workunit.client.0.smithi059.stdout:7/172: link d0/d7/c19 d0/c37 0 2024-04-25T16:16:17.587 INFO:tasks.workunit.client.0.smithi059.stdout:1/208: write d7/f28 [1313997,31394] 0 2024-04-25T16:16:17.711 INFO:tasks.workunit.client.0.smithi059.stdout:7/173: sync 2024-04-25T16:16:17.711 INFO:tasks.workunit.client.0.smithi059.stdout:4/179: dwrite d0/d4/df/d18/f2d [0,4194304] 0 2024-04-25T16:16:17.776 INFO:tasks.workunit.client.0.smithi059.stdout:3/193: rename d0/d22 to d0/db/d47 0 2024-04-25T16:16:17.814 INFO:tasks.workunit.client.0.smithi059.stdout:4/180: write d0/d4/df/d18/f2d [637950,77155] 0 2024-04-25T16:16:18.042 INFO:tasks.workunit.client.0.smithi059.stdout:6/203: write d9/f21 [3347575,109759] 0 2024-04-25T16:16:18.061 INFO:tasks.workunit.client.0.smithi059.stdout:8/176: mkdir d7/dd/d17/d23/d37 0 2024-04-25T16:16:18.087 INFO:tasks.workunit.client.0.smithi059.stdout:0/178: link dc/f2a dc/dd/f3c 0 2024-04-25T16:16:18.109 INFO:tasks.workunit.client.0.smithi059.stdout:7/174: dread - d0/d7/d16/f2a zero size 2024-04-25T16:16:18.141 INFO:tasks.workunit.client.0.smithi059.stdout:0/179: read f9 [1033500,82260] 0 2024-04-25T16:16:18.174 INFO:tasks.workunit.client.0.smithi059.stdout:0/180: chown dc/df 12931 1 2024-04-25T16:16:18.203 INFO:tasks.workunit.client.0.smithi059.stdout:2/185: dwrite f1 [0,4194304] 0 2024-04-25T16:16:18.546 INFO:tasks.workunit.client.0.smithi059.stdout:5/202: getdents d1 0 2024-04-25T16:16:18.553 INFO:tasks.workunit.client.0.smithi059.stdout:7/175: mkdir d0/d7/d16/d38 0 2024-04-25T16:16:18.592 INFO:tasks.workunit.client.0.smithi059.stdout:8/177: read d7/dd/d17/f1a [832415,73876] 0 2024-04-25T16:16:18.670 INFO:tasks.workunit.client.0.smithi059.stdout:4/181: dwrite d0/f26 [0,4194304] 0 2024-04-25T16:16:18.745 INFO:tasks.workunit.client.0.smithi059.stdout:2/186: truncate de/d2a/d2e/d36/f26 1489165 0 2024-04-25T16:16:18.798 INFO:tasks.workunit.client.0.smithi059.stdout:1/209: creat d7/d13/f45 x:0 0 0 2024-04-25T16:16:18.893 INFO:tasks.workunit.client.0.smithi059.stdout:1/210: chown d7/c1c 12 1 2024-04-25T16:16:18.955 INFO:tasks.workunit.client.0.smithi059.stdout:6/204: symlink d9/d16/l3e 0 2024-04-25T16:16:18.981 INFO:tasks.workunit.client.0.smithi059.stdout:3/194: dwrite d0/d1e/f1f [0,4194304] 0 2024-04-25T16:16:18.988 INFO:tasks.workunit.client.0.smithi059.stdout:7/176: creat d0/d7/d16/d20/d2b/d33/f39 x:0 0 0 2024-04-25T16:16:19.067 INFO:tasks.workunit.client.0.smithi059.stdout:9/201: dwrite d6/d35/d26/f33 [0,4194304] 0 2024-04-25T16:16:19.137 INFO:tasks.workunit.client.0.smithi059.stdout:0/181: mknod dc/dd/d3b/c3d 0 2024-04-25T16:16:19.180 INFO:tasks.workunit.client.0.smithi059.stdout:4/182: dread - d0/d4/df/f3a zero size 2024-04-25T16:16:19.207 INFO:tasks.workunit.client.0.smithi059.stdout:4/183: readlink d0/l1a 0 2024-04-25T16:16:19.311 INFO:tasks.workunit.client.0.smithi059.stdout:8/178: write d7/f20 [2287629,71839] 0 2024-04-25T16:16:19.471 INFO:tasks.workunit.client.0.smithi059.stdout:5/203: rename d1/d1e/d27/c3a to d1/d1e/d21/c43 0 2024-04-25T16:16:19.587 INFO:tasks.workunit.client.0.smithi059.stdout:1/211: fsync d7/d13/d2d/f40 0 2024-04-25T16:16:19.589 INFO:tasks.workunit.client.0.smithi059.stdout:2/187: truncate de/d2a/d2e/d36/f28 588149 0 2024-04-25T16:16:19.601 INFO:tasks.workunit.client.0.smithi059.stdout:3/195: creat d0/db/d47/f48 x:0 0 0 2024-04-25T16:16:19.617 INFO:tasks.workunit.client.0.smithi059.stdout:6/205: creat d9/d16/d24/f3f x:0 0 0 2024-04-25T16:16:19.638 INFO:tasks.workunit.client.0.smithi059.stdout:0/182: truncate dc/df/d24/f25 7016073 0 2024-04-25T16:16:19.827 INFO:tasks.workunit.client.0.smithi059.stdout:8/179: mkdir d7/dd/d17/d23/d38 0 2024-04-25T16:16:20.283 INFO:tasks.workunit.client.0.smithi059.stdout:5/204: mkdir d1/d1e/d21/d3d/d44 0 2024-04-25T16:16:20.595 INFO:tasks.workunit.client.0.smithi059.stdout:4/184: truncate d0/d4/df/f19 2233615 0 2024-04-25T16:16:20.610 INFO:tasks.workunit.client.0.smithi059.stdout:4/185: dread - d0/d4/df/f3a zero size 2024-04-25T16:16:20.670 INFO:tasks.workunit.client.0.smithi059.stdout:7/177: rename d0/c1a to d0/d7/d16/d38/c3a 0 2024-04-25T16:16:20.700 INFO:tasks.workunit.client.0.smithi059.stdout:5/205: symlink d1/d1e/d21/d3d/l45 0 2024-04-25T16:16:20.934 INFO:tasks.workunit.client.0.smithi059.stdout:3/196: mkdir d0/db/d3f/d49 0 2024-04-25T16:16:20.996 INFO:tasks.workunit.client.0.smithi059.stdout:3/197: dread d0/d1e/f1f [0,4194304] 0 2024-04-25T16:16:21.122 INFO:tasks.workunit.client.0.smithi059.stdout:5/206: creat d1/dd/f46 x:0 0 0 2024-04-25T16:16:21.285 INFO:tasks.workunit.client.0.smithi059.stdout:9/202: getdents d6/d35/d26 0 2024-04-25T16:16:21.292 INFO:tasks.workunit.client.0.smithi059.stdout:6/206: creat d9/f40 x:0 0 0 2024-04-25T16:16:21.403 INFO:tasks.workunit.client.0.smithi059.stdout:8/180: rmdir d7/d2f/d35 0 2024-04-25T16:16:21.403 INFO:tasks.workunit.client.0.smithi059.stdout:3/198: stat d0/l8 0 2024-04-25T16:16:21.488 INFO:tasks.workunit.client.0.smithi059.stdout:7/178: link d0/d7/d16/d20/d2b/d33/f39 d0/d7/d16/d20/d2b/d33/f3b 0 2024-04-25T16:16:21.637 INFO:tasks.workunit.client.0.smithi059.stdout:1/212: dwrite d7/d13/d16/f24 [0,4194304] 0 2024-04-25T16:16:21.722 INFO:tasks.workunit.client.0.smithi059.stdout:9/203: mkdir d6/d35/d2f/d39 0 2024-04-25T16:16:21.753 INFO:tasks.workunit.client.0.smithi059.stdout:3/199: mknod d0/db/c4a 0 2024-04-25T16:16:21.806 INFO:tasks.workunit.client.0.smithi059.stdout:9/204: read - d6/d35/d26/f2d zero size 2024-04-25T16:16:21.845 INFO:tasks.workunit.client.0.smithi059.stdout:0/183: dwrite fa [0,4194304] 0 2024-04-25T16:16:21.900 INFO:tasks.workunit.client.0.smithi059.stdout:9/205: read - d6/d35/d36/f38 zero size 2024-04-25T16:16:22.006 INFO:tasks.workunit.client.0.smithi059.stdout:1/213: rename d7/d13/d16/f1e to d7/d13/d16/f46 0 2024-04-25T16:16:22.013 INFO:tasks.workunit.client.0.smithi059.stdout:0/184: dwrite dc/df/f16 [0,4194304] 0 2024-04-25T16:16:22.097 INFO:tasks.workunit.client.0.smithi059.stdout:2/188: write de/d16/f19 [280580,78934] 0 2024-04-25T16:16:22.097 INFO:tasks.workunit.client.0.smithi059.stdout:6/207: dread - d9/d27/f34 zero size 2024-04-25T16:16:22.118 INFO:tasks.workunit.client.0.smithi059.stdout:3/200: creat d0/db/f4b x:0 0 0 2024-04-25T16:16:22.138 INFO:tasks.workunit.client.0.smithi059.stdout:4/186: write d0/d4/df/f3a [119949,73780] 0 2024-04-25T16:16:22.158 INFO:tasks.workunit.client.0.smithi059.stdout:0/185: chown dc/dd/d3b/c3d 309 1 2024-04-25T16:16:22.224 INFO:tasks.workunit.client.0.smithi059.stdout:1/214: symlink d7/d13/d2d/l47 0 2024-04-25T16:16:22.234 INFO:tasks.workunit.client.0.smithi059.stdout:1/215: dread - d7/d2a/f3d zero size 2024-04-25T16:16:22.270 INFO:tasks.workunit.client.0.smithi059.stdout:3/201: dread d0/f28 [0,4194304] 0 2024-04-25T16:16:22.278 INFO:tasks.workunit.client.0.smithi059.stdout:3/202: stat d0/db/f19 0 2024-04-25T16:16:22.295 INFO:tasks.workunit.client.0.smithi059.stdout:3/203: write d0/db/d47/f48 [264321,122369] 0 2024-04-25T16:16:22.365 INFO:tasks.workunit.client.0.smithi059.stdout:6/208: mknod d9/d16/d24/c41 0 2024-04-25T16:16:22.400 INFO:tasks.workunit.client.0.smithi059.stdout:0/186: readlink dc/l13 0 2024-04-25T16:16:22.434 INFO:tasks.workunit.client.0.smithi059.stdout:8/181: getdents d7/dd/d17 0 2024-04-25T16:16:22.449 INFO:tasks.workunit.client.0.smithi059.stdout:3/204: dwrite d0/db/f4b [0,4194304] 0 2024-04-25T16:16:22.547 INFO:tasks.workunit.client.0.smithi059.stdout:4/187: unlink d0/d4/df/c3b 0 2024-04-25T16:16:22.629 INFO:tasks.workunit.client.0.smithi059.stdout:2/189: symlink de/d2a/d2e/d36/d2c/l44 0 2024-04-25T16:16:22.694 INFO:tasks.workunit.client.0.smithi059.stdout:1/216: mknod d7/d2a/c48 0 2024-04-25T16:16:22.706 INFO:tasks.workunit.client.0.smithi059.stdout:1/217: stat d7/d13/d2d/f40 0 2024-04-25T16:16:22.712 INFO:tasks.workunit.client.0.smithi059.stdout:1/218: chown d7/c1c 843477 1 2024-04-25T16:16:22.826 INFO:tasks.workunit.client.0.smithi059.stdout:5/207: write d1/dd/f2c [902720,39941] 0 2024-04-25T16:16:22.836 INFO:tasks.workunit.client.0.smithi059.stdout:6/209: dread - d9/d27/f30 zero size 2024-04-25T16:16:22.942 INFO:tasks.workunit.client.0.smithi059.stdout:7/179: dwrite d0/d7/f1f [0,4194304] 0 2024-04-25T16:16:23.096 INFO:tasks.workunit.client.0.smithi059.stdout:0/187: mknod dc/df/d24/c3e 0 2024-04-25T16:16:23.113 INFO:tasks.workunit.client.0.smithi059.stdout:8/182: read d7/f15 [1191601,78307] 0 2024-04-25T16:16:23.165 INFO:tasks.workunit.client.0.smithi059.stdout:8/183: dread d7/f26 [0,4194304] 0 2024-04-25T16:16:23.418 INFO:tasks.workunit.client.0.smithi059.stdout:2/190: mknod de/d2a/c45 0 2024-04-25T16:16:23.425 INFO:tasks.workunit.client.0.smithi059.stdout:1/219: creat d7/d21/f49 x:0 0 0 2024-04-25T16:16:23.447 INFO:tasks.workunit.client.0.smithi059.stdout:5/208: creat d1/d1e/d21/f47 x:0 0 0 2024-04-25T16:16:23.448 INFO:tasks.workunit.client.0.smithi059.stdout:7/180: rmdir d0/d7/d16/d38 39 2024-04-25T16:16:23.449 INFO:tasks.workunit.client.0.smithi059.stdout:9/206: getdents d6/d35/d36 0 2024-04-25T16:16:23.473 INFO:tasks.workunit.client.0.smithi059.stdout:1/220: stat d7/d13/f1b 0 2024-04-25T16:16:23.513 INFO:tasks.workunit.client.0.smithi059.stdout:9/207: read - d6/d35/d28/f31 zero size 2024-04-25T16:16:23.515 INFO:tasks.workunit.client.0.smithi059.stdout:1/221: chown d7/c1c 56351 1 2024-04-25T16:16:23.701 INFO:tasks.workunit.client.0.smithi059.stdout:3/205: truncate d0/f7 322378 0 2024-04-25T16:16:23.707 INFO:tasks.workunit.client.0.smithi059.stdout:4/188: stat d0/d4/df/f19 0 2024-04-25T16:16:23.721 INFO:tasks.workunit.client.0.smithi059.stdout:8/184: write d7/f26 [388967,56879] 0 2024-04-25T16:16:23.723 INFO:tasks.workunit.client.0.smithi059.stdout:0/188: write dc/f3a [63876,111940] 0 2024-04-25T16:16:23.863 INFO:tasks.workunit.client.0.smithi059.stdout:4/189: dwrite d0/d4/df/f3a [0,4194304] 0 2024-04-25T16:16:23.932 INFO:tasks.workunit.client.0.smithi059.stdout:5/209: mkdir d1/d48 0 2024-04-25T16:16:23.973 INFO:tasks.workunit.client.0.smithi059.stdout:7/181: truncate d0/d7/f29 92706 0 2024-04-25T16:16:23.978 INFO:tasks.workunit.client.0.smithi059.stdout:9/208: symlink d6/d35/d36/l3a 0 2024-04-25T16:16:23.983 INFO:tasks.workunit.client.0.smithi059.stdout:6/210: rename d9/fd to d9/d16/f42 0 2024-04-25T16:16:24.032 INFO:tasks.workunit.client.0.smithi059.stdout:1/222: dread d7/f29 [0,4194304] 0 2024-04-25T16:16:24.117 INFO:tasks.workunit.client.0.smithi059.stdout:7/182: sync 2024-04-25T16:16:24.228 INFO:tasks.workunit.client.0.smithi059.stdout:2/191: rename de/d2a/c3b to de/d2a/d2e/d36/c46 0 2024-04-25T16:16:24.482 INFO:tasks.workunit.client.0.smithi059.stdout:3/206: write d0/d1e/f32 [1279190,107105] 0 2024-04-25T16:16:24.647 INFO:tasks.workunit.client.0.smithi059.stdout:8/185: dwrite d7/dd/ff [0,4194304] 0 2024-04-25T16:16:25.303 INFO:tasks.workunit.client.0.smithi059.stdout:4/190: creat d0/d4/df/f41 x:0 0 0 2024-04-25T16:16:25.322 INFO:tasks.workunit.client.0.smithi059.stdout:2/192: creat de/d2a/d2e/d36/d2c/d40/f47 x:0 0 0 2024-04-25T16:16:25.336 INFO:tasks.workunit.client.0.smithi059.stdout:5/210: fsync d1/d1e/f20 0 2024-04-25T16:16:25.342 INFO:tasks.workunit.client.0.smithi059.stdout:8/186: symlink d7/d2f/l39 0 2024-04-25T16:16:25.392 INFO:tasks.workunit.client.0.smithi059.stdout:4/191: sync 2024-04-25T16:16:25.398 INFO:tasks.workunit.client.0.smithi059.stdout:6/211: link d9/c12 d9/d16/d24/c43 0 2024-04-25T16:16:25.530 INFO:tasks.workunit.client.0.smithi059.stdout:0/189: dwrite dc/df/d28/f35 [0,4194304] 0 2024-04-25T16:16:25.535 INFO:tasks.workunit.client.0.smithi059.stdout:1/223: dwrite d7/d13/f1b [4194304,4194304] 0 2024-04-25T16:16:25.593 INFO:tasks.workunit.client.0.smithi059.stdout:5/211: stat d1/l7 0 2024-04-25T16:16:25.724 INFO:tasks.workunit.client.0.smithi059.stdout:8/187: dread d7/f20 [0,4194304] 0 2024-04-25T16:16:25.810 INFO:tasks.workunit.client.0.smithi059.stdout:2/193: mkdir de/d2a/d2e/d48 0 2024-04-25T16:16:25.814 INFO:tasks.workunit.client.0.smithi059.stdout:3/207: symlink d0/db/l4c 0 2024-04-25T16:16:25.837 INFO:tasks.workunit.client.0.smithi059.stdout:6/212: chown d9/d16/l2f 128289828 1 2024-04-25T16:16:26.500 INFO:tasks.workunit.client.0.smithi059.stdout:3/208: mknod d0/d1e/c4d 0 2024-04-25T16:16:26.509 INFO:tasks.workunit.client.0.smithi059.stdout:7/183: write d0/d7/d16/f1e [1506981,76535] 0 2024-04-25T16:16:26.563 INFO:tasks.workunit.client.0.smithi059.stdout:9/209: creat d6/d35/f3b x:0 0 0 2024-04-25T16:16:26.584 INFO:tasks.workunit.client.0.smithi059.stdout:6/213: read d9/d16/f42 [822176,97617] 0 2024-04-25T16:16:26.584 INFO:tasks.workunit.client.0.smithi059.stdout:8/188: dread d7/f1c [0,4194304] 0 2024-04-25T16:16:26.595 INFO:tasks.workunit.client.0.smithi059.stdout:3/209: chown d0/d1e/c43 95 1 2024-04-25T16:16:26.649 INFO:tasks.workunit.client.0.smithi059.stdout:2/194: dread de/d2a/d2e/d36/f26 [0,4194304] 0 2024-04-25T16:16:26.651 INFO:tasks.workunit.client.0.smithi059.stdout:3/210: readlink d0/d1e/d31/l34 0 2024-04-25T16:16:26.774 INFO:tasks.workunit.client.0.smithi059.stdout:4/192: creat d0/d4/df/f42 x:0 0 0 2024-04-25T16:16:26.873 INFO:tasks.workunit.client.0.smithi059.stdout:1/224: dwrite d7/d15/f34 [0,4194304] 0 2024-04-25T16:16:27.040 INFO:tasks.workunit.client.0.smithi059.stdout:6/214: fdatasync f6 0 2024-04-25T16:16:27.055 INFO:tasks.workunit.client.0.smithi059.stdout:9/210: creat d6/d35/d2f/f3c x:0 0 0 2024-04-25T16:16:27.059 INFO:tasks.workunit.client.0.smithi059.stdout:7/184: dread - d0/f30 zero size 2024-04-25T16:16:27.078 INFO:tasks.workunit.client.0.smithi059.stdout:2/195: creat de/d2a/d2e/d36/d2c/d40/f49 x:0 0 0 2024-04-25T16:16:27.091 INFO:tasks.workunit.client.0.smithi059.stdout:8/189: chown d7/dd/f31 1 1 2024-04-25T16:16:27.096 INFO:tasks.workunit.client.0.smithi059.stdout:3/211: dread - d0/db/d2d/f3c zero size 2024-04-25T16:16:27.103 INFO:tasks.workunit.client.0.smithi059.stdout:4/193: symlink d0/d4/l43 0 2024-04-25T16:16:27.112 INFO:tasks.workunit.client.0.smithi059.stdout:1/225: mkdir d7/d13/d2d/d4a 0 2024-04-25T16:16:27.160 INFO:tasks.workunit.client.0.smithi059.stdout:3/212: read - d0/db/d2d/f3c zero size 2024-04-25T16:16:27.178 INFO:tasks.workunit.client.0.smithi059.stdout:3/213: dread d0/f28 [0,4194304] 0 2024-04-25T16:16:27.287 INFO:tasks.workunit.client.0.smithi059.stdout:3/214: dwrite d0/d1e/f1f [4194304,4194304] 0 2024-04-25T16:16:27.424 INFO:tasks.workunit.client.0.smithi059.stdout:5/212: creat d1/f49 x:0 0 0 2024-04-25T16:16:27.476 INFO:tasks.workunit.client.0.smithi059.stdout:7/185: rmdir d0/d7/d16/d20/d2b/d33 39 2024-04-25T16:16:27.482 INFO:tasks.workunit.client.0.smithi059.stdout:4/194: fsync d0/d4/df/f14 0 2024-04-25T16:16:27.518 INFO:tasks.workunit.client.0.smithi059.stdout:3/215: creat d0/db/d2d/f4e x:0 0 0 2024-04-25T16:16:27.596 INFO:tasks.workunit.client.0.smithi059.stdout:0/190: dwrite dc/f1f [4194304,4194304] 0 2024-04-25T16:16:27.715 INFO:tasks.workunit.client.0.smithi059.stdout:8/190: write d7/fa [4350388,66087] 0 2024-04-25T16:16:28.001 INFO:tasks.workunit.client.0.smithi059.stdout:6/215: rename d9/c12 to d9/d16/d24/c44 0 2024-04-25T16:16:28.012 INFO:tasks.workunit.client.0.smithi059.stdout:5/213: stat d1/c2a 0 2024-04-25T16:16:28.019 INFO:tasks.workunit.client.0.smithi059.stdout:3/216: symlink d0/db/l4f 0 2024-04-25T16:16:28.053 INFO:tasks.workunit.client.0.smithi059.stdout:7/186: dread d0/f27 [0,4194304] 0 2024-04-25T16:16:28.213 INFO:tasks.workunit.client.0.smithi059.stdout:8/191: stat d7/l25 0 2024-04-25T16:16:28.328 INFO:tasks.workunit.client.0.smithi059.stdout:2/196: dwrite f4 [0,4194304] 0 2024-04-25T16:16:28.394 INFO:tasks.workunit.client.0.smithi059.stdout:2/197: stat de/d2a/d2e/d36/c42 0 2024-04-25T16:16:28.406 INFO:tasks.workunit.client.0.smithi059.stdout:0/191: rename lb to dc/df/l3f 0 2024-04-25T16:16:28.406 INFO:tasks.workunit.client.0.smithi059.stdout:4/195: mkdir d0/d4/df/d44 0 2024-04-25T16:16:28.488 INFO:tasks.workunit.client.0.smithi059.stdout:2/198: dread f4 [0,4194304] 0 2024-04-25T16:16:28.526 INFO:tasks.workunit.client.0.smithi059.stdout:6/216: unlink d9/d27/l3b 0 2024-04-25T16:16:28.539 INFO:tasks.workunit.client.0.smithi059.stdout:7/187: fsync d0/d7/d16/d20/d2b/f2e 0 2024-04-25T16:16:28.557 INFO:tasks.workunit.client.0.smithi059.stdout:9/211: link c3 d6/d35/c3d 0 2024-04-25T16:16:28.566 INFO:tasks.workunit.client.0.smithi059.stdout:8/192: mkdir d7/d16/d3a 0 2024-04-25T16:16:28.567 INFO:tasks.workunit.client.0.smithi059.stdout:1/226: getdents d7/d21 0 2024-04-25T16:16:28.573 INFO:tasks.workunit.client.0.smithi059.stdout:5/214: dread - d1/d1e/d21/f47 zero size 2024-04-25T16:16:28.627 INFO:tasks.workunit.client.0.smithi059.stdout:7/188: read - d0/d7/d16/d20/d2b/f2e zero size 2024-04-25T16:16:28.629 INFO:tasks.workunit.client.0.smithi059.stdout:9/212: write d6/d35/f3b [843689,95990] 0 2024-04-25T16:16:28.630 INFO:tasks.workunit.client.0.smithi059.stdout:1/227: chown d7/d15/f2e 5 1 2024-04-25T16:16:28.651 INFO:tasks.workunit.client.0.smithi059.stdout:1/228: stat l5 0 2024-04-25T16:16:28.676 INFO:tasks.workunit.client.0.smithi059.stdout:0/192: write dc/df/f16 [205581,33474] 0 2024-04-25T16:16:28.736 INFO:tasks.workunit.client.0.smithi059.stdout:4/196: rename d0/d4/df/d18 to d0/d4/df/d1c/d45 0 2024-04-25T16:16:28.789 INFO:tasks.workunit.client.0.smithi059.stdout:2/199: fsync de/f2d 0 2024-04-25T16:16:29.071 INFO:tasks.workunit.client.0.smithi059.stdout:6/217: fsync d9/d16/f1f 0 2024-04-25T16:16:29.102 INFO:tasks.workunit.client.0.smithi059.stdout:9/213: creat d6/d35/d28/f3e x:0 0 0 2024-04-25T16:16:29.184 INFO:tasks.workunit.client.0.smithi059.stdout:6/218: sync 2024-04-25T16:16:29.345 INFO:tasks.workunit.client.0.smithi059.stdout:3/217: dwrite d0/db/d47/f2e [0,4194304] 0 2024-04-25T16:16:29.453 INFO:tasks.workunit.client.0.smithi059.stdout:9/214: unlink d6/l16 0 2024-04-25T16:16:29.578 INFO:tasks.workunit.client.0.smithi059.stdout:1/229: creat d7/d13/d2d/d4a/f4b x:0 0 0 2024-04-25T16:16:29.867 INFO:tasks.workunit.client.0.smithi059.stdout:7/189: creat d0/f3c x:0 0 0 2024-04-25T16:16:30.085 INFO:tasks.workunit.client.0.smithi059.stdout:1/230: readlink d7/d2a/l3a 0 2024-04-25T16:16:30.150 INFO:tasks.workunit.client.0.smithi059.stdout:5/215: getdents d1 0 2024-04-25T16:16:30.175 INFO:tasks.workunit.client.0.smithi059.stdout:8/193: dwrite d7/f15 [0,4194304] 0 2024-04-25T16:16:30.297 INFO:tasks.workunit.client.0.smithi059.stdout:9/215: dwrite d6/d35/f29 [0,4194304] 0 2024-04-25T16:16:30.370 INFO:tasks.workunit.client.0.smithi059.stdout:2/200: write de/d2a/d33/f41 [1047114,18673] 0 2024-04-25T16:16:30.446 INFO:tasks.workunit.client.0.smithi059.stdout:6/219: write d9/d16/d24/f2b [559223,122817] 0 2024-04-25T16:16:30.479 INFO:tasks.workunit.client.0.smithi059.stdout:7/190: dread - d0/d7/d16/d20/d2b/d33/f39 zero size 2024-04-25T16:16:30.574 INFO:tasks.workunit.client.0.smithi059.stdout:4/197: dwrite d0/d4/df/d1c/f37 [0,4194304] 0 2024-04-25T16:16:30.694 INFO:tasks.workunit.client.0.smithi059.stdout:5/216: dread d1/f1c [0,4194304] 0 2024-04-25T16:16:30.760 INFO:tasks.workunit.client.0.smithi059.stdout:0/193: write dc/df/f10 [6165012,85599] 0 2024-04-25T16:16:30.838 INFO:tasks.workunit.client.0.smithi059.stdout:3/218: getdents d0/db 0 2024-04-25T16:16:30.908 INFO:tasks.workunit.client.0.smithi059.stdout:4/198: dwrite d0/d4/df/f42 [0,4194304] 0 2024-04-25T16:16:30.992 INFO:tasks.workunit.client.0.smithi059.stdout:4/199: read d0/d4/df/f42 [1420324,78546] 0 2024-04-25T16:16:31.047 INFO:tasks.workunit.client.0.smithi059.stdout:7/191: unlink d0/d7/c2d 0 2024-04-25T16:16:31.119 INFO:tasks.workunit.client.0.smithi059.stdout:6/220: symlink d9/d16/d24/l45 0 2024-04-25T16:16:31.354 INFO:tasks.workunit.client.0.smithi059.stdout:1/231: rename d7/d21/l38 to d7/d2a/l4c 0 2024-04-25T16:16:31.412 INFO:tasks.workunit.client.0.smithi059.stdout:0/194: chown dc/l18 368405 1 2024-04-25T16:16:31.549 INFO:tasks.workunit.client.0.smithi059.stdout:3/219: mknod d0/d1e/d31/c50 0 2024-04-25T16:16:31.599 INFO:tasks.workunit.client.0.smithi059.stdout:2/201: write de/d16/f22 [4832114,48694] 0 2024-04-25T16:16:31.662 INFO:tasks.workunit.client.0.smithi059.stdout:2/202: dread de/f2d [0,4194304] 0 2024-04-25T16:16:31.696 INFO:tasks.workunit.client.0.smithi059.stdout:4/200: truncate d0/d4/f20 1699333 0 2024-04-25T16:16:31.709 INFO:tasks.workunit.client.0.smithi059.stdout:4/201: read d0/fc [770934,44103] 0 2024-04-25T16:16:31.722 INFO:tasks.workunit.client.0.smithi059.stdout:4/202: chown d0/d4/df/f19 1 1 2024-04-25T16:16:31.751 INFO:tasks.workunit.client.0.smithi059.stdout:4/203: readlink d0/d4/df/d1c/d45/l1d 0 2024-04-25T16:16:31.848 INFO:tasks.workunit.client.0.smithi059.stdout:5/217: getdents d1/d48 0 2024-04-25T16:16:32.019 INFO:tasks.workunit.client.0.smithi059.stdout:9/216: link f2 d6/d35/d36/f3f 0 2024-04-25T16:16:32.140 INFO:tasks.workunit.client.0.smithi059.stdout:8/194: truncate d7/f15 224240 0 2024-04-25T16:16:32.409 INFO:tasks.workunit.client.0.smithi059.stdout:5/218: truncate d1/d1e/f41 655865 0 2024-04-25T16:16:32.418 INFO:tasks.workunit.client.0.smithi059.stdout:6/221: write d9/d16/d24/f32 [148301,41866] 0 2024-04-25T16:16:32.423 INFO:tasks.workunit.client.0.smithi059.stdout:3/220: symlink d0/db/d3f/d49/l51 0 2024-04-25T16:16:32.440 INFO:tasks.workunit.client.0.smithi059.stdout:1/232: write d7/d13/d16/f24 [4107773,127048] 0 2024-04-25T16:16:32.511 INFO:tasks.workunit.client.0.smithi059.stdout:0/195: dwrite dc/df/d28/f35 [0,4194304] 0 2024-04-25T16:16:32.639 INFO:tasks.workunit.client.0.smithi059.stdout:7/192: dwrite d0/fd [0,4194304] 0 2024-04-25T16:16:32.773 INFO:tasks.workunit.client.0.smithi059.stdout:3/221: rmdir d0 39 2024-04-25T16:16:32.847 INFO:tasks.workunit.client.0.smithi059.stdout:9/217: write d6/d35/d26/f2d [305911,113623] 0 2024-04-25T16:16:32.851 INFO:tasks.workunit.client.0.smithi059.stdout:0/196: truncate dc/f2d 125993 0 2024-04-25T16:16:32.858 INFO:tasks.workunit.client.0.smithi059.stdout:7/193: truncate d0/d7/d16/d20/f35 191028 0 2024-04-25T16:16:32.954 INFO:tasks.workunit.client.0.smithi059.stdout:9/218: chown d6/d35/d28 3591867 1 2024-04-25T16:16:33.006 INFO:tasks.workunit.client.0.smithi059.stdout:1/233: write d7/f22 [4794629,103295] 0 2024-04-25T16:16:33.038 INFO:tasks.workunit.client.0.smithi059.stdout:2/203: dwrite de/f1d [0,4194304] 0 2024-04-25T16:16:33.128 INFO:tasks.workunit.client.0.smithi059.stdout:4/204: dwrite d0/d4/df/f41 [0,4194304] 0 2024-04-25T16:16:33.144 INFO:tasks.workunit.client.0.smithi059.stdout:1/234: chown d7/d15 56224342 1 2024-04-25T16:16:33.294 INFO:tasks.workunit.client.0.smithi059.stdout:0/197: truncate dc/df/f1d 1857325 0 2024-04-25T16:16:33.322 INFO:tasks.workunit.client.0.smithi059.stdout:5/219: dwrite d1/dd/ff [0,4194304] 0 2024-04-25T16:16:33.460 INFO:tasks.workunit.client.0.smithi059.stdout:0/198: readlink dc/l1b 0 2024-04-25T16:16:33.648 INFO:tasks.workunit.client.0.smithi059.stdout:6/222: write d9/fe [1878103,27142] 0 2024-04-25T16:16:33.652 INFO:tasks.workunit.client.0.smithi059.stdout:1/235: dread d7/d13/d16/f24 [0,4194304] 0 2024-04-25T16:16:33.688 INFO:tasks.workunit.client.0.smithi059.stdout:8/195: dwrite d7/f15 [0,4194304] 0 2024-04-25T16:16:33.813 INFO:tasks.workunit.client.0.smithi059.stdout:2/204: dread de/d2a/d2e/f3f [0,4194304] 0 2024-04-25T16:16:33.829 INFO:tasks.workunit.client.0.smithi059.stdout:0/199: symlink dc/df/l40 0 2024-04-25T16:16:33.882 INFO:tasks.workunit.client.0.smithi059.stdout:9/219: getdents d6/d35/d28 0 2024-04-25T16:16:33.910 INFO:tasks.workunit.client.0.smithi059.stdout:3/222: dread d0/db/f20 [0,4194304] 0 2024-04-25T16:16:33.917 INFO:tasks.workunit.client.0.smithi059.stdout:0/200: chown dc/c33 14557098 1 2024-04-25T16:16:33.946 INFO:tasks.workunit.client.0.smithi059.stdout:8/196: chown d7/d2f/l30 0 1 2024-04-25T16:16:33.967 INFO:tasks.workunit.client.0.smithi059.stdout:4/205: rename d0/d4/f20 to d0/d4/df/d44/f46 0 2024-04-25T16:16:34.006 INFO:tasks.workunit.client.0.smithi059.stdout:0/201: chown dc/l13 80 1 2024-04-25T16:16:34.008 INFO:tasks.workunit.client.0.smithi059.stdout:7/194: dwrite d0/d7/f28 [0,4194304] 0 2024-04-25T16:16:34.107 INFO:tasks.workunit.client.0.smithi059.stdout:4/206: write d0/d4/df/d1c/f37 [2075049,130026] 0 2024-04-25T16:16:34.142 INFO:tasks.workunit.client.0.smithi059.stdout:6/223: mknod d9/d27/c46 0 2024-04-25T16:16:34.184 INFO:tasks.workunit.client.0.smithi059.stdout:9/220: read f2 [1227961,3098] 0 2024-04-25T16:16:34.191 INFO:tasks.workunit.client.0.smithi059.stdout:1/236: dread d7/d13/f20 [0,4194304] 0 2024-04-25T16:16:34.205 INFO:tasks.workunit.client.0.smithi059.stdout:9/221: chown d6/l14 99086 1 2024-04-25T16:16:34.301 INFO:tasks.workunit.client.0.smithi059.stdout:7/195: symlink d0/d7/d16/d20/l3d 0 2024-04-25T16:16:34.470 INFO:tasks.workunit.client.0.smithi059.stdout:1/237: mkdir d7/d13/d2d/d4a/d4d 0 2024-04-25T16:16:34.476 INFO:tasks.workunit.client.0.smithi059.stdout:9/222: creat d6/d35/d28/f40 x:0 0 0 2024-04-25T16:16:34.579 INFO:tasks.workunit.client.0.smithi059.stdout:5/220: getdents d1/d1e/d21/d3d 0 2024-04-25T16:16:34.677 INFO:tasks.workunit.client.0.smithi059.stdout:3/223: dwrite d0/db/f1c [0,4194304] 0 2024-04-25T16:16:34.764 INFO:tasks.workunit.client.0.smithi059.stdout:9/223: mknod d6/d35/d26/c41 0 2024-04-25T16:16:34.768 INFO:tasks.workunit.client.0.smithi059.stdout:0/202: link dc/df/d24/c3e dc/df/d24/c41 0 2024-04-25T16:16:34.768 INFO:tasks.workunit.client.0.smithi059.stdout:1/238: dread - d7/d13/f45 zero size 2024-04-25T16:16:34.780 INFO:tasks.workunit.client.0.smithi059.stdout:6/224: write f8 [3957741,7760] 0 2024-04-25T16:16:34.801 INFO:tasks.workunit.client.0.smithi059.stdout:9/224: stat d6/f18 0 2024-04-25T16:16:35.067 INFO:tasks.workunit.client.0.smithi059.stdout:2/205: rename de/l11 to de/d16/l4a 0 2024-04-25T16:16:35.081 INFO:tasks.workunit.client.0.smithi059.stdout:8/197: rename d7/dd/d17/d23/d38 to d7/dd/d17/d23/d38/d3b 22 2024-04-25T16:16:35.104 INFO:tasks.workunit.client.0.smithi059.stdout:8/198: readlink d7/l1d 0 2024-04-25T16:16:35.108 INFO:tasks.workunit.client.0.smithi059.stdout:4/207: dwrite d0/d4/df/d1c/d45/f2d [0,4194304] 0 2024-04-25T16:16:35.196 INFO:tasks.workunit.client.0.smithi059.stdout:4/208: chown d0/d4/df/f19 254 1 2024-04-25T16:16:35.368 INFO:tasks.workunit.client.0.smithi059.stdout:7/196: dwrite d0/d7/d16/f2a [0,4194304] 0 2024-04-25T16:16:35.433 INFO:tasks.workunit.client.0.smithi059.stdout:7/197: readlink d0/d7/d16/l2f 0 2024-04-25T16:16:35.661 INFO:tasks.workunit.client.0.smithi059.stdout:6/225: unlink d9/d16/c1e 0 2024-04-25T16:16:35.675 INFO:tasks.workunit.client.0.smithi059.stdout:0/203: creat dc/df/d24/f42 x:0 0 0 2024-04-25T16:16:35.676 INFO:tasks.workunit.client.0.smithi059.stdout:5/221: creat d1/d1e/d21/d3d/d44/f4a x:0 0 0 2024-04-25T16:16:35.725 INFO:tasks.workunit.client.0.smithi059.stdout:2/206: symlink de/d2a/d2e/d36/l4b 0 2024-04-25T16:16:35.959 INFO:tasks.workunit.client.0.smithi059.stdout:7/198: rename d0/d7/d16/l24 to d0/d7/d16/d20/l3e 0 2024-04-25T16:16:35.961 INFO:tasks.workunit.client.0.smithi059.stdout:3/224: dwrite d0/db/f4b [0,4194304] 0 2024-04-25T16:16:36.153 INFO:tasks.workunit.client.0.smithi059.stdout:2/207: rmdir de/d2a 39 2024-04-25T16:16:36.179 INFO:tasks.workunit.client.0.smithi059.stdout:1/239: write d7/d21/f23 [914227,66942] 0 2024-04-25T16:16:36.462 INFO:tasks.workunit.client.0.smithi059.stdout:0/204: rename dc/l18 to dc/d37/l43 0 2024-04-25T16:16:36.497 INFO:tasks.workunit.client.0.smithi059.stdout:0/205: write dc/df/d28/f35 [3049745,125770] 0 2024-04-25T16:16:36.827 INFO:tasks.workunit.client.0.smithi059.stdout:3/225: truncate d0/f6 2916156 0 2024-04-25T16:16:36.832 INFO:tasks.workunit.client.0.smithi059.stdout:9/225: symlink d6/l42 0 2024-04-25T16:16:36.859 INFO:tasks.workunit.client.0.smithi059.stdout:9/226: readlink d6/l1e 0 2024-04-25T16:16:36.866 INFO:tasks.workunit.client.0.smithi059.stdout:8/199: write d7/dd/f31 [3080902,102643] 0 2024-04-25T16:16:36.976 INFO:tasks.workunit.client.0.smithi059.stdout:2/208: dread de/d2a/d2e/d36/f28 [0,4194304] 0 2024-04-25T16:16:36.984 INFO:tasks.workunit.client.0.smithi059.stdout:3/226: sync 2024-04-25T16:16:37.061 INFO:tasks.workunit.client.0.smithi059.stdout:0/206: dread dc/f1f [0,4194304] 0 2024-04-25T16:16:37.101 INFO:tasks.workunit.client.0.smithi059.stdout:4/209: dwrite d0/f26 [0,4194304] 0 2024-04-25T16:16:37.170 INFO:tasks.workunit.client.0.smithi059.stdout:7/199: unlink d0/d7/l17 0 2024-04-25T16:16:37.174 INFO:tasks.workunit.client.0.smithi059.stdout:5/222: write d1/fa [3076644,47555] 0 2024-04-25T16:16:37.214 INFO:tasks.workunit.client.0.smithi059.stdout:6/226: write d9/d16/f22 [2007211,18271] 0 2024-04-25T16:16:37.277 INFO:tasks.workunit.client.0.smithi059.stdout:6/227: fsync f8 0 2024-04-25T16:16:37.292 INFO:tasks.workunit.client.0.smithi059.stdout:8/200: creat d7/dd/f3c x:0 0 0 2024-04-25T16:16:37.321 INFO:tasks.workunit.client.0.smithi059.stdout:2/209: truncate de/d2a/d2e/f3f 3718695 0 2024-04-25T16:16:37.353 INFO:tasks.workunit.client.0.smithi059.stdout:3/227: dread d0/db/f1c [0,4194304] 0 2024-04-25T16:16:37.395 INFO:tasks.workunit.client.0.smithi059.stdout:8/201: chown d7/d2f/l39 5323346 1 2024-04-25T16:16:37.410 INFO:tasks.workunit.client.0.smithi059.stdout:6/228: chown d9/d1b/f36 3229 1 2024-04-25T16:16:37.472 INFO:tasks.workunit.client.0.smithi059.stdout:2/210: chown de/d2a/d2e/d36/f25 2 1 2024-04-25T16:16:37.476 INFO:tasks.workunit.client.0.smithi059.stdout:1/240: dwrite d7/d15/f2e [0,4194304] 0 2024-04-25T16:16:37.562 INFO:tasks.workunit.client.0.smithi059.stdout:2/211: chown de/d2a/d2e/d36/d2c/l44 56 1 2024-04-25T16:16:37.618 INFO:tasks.workunit.client.0.smithi059.stdout:2/212: sync 2024-04-25T16:16:37.693 INFO:tasks.workunit.client.0.smithi059.stdout:2/213: sync 2024-04-25T16:16:37.750 INFO:tasks.workunit.client.0.smithi059.stdout:2/214: sync 2024-04-25T16:16:37.757 INFO:tasks.workunit.client.0.smithi059.stdout:2/215: stat de/d2a/c45 0 2024-04-25T16:16:37.895 INFO:tasks.workunit.client.0.smithi059.stdout:0/207: write dc/df/d24/f39 [3533525,48126] 0 2024-04-25T16:16:37.925 INFO:tasks.workunit.client.0.smithi059.stdout:4/210: rename d0/d4/df/c3e to d0/d4/df/d44/c47 0 2024-04-25T16:16:37.933 INFO:tasks.workunit.client.0.smithi059.stdout:5/223: write d1/f8 [4283181,30577] 0 2024-04-25T16:16:37.945 INFO:tasks.workunit.client.0.smithi059.stdout:9/227: creat d6/f43 x:0 0 0 2024-04-25T16:16:37.992 INFO:tasks.workunit.client.0.smithi059.stdout:3/228: fdatasync d0/fa 0 2024-04-25T16:16:38.004 INFO:tasks.workunit.client.0.smithi059.stdout:0/208: chown dc/df/c17 34397095 1 2024-04-25T16:16:38.005 INFO:tasks.workunit.client.0.smithi059.stdout:6/229: mknod d9/d27/c47 0 2024-04-25T16:16:38.063 INFO:tasks.workunit.client.0.smithi059.stdout:9/228: chown d6/ca 26720 1 2024-04-25T16:16:38.172 INFO:tasks.workunit.client.0.smithi059.stdout:7/200: dwrite d0/d7/fa [4194304,4194304] 0 2024-04-25T16:16:38.254 INFO:tasks.workunit.client.0.smithi059.stdout:2/216: rename de/d2a/d2e/d36/f26 to de/d2a/f4c 0 2024-04-25T16:16:38.290 INFO:tasks.workunit.client.0.smithi059.stdout:5/224: unlink d1/ce 0 2024-04-25T16:16:38.379 INFO:tasks.workunit.client.0.smithi059.stdout:3/229: creat d0/d1e/f52 x:0 0 0 2024-04-25T16:16:38.445 INFO:tasks.workunit.client.0.smithi059.stdout:8/202: dwrite d7/f20 [0,4194304] 0 2024-04-25T16:16:38.445 INFO:tasks.workunit.client.0.smithi059.stdout:6/230: creat d9/d1b/f48 x:0 0 0 2024-04-25T16:16:38.451 INFO:tasks.workunit.client.0.smithi059.stdout:3/230: sync 2024-04-25T16:16:38.454 INFO:tasks.workunit.client.0.smithi059.stdout:1/241: dwrite d7/f28 [0,4194304] 0 2024-04-25T16:16:38.604 INFO:tasks.workunit.client.0.smithi059.stdout:4/211: write d0/d4/df/f12 [4128262,22388] 0 2024-04-25T16:16:38.712 INFO:tasks.workunit.client.0.smithi059.stdout:2/217: chown de/d2a/c38 0 1 2024-04-25T16:16:38.714 INFO:tasks.workunit.client.0.smithi059.stdout:0/209: dread f6 [4194304,4194304] 0 2024-04-25T16:16:38.719 INFO:tasks.workunit.client.0.smithi059.stdout:5/225: rename d1/dd/f2c to d1/d1e/d21/d24/f4b 0 2024-04-25T16:16:38.720 INFO:tasks.workunit.client.0.smithi059.stdout:3/231: chown d0/db/d2d/f38 11685532 1 2024-04-25T16:16:38.866 INFO:tasks.workunit.client.0.smithi059.stdout:7/201: mkdir d0/d3f 0 2024-04-25T16:16:38.910 INFO:tasks.workunit.client.0.smithi059.stdout:7/202: chown d0/d7/l25 0 1 2024-04-25T16:16:39.025 INFO:tasks.workunit.client.0.smithi059.stdout:8/203: symlink d7/d16/l3d 0 2024-04-25T16:16:39.041 INFO:tasks.workunit.client.0.smithi059.stdout:0/210: rmdir dc/dd 39 2024-04-25T16:16:39.060 INFO:tasks.workunit.client.0.smithi059.stdout:8/204: readlink d7/dd/d17/d23/l24 0 2024-04-25T16:16:39.105 INFO:tasks.workunit.client.0.smithi059.stdout:3/232: creat d0/d1e/f53 x:0 0 0 2024-04-25T16:16:39.198 INFO:tasks.workunit.client.0.smithi059.stdout:8/205: dread d7/dd/f31 [0,4194304] 0 2024-04-25T16:16:39.393 INFO:tasks.workunit.client.0.smithi059.stdout:9/229: link d6/fb d6/d35/d26/f44 0 2024-04-25T16:16:39.411 INFO:tasks.workunit.client.0.smithi059.stdout:0/211: rmdir dc/df 39 2024-04-25T16:16:39.553 INFO:tasks.workunit.client.0.smithi059.stdout:5/226: mknod d1/d1e/d21/d42/c4c 0 2024-04-25T16:16:39.570 INFO:tasks.workunit.client.0.smithi059.stdout:3/233: readlink d0/l33 0 2024-04-25T16:16:39.578 INFO:tasks.workunit.client.0.smithi059.stdout:3/234: chown d0/d1e/c4d 74386 1 2024-04-25T16:16:39.700 INFO:tasks.workunit.client.0.smithi059.stdout:6/231: dwrite d9/d27/f34 [0,4194304] 0 2024-04-25T16:16:39.787 INFO:tasks.workunit.client.0.smithi059.stdout:6/232: chown d9/d16/d24/l45 5403 1 2024-04-25T16:16:39.814 INFO:tasks.workunit.client.0.smithi059.stdout:9/230: rename d6/f1a to d6/d35/d36/f45 0 2024-04-25T16:16:40.064 INFO:tasks.workunit.client.0.smithi059.stdout:1/242: link d7/d13/d16/c44 d7/d13/d2d/d4a/d4d/c4e 0 2024-04-25T16:16:40.082 INFO:tasks.workunit.client.0.smithi059.stdout:1/243: write d7/d15/f2e [2213899,117924] 0 2024-04-25T16:16:40.209 INFO:tasks.workunit.client.0.smithi059.stdout:3/235: symlink d0/db/d2d/l54 0 2024-04-25T16:16:40.261 INFO:tasks.workunit.client.0.smithi059.stdout:4/212: getdents d0/d4/df 0 2024-04-25T16:16:40.263 INFO:tasks.workunit.client.0.smithi059.stdout:8/206: creat d7/d16/d3a/f3e x:0 0 0 2024-04-25T16:16:40.355 INFO:tasks.workunit.client.0.smithi059.stdout:7/203: dwrite d0/d7/f10 [0,4194304] 0 2024-04-25T16:16:40.426 INFO:tasks.workunit.client.0.smithi059.stdout:0/212: unlink dc/df/d24/f42 0 2024-04-25T16:16:40.830 INFO:tasks.workunit.client.0.smithi059.stdout:3/236: chown d0/f27 105 1 2024-04-25T16:16:41.085 INFO:tasks.workunit.client.0.smithi059.stdout:4/213: fdatasync d0/d4/f1b 0 2024-04-25T16:16:41.085 INFO:tasks.workunit.client.0.smithi059.stdout:2/218: link de/d16/l17 de/l4d 0 2024-04-25T16:16:41.204 INFO:tasks.workunit.client.0.smithi059.stdout:9/231: mknod d6/c46 0 2024-04-25T16:16:41.247 INFO:tasks.workunit.client.0.smithi059.stdout:9/232: chown d6/l14 9074434 1 2024-04-25T16:16:41.276 INFO:tasks.workunit.client.0.smithi059.stdout:5/227: dwrite d1/dd/f46 [0,4194304] 0 2024-04-25T16:16:41.539 INFO:tasks.workunit.client.0.smithi059.stdout:6/233: dwrite d9/d16/f26 [4194304,4194304] 0 2024-04-25T16:16:41.609 INFO:tasks.workunit.client.0.smithi059.stdout:2/219: creat de/d2a/d2e/d36/d2c/f4e x:0 0 0 2024-04-25T16:16:41.830 INFO:tasks.workunit.client.0.smithi059.stdout:4/214: mkdir d0/d4/df/d48 0 2024-04-25T16:16:41.917 INFO:tasks.workunit.client.0.smithi059.stdout:5/228: fdatasync d1/f49 0 2024-04-25T16:16:41.921 INFO:tasks.workunit.client.0.smithi059.stdout:7/204: creat d0/d7/f40 x:0 0 0 2024-04-25T16:16:41.992 INFO:tasks.workunit.client.0.smithi059.stdout:1/244: dwrite d7/d13/f20 [0,4194304] 0 2024-04-25T16:16:42.069 INFO:tasks.workunit.client.0.smithi059.stdout:6/234: mkdir d9/d2e/d49 0 2024-04-25T16:16:42.106 INFO:tasks.workunit.client.0.smithi059.stdout:3/237: link d0/d1e/c4d d0/db/d47/c55 0 2024-04-25T16:16:42.152 INFO:tasks.workunit.client.0.smithi059.stdout:6/235: dread - d9/d1b/f48 zero size 2024-04-25T16:16:42.234 INFO:tasks.workunit.client.0.smithi059.stdout:2/220: dread de/d2a/d33/f41 [0,4194304] 0 2024-04-25T16:16:42.273 INFO:tasks.workunit.client.0.smithi059.stdout:7/205: dwrite d0/d7/fa [0,4194304] 0 2024-04-25T16:16:42.383 INFO:tasks.workunit.client.0.smithi059.stdout:8/207: dwrite d7/dd/ff [0,4194304] 0 2024-04-25T16:16:42.482 INFO:tasks.workunit.client.0.smithi059.stdout:3/238: creat d0/d1e/f56 x:0 0 0 2024-04-25T16:16:42.484 INFO:tasks.workunit.client.0.smithi059.stdout:6/236: rmdir d9/d1b 39 2024-04-25T16:16:42.567 INFO:tasks.workunit.client.0.smithi059.stdout:1/245: getdents d7/d2a/d36 0 2024-04-25T16:16:42.664 INFO:tasks.workunit.client.0.smithi059.stdout:2/221: creat de/d16/d3e/f4f x:0 0 0 2024-04-25T16:16:42.695 INFO:tasks.workunit.client.0.smithi059.stdout:6/237: chown d9/d16/l2a 751236585 1 2024-04-25T16:16:42.731 INFO:tasks.workunit.client.0.smithi059.stdout:5/229: dread d1/dd/f1d [0,4194304] 0 2024-04-25T16:16:42.741 INFO:tasks.workunit.client.0.smithi059.stdout:0/213: dwrite dc/f3a [0,4194304] 0 2024-04-25T16:16:43.058 INFO:tasks.workunit.client.0.smithi059.stdout:8/208: truncate d7/dd/f31 3593807 0 2024-04-25T16:16:43.067 INFO:tasks.workunit.client.0.smithi059.stdout:9/233: dwrite d6/f1c [0,4194304] 0 2024-04-25T16:16:43.266 INFO:tasks.workunit.client.0.smithi059.stdout:3/239: write d0/f3e [2623223,63487] 0 2024-04-25T16:16:43.269 INFO:tasks.workunit.client.0.smithi059.stdout:7/206: dwrite d0/d7/f29 [0,4194304] 0 2024-04-25T16:16:43.370 INFO:tasks.workunit.client.0.smithi059.stdout:3/240: readlink d0/l33 0 2024-04-25T16:16:43.370 INFO:tasks.workunit.client.0.smithi059.stdout:7/207: stat d0/d7/f40 0 2024-04-25T16:16:43.416 INFO:tasks.workunit.client.0.smithi059.stdout:3/241: chown d0/d1e/f1f 8 1 2024-04-25T16:16:43.422 INFO:tasks.workunit.client.0.smithi059.stdout:5/230: dread d1/dd/ff [0,4194304] 0 2024-04-25T16:16:43.555 INFO:tasks.workunit.client.0.smithi059.stdout:9/234: truncate d6/d35/d36/f38 571777 0 2024-04-25T16:16:43.555 INFO:tasks.workunit.client.0.smithi059.stdout:1/246: creat d7/d13/d2d/d4a/d4d/f4f x:0 0 0 2024-04-25T16:16:43.564 INFO:tasks.workunit.client.0.smithi059.stdout:6/238: creat d9/d27/d39/f4a x:0 0 0 2024-04-25T16:16:43.669 INFO:tasks.workunit.client.0.smithi059.stdout:9/235: sync 2024-04-25T16:16:43.697 INFO:tasks.workunit.client.0.smithi059.stdout:2/222: write de/d2a/d2e/d36/d2c/d40/f49 [455394,51537] 0 2024-04-25T16:16:43.830 INFO:tasks.workunit.client.0.smithi059.stdout:5/231: mknod d1/d1e/d21/d42/c4d 0 2024-04-25T16:16:43.977 INFO:tasks.workunit.client.0.smithi059.stdout:8/209: link d7/d16/d3a/f3e d7/d2f/f3f 0 2024-04-25T16:16:43.989 INFO:tasks.workunit.client.0.smithi059.stdout:0/214: rename dc/df/d28 to dc/d44 0 2024-04-25T16:16:44.003 INFO:tasks.workunit.client.0.smithi059.stdout:0/215: chown dc/df/c22 2 1 2024-04-25T16:16:44.079 INFO:tasks.workunit.client.0.smithi059.stdout:1/247: fsync d7/d15/f34 0 2024-04-25T16:16:44.275 INFO:tasks.workunit.client.0.smithi059.stdout:5/232: creat d1/d1e/d27/f4e x:0 0 0 2024-04-25T16:16:44.289 INFO:tasks.workunit.client.0.smithi059.stdout:5/233: dread - d1/d1e/d21/f39 zero size 2024-04-25T16:16:44.547 INFO:tasks.workunit.client.0.smithi059.stdout:7/208: dwrite d0/d7/d16/d20/d2b/d33/f3b [0,4194304] 0 2024-04-25T16:16:44.670 INFO:tasks.workunit.client.0.smithi059.stdout:3/242: dwrite d0/fa [0,4194304] 0 2024-04-25T16:16:44.748 INFO:tasks.workunit.client.0.smithi059.stdout:9/236: write d6/d35/f3b [1639273,91498] 0 2024-04-25T16:16:44.757 INFO:tasks.workunit.client.0.smithi059.stdout:4/215: write d0/d4/df/d44/f46 [1178861,84225] 0 2024-04-25T16:16:44.871 INFO:tasks.workunit.client.0.smithi059.stdout:5/234: symlink d1/d1e/d27/l4f 0 2024-04-25T16:16:44.905 INFO:tasks.workunit.client.0.smithi059.stdout:7/209: dwrite d0/d7/d16/d20/d2b/d33/f39 [0,4194304] 0 2024-04-25T16:16:45.052 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:16:45.055 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:16:45.197 INFO:tasks.workunit.client.0.smithi059.stdout:8/210: write d7/d2f/f3f [569893,130994] 0 2024-04-25T16:16:45.460 INFO:tasks.workunit.client.0.smithi059.stdout:3/243: dread - d0/d1e/d31/f40 zero size 2024-04-25T16:16:45.653 INFO:tasks.workunit.client.0.smithi059.stdout:5/235: fsync d1/f1c 0 2024-04-25T16:16:45.664 INFO:tasks.workunit.client.0.smithi059.stdout:5/236: chown d1/d1e/d21 4081 1 2024-04-25T16:16:45.668 INFO:tasks.workunit.client.0.smithi059.stdout:5/237: chown d1/f11 8 1 2024-04-25T16:16:45.783 INFO:tasks.workunit.client.0.smithi059.stdout:7/210: chown d0/d7/d16/d20/d2b/d33/c36 3 1 2024-04-25T16:16:45.810 INFO:tasks.workunit.client.0.smithi059.stdout:8/211: dread - d7/dd/f3c zero size 2024-04-25T16:16:45.907 INFO:tasks.workunit.client.0.smithi059.stdout:2/223: link de/l4d de/d2a/d2e/l50 0 2024-04-25T16:16:45.927 INFO:tasks.workunit.client.0.smithi059.stdout:2/224: dread de/d2a/d2e/d36/f28 [0,4194304] 0 2024-04-25T16:16:46.019 INFO:tasks.workunit.client.0.smithi059.stdout:3/244: chown d0/c23 12655354 1 2024-04-25T16:16:46.093 INFO:tasks.workunit.client.0.smithi059.stdout:4/216: rename d0/d4/f8 to d0/d4/df/d44/f49 0 2024-04-25T16:16:46.176 INFO:tasks.workunit.client.0.smithi059.stdout:5/238: mkdir d1/d1e/d21/d3d/d50 0 2024-04-25T16:16:46.243 INFO:tasks.workunit.client.0.smithi059.stdout:8/212: unlink d7/dd/d17/d23/l24 0 2024-04-25T16:16:46.273 INFO:tasks.workunit.client.0.smithi059.stdout:1/248: write d7/d13/d16/f46 [931051,101734] 0 2024-04-25T16:16:46.401 INFO:tasks.workunit.client.0.smithi059.stdout:2/225: creat de/d2a/d2e/d36/f51 x:0 0 0 2024-04-25T16:16:46.451 INFO:tasks.workunit.client.0.smithi059.stdout:6/239: creat d9/f4b x:0 0 0 2024-04-25T16:16:46.459 INFO:tasks.workunit.client.0.smithi059.stdout:6/240: chown d9/cb 21 1 2024-04-25T16:16:46.542 INFO:tasks.workunit.client.0.smithi059.stdout:3/245: rmdir d0/db/d3f/d49 39 2024-04-25T16:16:46.582 INFO:tasks.workunit.client.0.smithi059.stdout:4/217: rmdir d0/d4 39 2024-04-25T16:16:46.587 INFO:tasks.workunit.client.0.smithi059.stdout:6/241: sync 2024-04-25T16:16:46.621 INFO:tasks.workunit.client.0.smithi059.stdout:7/211: chown d0/d7/d16/d38/c3a 123173 1 2024-04-25T16:16:46.654 INFO:tasks.workunit.client.0.smithi059.stdout:5/239: symlink d1/d1e/d21/d3d/d44/l51 0 2024-04-25T16:16:46.757 INFO:tasks.workunit.client.0.smithi059.stdout:1/249: fdatasync d7/f30 0 2024-04-25T16:16:46.789 INFO:tasks.workunit.client.0.smithi059.stdout:0/216: link dc/f2a dc/dd/d3b/f45 0 2024-04-25T16:16:46.821 INFO:tasks.workunit.client.0.smithi059.stdout:2/226: dread - de/d16/f43 zero size 2024-04-25T16:16:47.014 INFO:tasks.workunit.client.0.smithi059.stdout:5/240: creat d1/d1e/d21/d42/f52 x:0 0 0 2024-04-25T16:16:47.030 INFO:tasks.workunit.client.0.smithi059.stdout:5/241: chown d1/d1e/d21/f22 959 1 2024-04-25T16:16:47.110 INFO:tasks.workunit.client.0.smithi059.stdout:7/212: rename d0/d7/f22 to d0/d7/d16/d20/d2b/d33/f41 0 2024-04-25T16:16:47.196 INFO:tasks.workunit.client.0.smithi059.stdout:1/250: creat d7/d13/d16/f50 x:0 0 0 2024-04-25T16:16:47.209 INFO:tasks.workunit.client.0.smithi059.stdout:9/237: write d6/d35/d36/f38 [75972,3368] 0 2024-04-25T16:16:47.217 INFO:tasks.workunit.client.0.smithi059.stdout:7/213: dwrite d0/d7/d16/d20/d2b/d33/f39 [0,4194304] 0 2024-04-25T16:16:47.290 INFO:tasks.workunit.client.0.smithi059.stdout:0/217: symlink dc/dd/l46 0 2024-04-25T16:16:47.326 INFO:tasks.workunit.client.0.smithi059.stdout:0/218: readlink dc/df/d24/l34 0 2024-04-25T16:16:47.356 INFO:tasks.workunit.client.0.smithi059.stdout:6/242: mknod d9/c4c 0 2024-04-25T16:16:47.876 INFO:tasks.workunit.client.0.smithi059.stdout:4/218: mknod d0/d4/df/d48/c4a 0 2024-04-25T16:16:47.991 INFO:tasks.workunit.client.0.smithi059.stdout:6/243: unlink d9/f25 0 2024-04-25T16:16:48.000 INFO:tasks.workunit.client.0.smithi059.stdout:3/246: write d0/d1e/f52 [516793,83233] 0 2024-04-25T16:16:48.033 INFO:tasks.workunit.client.0.smithi059.stdout:8/213: link d7/fa d7/f40 0 2024-04-25T16:16:48.259 INFO:tasks.workunit.client.0.smithi059.stdout:4/219: creat d0/d4/f4b x:0 0 0 2024-04-25T16:16:48.285 INFO:tasks.workunit.client.0.smithi059.stdout:7/214: dread d0/d7/d16/d20/d2b/d33/f41 [0,4194304] 0 2024-04-25T16:16:48.293 INFO:tasks.workunit.client.0.smithi059.stdout:7/215: stat d0/d7/f2c 0 2024-04-25T16:16:48.653 INFO:tasks.workunit.client.0.smithi059.stdout:9/238: dwrite f2 [0,4194304] 0 2024-04-25T16:16:48.656 INFO:tasks.workunit.client.0.smithi059.stdout:8/214: rmdir d7/d16/d3a 39 2024-04-25T16:16:48.672 INFO:tasks.workunit.client.0.smithi059.stdout:2/227: write de/d2a/d2e/f3f [3850329,122545] 0 2024-04-25T16:16:48.674 INFO:tasks.workunit.client.0.smithi059.stdout:1/251: write d7/d13/d16/f24 [1725210,35721] 0 2024-04-25T16:16:48.829 INFO:tasks.workunit.client.0.smithi059.stdout:5/242: write d1/d1e/d21/d24/f4b [450575,72250] 0 2024-04-25T16:16:48.849 INFO:tasks.workunit.client.0.smithi059.stdout:5/243: chown d1/d48 683270179 1 2024-04-25T16:16:48.855 INFO:tasks.workunit.client.0.smithi059.stdout:5/244: readlink d1/d1e/l2f 0 2024-04-25T16:16:48.949 INFO:tasks.workunit.client.0.smithi059.stdout:0/219: write dc/f2d [56190,31116] 0 2024-04-25T16:16:48.964 INFO:tasks.workunit.client.0.smithi059.stdout:4/220: write d0/f26 [5058856,109604] 0 2024-04-25T16:16:49.125 INFO:tasks.workunit.client.0.smithi059.stdout:3/247: dwrite d0/db/d2d/f38 [0,4194304] 0 2024-04-25T16:16:49.275 INFO:tasks.workunit.client.0.smithi059.stdout:4/221: rmdir d0/d4 39 2024-04-25T16:16:49.316 INFO:tasks.workunit.client.0.smithi059.stdout:7/216: dwrite d0/d7/f2c [0,4194304] 0 2024-04-25T16:16:49.413 INFO:tasks.workunit.client.0.smithi059.stdout:1/252: write d7/d15/f25 [1845819,57947] 0 2024-04-25T16:16:49.467 INFO:tasks.workunit.client.0.smithi059.stdout:8/215: creat d7/dd/d33/f41 x:0 0 0 2024-04-25T16:16:49.482 INFO:tasks.workunit.client.0.smithi059.stdout:7/217: stat d0/f3c 0 2024-04-25T16:16:49.592 INFO:tasks.workunit.client.0.smithi059.stdout:1/253: stat d7/c1c 0 2024-04-25T16:16:49.619 INFO:tasks.workunit.client.0.smithi059.stdout:3/248: read d0/f6 [2425003,104431] 0 2024-04-25T16:16:49.754 INFO:tasks.workunit.client.0.smithi059.stdout:3/249: stat d0 0 2024-04-25T16:16:49.868 INFO:tasks.workunit.client.0.smithi059.stdout:4/222: write d0/d4/f35 [928032,22165] 0 2024-04-25T16:16:49.877 INFO:tasks.workunit.client.0.smithi059.stdout:6/244: dwrite d9/d1b/f36 [0,4194304] 0 2024-04-25T16:16:49.898 INFO:tasks.workunit.client.0.smithi059.stdout:9/239: dread d6/d35/d26/f44 [0,4194304] 0 2024-04-25T16:16:49.993 INFO:tasks.workunit.client.0.smithi059.stdout:5/245: dread d1/d1e/d21/d24/f38 [0,4194304] 0 2024-04-25T16:16:50.042 INFO:tasks.workunit.client.0.smithi059.stdout:2/228: dwrite de/f2d [0,4194304] 0 2024-04-25T16:16:50.076 INFO:tasks.workunit.client.0.smithi059.stdout:0/220: dread dc/df/f16 [0,4194304] 0 2024-04-25T16:16:50.198 INFO:tasks.workunit.client.0.smithi059.stdout:4/223: chown d0/d4/f1b 310180057 1 2024-04-25T16:16:50.212 INFO:tasks.workunit.client.0.smithi059.stdout:5/246: stat d1/d1e/d21/d24/f4b 0 2024-04-25T16:16:50.275 INFO:tasks.workunit.client.0.smithi059.stdout:3/250: dread d0/db/f20 [0,4194304] 0 2024-04-25T16:16:50.293 INFO:tasks.workunit.client.0.smithi059.stdout:9/240: dread d6/f1b [0,4194304] 0 2024-04-25T16:16:50.303 INFO:tasks.workunit.client.0.smithi059.stdout:1/254: dwrite d7/d13/d16/f24 [0,4194304] 0 2024-04-25T16:16:50.403 INFO:tasks.workunit.client.0.smithi059.stdout:8/216: rename d7/f26 to d7/dd/d17/f42 0 2024-04-25T16:16:50.569 INFO:tasks.workunit.client.0.smithi059.stdout:6/245: dread d9/f14 [0,4194304] 0 2024-04-25T16:16:50.579 INFO:tasks.workunit.client.0.smithi059.stdout:6/246: dread - d9/f35 zero size 2024-04-25T16:16:51.019 INFO:tasks.workunit.client.0.smithi059.stdout:9/241: truncate d6/d35/d28/f3e 515908 0 2024-04-25T16:16:51.027 INFO:tasks.workunit.client.0.smithi059.stdout:3/251: stat d0/c1d 0 2024-04-25T16:16:51.035 INFO:tasks.workunit.client.0.smithi059.stdout:7/218: creat d0/d7/d16/f42 x:0 0 0 2024-04-25T16:16:51.200 INFO:tasks.workunit.client.0.smithi059.stdout:5/247: mknod d1/d1e/c53 0 2024-04-25T16:16:51.227 INFO:tasks.workunit.client.0.smithi059.stdout:1/255: dread d7/d13/d16/f33 [0,4194304] 0 2024-04-25T16:16:51.229 INFO:tasks.workunit.client.0.smithi059.stdout:5/248: stat d1/d1e/f20 0 2024-04-25T16:16:51.248 INFO:tasks.workunit.client.0.smithi059.stdout:5/249: chown d1/f29 17 1 2024-04-25T16:16:51.268 INFO:tasks.workunit.client.0.smithi059.stdout:2/229: write f7 [952493,27357] 0 2024-04-25T16:16:51.335 INFO:tasks.workunit.client.0.smithi059.stdout:3/252: mkdir d0/d1e/d57 0 2024-04-25T16:16:51.427 INFO:tasks.workunit.client.0.smithi059.stdout:0/221: dwrite dc/f3a [0,4194304] 0 2024-04-25T16:16:51.434 INFO:tasks.workunit.client.0.smithi059.stdout:8/217: write d7/f1f [4873115,42031] 0 2024-04-25T16:16:51.618 INFO:tasks.workunit.client.0.smithi059.stdout:6/247: write d9/d16/d24/f32 [176945,49077] 0 2024-04-25T16:16:51.624 INFO:tasks.workunit.client.0.smithi059.stdout:7/219: creat d0/d7/d16/d20/d2b/d33/f43 x:0 0 0 2024-04-25T16:16:51.668 INFO:tasks.workunit.client.0.smithi059.stdout:3/253: creat d0/db/d2d/f58 x:0 0 0 2024-04-25T16:16:51.681 INFO:tasks.workunit.client.0.smithi059.stdout:4/224: write d0/d4/df/d1c/f37 [922814,111031] 0 2024-04-25T16:16:51.724 INFO:tasks.workunit.client.0.smithi059.stdout:4/225: stat d0/d4 0 2024-04-25T16:16:51.835 INFO:tasks.workunit.client.0.smithi059.stdout:4/226: sync 2024-04-25T16:16:51.874 INFO:tasks.workunit.client.0.smithi059.stdout:8/218: mkdir d7/d2f/d43 0 2024-04-25T16:16:51.912 INFO:tasks.workunit.client.0.smithi059.stdout:7/220: dread - d0/d7/f40 zero size 2024-04-25T16:16:51.934 INFO:tasks.workunit.client.0.smithi059.stdout:3/254: symlink d0/d1e/l59 0 2024-04-25T16:16:52.010 INFO:tasks.workunit.client.0.smithi059.stdout:0/222: write dc/d44/f35 [4628018,86372] 0 2024-04-25T16:16:52.021 INFO:tasks.workunit.client.0.smithi059.stdout:2/230: dread de/d2a/d2e/f30 [0,4194304] 0 2024-04-25T16:16:52.029 INFO:tasks.workunit.client.0.smithi059.stdout:9/242: dwrite d6/d35/d2f/f3c [0,4194304] 0 2024-04-25T16:16:52.160 INFO:tasks.workunit.client.0.smithi059.stdout:6/248: rename d9/d27/d39/f4a to d9/f4d 0 2024-04-25T16:16:52.268 INFO:tasks.workunit.client.0.smithi059.stdout:3/255: rmdir d0/d1e 39 2024-04-25T16:16:52.302 INFO:tasks.workunit.client.0.smithi059.stdout:1/256: dwrite d7/d15/f2e [0,4194304] 0 2024-04-25T16:16:52.370 INFO:tasks.workunit.client.0.smithi059.stdout:5/250: dwrite d1/d1e/d21/d3d/f40 [0,4194304] 0 2024-04-25T16:16:52.553 INFO:tasks.workunit.client.0.smithi059.stdout:8/219: dread d7/d16/d3a/f3e [0,4194304] 0 2024-04-25T16:16:52.650 INFO:tasks.workunit.client.0.smithi059.stdout:2/231: creat de/d2a/d2e/d36/d2c/d40/f52 x:0 0 0 2024-04-25T16:16:52.654 INFO:tasks.workunit.client.0.smithi059.stdout:9/243: write d6/f1b [719532,103527] 0 2024-04-25T16:16:52.661 INFO:tasks.workunit.client.0.smithi059.stdout:0/223: write f9 [1532716,100960] 0 2024-04-25T16:16:52.698 INFO:tasks.workunit.client.0.smithi059.stdout:4/227: dread d0/d4/df/d44/f49 [4194304,4194304] 0 2024-04-25T16:16:52.759 INFO:tasks.workunit.client.0.smithi059.stdout:0/224: dread - dc/df/d24/f2e zero size 2024-04-25T16:16:52.914 INFO:tasks.workunit.client.0.smithi059.stdout:6/249: dwrite d9/d27/f30 [0,4194304] 0 2024-04-25T16:16:52.925 INFO:tasks.workunit.client.0.smithi059.stdout:7/221: creat d0/d7/d16/f44 x:0 0 0 2024-04-25T16:16:52.926 INFO:tasks.workunit.client.0.smithi059.stdout:5/251: symlink d1/d48/l54 0 2024-04-25T16:16:52.969 INFO:tasks.workunit.client.0.smithi059.stdout:3/256: write d0/f3e [2749566,27931] 0 2024-04-25T16:16:53.187 INFO:tasks.workunit.client.0.smithi059.stdout:9/244: rename f0 to d6/f47 0 2024-04-25T16:16:53.219 INFO:tasks.workunit.client.0.smithi059.stdout:2/232: dread f2 [0,4194304] 0 2024-04-25T16:16:53.584 INFO:tasks.workunit.client.0.smithi059.stdout:2/233: creat de/d2a/d33/f53 x:0 0 0 2024-04-25T16:16:53.587 INFO:tasks.workunit.client.0.smithi059.stdout:7/222: write d0/d7/f23 [2748677,20889] 0 2024-04-25T16:16:53.595 INFO:tasks.workunit.client.0.smithi059.stdout:9/245: fdatasync d6/d35/d26/f44 0 2024-04-25T16:16:53.645 INFO:tasks.workunit.client.0.smithi059.stdout:1/257: dwrite d7/d13/d2d/d4a/f4b [0,4194304] 0 2024-04-25T16:16:53.650 INFO:tasks.workunit.client.0.smithi059.stdout:3/257: chown d0/d1e/d31/c50 602 1 2024-04-25T16:16:53.658 INFO:tasks.workunit.client.0.smithi059.stdout:0/225: dwrite dc/df/d24/f2e [0,4194304] 0 2024-04-25T16:16:53.722 INFO:tasks.workunit.client.0.smithi059.stdout:5/252: dread d1/dd/f1d [0,4194304] 0 2024-04-25T16:16:53.750 INFO:tasks.workunit.client.0.smithi059.stdout:8/220: dwrite d7/dd/ff [4194304,4194304] 0 2024-04-25T16:16:53.902 INFO:tasks.workunit.client.0.smithi059.stdout:4/228: dread d0/d4/df/f41 [0,4194304] 0 2024-04-25T16:16:53.993 INFO:tasks.workunit.client.0.smithi059.stdout:1/258: dread d7/fc [0,4194304] 0 2024-04-25T16:16:54.000 INFO:tasks.workunit.client.0.smithi059.stdout:2/234: chown de/cf 107 1 2024-04-25T16:16:54.063 INFO:tasks.workunit.client.0.smithi059.stdout:3/258: read d0/d1e/f1f [8007919,22523] 0 2024-04-25T16:16:54.091 INFO:tasks.workunit.client.0.smithi059.stdout:6/250: dwrite d9/d27/f34 [0,4194304] 0 2024-04-25T16:16:54.194 INFO:tasks.workunit.client.0.smithi059.stdout:5/253: rename d1/f49 to d1/d1e/d21/d3d/f55 0 2024-04-25T16:16:54.268 INFO:tasks.workunit.client.0.smithi059.stdout:9/246: write d6/d35/d26/f33 [4502298,25014] 0 2024-04-25T16:16:54.272 INFO:tasks.workunit.client.0.smithi059.stdout:6/251: readlink d9/d16/d24/l45 0 2024-04-25T16:16:54.278 INFO:tasks.workunit.client.0.smithi059.stdout:0/226: write dc/dd/f20 [1698949,46000] 0 2024-04-25T16:16:54.340 INFO:tasks.workunit.client.0.smithi059.stdout:1/259: dread d7/d15/f2e [0,4194304] 0 2024-04-25T16:16:54.514 INFO:tasks.workunit.client.0.smithi059.stdout:3/259: dread d0/db/f14 [0,4194304] 0 2024-04-25T16:16:54.570 INFO:tasks.workunit.client.0.smithi059.stdout:4/229: dwrite d0/f2a [0,4194304] 0 2024-04-25T16:16:54.662 INFO:tasks.workunit.client.0.smithi059.stdout:3/260: dread d0/db/f19 [0,4194304] 0 2024-04-25T16:16:54.670 INFO:tasks.workunit.client.0.smithi059.stdout:2/235: rename de/d2a/d33/c3a to de/d2a/d2e/d48/c54 0 2024-04-25T16:16:54.688 INFO:tasks.workunit.client.0.smithi059.stdout:9/247: fsync d6/d35/f29 0 2024-04-25T16:16:54.708 INFO:tasks.workunit.client.0.smithi059.stdout:6/252: truncate d9/d16/f42 4602438 0 2024-04-25T16:16:54.713 INFO:tasks.workunit.client.0.smithi059.stdout:0/227: chown dc/df/d24/c41 1368416 1 2024-04-25T16:16:54.767 INFO:tasks.workunit.client.0.smithi059.stdout:8/221: link d7/dd/d17/d23/f2a d7/dd/d17/d23/d37/f44 0 2024-04-25T16:16:55.388 INFO:tasks.workunit.client.0.smithi059.stdout:7/223: link d0/d7/c19 d0/d7/c45 0 2024-04-25T16:16:55.397 INFO:tasks.workunit.client.0.smithi059.stdout:1/260: write d7/fc [75259,125499] 0 2024-04-25T16:16:55.427 INFO:tasks.workunit.client.0.smithi059.stdout:5/254: rename d1/lc to d1/d1e/d21/d3d/d50/l56 0 2024-04-25T16:16:55.558 INFO:tasks.workunit.client.0.smithi059.stdout:0/228: dread dc/df/f1d [0,4194304] 0 2024-04-25T16:16:55.568 INFO:tasks.workunit.client.0.smithi059.stdout:0/229: chown dc/df/f10 162 1 2024-04-25T16:16:55.689 INFO:tasks.workunit.client.0.smithi059.stdout:2/236: symlink de/d2a/d2e/d36/d2c/l55 0 2024-04-25T16:16:55.699 INFO:tasks.workunit.client.0.smithi059.stdout:9/248: mkdir d6/d35/d36/d48 0 2024-04-25T16:16:55.753 INFO:tasks.workunit.client.0.smithi059.stdout:9/249: dread d6/d35/d2f/f3c [0,4194304] 0 2024-04-25T16:16:56.151 INFO:tasks.workunit.client.0.smithi059.stdout:1/261: mkdir d7/d21/d51 0 2024-04-25T16:16:56.170 INFO:tasks.workunit.client.0.smithi059.stdout:3/261: write d0/db/f3a [950004,57419] 0 2024-04-25T16:16:56.278 INFO:tasks.workunit.client.0.smithi059.stdout:6/253: mknod d9/d16/c4e 0 2024-04-25T16:16:56.294 INFO:tasks.workunit.client.0.smithi059.stdout:5/255: stat d1/l4 0 2024-04-25T16:16:56.295 INFO:tasks.workunit.client.0.smithi059.stdout:3/262: dread d0/f6 [0,4194304] 0 2024-04-25T16:16:56.339 INFO:tasks.workunit.client.0.smithi059.stdout:0/230: mkdir dc/d37/d47 0 2024-04-25T16:16:56.535 INFO:tasks.workunit.client.0.smithi059.stdout:8/222: mkdir d7/d16/d45 0 2024-04-25T16:16:56.584 INFO:tasks.workunit.client.0.smithi059.stdout:9/250: dread d6/f1c [0,4194304] 0 2024-04-25T16:16:56.602 INFO:tasks.workunit.client.0.smithi059.stdout:1/262: symlink d7/d13/d2d/d41/l52 0 2024-04-25T16:16:56.611 INFO:tasks.workunit.client.0.smithi059.stdout:1/263: read d7/fb [3953598,84379] 0 2024-04-25T16:16:56.621 INFO:tasks.workunit.client.0.smithi059.stdout:1/264: stat d7/d2a/d36/c3e 0 2024-04-25T16:16:56.625 INFO:tasks.workunit.client.0.smithi059.stdout:1/265: readlink d7/lf 0 2024-04-25T16:16:56.781 INFO:tasks.workunit.client.0.smithi059.stdout:4/230: dwrite d0/d4/df/f42 [0,4194304] 0 2024-04-25T16:16:56.848 INFO:tasks.workunit.client.0.smithi059.stdout:3/263: unlink d0/d1e/c25 0 2024-04-25T16:16:56.853 INFO:tasks.workunit.client.0.smithi059.stdout:5/256: truncate d1/d1e/f37 913115 0 2024-04-25T16:16:56.885 INFO:tasks.workunit.client.0.smithi059.stdout:7/224: unlink d0/fd 0 2024-04-25T16:16:56.964 INFO:tasks.workunit.client.0.smithi059.stdout:0/231: creat dc/dd/f48 x:0 0 0 2024-04-25T16:16:57.053 INFO:tasks.workunit.client.0.smithi059.stdout:8/223: creat d7/d16/d3a/f46 x:0 0 0 2024-04-25T16:16:57.161 INFO:tasks.workunit.client.0.smithi059.stdout:6/254: symlink d9/d2e/d49/l4f 0 2024-04-25T16:16:57.196 INFO:tasks.workunit.client.0.smithi059.stdout:4/231: rmdir d0/d4/df 39 2024-04-25T16:16:57.248 INFO:tasks.workunit.client.0.smithi059.stdout:3/264: rename d0/db/f4b to d0/db/f5a 0 2024-04-25T16:16:57.255 INFO:tasks.workunit.client.0.smithi059.stdout:3/265: chown d0/f27 6669877 1 2024-04-25T16:16:57.330 INFO:tasks.workunit.client.0.smithi059.stdout:5/257: rename d1/f1c to d1/d1e/d21/d3d/f57 0 2024-04-25T16:16:57.417 INFO:tasks.workunit.client.0.smithi059.stdout:0/232: mknod dc/df/d24/c49 0 2024-04-25T16:16:57.577 INFO:tasks.workunit.client.0.smithi059.stdout:6/255: stat d9/d16/d24/c44 0 2024-04-25T16:16:57.681 INFO:tasks.workunit.client.0.smithi059.stdout:6/256: dwrite d9/d1b/f2c [0,4194304] 0 2024-04-25T16:16:58.015 INFO:tasks.workunit.client.0.smithi059.stdout:3/266: fsync d0/db/d47/f2e 0 2024-04-25T16:16:58.058 INFO:tasks.workunit.client.0.smithi059.stdout:5/258: fdatasync d1/d1e/d21/d24/f38 0 2024-04-25T16:16:58.103 INFO:tasks.workunit.client.0.smithi059.stdout:2/237: dwrite de/d16/f32 [0,4194304] 0 2024-04-25T16:16:58.245 INFO:tasks.workunit.client.0.smithi059.stdout:9/251: write f1 [1811637,353] 0 2024-04-25T16:16:58.255 INFO:tasks.workunit.client.0.smithi059.stdout:9/252: chown d6/d35 5 1 2024-04-25T16:16:58.291 INFO:tasks.workunit.client.0.smithi059.stdout:8/224: link d7/dd/ff d7/d2f/f47 0 2024-04-25T16:16:58.300 INFO:tasks.workunit.client.0.smithi059.stdout:1/266: creat d7/f53 x:0 0 0 2024-04-25T16:16:58.378 INFO:tasks.workunit.client.0.smithi059.stdout:9/253: sync 2024-04-25T16:16:58.400 INFO:tasks.workunit.client.0.smithi059.stdout:9/254: chown d6/d35/d36/f3f 18712294 1 2024-04-25T16:16:58.424 INFO:tasks.workunit.client.0.smithi059.stdout:9/255: readlink d6/l14 0 2024-04-25T16:16:58.484 INFO:tasks.workunit.client.0.smithi059.stdout:9/256: write d6/d35/d26/f33 [3635705,43788] 0 2024-04-25T16:16:58.497 INFO:tasks.workunit.client.0.smithi059.stdout:4/232: mknod d0/d4/df/d48/c4c 0 2024-04-25T16:16:58.504 INFO:tasks.workunit.client.0.smithi059.stdout:7/225: dwrite d0/d7/fa [4194304,4194304] 0 2024-04-25T16:16:58.655 INFO:tasks.workunit.client.0.smithi059.stdout:3/267: mkdir d0/db/d47/d5b 0 2024-04-25T16:16:58.716 INFO:tasks.workunit.client.0.smithi059.stdout:5/259: mknod d1/c58 0 2024-04-25T16:16:58.792 INFO:tasks.workunit.client.0.smithi059.stdout:2/238: creat de/d2a/d2e/d48/f56 x:0 0 0 2024-04-25T16:16:58.921 INFO:tasks.workunit.client.0.smithi059.stdout:0/233: write dc/dd/f23 [948691,124545] 0 2024-04-25T16:16:59.048 INFO:tasks.workunit.client.0.smithi059.stdout:8/225: mknod d7/dd/d17/c48 0 2024-04-25T16:16:59.139 INFO:tasks.workunit.client.0.smithi059.stdout:1/267: rename d7/d2a/d36 to d7/d13/d16/d54 0 2024-04-25T16:16:59.145 INFO:tasks.workunit.client.0.smithi059.stdout:6/257: write d9/f21 [819626,80475] 0 2024-04-25T16:16:59.169 INFO:tasks.workunit.client.0.smithi059.stdout:6/258: chown d9/f40 601065176 1 2024-04-25T16:16:59.260 INFO:tasks.workunit.client.0.smithi059.stdout:9/257: unlink d6/d35/d26/c27 0 2024-04-25T16:16:59.441 INFO:tasks.workunit.client.0.smithi059.stdout:7/226: unlink d0/f3c 0 2024-04-25T16:16:59.559 INFO:tasks.workunit.client.0.smithi059.stdout:4/233: dread d0/d4/df/f3a [0,4194304] 0 2024-04-25T16:16:59.599 INFO:tasks.workunit.client.0.smithi059.stdout:2/239: mkdir de/d2a/d2e/d36/d2c/d40/d57 0 2024-04-25T16:16:59.619 INFO:tasks.workunit.client.0.smithi059.stdout:1/268: mknod d7/d13/d2d/d4a/c55 0 2024-04-25T16:16:59.666 INFO:tasks.workunit.client.0.smithi059.stdout:6/259: truncate d9/f10 1181460 0 2024-04-25T16:16:59.671 INFO:tasks.workunit.client.0.smithi059.stdout:9/258: unlink d6/f13 0 2024-04-25T16:16:59.684 INFO:tasks.workunit.client.0.smithi059.stdout:9/259: chown d6/fb 5641 1 2024-04-25T16:16:59.697 INFO:tasks.workunit.client.0.smithi059.stdout:9/260: stat d6/d35/d36/l3a 0 2024-04-25T16:16:59.887 INFO:tasks.workunit.client.0.smithi059.stdout:8/226: symlink d7/d16/d36/l49 0 2024-04-25T16:16:59.900 INFO:tasks.workunit.client.0.smithi059.stdout:2/240: dread - de/d2a/d2e/d36/f51 zero size 2024-04-25T16:16:59.909 INFO:tasks.workunit.client.0.smithi059.stdout:1/269: chown d7/f26 10 1 2024-04-25T16:17:00.188 INFO:tasks.workunit.client.0.smithi059.stdout:6/260: truncate d9/f4b 506269 0 2024-04-25T16:17:00.197 INFO:tasks.workunit.client.0.smithi059.stdout:7/227: mkdir d0/d3f/d46 0 2024-04-25T16:17:00.198 INFO:tasks.workunit.client.0.smithi059.stdout:9/261: fdatasync d6/d35/d28/f40 0 2024-04-25T16:17:00.406 INFO:tasks.workunit.client.0.smithi059.stdout:3/268: write d0/fa [1045376,110123] 0 2024-04-25T16:17:00.479 INFO:tasks.workunit.client.0.smithi059.stdout:5/260: dwrite d1/f8 [0,4194304] 0 2024-04-25T16:17:00.749 INFO:tasks.workunit.client.0.smithi059.stdout:4/234: truncate d0/d4/df/f12 3434773 0 2024-04-25T16:17:00.757 INFO:tasks.workunit.client.0.smithi059.stdout:2/241: creat de/d2a/d2e/f58 x:0 0 0 2024-04-25T16:17:00.777 INFO:tasks.workunit.client.0.smithi059.stdout:1/270: creat d7/d13/d2d/d4a/f56 x:0 0 0 2024-04-25T16:17:00.810 INFO:tasks.workunit.client.0.smithi059.stdout:5/261: creat d1/d1e/d27/f59 x:0 0 0 2024-04-25T16:17:00.857 INFO:tasks.workunit.client.0.smithi059.stdout:0/234: getdents dc 0 2024-04-25T16:17:01.029 INFO:tasks.workunit.client.0.smithi059.stdout:7/228: mkdir d0/d3f/d46/d47 0 2024-04-25T16:17:01.073 INFO:tasks.workunit.client.0.smithi059.stdout:1/271: dwrite d7/f53 [0,4194304] 0 2024-04-25T16:17:01.075 INFO:tasks.workunit.client.0.smithi059.stdout:0/235: dread f6 [4194304,4194304] 0 2024-04-25T16:17:01.262 INFO:tasks.workunit.client.0.smithi059.stdout:5/262: symlink d1/d1e/d21/l5a 0 2024-04-25T16:17:01.322 INFO:tasks.workunit.client.0.smithi059.stdout:4/235: dread d0/d4/df/d1c/f37 [0,4194304] 0 2024-04-25T16:17:01.380 INFO:tasks.workunit.client.0.smithi059.stdout:7/229: fdatasync d0/f30 0 2024-04-25T16:17:01.639 INFO:tasks.workunit.client.0.smithi059.stdout:1/272: dread d7/d13/f1b [0,4194304] 0 2024-04-25T16:17:01.988 INFO:tasks.workunit.client.0.smithi059.stdout:4/236: link d0/d4/f35 d0/d4/df/d44/f4d 0 2024-04-25T16:17:02.423 INFO:tasks.workunit.client.0.smithi059.stdout:9/262: write d6/d35/d36/f38 [1000080,103503] 0 2024-04-25T16:17:02.443 INFO:tasks.workunit.client.0.smithi059.stdout:8/227: write d7/dd/d17/d23/f2a [268068,113217] 0 2024-04-25T16:17:02.462 INFO:tasks.workunit.client.0.smithi059.stdout:2/242: write fd [3906189,25480] 0 2024-04-25T16:17:02.508 INFO:tasks.workunit.client.0.smithi059.stdout:2/243: chown de/d16 336742507 1 2024-04-25T16:17:02.572 INFO:tasks.workunit.client.0.smithi059.stdout:8/228: write d7/dd/d17/d23/d37/f44 [1275722,231] 0 2024-04-25T16:17:02.581 INFO:tasks.workunit.client.0.smithi059.stdout:2/244: chown de/d16/f32 674216 1 2024-04-25T16:17:02.590 INFO:tasks.workunit.client.0.smithi059.stdout:6/261: dwrite d9/f29 [0,4194304] 0 2024-04-25T16:17:02.670 INFO:tasks.workunit.client.0.smithi059.stdout:7/230: rmdir d0 39 2024-04-25T16:17:02.693 INFO:tasks.workunit.client.0.smithi059.stdout:5/263: creat d1/f5b x:0 0 0 2024-04-25T16:17:02.695 INFO:tasks.workunit.client.0.smithi059.stdout:1/273: rename d7/d15/l31 to d7/d13/l57 0 2024-04-25T16:17:02.700 INFO:tasks.workunit.client.0.smithi059.stdout:3/269: write d0/db/d2d/f46 [183832,104012] 0 2024-04-25T16:17:02.839 INFO:tasks.workunit.client.0.smithi059.stdout:0/236: dwrite dc/f29 [0,4194304] 0 2024-04-25T16:17:02.972 INFO:tasks.workunit.client.0.smithi059.stdout:6/262: read f8 [3840858,13420] 0 2024-04-25T16:17:03.081 INFO:tasks.workunit.client.0.smithi059.stdout:8/229: creat d7/d2f/f4a x:0 0 0 2024-04-25T16:17:03.382 INFO:tasks.workunit.client.0.smithi059.stdout:9/263: unlink d6/d35/f20 0 2024-04-25T16:17:03.487 INFO:tasks.workunit.client.0.smithi059.stdout:0/237: mknod dc/df/d24/c4a 0 2024-04-25T16:17:03.495 INFO:tasks.workunit.client.0.smithi059.stdout:6/263: mknod d9/d27/d39/c50 0 2024-04-25T16:17:03.497 INFO:tasks.workunit.client.0.smithi059.stdout:2/245: write f2 [4707195,85541] 0 2024-04-25T16:17:03.555 INFO:tasks.workunit.client.0.smithi059.stdout:7/231: creat d0/d3f/d46/f48 x:0 0 0 2024-04-25T16:17:03.789 INFO:tasks.workunit.client.0.smithi059.stdout:3/270: dwrite d0/db/f1a [0,4194304] 0 2024-04-25T16:17:03.912 INFO:tasks.workunit.client.0.smithi059.stdout:6/264: creat d9/d27/f51 x:0 0 0 2024-04-25T16:17:03.978 INFO:tasks.workunit.client.0.smithi059.stdout:0/238: creat dc/d37/f4b x:0 0 0 2024-04-25T16:17:04.019 INFO:tasks.workunit.client.0.smithi059.stdout:2/246: mkdir de/d2a/d2e/d36/d59 0 2024-04-25T16:17:04.064 INFO:tasks.workunit.client.0.smithi059.stdout:7/232: symlink d0/d3f/d46/l49 0 2024-04-25T16:17:04.119 INFO:tasks.workunit.client.0.smithi059.stdout:8/230: dwrite d7/dd/d17/f1a [0,4194304] 0 2024-04-25T16:17:04.121 INFO:tasks.workunit.client.0.smithi059.stdout:7/233: chown d0/d7/d16/f1e 809 1 2024-04-25T16:17:04.389 INFO:tasks.workunit.client.0.smithi059.stdout:1/274: rename d7/d15 to d7/d13/d58 0 2024-04-25T16:17:04.390 INFO:tasks.workunit.client.0.smithi059.stdout:5/264: creat d1/d1e/f5c x:0 0 0 2024-04-25T16:17:04.393 INFO:tasks.workunit.client.0.smithi059.stdout:4/237: link d0/d4/df/f12 d0/d4/df/d48/f4e 0 2024-04-25T16:17:04.400 INFO:tasks.workunit.client.0.smithi059.stdout:9/264: fdatasync d6/d35/d28/f3e 0 2024-04-25T16:17:04.448 INFO:tasks.workunit.client.0.smithi059.stdout:8/231: unlink d7/dd/d17/f1a 0 2024-04-25T16:17:04.455 INFO:tasks.workunit.client.0.smithi059.stdout:7/234: truncate d0/d7/d16/f1e 2161629 0 2024-04-25T16:17:04.472 INFO:tasks.workunit.client.0.smithi059.stdout:6/265: chown d9/d16/f1f 30808 1 2024-04-25T16:17:04.484 INFO:tasks.workunit.client.0.smithi059.stdout:1/275: chown d7/d21/c32 7427 1 2024-04-25T16:17:04.608 INFO:tasks.workunit.client.0.smithi059.stdout:3/271: mknod d0/db/d2d/c5c 0 2024-04-25T16:17:04.887 INFO:tasks.workunit.client.0.smithi059.stdout:6/266: fdatasync d9/d1b/f2c 0 2024-04-25T16:17:04.920 INFO:tasks.workunit.client.0.smithi059.stdout:5/265: truncate d1/d1e/d27/f4e 441714 0 2024-04-25T16:17:04.993 INFO:tasks.workunit.client.0.smithi059.stdout:1/276: creat d7/d13/d58/f59 x:0 0 0 2024-04-25T16:17:05.063 INFO:tasks.workunit.client.0.smithi059.stdout:5/266: dread d1/d1e/d21/f23 [0,4194304] 0 2024-04-25T16:17:05.231 INFO:tasks.workunit.client.0.smithi059.stdout:3/272: rmdir d0/d1e 39 2024-04-25T16:17:05.371 INFO:tasks.workunit.client.0.smithi059.stdout:0/239: dwrite dc/df/d24/f39 [8388608,4194304] 0 2024-04-25T16:17:05.833 INFO:tasks.workunit.client.0.smithi059.stdout:6/267: truncate d9/f14 3092035 0 2024-04-25T16:17:05.836 INFO:tasks.workunit.client.0.smithi059.stdout:4/238: fsync d0/d4/df/d1c/f3d 0 2024-04-25T16:17:05.839 INFO:tasks.workunit.client.0.smithi059.stdout:1/277: fsync d7/f30 0 2024-04-25T16:17:05.856 INFO:tasks.workunit.client.0.smithi059.stdout:5/267: creat d1/d1e/d21/d3d/f5d x:0 0 0 2024-04-25T16:17:05.928 INFO:tasks.workunit.client.0.smithi059.stdout:9/265: write d6/f43 [986510,83410] 0 2024-04-25T16:17:06.028 INFO:tasks.workunit.client.0.smithi059.stdout:8/232: dwrite d7/dd/d17/f2e [0,4194304] 0 2024-04-25T16:17:06.470 INFO:tasks.workunit.client.0.smithi059.stdout:0/240: fdatasync dc/dd/d3b/f45 0 2024-04-25T16:17:06.536 INFO:tasks.workunit.client.0.smithi059.stdout:3/273: dwrite d0/db/f30 [0,4194304] 0 2024-04-25T16:17:06.631 INFO:tasks.workunit.client.0.smithi059.stdout:7/235: link d0/d7/f29 d0/d7/d16/d20/d2b/f4a 0 2024-04-25T16:17:07.102 INFO:tasks.workunit.client.0.smithi059.stdout:0/241: creat dc/dd/f4c x:0 0 0 2024-04-25T16:17:07.149 INFO:tasks.workunit.client.0.smithi059.stdout:9/266: mkdir d6/d35/d36/d48/d49 0 2024-04-25T16:17:07.239 INFO:tasks.workunit.client.0.smithi059.stdout:7/236: truncate d0/d7/d16/d20/d2b/d33/f41 3481780 0 2024-04-25T16:17:07.255 INFO:tasks.workunit.client.0.smithi059.stdout:4/239: link d0/f2a d0/d4/df/d44/f4f 0 2024-04-25T16:17:07.265 INFO:tasks.workunit.client.0.smithi059.stdout:4/240: dread - d0/d4/f1b zero size 2024-04-25T16:17:07.302 INFO:tasks.workunit.client.0.smithi059.stdout:0/242: symlink dc/df/d24/l4d 0 2024-04-25T16:17:07.443 INFO:tasks.workunit.client.0.smithi059.stdout:3/274: creat d0/db/d47/d5b/f5d x:0 0 0 2024-04-25T16:17:07.446 INFO:tasks.workunit.client.0.smithi059.stdout:5/268: write d1/f11 [811511,26429] 0 2024-04-25T16:17:07.463 INFO:tasks.workunit.client.0.smithi059.stdout:6/268: write d9/d16/d24/f3f [574771,84741] 0 2024-04-25T16:17:07.504 INFO:tasks.workunit.client.0.smithi059.stdout:0/243: fdatasync dc/dd/f3c 0 2024-04-25T16:17:07.689 INFO:tasks.workunit.client.0.smithi059.stdout:8/233: getdents d7/d2f 0 2024-04-25T16:17:07.725 INFO:tasks.workunit.client.0.smithi059.stdout:2/247: rename de/d2a/d2e/d48 to de/d5a 0 2024-04-25T16:17:07.731 INFO:tasks.workunit.client.0.smithi059.stdout:5/269: fdatasync d1/dd/f46 0 2024-04-25T16:17:07.773 INFO:tasks.workunit.client.0.smithi059.stdout:5/270: chown d1/d1e/d21/d42/f52 3141528 1 2024-04-25T16:17:07.884 INFO:tasks.workunit.client.0.smithi059.stdout:0/244: creat dc/f4e x:0 0 0 2024-04-25T16:17:07.888 INFO:tasks.workunit.client.0.smithi059.stdout:9/267: creat d6/f4a x:0 0 0 2024-04-25T16:17:08.102 INFO:tasks.workunit.client.0.smithi059.stdout:5/271: creat d1/d1e/d21/d24/f5e x:0 0 0 2024-04-25T16:17:08.109 INFO:tasks.workunit.client.0.smithi059.stdout:5/272: chown d1/d1e 5981904 1 2024-04-25T16:17:08.213 INFO:tasks.workunit.client.0.smithi059.stdout:8/234: fsync d7/dd/d17/f42 0 2024-04-25T16:17:08.246 INFO:tasks.workunit.client.0.smithi059.stdout:5/273: dread d1/f10 [0,4194304] 0 2024-04-25T16:17:08.315 INFO:tasks.workunit.client.0.smithi059.stdout:5/274: dread d1/d1e/d21/d24/f38 [0,4194304] 0 2024-04-25T16:17:08.390 INFO:tasks.workunit.client.0.smithi059.stdout:3/275: creat d0/db/d3f/f5e x:0 0 0 2024-04-25T16:17:08.514 INFO:tasks.workunit.client.0.smithi059.stdout:6/269: creat d9/d16/f52 x:0 0 0 2024-04-25T16:17:08.567 INFO:tasks.workunit.client.0.smithi059.stdout:2/248: symlink de/d2a/d2e/d36/d2c/d40/d57/l5b 0 2024-04-25T16:17:08.745 INFO:tasks.workunit.client.0.smithi059.stdout:7/237: rename d0/d7/l13 to d0/l4b 0 2024-04-25T16:17:08.787 INFO:tasks.workunit.client.0.smithi059.stdout:4/241: dwrite d0/f2a [0,4194304] 0 2024-04-25T16:17:08.888 INFO:tasks.workunit.client.0.smithi059.stdout:1/278: link d7/f26 d7/d13/f5a 0 2024-04-25T16:17:08.943 INFO:tasks.workunit.client.0.smithi059.stdout:4/242: sync 2024-04-25T16:17:09.307 INFO:tasks.workunit.client.0.smithi059.stdout:6/270: rmdir d9/d16 39 2024-04-25T16:17:09.314 INFO:tasks.workunit.client.0.smithi059.stdout:2/249: fdatasync de/d16/f43 0 2024-04-25T16:17:09.399 INFO:tasks.workunit.client.0.smithi059.stdout:9/268: creat d6/d35/f4b x:0 0 0 2024-04-25T16:17:09.437 INFO:tasks.workunit.client.0.smithi059.stdout:5/275: mknod d1/d1e/c5f 0 2024-04-25T16:17:09.509 INFO:tasks.workunit.client.0.smithi059.stdout:7/238: unlink d0/d7/d16/d20/d2b/d33/f3b 0 2024-04-25T16:17:09.515 INFO:tasks.workunit.client.0.smithi059.stdout:7/239: chown d0/f30 0 1 2024-04-25T16:17:09.548 INFO:tasks.workunit.client.0.smithi059.stdout:8/235: write d7/d2f/f3f [238522,103074] 0 2024-04-25T16:17:09.777 INFO:tasks.workunit.client.0.smithi059.stdout:2/250: symlink de/d2a/d2e/l5c 0 2024-04-25T16:17:10.064 INFO:tasks.workunit.client.0.smithi059.stdout:5/276: creat d1/d1e/d21/d3d/f60 x:0 0 0 2024-04-25T16:17:10.110 INFO:tasks.workunit.client.0.smithi059.stdout:7/240: dread - d0/d3f/d46/f48 zero size 2024-04-25T16:17:10.199 INFO:tasks.workunit.client.0.smithi059.stdout:5/277: dread d1/dd/f12 [0,4194304] 0 2024-04-25T16:17:10.739 INFO:tasks.workunit.client.0.smithi059.stdout:9/269: getdents d6/d35/d36/d48/d49 0 2024-04-25T16:17:10.741 INFO:tasks.workunit.client.0.smithi059.stdout:7/241: truncate d0/d7/d16/f44 986149 0 2024-04-25T16:17:10.785 INFO:tasks.workunit.client.0.smithi059.stdout:3/276: dwrite d0/f7 [0,4194304] 0 2024-04-25T16:17:10.855 INFO:tasks.workunit.client.0.smithi059.stdout:1/279: link l5 d7/d21/l5b 0 2024-04-25T16:17:11.163 INFO:tasks.workunit.client.0.smithi059.stdout:5/278: write d1/d1e/d21/d42/f52 [112572,111444] 0 2024-04-25T16:17:11.168 INFO:tasks.workunit.client.0.smithi059.stdout:8/236: rename d7/f40 to d7/dd/d17/d23/f4b 0 2024-04-25T16:17:11.173 INFO:tasks.workunit.client.0.smithi059.stdout:4/243: write d0/d4/df/f14 [736010,130231] 0 2024-04-25T16:17:11.189 INFO:tasks.workunit.client.0.smithi059.stdout:6/271: mkdir d9/d16/d53 0 2024-04-25T16:17:11.257 INFO:tasks.workunit.client.0.smithi059.stdout:7/242: rmdir d0/d7/d16/d38 39 2024-04-25T16:17:11.260 INFO:tasks.workunit.client.0.smithi059.stdout:5/279: sync 2024-04-25T16:17:11.271 INFO:tasks.workunit.client.0.smithi059.stdout:9/270: fsync d6/d35/d26/f44 0 2024-04-25T16:17:11.353 INFO:tasks.workunit.client.0.smithi059.stdout:0/245: dwrite dc/f29 [0,4194304] 0 2024-04-25T16:17:11.438 INFO:tasks.workunit.client.0.smithi059.stdout:9/271: chown d6/d35/f3b 708 1 2024-04-25T16:17:11.476 INFO:tasks.workunit.client.0.smithi059.stdout:2/251: getdents de 0 2024-04-25T16:17:11.485 INFO:tasks.workunit.client.0.smithi059.stdout:3/277: fsync d0/d1e/f56 0 2024-04-25T16:17:11.519 INFO:tasks.workunit.client.0.smithi059.stdout:1/280: fdatasync d7/d13/f5a 0 2024-04-25T16:17:11.737 INFO:tasks.workunit.client.0.smithi059.stdout:5/280: dread d1/d1e/d21/d24/f38 [0,4194304] 0 2024-04-25T16:17:11.764 INFO:tasks.workunit.client.0.smithi059.stdout:7/243: mkdir d0/d7/d16/d20/d2b/d33/d4c 0 2024-04-25T16:17:11.783 INFO:tasks.workunit.client.0.smithi059.stdout:6/272: write d9/d1b/f36 [2314830,43953] 0 2024-04-25T16:17:11.809 INFO:tasks.workunit.client.0.smithi059.stdout:6/273: dread - d9/d16/f52 zero size 2024-04-25T16:17:11.865 INFO:tasks.workunit.client.0.smithi059.stdout:9/272: dread d6/f43 [0,4194304] 0 2024-04-25T16:17:11.993 INFO:tasks.workunit.client.0.smithi059.stdout:8/237: rename d7/fa to d7/dd/d33/f4c 0 2024-04-25T16:17:12.113 INFO:tasks.workunit.client.0.smithi059.stdout:1/281: mkdir d7/d13/d16/d5c 0 2024-04-25T16:17:12.218 INFO:tasks.workunit.client.0.smithi059.stdout:2/252: rename f2 to de/d16/d3e/f5d 0 2024-04-25T16:17:12.696 INFO:tasks.workunit.client.0.smithi059.stdout:9/273: mknod d6/c4c 0 2024-04-25T16:17:12.697 INFO:tasks.workunit.client.0.smithi059.stdout:6/274: write d9/d16/d24/f2b [884300,58075] 0 2024-04-25T16:17:12.706 INFO:tasks.workunit.client.0.smithi059.stdout:8/238: symlink d7/d2f/d43/l4d 0 2024-04-25T16:17:12.846 INFO:tasks.workunit.client.0.smithi059.stdout:4/244: link d0/d4/df/d1c/l25 d0/d4/df/d48/l50 0 2024-04-25T16:17:12.936 INFO:tasks.workunit.client.0.smithi059.stdout:7/244: dwrite d0/d7/d16/d20/d2b/f2e [0,4194304] 0 2024-04-25T16:17:13.044 INFO:tasks.workunit.client.0.smithi059.stdout:5/281: dwrite d1/d1e/d21/f39 [0,4194304] 0 2024-04-25T16:17:13.133 INFO:tasks.workunit.client.0.smithi059.stdout:0/246: getdents dc/df 0 2024-04-25T16:17:13.143 INFO:tasks.workunit.client.0.smithi059.stdout:3/278: link d0/l10 d0/l5f 0 2024-04-25T16:17:13.174 INFO:tasks.workunit.client.0.smithi059.stdout:7/245: read d0/d7/f10 [549795,56290] 0 2024-04-25T16:17:13.502 INFO:tasks.workunit.client.0.smithi059.stdout:6/275: write d9/d27/f30 [4789670,88113] 0 2024-04-25T16:17:13.506 INFO:tasks.workunit.client.0.smithi059.stdout:9/274: write d6/d35/d26/f2d [1350299,9432] 0 2024-04-25T16:17:13.552 INFO:tasks.workunit.client.0.smithi059.stdout:2/253: getdents de/d2a/d2e/d36 0 2024-04-25T16:17:13.565 INFO:tasks.workunit.client.0.smithi059.stdout:1/282: getdents d7/d13 0 2024-04-25T16:17:13.574 INFO:tasks.workunit.client.0.smithi059.stdout:4/245: fsync d0/d4/f35 0 2024-04-25T16:17:13.583 INFO:tasks.workunit.client.0.smithi059.stdout:0/247: symlink dc/df/l4f 0 2024-04-25T16:17:13.592 INFO:tasks.workunit.client.0.smithi059.stdout:7/246: unlink d0/f12 0 2024-04-25T16:17:13.606 INFO:tasks.workunit.client.0.smithi059.stdout:8/239: write d7/dd/d17/f42 [6935161,118570] 0 2024-04-25T16:17:13.679 INFO:tasks.workunit.client.0.smithi059.stdout:6/276: chown d9/d27/d39/c50 270760439 1 2024-04-25T16:17:13.785 INFO:tasks.workunit.client.0.smithi059.stdout:0/248: chown dc/f36 2058588 1 2024-04-25T16:17:13.822 INFO:tasks.workunit.client.0.smithi059.stdout:8/240: fsync d7/f1c 0 2024-04-25T16:17:13.892 INFO:tasks.workunit.client.0.smithi059.stdout:1/283: creat d7/d13/d2d/d41/f5d x:0 0 0 2024-04-25T16:17:13.950 INFO:tasks.workunit.client.0.smithi059.stdout:9/275: rename d6/d35/f3b to d6/d35/d2f/f4d 0 2024-04-25T16:17:13.955 INFO:tasks.workunit.client.0.smithi059.stdout:5/282: dwrite d1/f10 [4194304,4194304] 0 2024-04-25T16:17:14.114 INFO:tasks.workunit.client.0.smithi059.stdout:7/247: truncate d0/d7/f1d 353908 0 2024-04-25T16:17:14.124 INFO:tasks.workunit.client.0.smithi059.stdout:2/254: truncate de/d2a/d33/f53 104848 0 2024-04-25T16:17:14.140 INFO:tasks.workunit.client.0.smithi059.stdout:3/279: dwrite d0/f28 [0,4194304] 0 2024-04-25T16:17:14.224 INFO:tasks.workunit.client.0.smithi059.stdout:7/248: chown d0/d7 10060582 1 2024-04-25T16:17:14.252 INFO:tasks.workunit.client.0.smithi059.stdout:3/280: read d0/db/f16 [1771862,111116] 0 2024-04-25T16:17:14.585 INFO:tasks.workunit.client.0.smithi059.stdout:6/277: mkdir d9/d16/d54 0 2024-04-25T16:17:14.597 INFO:tasks.workunit.client.0.smithi059.stdout:0/249: creat dc/d44/f50 x:0 0 0 2024-04-25T16:17:14.613 INFO:tasks.workunit.client.0.smithi059.stdout:7/249: creat d0/d3f/f4d x:0 0 0 2024-04-25T16:17:14.625 INFO:tasks.workunit.client.0.smithi059.stdout:2/255: dread - de/d2a/d2e/d36/d2c/f4e zero size 2024-04-25T16:17:14.710 INFO:tasks.workunit.client.0.smithi059.stdout:0/250: sync 2024-04-25T16:17:14.879 INFO:tasks.workunit.client.0.smithi059.stdout:4/246: fsync d0/d4/df/f19 0 2024-04-25T16:17:14.880 INFO:tasks.workunit.client.0.smithi059.stdout:1/284: write d7/d13/f20 [3963626,61600] 0 2024-04-25T16:17:14.886 INFO:tasks.workunit.client.0.smithi059.stdout:8/241: write d7/dd/d17/d23/d37/f44 [2105432,28833] 0 2024-04-25T16:17:15.025 INFO:tasks.workunit.client.0.smithi059.stdout:4/247: dwrite d0/d4/df/f14 [0,4194304] 0 2024-04-25T16:17:15.101 INFO:tasks.workunit.client.0.smithi059.stdout:0/251: creat dc/df/d24/f51 x:0 0 0 2024-04-25T16:17:15.115 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:17:15.118 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:17:15.122 INFO:tasks.workunit.client.0.smithi059.stdout:4/248: dread - d0/d4/f1b zero size 2024-04-25T16:17:15.375 INFO:tasks.workunit.client.0.smithi059.stdout:5/283: write d1/fa [2783565,110332] 0 2024-04-25T16:17:15.386 INFO:tasks.workunit.client.0.smithi059.stdout:9/276: write d6/d35/f29 [986980,116440] 0 2024-04-25T16:17:15.405 INFO:tasks.workunit.client.0.smithi059.stdout:3/281: write d0/d1e/f32 [791050,61131] 0 2024-04-25T16:17:15.446 INFO:tasks.workunit.client.0.smithi059.stdout:3/282: write d0/f28 [910659,130032] 0 2024-04-25T16:17:15.607 INFO:tasks.workunit.client.0.smithi059.stdout:1/285: rename d7/d13/d58/f34 to d7/d13/d58/f5e 0 2024-04-25T16:17:15.613 INFO:tasks.workunit.client.0.smithi059.stdout:6/278: mkdir d9/d16/d53/d55 0 2024-04-25T16:17:15.641 INFO:tasks.workunit.client.0.smithi059.stdout:6/279: stat d9/d27 0 2024-04-25T16:17:15.809 INFO:tasks.workunit.client.0.smithi059.stdout:2/256: dwrite de/d2a/f35 [0,4194304] 0 2024-04-25T16:17:15.875 INFO:tasks.workunit.client.0.smithi059.stdout:5/284: creat d1/d1e/d21/f61 x:0 0 0 2024-04-25T16:17:15.932 INFO:tasks.workunit.client.0.smithi059.stdout:3/283: dread d0/db/f1a [0,4194304] 0 2024-04-25T16:17:16.123 INFO:tasks.workunit.client.0.smithi059.stdout:0/252: mkdir dc/d37/d52 0 2024-04-25T16:17:16.252 INFO:tasks.workunit.client.0.smithi059.stdout:1/286: dread d7/d13/d16/f46 [0,4194304] 0 2024-04-25T16:17:16.400 INFO:tasks.workunit.client.0.smithi059.stdout:6/280: unlink d9/d1b/f33 0 2024-04-25T16:17:16.441 INFO:tasks.workunit.client.0.smithi059.stdout:2/257: stat fb 0 2024-04-25T16:17:16.480 INFO:tasks.workunit.client.0.smithi059.stdout:8/242: creat d7/dd/d17/f4e x:0 0 0 2024-04-25T16:17:16.513 INFO:tasks.workunit.client.0.smithi059.stdout:5/285: fdatasync d1/f29 0 2024-04-25T16:17:16.537 INFO:tasks.workunit.client.0.smithi059.stdout:9/277: mkdir d6/d4e 0 2024-04-25T16:17:16.554 INFO:tasks.workunit.client.0.smithi059.stdout:9/278: write d6/d35/d26/f2d [1011566,80871] 0 2024-04-25T16:17:16.698 INFO:tasks.workunit.client.0.smithi059.stdout:3/284: rename d0/db/d47/l3b to d0/d1e/d57/l60 0 2024-04-25T16:17:16.734 INFO:tasks.workunit.client.0.smithi059.stdout:0/253: chown dc/f1f 2 1 2024-04-25T16:17:16.805 INFO:tasks.workunit.client.0.smithi059.stdout:8/243: mknod d7/d16/d36/c4f 0 2024-04-25T16:17:16.818 INFO:tasks.workunit.client.0.smithi059.stdout:8/244: chown d7/f20 27 1 2024-04-25T16:17:16.834 INFO:tasks.workunit.client.0.smithi059.stdout:7/250: write d0/d7/d16/d20/f35 [1093702,115837] 0 2024-04-25T16:17:16.848 INFO:tasks.workunit.client.0.smithi059.stdout:7/251: dread - d0/f30 zero size 2024-04-25T16:17:16.978 INFO:tasks.workunit.client.0.smithi059.stdout:4/249: dwrite d0/f2a [0,4194304] 0 2024-04-25T16:17:17.043 INFO:tasks.workunit.client.0.smithi059.stdout:5/286: creat d1/d1e/d21/d24/f62 x:0 0 0 2024-04-25T16:17:17.353 INFO:tasks.workunit.client.0.smithi059.stdout:9/279: rename d6/f1c to d6/d35/d2f/d39/f4f 0 2024-04-25T16:17:17.424 INFO:tasks.workunit.client.0.smithi059.stdout:3/285: truncate d0/d1e/f52 274175 0 2024-04-25T16:17:17.443 INFO:tasks.workunit.client.0.smithi059.stdout:3/286: write d0/db/f30 [8433904,107888] 0 2024-04-25T16:17:17.456 INFO:tasks.workunit.client.0.smithi059.stdout:3/287: chown d0/l33 27470557 1 2024-04-25T16:17:17.547 INFO:tasks.workunit.client.0.smithi059.stdout:8/245: creat d7/d16/d3a/f50 x:0 0 0 2024-04-25T16:17:17.853 INFO:tasks.workunit.client.0.smithi059.stdout:0/254: creat dc/dd/f53 x:0 0 0 2024-04-25T16:17:17.853 INFO:tasks.workunit.client.0.smithi059.stdout:6/281: creat d9/f56 x:0 0 0 2024-04-25T16:17:17.876 INFO:tasks.workunit.client.0.smithi059.stdout:0/255: chown dc/dd/f53 46271 1 2024-04-25T16:17:17.885 INFO:tasks.workunit.client.0.smithi059.stdout:6/282: write d9/d16/d24/f2b [1479539,14613] 0 2024-04-25T16:17:18.054 INFO:tasks.workunit.client.0.smithi059.stdout:7/252: mkdir d0/d7/d16/d20/d2b/d33/d4c/d4e 0 2024-04-25T16:17:18.091 INFO:tasks.workunit.client.0.smithi059.stdout:2/258: dwrite fb [0,4194304] 0 2024-04-25T16:17:18.172 INFO:tasks.workunit.client.0.smithi059.stdout:1/287: dwrite d7/d13/d2d/d4a/f56 [0,4194304] 0 2024-04-25T16:17:18.287 INFO:tasks.workunit.client.0.smithi059.stdout:1/288: dread - d7/d2a/f3d zero size 2024-04-25T16:17:18.377 INFO:tasks.workunit.client.0.smithi059.stdout:1/289: chown d7/d13/d2d/d4a/c55 402 1 2024-04-25T16:17:18.389 INFO:tasks.workunit.client.0.smithi059.stdout:7/253: dread d0/d7/f10 [0,4194304] 0 2024-04-25T16:17:18.406 INFO:tasks.workunit.client.0.smithi059.stdout:1/290: chown d7/d13/d16/f50 11286457 1 2024-04-25T16:17:18.466 INFO:tasks.workunit.client.0.smithi059.stdout:8/246: symlink d7/l51 0 2024-04-25T16:17:18.498 INFO:tasks.workunit.client.0.smithi059.stdout:5/287: write d1/d1e/d21/f23 [1333182,96331] 0 2024-04-25T16:17:18.637 INFO:tasks.workunit.client.0.smithi059.stdout:6/283: mknod d9/d16/c57 0 2024-04-25T16:17:18.650 INFO:tasks.workunit.client.0.smithi059.stdout:0/256: unlink l3 0 2024-04-25T16:17:18.741 INFO:tasks.workunit.client.0.smithi059.stdout:2/259: symlink de/d2a/d2e/l5e 0 2024-04-25T16:17:18.758 INFO:tasks.workunit.client.0.smithi059.stdout:1/291: mknod d7/d2a/c5f 0 2024-04-25T16:17:18.762 INFO:tasks.workunit.client.0.smithi059.stdout:6/284: sync 2024-04-25T16:17:18.821 INFO:tasks.workunit.client.0.smithi059.stdout:0/257: stat dc/d37/d52 0 2024-04-25T16:17:18.836 INFO:tasks.workunit.client.0.smithi059.stdout:3/288: dwrite d0/f3e [0,4194304] 0 2024-04-25T16:17:18.988 INFO:tasks.workunit.client.0.smithi059.stdout:9/280: dwrite d6/f18 [0,4194304] 0 2024-04-25T16:17:18.992 INFO:tasks.workunit.client.0.smithi059.stdout:4/250: dwrite d0/f39 [0,4194304] 0 2024-04-25T16:17:19.050 INFO:tasks.workunit.client.0.smithi059.stdout:5/288: creat d1/f63 x:0 0 0 2024-04-25T16:17:19.057 INFO:tasks.workunit.client.0.smithi059.stdout:3/289: dread - d0/f27 zero size 2024-04-25T16:17:19.065 INFO:tasks.workunit.client.0.smithi059.stdout:9/281: stat f1 0 2024-04-25T16:17:19.074 INFO:tasks.workunit.client.0.smithi059.stdout:7/254: unlink d0/d7/d16/f1e 0 2024-04-25T16:17:19.112 INFO:tasks.workunit.client.0.smithi059.stdout:2/260: mknod de/d2a/d33/c5f 0 2024-04-25T16:17:19.168 INFO:tasks.workunit.client.0.smithi059.stdout:6/285: dread d9/f4b [0,4194304] 0 2024-04-25T16:17:19.443 INFO:tasks.workunit.client.0.smithi059.stdout:8/247: creat d7/d16/f52 x:0 0 0 2024-04-25T16:17:19.499 INFO:tasks.workunit.client.0.smithi059.stdout:0/258: truncate dc/df/d24/f25 6581116 0 2024-04-25T16:17:19.515 INFO:tasks.workunit.client.0.smithi059.stdout:7/255: chown d0/l18 4 1 2024-04-25T16:17:19.522 INFO:tasks.workunit.client.0.smithi059.stdout:9/282: read d6/d35/d26/f33 [3319831,84023] 0 2024-04-25T16:17:19.563 INFO:tasks.workunit.client.0.smithi059.stdout:9/283: chown d6/c22 2 1 2024-04-25T16:17:19.650 INFO:tasks.workunit.client.0.smithi059.stdout:4/251: symlink d0/d4/df/l51 0 2024-04-25T16:17:19.810 INFO:tasks.workunit.client.0.smithi059.stdout:2/261: mknod de/d2a/d2e/d36/d59/c60 0 2024-04-25T16:17:19.815 INFO:tasks.workunit.client.0.smithi059.stdout:5/289: write d1/d1e/d21/f39 [3215976,31544] 0 2024-04-25T16:17:19.850 INFO:tasks.workunit.client.0.smithi059.stdout:5/290: dread d1/d1e/f20 [0,4194304] 0 2024-04-25T16:17:19.863 INFO:tasks.workunit.client.0.smithi059.stdout:5/291: dread - d1/d1e/d21/f61 zero size 2024-04-25T16:17:19.871 INFO:tasks.workunit.client.0.smithi059.stdout:5/292: readlink d1/d1e/l2f 0 2024-04-25T16:17:20.170 INFO:tasks.workunit.client.0.smithi059.stdout:6/286: write d9/d16/d24/f32 [322708,26632] 0 2024-04-25T16:17:20.277 INFO:tasks.workunit.client.0.smithi059.stdout:4/252: creat d0/d4/df/d1c/d45/f52 x:0 0 0 2024-04-25T16:17:20.280 INFO:tasks.workunit.client.0.smithi059.stdout:1/292: link d7/d13/d2d/d41/l42 d7/d13/d16/d5c/l60 0 2024-04-25T16:17:20.286 INFO:tasks.workunit.client.0.smithi059.stdout:2/262: creat de/d2a/d2e/d36/d59/f61 x:0 0 0 2024-04-25T16:17:20.384 INFO:tasks.workunit.client.0.smithi059.stdout:7/256: dread d0/d7/d16/d20/d2b/d33/f39 [0,4194304] 0 2024-04-25T16:17:20.447 INFO:tasks.workunit.client.0.smithi059.stdout:4/253: dread d0/d4/df/d1c/f37 [0,4194304] 0 2024-04-25T16:17:20.577 INFO:tasks.workunit.client.0.smithi059.stdout:0/259: truncate dc/f3a 3595009 0 2024-04-25T16:17:20.644 INFO:tasks.workunit.client.0.smithi059.stdout:8/248: write d7/dd/f31 [1382480,10491] 0 2024-04-25T16:17:20.721 INFO:tasks.workunit.client.0.smithi059.stdout:9/284: dwrite d6/f4a [0,4194304] 0 2024-04-25T16:17:20.786 INFO:tasks.workunit.client.0.smithi059.stdout:1/293: creat d7/d13/d2d/f61 x:0 0 0 2024-04-25T16:17:20.814 INFO:tasks.workunit.client.0.smithi059.stdout:2/263: truncate de/d2a/d2e/d36/f51 609061 0 2024-04-25T16:17:20.963 INFO:tasks.workunit.client.0.smithi059.stdout:7/257: truncate d0/d7/fa 9274134 0 2024-04-25T16:17:20.988 INFO:tasks.workunit.client.0.smithi059.stdout:7/258: chown d0/f27 24493 1 2024-04-25T16:17:21.035 INFO:tasks.workunit.client.0.smithi059.stdout:3/290: rename d0/l2 to d0/db/d3f/l61 0 2024-04-25T16:17:21.673 INFO:tasks.workunit.client.0.smithi059.stdout:8/249: rmdir d7/dd/d17/d23/d37 39 2024-04-25T16:17:21.683 INFO:tasks.workunit.client.0.smithi059.stdout:1/294: mkdir d7/d2a/d62 0 2024-04-25T16:17:21.701 INFO:tasks.workunit.client.0.smithi059.stdout:4/254: truncate d0/d4/df/f12 3221443 0 2024-04-25T16:17:21.721 INFO:tasks.workunit.client.0.smithi059.stdout:6/287: rename d9/d2e to d9/d1b/d58 0 2024-04-25T16:17:21.728 INFO:tasks.workunit.client.0.smithi059.stdout:3/291: readlink d0/l8 0 2024-04-25T16:17:21.795 INFO:tasks.workunit.client.0.smithi059.stdout:8/250: sync 2024-04-25T16:17:21.911 INFO:tasks.workunit.client.0.smithi059.stdout:5/293: write d1/d1e/d21/d3d/f55 [369120,2195] 0 2024-04-25T16:17:21.995 INFO:tasks.workunit.client.0.smithi059.stdout:2/264: dread de/d2a/d2e/f3f [0,4194304] 0 2024-04-25T16:17:22.019 INFO:tasks.workunit.client.0.smithi059.stdout:6/288: dread d9/d16/f1f [0,4194304] 0 2024-04-25T16:17:22.038 INFO:tasks.workunit.client.0.smithi059.stdout:1/295: creat d7/d13/f63 x:0 0 0 2024-04-25T16:17:22.093 INFO:tasks.workunit.client.0.smithi059.stdout:3/292: mknod d0/db/d47/c62 0 2024-04-25T16:17:22.141 INFO:tasks.workunit.client.0.smithi059.stdout:4/255: symlink d0/d4/df/d44/l53 0 2024-04-25T16:17:22.198 INFO:tasks.workunit.client.0.smithi059.stdout:3/293: dwrite d0/db/f30 [0,4194304] 0 2024-04-25T16:17:22.259 INFO:tasks.workunit.client.0.smithi059.stdout:0/260: rmdir dc/d37/d52 0 2024-04-25T16:17:22.315 INFO:tasks.workunit.client.0.smithi059.stdout:5/294: symlink d1/dd/l64 0 2024-04-25T16:17:22.388 INFO:tasks.workunit.client.0.smithi059.stdout:2/265: symlink de/d2a/d2e/d36/d2c/l62 0 2024-04-25T16:17:22.435 INFO:tasks.workunit.client.0.smithi059.stdout:1/296: symlink d7/d2a/l64 0 2024-04-25T16:17:22.510 INFO:tasks.workunit.client.0.smithi059.stdout:9/285: dwrite d6/d35/d26/f33 [0,4194304] 0 2024-04-25T16:17:22.650 INFO:tasks.workunit.client.0.smithi059.stdout:3/294: mknod d0/d1e/d57/c63 0 2024-04-25T16:17:22.713 INFO:tasks.workunit.client.0.smithi059.stdout:7/259: dwrite d0/d7/d16/d20/d2b/f2e [0,4194304] 0 2024-04-25T16:17:22.774 INFO:tasks.workunit.client.0.smithi059.stdout:5/295: mknod d1/d1e/d27/c65 0 2024-04-25T16:17:23.151 INFO:tasks.workunit.client.0.smithi059.stdout:3/295: readlink d0/db/d3f/d49/l51 0 2024-04-25T16:17:23.171 INFO:tasks.workunit.client.0.smithi059.stdout:0/261: getdents dc/d37/d47 0 2024-04-25T16:17:23.234 INFO:tasks.workunit.client.0.smithi059.stdout:6/289: creat d9/f59 x:0 0 0 2024-04-25T16:17:23.327 INFO:tasks.workunit.client.0.smithi059.stdout:5/296: mkdir d1/d1e/d27/d66 0 2024-04-25T16:17:23.408 INFO:tasks.workunit.client.0.smithi059.stdout:7/260: dread d0/d7/d16/f2a [0,4194304] 0 2024-04-25T16:17:23.419 INFO:tasks.workunit.client.0.smithi059.stdout:9/286: truncate d6/d35/d2f/d39/f4f 840664 0 2024-04-25T16:17:23.495 INFO:tasks.workunit.client.0.smithi059.stdout:8/251: dwrite d7/dd/d17/d23/f4b [0,4194304] 0 2024-04-25T16:17:23.573 INFO:tasks.workunit.client.0.smithi059.stdout:3/296: truncate d0/db/d3f/f5e 733972 0 2024-04-25T16:17:23.581 INFO:tasks.workunit.client.0.smithi059.stdout:2/266: write de/d16/f3d [591244,27972] 0 2024-04-25T16:17:23.645 INFO:tasks.workunit.client.0.smithi059.stdout:3/297: read d0/d1e/f32 [2060474,64933] 0 2024-04-25T16:17:23.675 INFO:tasks.workunit.client.0.smithi059.stdout:6/290: symlink d9/d1b/l5a 0 2024-04-25T16:17:23.681 INFO:tasks.workunit.client.0.smithi059.stdout:0/262: fsync dc/dd/f48 0 2024-04-25T16:17:23.687 INFO:tasks.workunit.client.0.smithi059.stdout:4/256: getdents d0/d4/df/d48 0 2024-04-25T16:17:23.723 INFO:tasks.workunit.client.0.smithi059.stdout:5/297: rename d1/dd/f46 to d1/d1e/d21/d3d/d44/f67 0 2024-04-25T16:17:24.405 INFO:tasks.workunit.client.0.smithi059.stdout:0/263: fsync dc/dd/f48 0 2024-04-25T16:17:24.409 INFO:tasks.workunit.client.0.smithi059.stdout:2/267: creat de/d2a/d2e/d36/d2c/f63 x:0 0 0 2024-04-25T16:17:24.420 INFO:tasks.workunit.client.0.smithi059.stdout:6/291: rmdir d9/d1b/d58/d49 39 2024-04-25T16:17:24.426 INFO:tasks.workunit.client.0.smithi059.stdout:4/257: unlink d0/d4/df/d1c/c40 0 2024-04-25T16:17:24.433 INFO:tasks.workunit.client.0.smithi059.stdout:8/252: rename d7/dd/d17/d23/f4b to d7/d2f/f53 0 2024-04-25T16:17:24.444 INFO:tasks.workunit.client.0.smithi059.stdout:5/298: mknod d1/d48/c68 0 2024-04-25T16:17:24.453 INFO:tasks.workunit.client.0.smithi059.stdout:7/261: mkdir d0/d7/d16/d20/d2b/d33/d4c/d4e/d4f 0 2024-04-25T16:17:24.486 INFO:tasks.workunit.client.0.smithi059.stdout:6/292: chown d9/d16/f26 1479 1 2024-04-25T16:17:24.519 INFO:tasks.workunit.client.0.smithi059.stdout:8/253: sync 2024-04-25T16:17:24.550 INFO:tasks.workunit.client.0.smithi059.stdout:2/268: truncate de/d2a/d2e/d36/d59/f61 897202 0 2024-04-25T16:17:24.887 INFO:tasks.workunit.client.0.smithi059.stdout:3/298: mknod d0/db/d2d/c64 0 2024-04-25T16:17:24.909 INFO:tasks.workunit.client.0.smithi059.stdout:7/262: truncate d0/d3f/f4d 472088 0 2024-04-25T16:17:24.910 INFO:tasks.workunit.client.0.smithi059.stdout:6/293: chown d9/d1b/d58/d49 98 1 2024-04-25T16:17:24.917 INFO:tasks.workunit.client.0.smithi059.stdout:5/299: truncate d1/d1e/f5c 796406 0 2024-04-25T16:17:24.929 INFO:tasks.workunit.client.0.smithi059.stdout:2/269: mknod de/d2a/c64 0 2024-04-25T16:17:25.059 INFO:tasks.workunit.client.0.smithi059.stdout:9/287: getdents d6 0 2024-04-25T16:17:25.458 INFO:tasks.workunit.client.0.smithi059.stdout:7/263: creat d0/d3f/f50 x:0 0 0 2024-04-25T16:17:25.514 INFO:tasks.workunit.client.0.smithi059.stdout:1/297: dwrite d7/d13/d2d/d4a/f4b [0,4194304] 0 2024-04-25T16:17:25.792 INFO:tasks.workunit.client.0.smithi059.stdout:0/264: mknod dc/df/c54 0 2024-04-25T16:17:25.954 INFO:tasks.workunit.client.0.smithi059.stdout:4/258: write d0/d4/df/f19 [2409948,11931] 0 2024-04-25T16:17:26.073 INFO:tasks.workunit.client.0.smithi059.stdout:1/298: readlink d7/d13/l18 0 2024-04-25T16:17:26.148 INFO:tasks.workunit.client.0.smithi059.stdout:8/254: dwrite d7/dd/d17/f2e [0,4194304] 0 2024-04-25T16:17:26.450 INFO:tasks.workunit.client.0.smithi059.stdout:4/259: mkdir d0/d4/df/d1c/d45/d54 0 2024-04-25T16:17:26.564 INFO:tasks.workunit.client.0.smithi059.stdout:2/270: write de/f1d [1472557,22132] 0 2024-04-25T16:17:26.603 INFO:tasks.workunit.client.0.smithi059.stdout:9/288: write d6/f1b [314025,105627] 0 2024-04-25T16:17:26.660 INFO:tasks.workunit.client.0.smithi059.stdout:2/271: readlink de/d2a/d2e/l5e 0 2024-04-25T16:17:26.715 INFO:tasks.workunit.client.0.smithi059.stdout:6/294: getdents d9/d16 0 2024-04-25T16:17:26.729 INFO:tasks.workunit.client.0.smithi059.stdout:9/289: chown d6/l1e 3 1 2024-04-25T16:17:26.765 INFO:tasks.workunit.client.0.smithi059.stdout:5/300: dwrite d1/d1e/d21/d3d/f5d [0,4194304] 0 2024-04-25T16:17:26.827 INFO:tasks.workunit.client.0.smithi059.stdout:6/295: readlink d9/d16/l1d 0 2024-04-25T16:17:26.842 INFO:tasks.workunit.client.0.smithi059.stdout:4/260: read d0/d4/df/f14 [2613115,22446] 0 2024-04-25T16:17:27.054 INFO:tasks.workunit.client.0.smithi059.stdout:3/299: write d0/db/d2d/f58 [326647,42735] 0 2024-04-25T16:17:27.365 INFO:tasks.workunit.client.0.smithi059.stdout:2/272: mkdir de/d2a/d33/d65 0 2024-04-25T16:17:27.656 INFO:tasks.workunit.client.0.smithi059.stdout:3/300: read - d0/d1e/f56 zero size 2024-04-25T16:17:27.660 INFO:tasks.workunit.client.0.smithi059.stdout:4/261: chown d0/d4/df/d48/f4e 102 1 2024-04-25T16:17:27.775 INFO:tasks.workunit.client.0.smithi059.stdout:1/299: rename d7/d13/l17 to d7/d13/d16/d5c/l65 0 2024-04-25T16:17:27.794 INFO:tasks.workunit.client.0.smithi059.stdout:1/300: readlink d7/lf 0 2024-04-25T16:17:27.933 INFO:tasks.workunit.client.0.smithi059.stdout:5/301: creat d1/d1e/d27/d66/f69 x:0 0 0 2024-04-25T16:17:27.998 INFO:tasks.workunit.client.0.smithi059.stdout:7/264: mkdir d0/d7/d51 0 2024-04-25T16:17:28.007 INFO:tasks.workunit.client.0.smithi059.stdout:7/265: chown d0/d7/f10 98679408 1 2024-04-25T16:17:28.125 INFO:tasks.workunit.client.0.smithi059.stdout:3/301: mkdir d0/db/d3f/d49/d65 0 2024-04-25T16:17:28.135 INFO:tasks.workunit.client.0.smithi059.stdout:3/302: chown d0/db/d2d/c64 63999059 1 2024-04-25T16:17:28.207 INFO:tasks.workunit.client.0.smithi059.stdout:8/255: link d7/l10 d7/dd/l54 0 2024-04-25T16:17:28.342 INFO:tasks.workunit.client.0.smithi059.stdout:0/265: truncate dc/df/d24/f25 6079830 0 2024-04-25T16:17:28.345 INFO:tasks.workunit.client.0.smithi059.stdout:5/302: symlink d1/l6a 0 2024-04-25T16:17:28.359 INFO:tasks.workunit.client.0.smithi059.stdout:0/266: chown l8 158 1 2024-04-25T16:17:28.366 INFO:tasks.workunit.client.0.smithi059.stdout:0/267: stat dc/dd/f20 0 2024-04-25T16:17:28.666 INFO:tasks.workunit.client.0.smithi059.stdout:6/296: write d9/d1b/f36 [2408656,57690] 0 2024-04-25T16:17:28.750 INFO:tasks.workunit.client.0.smithi059.stdout:2/273: write de/d16/f31 [1107937,121289] 0 2024-04-25T16:17:28.786 INFO:tasks.workunit.client.0.smithi059.stdout:6/297: read d9/d16/f1f [401321,31737] 0 2024-04-25T16:17:28.844 INFO:tasks.workunit.client.0.smithi059.stdout:5/303: fdatasync d1/dd/f34 0 2024-04-25T16:17:28.854 INFO:tasks.workunit.client.0.smithi059.stdout:7/266: creat d0/d7/d16/d20/d2b/d33/d4c/d4e/d4f/f52 x:0 0 0 2024-04-25T16:17:28.947 INFO:tasks.workunit.client.0.smithi059.stdout:9/290: dwrite d6/d35/d26/f44 [4194304,4194304] 0 2024-04-25T16:17:29.055 INFO:tasks.workunit.client.0.smithi059.stdout:4/262: dwrite d0/d4/df/d44/f46 [0,4194304] 0 2024-04-25T16:17:29.055 INFO:tasks.workunit.client.0.smithi059.stdout:9/291: stat d6/l1e 0 2024-04-25T16:17:29.133 INFO:tasks.workunit.client.0.smithi059.stdout:4/263: stat d0/d4/df/d48/c4a 0 2024-04-25T16:17:29.262 INFO:tasks.workunit.client.0.smithi059.stdout:0/268: symlink dc/d37/d47/l55 0 2024-04-25T16:17:29.284 INFO:tasks.workunit.client.0.smithi059.stdout:3/303: creat d0/db/d2d/f66 x:0 0 0 2024-04-25T16:17:29.290 INFO:tasks.workunit.client.0.smithi059.stdout:8/256: creat d7/d16/f55 x:0 0 0 2024-04-25T16:17:29.318 INFO:tasks.workunit.client.0.smithi059.stdout:1/301: mknod d7/d13/d16/c66 0 2024-04-25T16:17:29.381 INFO:tasks.workunit.client.0.smithi059.stdout:9/292: fsync d6/d35/d26/f33 0 2024-04-25T16:17:29.503 INFO:tasks.workunit.client.0.smithi059.stdout:6/298: dread d9/fe [0,4194304] 0 2024-04-25T16:17:29.771 INFO:tasks.workunit.client.0.smithi059.stdout:8/257: truncate d7/dd/f3c 701380 0 2024-04-25T16:17:29.772 INFO:tasks.workunit.client.0.smithi059.stdout:4/264: getdents d0/d4/df/d1c/d45/d54 0 2024-04-25T16:17:29.902 INFO:tasks.workunit.client.0.smithi059.stdout:0/269: dwrite f9 [4194304,4194304] 0 2024-04-25T16:17:29.912 INFO:tasks.workunit.client.0.smithi059.stdout:1/302: rename d7/d21/f23 to d7/d2a/f67 0 2024-04-25T16:17:29.977 INFO:tasks.workunit.client.0.smithi059.stdout:2/274: link de/d2a/d2e/l37 de/d2a/d2e/l66 0 2024-04-25T16:17:29.993 INFO:tasks.workunit.client.0.smithi059.stdout:5/304: dwrite d1/d1e/f20 [0,4194304] 0 2024-04-25T16:17:30.081 INFO:tasks.workunit.client.0.smithi059.stdout:9/293: creat d6/d35/d28/f50 x:0 0 0 2024-04-25T16:17:30.097 INFO:tasks.workunit.client.0.smithi059.stdout:7/267: creat d0/d7/d16/f53 x:0 0 0 2024-04-25T16:17:30.174 INFO:tasks.workunit.client.0.smithi059.stdout:1/303: dread d7/d13/d16/f33 [0,4194304] 0 2024-04-25T16:17:30.255 INFO:tasks.workunit.client.0.smithi059.stdout:0/270: fsync dc/d44/f50 0 2024-04-25T16:17:30.310 INFO:tasks.workunit.client.0.smithi059.stdout:0/271: chown dc/d44/f35 65735 1 2024-04-25T16:17:30.380 INFO:tasks.workunit.client.0.smithi059.stdout:6/299: dwrite d9/d16/d24/f32 [0,4194304] 0 2024-04-25T16:17:30.501 INFO:tasks.workunit.client.0.smithi059.stdout:2/275: mkdir de/d67 0 2024-04-25T16:17:30.507 INFO:tasks.workunit.client.0.smithi059.stdout:9/294: mknod d6/d35/d36/d48/c51 0 2024-04-25T16:17:30.523 INFO:tasks.workunit.client.0.smithi059.stdout:8/258: rename d7/d16/c19 to d7/d16/d45/c56 0 2024-04-25T16:17:30.533 INFO:tasks.workunit.client.0.smithi059.stdout:9/295: stat d6/fb 0 2024-04-25T16:17:30.569 INFO:tasks.workunit.client.0.smithi059.stdout:9/296: truncate d6/d35/d28/f50 686239 0 2024-04-25T16:17:30.745 INFO:tasks.workunit.client.0.smithi059.stdout:3/304: getdents d0/d1e/d57 0 2024-04-25T16:17:30.990 INFO:tasks.workunit.client.0.smithi059.stdout:1/304: write d7/d21/f49 [868682,80408] 0 2024-04-25T16:17:31.118 INFO:tasks.workunit.client.0.smithi059.stdout:4/265: rename d0/d4/df/d1c/l36 to d0/d4/df/d1c/d45/d54/l55 0 2024-04-25T16:17:31.297 INFO:tasks.workunit.client.0.smithi059.stdout:8/259: fdatasync d7/dd/d17/f42 0 2024-04-25T16:17:31.373 INFO:tasks.workunit.client.0.smithi059.stdout:0/272: dwrite dc/f29 [0,4194304] 0 2024-04-25T16:17:31.443 INFO:tasks.workunit.client.0.smithi059.stdout:6/300: mknod d9/d16/d53/d55/c5b 0 2024-04-25T16:17:31.443 INFO:tasks.workunit.client.0.smithi059.stdout:9/297: creat d6/d35/d2f/d39/f52 x:0 0 0 2024-04-25T16:17:31.452 INFO:tasks.workunit.client.0.smithi059.stdout:7/268: creat d0/d7/d16/f54 x:0 0 0 2024-04-25T16:17:31.591 INFO:tasks.workunit.client.0.smithi059.stdout:5/305: rename d1/d1e/d27/l36 to d1/dd/l6b 0 2024-04-25T16:17:31.605 INFO:tasks.workunit.client.0.smithi059.stdout:8/260: mkdir d7/dd/d33/d57 0 2024-04-25T16:17:31.836 INFO:tasks.workunit.client.0.smithi059.stdout:9/298: mknod d6/d35/d2f/c53 0 2024-04-25T16:17:31.971 INFO:tasks.workunit.client.0.smithi059.stdout:1/305: mknod d7/d2a/d62/c68 0 2024-04-25T16:17:31.973 INFO:tasks.workunit.client.0.smithi059.stdout:3/305: rename d0 to d0/db/d2d/d67 22 2024-04-25T16:17:32.148 INFO:tasks.workunit.client.0.smithi059.stdout:8/261: unlink d7/dd/f31 0 2024-04-25T16:17:32.181 INFO:tasks.workunit.client.0.smithi059.stdout:6/301: creat d9/d16/d54/f5c x:0 0 0 2024-04-25T16:17:32.274 INFO:tasks.workunit.client.0.smithi059.stdout:4/266: dwrite d0/f2a [0,4194304] 0 2024-04-25T16:17:32.405 INFO:tasks.workunit.client.0.smithi059.stdout:9/299: rmdir d6/d35/d2f 39 2024-04-25T16:17:32.465 INFO:tasks.workunit.client.0.smithi059.stdout:4/267: fdatasync d0/d4/df/d44/f4f 0 2024-04-25T16:17:32.467 INFO:tasks.workunit.client.0.smithi059.stdout:5/306: write d1/dd/ff [3638715,19449] 0 2024-04-25T16:17:32.561 INFO:tasks.workunit.client.0.smithi059.stdout:3/306: mkdir d0/db/d68 0 2024-04-25T16:17:32.564 INFO:tasks.workunit.client.0.smithi059.stdout:8/262: mknod d7/dd/d33/c58 0 2024-04-25T16:17:32.582 INFO:tasks.workunit.client.0.smithi059.stdout:6/302: truncate d9/d16/f17 1606696 0 2024-04-25T16:17:32.719 INFO:tasks.workunit.client.0.smithi059.stdout:2/276: dwrite de/d2a/d2e/f58 [0,4194304] 0 2024-04-25T16:17:32.781 INFO:tasks.workunit.client.0.smithi059.stdout:0/273: dwrite dc/d37/f4b [0,4194304] 0 2024-04-25T16:17:32.859 INFO:tasks.workunit.client.0.smithi059.stdout:7/269: dwrite d0/d7/d16/d20/f35 [0,4194304] 0 2024-04-25T16:17:32.910 INFO:tasks.workunit.client.0.smithi059.stdout:0/274: sync 2024-04-25T16:17:33.127 INFO:tasks.workunit.client.0.smithi059.stdout:9/300: mkdir d6/d4e/d54 0 2024-04-25T16:17:33.137 INFO:tasks.workunit.client.0.smithi059.stdout:5/307: rename d1/d1e to d1/d1e/d6c 22 2024-04-25T16:17:33.145 INFO:tasks.workunit.client.0.smithi059.stdout:1/306: creat d7/f69 x:0 0 0 2024-04-25T16:17:33.163 INFO:tasks.workunit.client.0.smithi059.stdout:3/307: mknod d0/db/d47/c69 0 2024-04-25T16:17:33.220 INFO:tasks.workunit.client.0.smithi059.stdout:2/277: truncate fd 5184205 0 2024-04-25T16:17:33.224 INFO:tasks.workunit.client.0.smithi059.stdout:7/270: mknod d0/d3f/c55 0 2024-04-25T16:17:33.251 INFO:tasks.workunit.client.0.smithi059.stdout:2/278: chown de/d2a/d2e/d36/c42 439901 1 2024-04-25T16:17:33.561 INFO:tasks.workunit.client.0.smithi059.stdout:8/263: write d7/d2f/f3f [34790,56572] 0 2024-04-25T16:17:33.570 INFO:tasks.workunit.client.0.smithi059.stdout:0/275: write dc/d44/f35 [142113,118252] 0 2024-04-25T16:17:33.634 INFO:tasks.workunit.client.0.smithi059.stdout:9/301: creat d6/d4e/d54/f55 x:0 0 0 2024-04-25T16:17:33.681 INFO:tasks.workunit.client.0.smithi059.stdout:1/307: mkdir d7/d13/d6a 0 2024-04-25T16:17:33.715 INFO:tasks.workunit.client.0.smithi059.stdout:5/308: dread d1/d1e/d27/f4e [0,4194304] 0 2024-04-25T16:17:33.762 INFO:tasks.workunit.client.0.smithi059.stdout:8/264: write d7/d2f/f3f [1635187,90666] 0 2024-04-25T16:17:33.763 INFO:tasks.workunit.client.0.smithi059.stdout:4/268: getdents d0/d4/df/d44 0 2024-04-25T16:17:33.829 INFO:tasks.workunit.client.0.smithi059.stdout:6/303: dwrite d9/f21 [0,4194304] 0 2024-04-25T16:17:34.051 INFO:tasks.workunit.client.0.smithi059.stdout:7/271: dwrite d0/d7/f2c [0,4194304] 0 2024-04-25T16:17:34.131 INFO:tasks.workunit.client.0.smithi059.stdout:0/276: rename dc/df/d24/l32 to dc/d37/d47/l56 0 2024-04-25T16:17:34.221 INFO:tasks.workunit.client.0.smithi059.stdout:9/302: dread d6/f4a [0,4194304] 0 2024-04-25T16:17:34.236 INFO:tasks.workunit.client.0.smithi059.stdout:2/279: dwrite de/d16/f43 [0,4194304] 0 2024-04-25T16:17:34.309 INFO:tasks.workunit.client.0.smithi059.stdout:8/265: write d7/d2f/f4a [746934,92791] 0 2024-04-25T16:17:34.341 INFO:tasks.workunit.client.0.smithi059.stdout:9/303: fdatasync d6/fb 0 2024-04-25T16:17:34.400 INFO:tasks.workunit.client.0.smithi059.stdout:5/309: write d1/d1e/d21/d3d/f60 [521859,93224] 0 2024-04-25T16:17:34.411 INFO:tasks.workunit.client.0.smithi059.stdout:1/308: truncate d7/d13/f5a 583359 0 2024-04-25T16:17:34.435 INFO:tasks.workunit.client.0.smithi059.stdout:6/304: write d9/fe [221176,54074] 0 2024-04-25T16:17:34.477 INFO:tasks.workunit.client.0.smithi059.stdout:7/272: fdatasync d0/d3f/f50 0 2024-04-25T16:17:34.518 INFO:tasks.workunit.client.0.smithi059.stdout:4/269: dwrite d0/f39 [0,4194304] 0 2024-04-25T16:17:34.599 INFO:tasks.workunit.client.0.smithi059.stdout:4/270: stat d0/d4/df/d1c/l2b 0 2024-04-25T16:17:34.647 INFO:tasks.workunit.client.0.smithi059.stdout:3/308: link d0/db/l17 d0/l6a 0 2024-04-25T16:17:34.686 INFO:tasks.workunit.client.0.smithi059.stdout:8/266: mknod d7/d16/d36/c59 0 2024-04-25T16:17:34.703 INFO:tasks.workunit.client.0.smithi059.stdout:5/310: unlink d1/d1e/d21/d3d/f60 0 2024-04-25T16:17:34.756 INFO:tasks.workunit.client.0.smithi059.stdout:7/273: dwrite d0/d7/d16/f54 [0,4194304] 0 2024-04-25T16:17:34.875 INFO:tasks.workunit.client.0.smithi059.stdout:6/305: mkdir d9/d16/d24/d5d 0 2024-04-25T16:17:34.893 INFO:tasks.workunit.client.0.smithi059.stdout:2/280: rename de/c1b to de/d16/d3e/c68 0 2024-04-25T16:17:35.237 INFO:tasks.workunit.client.0.smithi059.stdout:3/309: fsync d0/d1e/d31/f40 0 2024-04-25T16:17:35.248 INFO:tasks.workunit.client.0.smithi059.stdout:6/306: unlink d9/f40 0 2024-04-25T16:17:35.469 INFO:tasks.workunit.client.0.smithi059.stdout:9/304: rename d6/c32 to d6/d35/d28/c56 0 2024-04-25T16:17:35.519 INFO:tasks.workunit.client.0.smithi059.stdout:0/277: write dc/df/f10 [2403693,69558] 0 2024-04-25T16:17:35.603 INFO:tasks.workunit.client.0.smithi059.stdout:1/309: dwrite d7/f29 [0,4194304] 0 2024-04-25T16:17:35.669 INFO:tasks.workunit.client.0.smithi059.stdout:1/310: chown d7/f69 61767 1 2024-04-25T16:17:35.923 INFO:tasks.workunit.client.0.smithi059.stdout:8/267: mknod d7/c5a 0 2024-04-25T16:17:35.935 INFO:tasks.workunit.client.0.smithi059.stdout:3/310: unlink d0/db/f16 0 2024-04-25T16:17:35.949 INFO:tasks.workunit.client.0.smithi059.stdout:4/271: creat d0/d4/f56 x:0 0 0 2024-04-25T16:17:36.054 INFO:tasks.workunit.client.0.smithi059.stdout:4/272: chown d0/d4/df/d1c/d45/f27 454416144 1 2024-04-25T16:17:36.070 INFO:tasks.workunit.client.0.smithi059.stdout:5/311: dwrite d1/dd/f1d [0,4194304] 0 2024-04-25T16:17:36.281 INFO:tasks.workunit.client.0.smithi059.stdout:8/268: read d7/dd/d17/f2e [4170003,27961] 0 2024-04-25T16:17:36.493 INFO:tasks.workunit.client.0.smithi059.stdout:3/311: creat d0/d1e/d31/f6b x:0 0 0 2024-04-25T16:17:36.502 INFO:tasks.workunit.client.0.smithi059.stdout:2/281: mknod de/d2a/d2e/d36/d2c/d40/d57/c69 0 2024-04-25T16:17:36.770 INFO:tasks.workunit.client.0.smithi059.stdout:4/273: mknod d0/d4/df/d1c/d45/c57 0 2024-04-25T16:17:36.780 INFO:tasks.workunit.client.0.smithi059.stdout:1/311: creat d7/d13/d2d/d41/f6b x:0 0 0 2024-04-25T16:17:36.787 INFO:tasks.workunit.client.0.smithi059.stdout:5/312: mkdir d1/d1e/d21/d42/d6d 0 2024-04-25T16:17:36.820 INFO:tasks.workunit.client.0.smithi059.stdout:4/274: chown d0/d4/df/d48/l50 40877 1 2024-04-25T16:17:36.881 INFO:tasks.workunit.client.0.smithi059.stdout:5/313: dread d1/dd/f12 [0,4194304] 0 2024-04-25T16:17:37.059 INFO:tasks.workunit.client.0.smithi059.stdout:8/269: dread - d7/d16/f55 zero size 2024-04-25T16:17:37.199 INFO:tasks.workunit.client.0.smithi059.stdout:8/270: dread d7/dd/ff [4194304,4194304] 0 2024-04-25T16:17:37.203 INFO:tasks.workunit.client.0.smithi059.stdout:1/312: read d7/d13/d16/f33 [1091790,116921] 0 2024-04-25T16:17:37.311 INFO:tasks.workunit.client.0.smithi059.stdout:8/271: dwrite d7/d2f/f4a [0,4194304] 0 2024-04-25T16:17:37.411 INFO:tasks.workunit.client.0.smithi059.stdout:6/307: getdents d9 0 2024-04-25T16:17:37.437 INFO:tasks.workunit.client.0.smithi059.stdout:8/272: stat d7/d2f/l39 0 2024-04-25T16:17:37.462 INFO:tasks.workunit.client.0.smithi059.stdout:3/312: fsync d0/db/d3f/f5e 0 2024-04-25T16:17:37.499 INFO:tasks.workunit.client.0.smithi059.stdout:6/308: chown d9/c11 97482856 1 2024-04-25T16:17:37.563 INFO:tasks.workunit.client.0.smithi059.stdout:0/278: dwrite dc/dd/f48 [0,4194304] 0 2024-04-25T16:17:37.629 INFO:tasks.workunit.client.0.smithi059.stdout:8/273: readlink d7/l12 0 2024-04-25T16:17:37.646 INFO:tasks.workunit.client.0.smithi059.stdout:8/274: chown d7/d2f/f4a 14 1 2024-04-25T16:17:37.722 INFO:tasks.workunit.client.0.smithi059.stdout:9/305: write d6/d35/d2f/d39/f52 [482219,10806] 0 2024-04-25T16:17:38.141 INFO:tasks.workunit.client.0.smithi059.stdout:6/309: creat d9/d16/d24/f5e x:0 0 0 2024-04-25T16:17:38.150 INFO:tasks.workunit.client.0.smithi059.stdout:3/313: chown d0/db/d2d/c42 0 1 2024-04-25T16:17:38.157 INFO:tasks.workunit.client.0.smithi059.stdout:3/314: stat d0/d1e/f45 0 2024-04-25T16:17:38.177 INFO:tasks.workunit.client.0.smithi059.stdout:4/275: symlink d0/d4/df/d1c/l58 0 2024-04-25T16:17:38.318 INFO:tasks.workunit.client.0.smithi059.stdout:4/276: sync 2024-04-25T16:17:38.417 INFO:tasks.workunit.client.0.smithi059.stdout:7/274: creat d0/f56 x:0 0 0 2024-04-25T16:17:38.600 INFO:tasks.workunit.client.0.smithi059.stdout:2/282: mkdir de/d2a/d2e/d6a 0 2024-04-25T16:17:38.673 INFO:tasks.workunit.client.0.smithi059.stdout:4/277: creat d0/d4/df/d44/f59 x:0 0 0 2024-04-25T16:17:38.770 INFO:tasks.workunit.client.0.smithi059.stdout:2/283: dread de/d2a/d2e/f30 [0,4194304] 0 2024-04-25T16:17:38.895 INFO:tasks.workunit.client.0.smithi059.stdout:7/275: dread d0/d7/f23 [0,4194304] 0 2024-04-25T16:17:39.040 INFO:tasks.workunit.client.0.smithi059.stdout:8/275: write d7/dd/ff [5703449,54258] 0 2024-04-25T16:17:39.041 INFO:tasks.workunit.client.0.smithi059.stdout:5/314: write d1/f3 [5907611,61694] 0 2024-04-25T16:17:39.073 INFO:tasks.workunit.client.0.smithi059.stdout:6/310: unlink l7 0 2024-04-25T16:17:39.088 INFO:tasks.workunit.client.0.smithi059.stdout:0/279: write dc/df/d24/f51 [560943,8349] 0 2024-04-25T16:17:39.099 INFO:tasks.workunit.client.0.smithi059.stdout:1/313: unlink d7/fb 0 2024-04-25T16:17:39.104 INFO:tasks.workunit.client.0.smithi059.stdout:9/306: write d6/d35/d36/f38 [1853103,35192] 0 2024-04-25T16:17:39.145 INFO:tasks.workunit.client.0.smithi059.stdout:4/278: rmdir d0/d4 39 2024-04-25T16:17:39.243 INFO:tasks.workunit.client.0.smithi059.stdout:3/315: dwrite d0/f6 [0,4194304] 0 2024-04-25T16:17:39.475 INFO:tasks.workunit.client.0.smithi059.stdout:7/276: truncate d0/f27 910650 0 2024-04-25T16:17:39.486 INFO:tasks.workunit.client.0.smithi059.stdout:5/315: creat d1/dd/f6e x:0 0 0 2024-04-25T16:17:39.505 INFO:tasks.workunit.client.0.smithi059.stdout:8/276: truncate d7/d16/f55 706835 0 2024-04-25T16:17:39.647 INFO:tasks.workunit.client.0.smithi059.stdout:1/314: dread d7/d13/f20 [0,4194304] 0 2024-04-25T16:17:39.926 INFO:tasks.workunit.client.0.smithi059.stdout:5/316: mknod d1/d48/c6f 0 2024-04-25T16:17:40.023 INFO:tasks.workunit.client.0.smithi059.stdout:6/311: write d9/d27/f51 [995044,76454] 0 2024-04-25T16:17:40.024 INFO:tasks.workunit.client.0.smithi059.stdout:9/307: write d6/d35/d26/f33 [3902331,63808] 0 2024-04-25T16:17:40.348 INFO:tasks.workunit.client.0.smithi059.stdout:4/279: symlink d0/d4/df/d48/l5a 0 2024-04-25T16:17:40.418 INFO:tasks.workunit.client.0.smithi059.stdout:4/280: sync 2024-04-25T16:17:40.497 INFO:tasks.workunit.client.0.smithi059.stdout:1/315: write d7/d13/d16/f24 [3385377,88086] 0 2024-04-25T16:17:40.525 INFO:tasks.workunit.client.0.smithi059.stdout:6/312: creat d9/d27/f5f x:0 0 0 2024-04-25T16:17:40.532 INFO:tasks.workunit.client.0.smithi059.stdout:6/313: stat d9/d16/c4e 0 2024-04-25T16:17:40.568 INFO:tasks.workunit.client.0.smithi059.stdout:6/314: sync 2024-04-25T16:17:40.821 INFO:tasks.workunit.client.0.smithi059.stdout:3/316: dwrite d0/db/d2d/f38 [0,4194304] 0 2024-04-25T16:17:40.911 INFO:tasks.workunit.client.0.smithi059.stdout:2/284: rename de/d16/f3d to de/d16/f6b 0 2024-04-25T16:17:40.934 INFO:tasks.workunit.client.0.smithi059.stdout:5/317: write d1/d1e/d21/d24/f5e [512684,128031] 0 2024-04-25T16:17:40.939 INFO:tasks.workunit.client.0.smithi059.stdout:7/277: rmdir d0/d3f/d46/d47 0 2024-04-25T16:17:40.954 INFO:tasks.workunit.client.0.smithi059.stdout:0/280: rename dc/l1b to dc/l57 0 2024-04-25T16:17:40.977 INFO:tasks.workunit.client.0.smithi059.stdout:2/285: sync 2024-04-25T16:17:41.191 INFO:tasks.workunit.client.0.smithi059.stdout:9/308: fdatasync d6/f1b 0 2024-04-25T16:17:41.199 INFO:tasks.workunit.client.0.smithi059.stdout:6/315: mkdir d9/d16/d54/d60 0 2024-04-25T16:17:41.206 INFO:tasks.workunit.client.0.smithi059.stdout:4/281: read d0/f2a [1595508,130748] 0 2024-04-25T16:17:41.225 INFO:tasks.workunit.client.0.smithi059.stdout:8/277: getdents d7/d2f 0 2024-04-25T16:17:41.276 INFO:tasks.workunit.client.0.smithi059.stdout:7/278: chown d0/c6 287931 1 2024-04-25T16:17:41.523 INFO:tasks.workunit.client.0.smithi059.stdout:2/286: dread de/d16/f31 [0,4194304] 0 2024-04-25T16:17:41.635 INFO:tasks.workunit.client.0.smithi059.stdout:3/317: mkdir d0/db/d3f/d6c 0 2024-04-25T16:17:41.644 INFO:tasks.workunit.client.0.smithi059.stdout:3/318: stat d0/db/d2d/f38 0 2024-04-25T16:17:41.889 INFO:tasks.workunit.client.0.smithi059.stdout:1/316: write d7/f69 [550771,81627] 0 2024-04-25T16:17:41.894 INFO:tasks.workunit.client.0.smithi059.stdout:9/309: symlink d6/d35/d36/d48/d49/l57 0 2024-04-25T16:17:42.002 INFO:tasks.workunit.client.0.smithi059.stdout:6/316: fdatasync d9/d16/f17 0 2024-04-25T16:17:42.013 INFO:tasks.workunit.client.0.smithi059.stdout:6/317: chown d9/d16/d54/d60 413413384 1 2024-04-25T16:17:42.095 INFO:tasks.workunit.client.0.smithi059.stdout:6/318: sync 2024-04-25T16:17:42.241 INFO:tasks.workunit.client.0.smithi059.stdout:3/319: unlink d0/db/l1b 0 2024-04-25T16:17:42.241 INFO:tasks.workunit.client.0.smithi059.stdout:0/281: creat dc/dd/f58 x:0 0 0 2024-04-25T16:17:42.306 INFO:tasks.workunit.client.0.smithi059.stdout:5/318: rename d1/d1e/d21 to d1/d1e/d27/d66/d70 0 2024-04-25T16:17:42.319 INFO:tasks.workunit.client.0.smithi059.stdout:1/317: symlink d7/d13/d2d/l6c 0 2024-04-25T16:17:42.421 INFO:tasks.workunit.client.0.smithi059.stdout:2/287: dwrite de/d16/f32 [0,4194304] 0 2024-04-25T16:17:42.676 INFO:tasks.workunit.client.0.smithi059.stdout:6/319: symlink d9/d16/d54/l61 0 2024-04-25T16:17:42.694 INFO:tasks.workunit.client.0.smithi059.stdout:7/279: write d0/d7/d16/d20/d2b/f4a [5010076,118782] 0 2024-04-25T16:17:42.723 INFO:tasks.workunit.client.0.smithi059.stdout:9/310: dread - d6/d4e/d54/f55 zero size 2024-04-25T16:17:42.736 INFO:tasks.workunit.client.0.smithi059.stdout:1/318: mknod d7/d13/d2d/d4a/c6d 0 2024-04-25T16:17:42.761 INFO:tasks.workunit.client.0.smithi059.stdout:8/278: link d7/dd/f3c d7/dd/f5b 0 2024-04-25T16:17:42.780 INFO:tasks.workunit.client.0.smithi059.stdout:2/288: creat de/d2a/d2e/d36/d2c/d40/d57/f6c x:0 0 0 2024-04-25T16:17:42.821 INFO:tasks.workunit.client.0.smithi059.stdout:3/320: dread d0/db/f3a [0,4194304] 0 2024-04-25T16:17:42.905 INFO:tasks.workunit.client.0.smithi059.stdout:4/282: rename d0/d4/df/l32 to d0/d4/df/d48/l5b 0 2024-04-25T16:17:43.056 INFO:tasks.workunit.client.0.smithi059.stdout:5/319: mknod d1/d1e/c71 0 2024-04-25T16:17:43.106 INFO:tasks.workunit.client.0.smithi059.stdout:9/311: read d6/d35/d28/f50 [59211,47847] 0 2024-04-25T16:17:43.115 INFO:tasks.workunit.client.0.smithi059.stdout:5/320: write d1/f3 [3761485,7438] 0 2024-04-25T16:17:43.124 INFO:tasks.workunit.client.0.smithi059.stdout:7/280: truncate d0/d7/d16/f2a 4749986 0 2024-04-25T16:17:43.132 INFO:tasks.workunit.client.0.smithi059.stdout:1/319: chown d7/d13/d2d/d41/l42 53 1 2024-04-25T16:17:43.150 INFO:tasks.workunit.client.0.smithi059.stdout:3/321: mknod d0/db/d3f/d49/c6d 0 2024-04-25T16:17:43.210 INFO:tasks.workunit.client.0.smithi059.stdout:0/282: dread dc/df/d24/f25 [4194304,4194304] 0 2024-04-25T16:17:43.294 INFO:tasks.workunit.client.0.smithi059.stdout:4/283: truncate d0/d4/df/d44/f4d 961454 0 2024-04-25T16:17:43.300 INFO:tasks.workunit.client.0.smithi059.stdout:6/320: mknod d9/d16/d54/d60/c62 0 2024-04-25T16:17:43.463 INFO:tasks.workunit.client.0.smithi059.stdout:7/281: mknod d0/d3f/d46/c57 0 2024-04-25T16:17:43.490 INFO:tasks.workunit.client.0.smithi059.stdout:0/283: chown dc/dd/l11 96006000 1 2024-04-25T16:17:43.504 INFO:tasks.workunit.client.0.smithi059.stdout:9/312: rename d6/d35/d28/f31 to d6/d35/d36/d48/d49/f58 0 2024-04-25T16:17:43.556 INFO:tasks.workunit.client.0.smithi059.stdout:2/289: unlink de/d5a/c54 0 2024-04-25T16:17:43.623 INFO:tasks.workunit.client.0.smithi059.stdout:5/321: dread d1/f10 [0,4194304] 0 2024-04-25T16:17:43.728 INFO:tasks.workunit.client.0.smithi059.stdout:1/320: mknod d7/d13/d6a/c6e 0 2024-04-25T16:17:43.743 INFO:tasks.workunit.client.0.smithi059.stdout:4/284: dread d0/d4/df/d44/f46 [0,4194304] 0 2024-04-25T16:17:43.843 INFO:tasks.workunit.client.0.smithi059.stdout:3/322: fdatasync d0/db/d2d/f4e 0 2024-04-25T16:17:43.867 INFO:tasks.workunit.client.0.smithi059.stdout:3/323: write d0/f6 [1342202,115136] 0 2024-04-25T16:17:43.890 INFO:tasks.workunit.client.0.smithi059.stdout:0/284: rmdir dc 39 2024-04-25T16:17:44.112 INFO:tasks.workunit.client.0.smithi059.stdout:2/290: unlink f4 0 2024-04-25T16:17:44.241 INFO:tasks.workunit.client.0.smithi059.stdout:4/285: rmdir d0/d4/df/d1c 39 2024-04-25T16:17:44.325 INFO:tasks.workunit.client.0.smithi059.stdout:1/321: dread d7/f22 [0,4194304] 0 2024-04-25T16:17:44.473 INFO:tasks.workunit.client.0.smithi059.stdout:8/279: dwrite d7/dd/d17/d23/d37/f44 [0,4194304] 0 2024-04-25T16:17:44.647 INFO:tasks.workunit.client.0.smithi059.stdout:8/280: dwrite d7/dd/d17/d23/d37/f44 [0,4194304] 0 2024-04-25T16:17:44.914 INFO:tasks.workunit.client.0.smithi059.stdout:6/321: dwrite d9/d27/f34 [0,4194304] 0 2024-04-25T16:17:45.015 INFO:tasks.workunit.client.0.smithi059.stdout:1/322: rename d7/d13/c43 to d7/d13/d2d/d41/c6f 0 2024-04-25T16:17:45.198 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:17:45.201 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:17:45.208 INFO:tasks.workunit.client.0.smithi059.stdout:8/281: mkdir d7/dd/d17/d23/d37/d5c 0 2024-04-25T16:17:45.260 INFO:tasks.workunit.client.0.smithi059.stdout:7/282: write d0/f27 [1360911,91804] 0 2024-04-25T16:17:45.345 INFO:tasks.workunit.client.0.smithi059.stdout:5/322: dwrite d1/f63 [0,4194304] 0 2024-04-25T16:17:45.419 INFO:tasks.workunit.client.0.smithi059.stdout:2/291: creat de/d16/f6d x:0 0 0 2024-04-25T16:17:45.448 INFO:tasks.workunit.client.0.smithi059.stdout:9/313: write d6/f4a [4774186,95209] 0 2024-04-25T16:17:45.471 INFO:tasks.workunit.client.0.smithi059.stdout:5/323: chown d1/d1e/d27/d66/d70/d3d/f40 816751 1 2024-04-25T16:17:45.664 INFO:tasks.workunit.client.0.smithi059.stdout:3/324: dwrite d0/ff [0,4194304] 0 2024-04-25T16:17:45.780 INFO:tasks.workunit.client.0.smithi059.stdout:2/292: chown de/d16/d3e/c68 21 1 2024-04-25T16:17:45.836 INFO:tasks.workunit.client.0.smithi059.stdout:4/286: dwrite d0/d4/df/d1c/d45/f2d [0,4194304] 0 2024-04-25T16:17:45.901 INFO:tasks.workunit.client.0.smithi059.stdout:4/287: chown d0/d4/f21 0 1 2024-04-25T16:17:46.192 INFO:tasks.workunit.client.0.smithi059.stdout:6/322: write d9/d1b/f48 [554568,63581] 0 2024-04-25T16:17:46.240 INFO:tasks.workunit.client.0.smithi059.stdout:8/282: creat d7/dd/d17/d23/d38/f5d x:0 0 0 2024-04-25T16:17:46.351 INFO:tasks.workunit.client.0.smithi059.stdout:0/285: rename dc/dd/f53 to dc/df/f59 0 2024-04-25T16:17:46.993 INFO:tasks.workunit.client.0.smithi059.stdout:1/323: creat d7/d13/d16/d5c/f70 x:0 0 0 2024-04-25T16:17:47.255 INFO:tasks.workunit.client.0.smithi059.stdout:0/286: chown dc/d37/d47/l55 486 1 2024-04-25T16:17:47.520 INFO:tasks.workunit.client.0.smithi059.stdout:7/283: rename d0/d7/d16/d20/d2b/l32 to d0/d7/d51/l58 0 2024-04-25T16:17:47.653 INFO:tasks.workunit.client.0.smithi059.stdout:5/324: getdents d1/d1e 0 2024-04-25T16:17:47.743 INFO:tasks.workunit.client.0.smithi059.stdout:4/288: dwrite d0/d4/df/d48/f4e [0,4194304] 0 2024-04-25T16:17:48.272 INFO:tasks.workunit.client.0.smithi059.stdout:9/314: unlink d6/l1e 0 2024-04-25T16:17:48.289 INFO:tasks.workunit.client.0.smithi059.stdout:1/324: creat d7/d13/d16/d54/f71 x:0 0 0 2024-04-25T16:17:48.294 INFO:tasks.workunit.client.0.smithi059.stdout:8/283: truncate d7/dd/d17/d23/d37/f44 1760770 0 2024-04-25T16:17:48.304 INFO:tasks.workunit.client.0.smithi059.stdout:3/325: rename d0/db/d2d/f66 to d0/d1e/f6e 0 2024-04-25T16:17:48.323 INFO:tasks.workunit.client.0.smithi059.stdout:7/284: fsync d0/d7/d16/d20/d2b/d33/f43 0 2024-04-25T16:17:48.337 INFO:tasks.workunit.client.0.smithi059.stdout:2/293: creat de/d2a/d2e/f6e x:0 0 0 2024-04-25T16:17:48.359 INFO:tasks.workunit.client.0.smithi059.stdout:0/287: readlink dc/df/l1c 0 2024-04-25T16:17:48.463 INFO:tasks.workunit.client.0.smithi059.stdout:7/285: sync 2024-04-25T16:17:48.493 INFO:tasks.workunit.client.0.smithi059.stdout:6/323: dwrite d9/d16/f1f [4194304,4194304] 0 2024-04-25T16:17:48.604 INFO:tasks.workunit.client.0.smithi059.stdout:1/325: fdatasync d7/d13/d2d/f61 0 2024-04-25T16:17:48.826 INFO:tasks.workunit.client.0.smithi059.stdout:6/324: dread d9/d16/f26 [4194304,4194304] 0 2024-04-25T16:17:48.831 INFO:tasks.workunit.client.0.smithi059.stdout:2/294: dread fb [0,4194304] 0 2024-04-25T16:17:48.857 INFO:tasks.workunit.client.0.smithi059.stdout:8/284: truncate d7/d2f/f47 2109094 0 2024-04-25T16:17:48.887 INFO:tasks.workunit.client.0.smithi059.stdout:4/289: creat d0/d4/f5c x:0 0 0 2024-04-25T16:17:48.890 INFO:tasks.workunit.client.0.smithi059.stdout:9/315: creat d6/d35/d36/f59 x:0 0 0 2024-04-25T16:17:48.901 INFO:tasks.workunit.client.0.smithi059.stdout:0/288: chown dc/c2c 845 1 2024-04-25T16:17:48.937 INFO:tasks.workunit.client.0.smithi059.stdout:9/316: dread - d6/d35/d36/f59 zero size 2024-04-25T16:17:48.957 INFO:tasks.workunit.client.0.smithi059.stdout:9/317: write d6/d35/d36/f59 [347659,49317] 0 2024-04-25T16:17:48.972 INFO:tasks.workunit.client.0.smithi059.stdout:9/318: chown d6/d35/d26/f2d 3658 1 2024-04-25T16:17:49.193 INFO:tasks.workunit.client.0.smithi059.stdout:1/326: dread - d7/d13/f63 zero size 2024-04-25T16:17:49.331 INFO:tasks.workunit.client.0.smithi059.stdout:3/326: rename d0/db/d47/c55 to d0/db/d3f/d49/d65/c6f 0 2024-04-25T16:17:49.336 INFO:tasks.workunit.client.0.smithi059.stdout:6/325: mknod d9/d1b/d58/d49/c63 0 2024-04-25T16:17:49.376 INFO:tasks.workunit.client.0.smithi059.stdout:0/289: symlink dc/dd/l5a 0 2024-04-25T16:17:49.441 INFO:tasks.workunit.client.0.smithi059.stdout:4/290: mknod d0/d4/df/d1c/c5d 0 2024-04-25T16:17:49.647 INFO:tasks.workunit.client.0.smithi059.stdout:5/325: link d1/cb d1/d1e/d27/d66/c72 0 2024-04-25T16:17:49.648 INFO:tasks.workunit.client.0.smithi059.stdout:2/295: readlink de/d2a/d2e/l5e 0 2024-04-25T16:17:49.695 INFO:tasks.workunit.client.0.smithi059.stdout:7/286: link d0/d7/f1f d0/d7/d16/d20/f59 0 2024-04-25T16:17:49.782 INFO:tasks.workunit.client.0.smithi059.stdout:3/327: write d0/f3e [2073889,90344] 0 2024-04-25T16:17:49.867 INFO:tasks.workunit.client.0.smithi059.stdout:6/326: truncate d9/fe 5003286 0 2024-04-25T16:17:50.006 INFO:tasks.workunit.client.0.smithi059.stdout:0/290: mknod dc/dd/c5b 0 2024-04-25T16:17:50.342 INFO:tasks.workunit.client.0.smithi059.stdout:1/327: mkdir d7/d13/d16/d72 0 2024-04-25T16:17:50.372 INFO:tasks.workunit.client.0.smithi059.stdout:3/328: stat d0/db/d2d/c3d 0 2024-04-25T16:17:50.382 INFO:tasks.workunit.client.0.smithi059.stdout:0/291: readlink dc/df/d24/l4d 0 2024-04-25T16:17:50.501 INFO:tasks.workunit.client.0.smithi059.stdout:5/326: creat d1/d1e/d27/d66/d70/d42/d6d/f73 x:0 0 0 2024-04-25T16:17:50.796 INFO:tasks.workunit.client.0.smithi059.stdout:9/319: getdents d6/d35 0 2024-04-25T16:17:50.820 INFO:tasks.workunit.client.0.smithi059.stdout:1/328: creat d7/d13/d2d/d41/f73 x:0 0 0 2024-04-25T16:17:50.950 INFO:tasks.workunit.client.0.smithi059.stdout:0/292: mkdir dc/dd/d5c 0 2024-04-25T16:17:51.089 INFO:tasks.workunit.client.0.smithi059.stdout:4/291: dwrite d0/d4/f1b [0,4194304] 0 2024-04-25T16:17:51.173 INFO:tasks.workunit.client.0.smithi059.stdout:9/320: creat d6/d35/d36/d48/f5a x:0 0 0 2024-04-25T16:17:51.186 INFO:tasks.workunit.client.0.smithi059.stdout:1/329: unlink d7/d13/d16/d5c/l60 0 2024-04-25T16:17:51.232 INFO:tasks.workunit.client.0.smithi059.stdout:8/285: dread d7/dd/d17/d23/f2a [0,4194304] 0 2024-04-25T16:17:51.322 INFO:tasks.workunit.client.0.smithi059.stdout:7/287: write d0/d7/f1d [1388213,80089] 0 2024-04-25T16:17:51.327 INFO:tasks.workunit.client.0.smithi059.stdout:8/286: sync 2024-04-25T16:17:51.337 INFO:tasks.workunit.client.0.smithi059.stdout:0/293: dread dc/f2a [0,4194304] 0 2024-04-25T16:17:51.431 INFO:tasks.workunit.client.0.smithi059.stdout:6/327: dwrite d9/d16/d24/f3c [0,4194304] 0 2024-04-25T16:17:51.513 INFO:tasks.workunit.client.0.smithi059.stdout:3/329: write d0/db/d47/f2e [5172971,41084] 0 2024-04-25T16:17:51.528 INFO:tasks.workunit.client.0.smithi059.stdout:3/330: readlink d0/d1e/d57/l60 0 2024-04-25T16:17:51.596 INFO:tasks.workunit.client.0.smithi059.stdout:2/296: link de/c3c de/d2a/d33/c6f 0 2024-04-25T16:17:51.844 INFO:tasks.workunit.client.0.smithi059.stdout:4/292: fdatasync d0/d4/f56 0 2024-04-25T16:17:51.853 INFO:tasks.workunit.client.0.smithi059.stdout:1/330: mkdir d7/d13/d16/d5c/d74 0 2024-04-25T16:17:51.866 INFO:tasks.workunit.client.0.smithi059.stdout:0/294: rmdir dc/d37/d47 39 2024-04-25T16:17:51.875 INFO:tasks.workunit.client.0.smithi059.stdout:6/328: mkdir d9/d16/d54/d60/d64 0 2024-04-25T16:17:51.919 INFO:tasks.workunit.client.0.smithi059.stdout:1/331: write d7/d13/d16/d5c/f70 [435982,77028] 0 2024-04-25T16:17:51.930 INFO:tasks.workunit.client.0.smithi059.stdout:3/331: mknod d0/d1e/d57/c70 0 2024-04-25T16:17:51.944 INFO:tasks.workunit.client.0.smithi059.stdout:1/332: read d7/f22 [2922524,82577] 0 2024-04-25T16:17:52.072 INFO:tasks.workunit.client.0.smithi059.stdout:2/297: unlink de/d16/f6d 0 2024-04-25T16:17:52.230 INFO:tasks.workunit.client.0.smithi059.stdout:7/288: mkdir d0/d7/d16/d5a 0 2024-04-25T16:17:52.242 INFO:tasks.workunit.client.0.smithi059.stdout:5/327: write d1/d1e/d27/d66/d70/f47 [819653,34092] 0 2024-04-25T16:17:52.256 INFO:tasks.workunit.client.0.smithi059.stdout:0/295: chown dc/f4e 8544518 1 2024-04-25T16:17:52.274 INFO:tasks.workunit.client.0.smithi059.stdout:5/328: stat d1/d1e/d27/l4f 0 2024-04-25T16:17:52.275 INFO:tasks.workunit.client.0.smithi059.stdout:0/296: readlink dc/dd/l46 0 2024-04-25T16:17:52.335 INFO:tasks.workunit.client.0.smithi059.stdout:4/293: creat d0/d4/df/d44/f5e x:0 0 0 2024-04-25T16:17:52.455 INFO:tasks.workunit.client.0.smithi059.stdout:4/294: dread d0/d4/df/f3a [0,4194304] 0 2024-04-25T16:17:52.496 INFO:tasks.workunit.client.0.smithi059.stdout:2/298: chown de/d2a/d2e/d36/d2c/d40/d57/c69 237 1 2024-04-25T16:17:52.521 INFO:tasks.workunit.client.0.smithi059.stdout:2/299: dread de/d16/f31 [0,4194304] 0 2024-04-25T16:17:52.595 INFO:tasks.workunit.client.0.smithi059.stdout:7/289: creat d0/d3f/f5b x:0 0 0 2024-04-25T16:17:52.604 INFO:tasks.workunit.client.0.smithi059.stdout:7/290: dread - d0/f30 zero size 2024-04-25T16:17:52.697 INFO:tasks.workunit.client.0.smithi059.stdout:0/297: truncate fa 612201 0 2024-04-25T16:17:52.704 INFO:tasks.workunit.client.0.smithi059.stdout:0/298: chown dc/dd 3 1 2024-04-25T16:17:52.749 INFO:tasks.workunit.client.0.smithi059.stdout:3/332: creat d0/db/d68/f71 x:0 0 0 2024-04-25T16:17:52.826 INFO:tasks.workunit.client.0.smithi059.stdout:4/295: mkdir d0/d4/df/d48/d5f 0 2024-04-25T16:17:52.922 INFO:tasks.workunit.client.0.smithi059.stdout:2/300: symlink de/d2a/d2e/d36/d2c/l70 0 2024-04-25T16:17:52.947 INFO:tasks.workunit.client.0.smithi059.stdout:7/291: truncate d0/d3f/f50 979387 0 2024-04-25T16:17:53.053 INFO:tasks.workunit.client.0.smithi059.stdout:8/287: dwrite d7/d16/d3a/f46 [0,4194304] 0 2024-04-25T16:17:53.134 INFO:tasks.workunit.client.0.smithi059.stdout:3/333: fsync d0/db/f1c 0 2024-04-25T16:17:53.152 INFO:tasks.workunit.client.0.smithi059.stdout:4/296: creat d0/d4/df/d1c/d45/f60 x:0 0 0 2024-04-25T16:17:53.245 INFO:tasks.workunit.client.0.smithi059.stdout:4/297: sync 2024-04-25T16:17:53.252 INFO:tasks.workunit.client.0.smithi059.stdout:4/298: chown d0/d4/df/d1c 3696268 1 2024-04-25T16:17:53.264 INFO:tasks.workunit.client.0.smithi059.stdout:4/299: chown d0/d4/df/d1c/f37 1 1 2024-04-25T16:17:53.322 INFO:tasks.workunit.client.0.smithi059.stdout:9/321: truncate f2 2102409 0 2024-04-25T16:17:53.463 INFO:tasks.workunit.client.0.smithi059.stdout:7/292: rename d0/d3f/d46 to d0/d7/d16/d20/d2b/d33/d4c/d5c 0 2024-04-25T16:17:53.475 INFO:tasks.workunit.client.0.smithi059.stdout:6/329: write d9/d27/f5f [468614,107148] 0 2024-04-25T16:17:53.562 INFO:tasks.workunit.client.0.smithi059.stdout:5/329: getdents d1/d1e/d27 0 2024-04-25T16:17:53.606 INFO:tasks.workunit.client.0.smithi059.stdout:8/288: truncate d7/dd/d17/f42 4139339 0 2024-04-25T16:17:53.660 INFO:tasks.workunit.client.0.smithi059.stdout:0/299: creat dc/df/f5d x:0 0 0 2024-04-25T16:17:53.702 INFO:tasks.workunit.client.0.smithi059.stdout:1/333: dwrite d7/f30 [0,4194304] 0 2024-04-25T16:17:53.705 INFO:tasks.workunit.client.0.smithi059.stdout:4/300: rmdir d0/d4/df/d1c/d45 39 2024-04-25T16:17:53.789 INFO:tasks.workunit.client.0.smithi059.stdout:9/322: creat d6/d35/d28/f5b x:0 0 0 2024-04-25T16:17:53.845 INFO:tasks.workunit.client.0.smithi059.stdout:1/334: dread d7/d13/d2d/f40 [0,4194304] 0 2024-04-25T16:17:53.887 INFO:tasks.workunit.client.0.smithi059.stdout:7/293: truncate d0/f30 944380 0 2024-04-25T16:17:53.904 INFO:tasks.workunit.client.0.smithi059.stdout:7/294: chown d0/d7/d16/d20/d2b/d33/d4c/d4e/d4f 22526 1 2024-04-25T16:17:53.962 INFO:tasks.workunit.client.0.smithi059.stdout:7/295: sync 2024-04-25T16:17:54.120 INFO:tasks.workunit.client.0.smithi059.stdout:8/289: mkdir d7/d16/d36/d5e 0 2024-04-25T16:17:54.164 INFO:tasks.workunit.client.0.smithi059.stdout:4/301: dread - d0/d4/f4b zero size 2024-04-25T16:17:54.215 INFO:tasks.workunit.client.0.smithi059.stdout:8/290: write d7/d16/d3a/f46 [1599506,16050] 0 2024-04-25T16:17:54.236 INFO:tasks.workunit.client.0.smithi059.stdout:0/300: dread dc/dd/f48 [0,4194304] 0 2024-04-25T16:17:54.250 INFO:tasks.workunit.client.0.smithi059.stdout:9/323: rmdir d6/d35/d26 39 2024-04-25T16:17:54.295 INFO:tasks.workunit.client.0.smithi059.stdout:1/335: chown d7/d21/l5b 677187219 1 2024-04-25T16:17:54.335 INFO:tasks.workunit.client.0.smithi059.stdout:7/296: truncate d0/f56 495452 0 2024-04-25T16:17:54.731 INFO:tasks.workunit.client.0.smithi059.stdout:2/301: write de/d2a/d2e/f3f [2949359,22834] 0 2024-04-25T16:17:54.739 INFO:tasks.workunit.client.0.smithi059.stdout:3/334: write d0/d1e/f45 [135842,33634] 0 2024-04-25T16:17:54.757 INFO:tasks.workunit.client.0.smithi059.stdout:4/302: chown d0/d4/df/d1c/d45/d54 854 1 2024-04-25T16:17:55.076 INFO:tasks.workunit.client.0.smithi059.stdout:1/336: unlink d7/d21/l35 0 2024-04-25T16:17:55.113 INFO:tasks.workunit.client.0.smithi059.stdout:5/330: write d1/d1e/d27/d66/d70/d3d/f55 [1352073,57936] 0 2024-04-25T16:17:55.125 INFO:tasks.workunit.client.0.smithi059.stdout:3/335: stat d0/d1e/f6e 0 2024-04-25T16:17:55.214 INFO:tasks.workunit.client.0.smithi059.stdout:2/302: creat de/d2a/d2e/d36/d2c/d40/d57/f71 x:0 0 0 2024-04-25T16:17:55.216 INFO:tasks.workunit.client.0.smithi059.stdout:8/291: write d7/d16/f52 [27169,4025] 0 2024-04-25T16:17:55.229 INFO:tasks.workunit.client.0.smithi059.stdout:4/303: read - d0/d4/df/d1c/d45/f27 zero size 2024-04-25T16:17:55.300 INFO:tasks.workunit.client.0.smithi059.stdout:6/330: dwrite d9/d27/f51 [0,4194304] 0 2024-04-25T16:17:55.369 INFO:tasks.workunit.client.0.smithi059.stdout:9/324: unlink d6/f43 0 2024-04-25T16:17:55.458 INFO:tasks.workunit.client.0.smithi059.stdout:7/297: mkdir d0/d7/d16/d38/d5d 0 2024-04-25T16:17:55.462 INFO:tasks.workunit.client.0.smithi059.stdout:1/337: fdatasync d7/d13/d16/d54/f71 0 2024-04-25T16:17:55.475 INFO:tasks.workunit.client.0.smithi059.stdout:7/298: readlink d0/d7/l25 0 2024-04-25T16:17:55.782 INFO:tasks.workunit.client.0.smithi059.stdout:6/331: mknod d9/d16/d54/d60/c65 0 2024-04-25T16:17:55.789 INFO:tasks.workunit.client.0.smithi059.stdout:1/338: symlink d7/d2a/d62/l75 0 2024-04-25T16:17:55.827 INFO:tasks.workunit.client.0.smithi059.stdout:1/339: stat d7/d2a/c5f 0 2024-04-25T16:17:55.874 INFO:tasks.workunit.client.0.smithi059.stdout:4/304: mknod d0/d4/df/c61 0 2024-04-25T16:17:55.881 INFO:tasks.workunit.client.0.smithi059.stdout:8/292: dread d7/d2f/f3f [0,4194304] 0 2024-04-25T16:17:56.079 INFO:tasks.workunit.client.0.smithi059.stdout:3/336: truncate d0/db/d2d/f3c 299271 0 2024-04-25T16:17:56.335 INFO:tasks.workunit.client.0.smithi059.stdout:0/301: write dc/d44/f50 [838930,66794] 0 2024-04-25T16:17:56.430 INFO:tasks.workunit.client.0.smithi059.stdout:6/332: rmdir d9/d1b/d58 39 2024-04-25T16:17:56.513 INFO:tasks.workunit.client.0.smithi059.stdout:4/305: creat d0/d4/df/d1c/d45/f62 x:0 0 0 2024-04-25T16:17:56.569 INFO:tasks.workunit.client.0.smithi059.stdout:8/293: truncate d7/dd/d17/d23/f2a 264245 0 2024-04-25T16:17:56.816 INFO:tasks.workunit.client.0.smithi059.stdout:7/299: write d0/d7/f2c [3045698,120507] 0 2024-04-25T16:17:56.816 INFO:tasks.workunit.client.0.smithi059.stdout:2/303: link de/d16/f22 de/d67/f72 0 2024-04-25T16:17:56.839 INFO:tasks.workunit.client.0.smithi059.stdout:7/300: dread - d0/d7/f40 zero size 2024-04-25T16:17:56.929 INFO:tasks.workunit.client.0.smithi059.stdout:9/325: creat d6/d35/d36/d48/d49/f5c x:0 0 0 2024-04-25T16:17:57.029 INFO:tasks.workunit.client.0.smithi059.stdout:9/326: sync 2024-04-25T16:17:57.081 INFO:tasks.workunit.client.0.smithi059.stdout:5/331: dwrite d1/d1e/d27/d66/d70/d3d/d44/f67 [0,4194304] 0 2024-04-25T16:17:57.204 INFO:tasks.workunit.client.0.smithi059.stdout:6/333: creat d9/d27/d39/f66 x:0 0 0 2024-04-25T16:17:57.223 INFO:tasks.workunit.client.0.smithi059.stdout:6/334: stat d9/d16/d54/d60/c65 0 2024-04-25T16:17:57.351 INFO:tasks.workunit.client.0.smithi059.stdout:2/304: rename de/d2a/d2e/d36/c39 to de/d2a/d2e/d36/d2c/c73 0 2024-04-25T16:17:57.610 INFO:tasks.workunit.client.0.smithi059.stdout:1/340: write d7/d13/d2d/f61 [477919,53775] 0 2024-04-25T16:17:57.729 INFO:tasks.workunit.client.0.smithi059.stdout:8/294: symlink d7/dd/d17/d23/l5f 0 2024-04-25T16:17:57.738 INFO:tasks.workunit.client.0.smithi059.stdout:8/295: stat d7/dd/d33/d57 0 2024-04-25T16:17:57.813 INFO:tasks.workunit.client.0.smithi059.stdout:6/335: chown d9/d1b/d58/c38 48 1 2024-04-25T16:17:57.886 INFO:tasks.workunit.client.0.smithi059.stdout:7/301: fsync d0/d7/d16/f44 0 2024-04-25T16:17:57.946 INFO:tasks.workunit.client.0.smithi059.stdout:3/337: dwrite d0/db/d2d/f46 [0,4194304] 0 2024-04-25T16:17:58.010 INFO:tasks.workunit.client.0.smithi059.stdout:2/305: creat de/d2a/d33/f74 x:0 0 0 2024-04-25T16:17:58.018 INFO:tasks.workunit.client.0.smithi059.stdout:9/327: truncate d6/d35/d36/f45 5233214 0 2024-04-25T16:17:58.223 INFO:tasks.workunit.client.0.smithi059.stdout:8/296: unlink d7/d16/l3d 0 2024-04-25T16:17:58.230 INFO:tasks.workunit.client.0.smithi059.stdout:6/336: readlink d9/d16/l2f 0 2024-04-25T16:17:58.348 INFO:tasks.workunit.client.0.smithi059.stdout:7/302: rmdir d0/d7/d16/d20/d2b/d33 39 2024-04-25T16:17:58.516 INFO:tasks.workunit.client.0.smithi059.stdout:9/328: dread d6/d35/f29 [0,4194304] 0 2024-04-25T16:17:58.631 INFO:tasks.workunit.client.0.smithi059.stdout:2/306: stat de/d2a/d2e/l23 0 2024-04-25T16:17:58.633 INFO:tasks.workunit.client.0.smithi059.stdout:8/297: symlink d7/dd/d17/d23/d38/l60 0 2024-04-25T16:17:58.717 INFO:tasks.workunit.client.0.smithi059.stdout:6/337: unlink d9/d16/d54/d60/c62 0 2024-04-25T16:17:58.725 INFO:tasks.workunit.client.0.smithi059.stdout:6/338: chown d9/d16/l2f 853 1 2024-04-25T16:17:58.768 INFO:tasks.workunit.client.0.smithi059.stdout:7/303: creat d0/d3f/f5e x:0 0 0 2024-04-25T16:17:58.822 INFO:tasks.workunit.client.0.smithi059.stdout:9/329: chown d6/d35/d28/l2b 79 1 2024-04-25T16:17:58.923 INFO:tasks.workunit.client.0.smithi059.stdout:0/302: dwrite dc/df/d24/f25 [4194304,4194304] 0 2024-04-25T16:17:59.073 INFO:tasks.workunit.client.0.smithi059.stdout:2/307: creat de/d2a/d2e/d36/d2c/d40/f75 x:0 0 0 2024-04-25T16:17:59.076 INFO:tasks.workunit.client.0.smithi059.stdout:6/339: symlink d9/d16/d24/l67 0 2024-04-25T16:17:59.158 INFO:tasks.workunit.client.0.smithi059.stdout:4/306: write d0/d4/df/d1c/f3d [2862343,8433] 0 2024-04-25T16:17:59.192 INFO:tasks.workunit.client.0.smithi059.stdout:4/307: write d0/d4/df/d1c/d45/f62 [196370,69584] 0 2024-04-25T16:17:59.265 INFO:tasks.workunit.client.0.smithi059.stdout:6/340: rmdir d9/d16/d24 39 2024-04-25T16:17:59.303 INFO:tasks.workunit.client.0.smithi059.stdout:4/308: sync 2024-04-25T16:17:59.323 INFO:tasks.workunit.client.0.smithi059.stdout:2/308: truncate de/d16/f32 2868734 0 2024-04-25T16:17:59.363 INFO:tasks.workunit.client.0.smithi059.stdout:5/332: dwrite d1/fa [0,4194304] 0 2024-04-25T16:17:59.436 INFO:tasks.workunit.client.0.smithi059.stdout:2/309: write de/d2a/d2e/f3f [1804364,63667] 0 2024-04-25T16:17:59.470 INFO:tasks.workunit.client.0.smithi059.stdout:5/333: write d1/d1e/d27/d66/d70/d3d/d44/f67 [3489905,36400] 0 2024-04-25T16:17:59.488 INFO:tasks.workunit.client.0.smithi059.stdout:0/303: mkdir dc/df/d5e 0 2024-04-25T16:17:59.507 INFO:tasks.workunit.client.0.smithi059.stdout:6/341: read d9/d16/f17 [1086862,50190] 0 2024-04-25T16:17:59.517 INFO:tasks.workunit.client.0.smithi059.stdout:5/334: chown d1/dd/l14 8430 1 2024-04-25T16:17:59.593 INFO:tasks.workunit.client.0.smithi059.stdout:6/342: dread d9/d16/f22 [0,4194304] 0 2024-04-25T16:17:59.766 INFO:tasks.workunit.client.0.smithi059.stdout:7/304: rename d0/d7/d16/f54 to d0/d7/d16/d20/d2b/f5f 0 2024-04-25T16:17:59.819 INFO:tasks.workunit.client.0.smithi059.stdout:0/304: mkdir dc/d44/d5f 0 2024-04-25T16:17:59.854 INFO:tasks.workunit.client.0.smithi059.stdout:5/335: rmdir d1/d1e/d27 39 2024-04-25T16:17:59.942 INFO:tasks.workunit.client.0.smithi059.stdout:6/343: truncate d9/d1b/f36 1675377 0 2024-04-25T16:18:00.123 INFO:tasks.workunit.client.0.smithi059.stdout:9/330: rename d6/d35/d36 to d6/d4e/d54/d5d 0 2024-04-25T16:18:00.348 INFO:tasks.workunit.client.0.smithi059.stdout:2/310: creat de/f76 x:0 0 0 2024-04-25T16:18:00.369 INFO:tasks.workunit.client.0.smithi059.stdout:0/305: dread dc/f1f [4194304,4194304] 0 2024-04-25T16:18:00.386 INFO:tasks.workunit.client.0.smithi059.stdout:9/331: rmdir d6/d4e/d54/d5d/d48 39 2024-04-25T16:18:00.392 INFO:tasks.workunit.client.0.smithi059.stdout:3/338: write d0/d1e/f32 [8581791,120361] 0 2024-04-25T16:18:00.428 INFO:tasks.workunit.client.0.smithi059.stdout:7/305: truncate d0/d7/d16/d20/d2b/d33/d4c/d4e/d4f/f52 100961 0 2024-04-25T16:18:00.487 INFO:tasks.workunit.client.0.smithi059.stdout:3/339: sync 2024-04-25T16:18:00.862 INFO:tasks.workunit.client.0.smithi059.stdout:1/341: dwrite d7/d13/d58/f5e [0,4194304] 0 2024-04-25T16:18:00.868 INFO:tasks.workunit.client.0.smithi059.stdout:3/340: symlink d0/d1e/d57/l72 0 2024-04-25T16:18:00.954 INFO:tasks.workunit.client.0.smithi059.stdout:2/311: readlink de/d16/l17 0 2024-04-25T16:18:00.955 INFO:tasks.workunit.client.0.smithi059.stdout:3/341: chown d0/db/d47/d5b/f5d 323 1 2024-04-25T16:18:01.147 INFO:tasks.workunit.client.0.smithi059.stdout:7/306: symlink d0/d7/l60 0 2024-04-25T16:18:01.182 INFO:tasks.workunit.client.0.smithi059.stdout:1/342: read d7/d13/d16/f33 [3887005,110316] 0 2024-04-25T16:18:01.278 INFO:tasks.workunit.client.0.smithi059.stdout:3/342: creat d0/db/d47/d5b/f73 x:0 0 0 2024-04-25T16:18:01.347 INFO:tasks.workunit.client.0.smithi059.stdout:9/332: fsync d6/d35/d2f/d39/f4f 0 2024-04-25T16:18:01.370 INFO:tasks.workunit.client.0.smithi059.stdout:3/343: sync 2024-04-25T16:18:01.384 INFO:tasks.workunit.client.0.smithi059.stdout:2/312: dread de/d16/f22 [0,4194304] 0 2024-04-25T16:18:01.448 INFO:tasks.workunit.client.0.smithi059.stdout:4/309: write d0/d4/df/d1c/d45/f2d [415458,18767] 0 2024-04-25T16:18:01.460 INFO:tasks.workunit.client.0.smithi059.stdout:1/343: chown d7/d13/d2d/d4a/d4d/c4e 0 1 2024-04-25T16:18:01.839 INFO:tasks.workunit.client.0.smithi059.stdout:8/298: dread d7/dd/d17/d23/f2a [0,4194304] 0 2024-04-25T16:18:01.862 INFO:tasks.workunit.client.0.smithi059.stdout:6/344: write d9/f14 [3130795,125460] 0 2024-04-25T16:18:01.961 INFO:tasks.workunit.client.0.smithi059.stdout:4/310: creat d0/d4/df/d1c/d45/d54/f63 x:0 0 0 2024-04-25T16:18:02.005 INFO:tasks.workunit.client.0.smithi059.stdout:2/313: creat de/d5a/f77 x:0 0 0 2024-04-25T16:18:02.026 INFO:tasks.workunit.client.0.smithi059.stdout:6/345: dread f6 [0,4194304] 0 2024-04-25T16:18:02.057 INFO:tasks.workunit.client.0.smithi059.stdout:3/344: symlink d0/db/d3f/d6c/l74 0 2024-04-25T16:18:02.122 INFO:tasks.workunit.client.0.smithi059.stdout:6/346: sync 2024-04-25T16:18:02.153 INFO:tasks.workunit.client.0.smithi059.stdout:9/333: creat d6/d4e/d54/d5d/d48/d49/f5e x:0 0 0 2024-04-25T16:18:02.163 INFO:tasks.workunit.client.0.smithi059.stdout:9/334: chown d6/d35/d2f/d39 1654 1 2024-04-25T16:18:02.473 INFO:tasks.workunit.client.0.smithi059.stdout:3/345: mkdir d0/db/d47/d5b/d75 0 2024-04-25T16:18:02.527 INFO:tasks.workunit.client.0.smithi059.stdout:5/336: dwrite d1/d1e/d27/d66/d70/f47 [0,4194304] 0 2024-04-25T16:18:02.602 INFO:tasks.workunit.client.0.smithi059.stdout:9/335: symlink d6/d35/d2f/l5f 0 2024-04-25T16:18:02.612 INFO:tasks.workunit.client.0.smithi059.stdout:0/306: write dc/df/f59 [799894,81134] 0 2024-04-25T16:18:02.618 INFO:tasks.workunit.client.0.smithi059.stdout:8/299: fdatasync d7/d16/f55 0 2024-04-25T16:18:02.892 INFO:tasks.workunit.client.0.smithi059.stdout:4/311: mknod d0/d4/df/d1c/c64 0 2024-04-25T16:18:02.984 INFO:tasks.workunit.client.0.smithi059.stdout:3/346: dread d0/d1e/f45 [0,4194304] 0 2024-04-25T16:18:03.073 INFO:tasks.workunit.client.0.smithi059.stdout:7/307: dwrite d0/d7/d16/f2a [0,4194304] 0 2024-04-25T16:18:03.143 INFO:tasks.workunit.client.0.smithi059.stdout:0/307: truncate f9 471650 0 2024-04-25T16:18:03.168 INFO:tasks.workunit.client.0.smithi059.stdout:5/337: mknod d1/d1e/d27/d66/d70/d3d/d50/c74 0 2024-04-25T16:18:03.179 INFO:tasks.workunit.client.0.smithi059.stdout:5/338: stat d1/dd/f13 0 2024-04-25T16:18:03.196 INFO:tasks.workunit.client.0.smithi059.stdout:5/339: chown d1/d1e/d27/d66/d70/d3d/d50/l56 0 1 2024-04-25T16:18:03.253 INFO:tasks.workunit.client.0.smithi059.stdout:9/336: mknod d6/d4e/d54/d5d/d48/d49/c60 0 2024-04-25T16:18:03.340 INFO:tasks.workunit.client.0.smithi059.stdout:1/344: write d7/d13/d58/f2e [6467,82457] 0 2024-04-25T16:18:03.424 INFO:tasks.workunit.client.0.smithi059.stdout:4/312: dread d0/d4/df/f12 [0,4194304] 0 2024-04-25T16:18:03.783 INFO:tasks.workunit.client.0.smithi059.stdout:7/308: truncate d0/d7/f23 3606962 0 2024-04-25T16:18:03.825 INFO:tasks.workunit.client.0.smithi059.stdout:1/345: creat d7/d13/d2d/d4a/d4d/f76 x:0 0 0 2024-04-25T16:18:03.833 INFO:tasks.workunit.client.0.smithi059.stdout:1/346: readlink d7/d21/l5b 0 2024-04-25T16:18:03.910 INFO:tasks.workunit.client.0.smithi059.stdout:4/313: truncate d0/d4/df/d1c/d45/f27 592348 0 2024-04-25T16:18:04.012 INFO:tasks.workunit.client.0.smithi059.stdout:0/308: mkdir dc/d37/d47/d60 0 2024-04-25T16:18:04.050 INFO:tasks.workunit.client.0.smithi059.stdout:7/309: mknod d0/d7/d16/d20/c61 0 2024-04-25T16:18:04.086 INFO:tasks.workunit.client.0.smithi059.stdout:1/347: readlink d7/d13/l3c 0 2024-04-25T16:18:04.142 INFO:tasks.workunit.client.0.smithi059.stdout:6/347: dwrite f3 [0,4194304] 0 2024-04-25T16:18:04.210 INFO:tasks.workunit.client.0.smithi059.stdout:9/337: creat d6/d4e/d54/d5d/f61 x:0 0 0 2024-04-25T16:18:04.432 INFO:tasks.workunit.client.0.smithi059.stdout:2/314: write de/d2a/d33/f41 [1811775,79710] 0 2024-04-25T16:18:04.545 INFO:tasks.workunit.client.0.smithi059.stdout:8/300: dwrite d7/dd/d17/f2e [4194304,4194304] 0 2024-04-25T16:18:04.667 INFO:tasks.workunit.client.0.smithi059.stdout:3/347: write d0/d1e/f6e [335750,51983] 0 2024-04-25T16:18:04.670 INFO:tasks.workunit.client.0.smithi059.stdout:5/340: write d1/dd/ff [64271,72824] 0 2024-04-25T16:18:04.713 INFO:tasks.workunit.client.0.smithi059.stdout:5/341: fsync d1/d1e/d27/d66/d70/d3d/d44/f67 0 2024-04-25T16:18:05.088 INFO:tasks.workunit.client.0.smithi059.stdout:1/348: write d7/f22 [7497570,92663] 0 2024-04-25T16:18:05.141 INFO:tasks.workunit.client.0.smithi059.stdout:4/314: dwrite d0/d4/f4b [0,4194304] 0 2024-04-25T16:18:05.265 INFO:tasks.workunit.client.0.smithi059.stdout:8/301: unlink d7/d16/f55 0 2024-04-25T16:18:05.342 INFO:tasks.workunit.client.0.smithi059.stdout:5/342: mkdir d1/d1e/d27/d66/d70/d75 0 2024-04-25T16:18:05.426 INFO:tasks.workunit.client.0.smithi059.stdout:6/348: truncate d9/d16/d24/f3c 2141738 0 2024-04-25T16:18:05.494 INFO:tasks.workunit.client.0.smithi059.stdout:0/309: link dc/f4e dc/d37/d47/d60/f61 0 2024-04-25T16:18:05.831 INFO:tasks.workunit.client.0.smithi059.stdout:4/315: truncate d0/d4/df/f41 2369464 0 2024-04-25T16:18:05.835 INFO:tasks.workunit.client.0.smithi059.stdout:8/302: rename d7 to d7/dd/d17/d23/d61 22 2024-04-25T16:18:05.872 INFO:tasks.workunit.client.0.smithi059.stdout:7/310: write d0/f56 [11431,105247] 0 2024-04-25T16:18:06.109 INFO:tasks.workunit.client.0.smithi059.stdout:1/349: mkdir d7/d13/d77 0 2024-04-25T16:18:06.116 INFO:tasks.workunit.client.0.smithi059.stdout:2/315: getdents de/d2a/d2e/d6a 0 2024-04-25T16:18:06.130 INFO:tasks.workunit.client.0.smithi059.stdout:9/338: link d6/f18 d6/d4e/d54/f62 0 2024-04-25T16:18:06.156 INFO:tasks.workunit.client.0.smithi059.stdout:7/311: readlink d0/l1c 0 2024-04-25T16:18:06.164 INFO:tasks.workunit.client.0.smithi059.stdout:1/350: stat d7/d2a/c48 0 2024-04-25T16:18:06.199 INFO:tasks.workunit.client.0.smithi059.stdout:1/351: fsync d7/d13/d2d/f40 0 2024-04-25T16:18:06.229 INFO:tasks.workunit.client.0.smithi059.stdout:2/316: sync 2024-04-25T16:18:06.763 INFO:tasks.workunit.client.0.smithi059.stdout:5/343: link d1/c35 d1/d48/c76 0 2024-04-25T16:18:06.869 INFO:tasks.workunit.client.0.smithi059.stdout:9/339: mknod d6/d4e/d54/d5d/d48/d49/c63 0 2024-04-25T16:18:06.893 INFO:tasks.workunit.client.0.smithi059.stdout:3/348: dwrite d0/db/d2d/f3c [0,4194304] 0 2024-04-25T16:18:06.977 INFO:tasks.workunit.client.0.smithi059.stdout:3/349: chown d0/d1e/d57/c63 35209984 1 2024-04-25T16:18:06.978 INFO:tasks.workunit.client.0.smithi059.stdout:9/340: dread - d6/d4e/d54/d5d/d48/d49/f5e zero size 2024-04-25T16:18:06.992 INFO:tasks.workunit.client.0.smithi059.stdout:7/312: mkdir d0/d7/d16/d20/d2b/d33/d62 0 2024-04-25T16:18:07.018 INFO:tasks.workunit.client.0.smithi059.stdout:7/313: dread - d0/d7/d16/d20/d2b/d33/d4c/d5c/f48 zero size 2024-04-25T16:18:07.204 INFO:tasks.workunit.client.0.smithi059.stdout:6/349: write d9/d1b/f36 [965774,34901] 0 2024-04-25T16:18:07.579 INFO:tasks.workunit.client.0.smithi059.stdout:0/310: getdents dc/df/d24 0 2024-04-25T16:18:07.854 INFO:tasks.workunit.client.0.smithi059.stdout:5/344: mkdir d1/d1e/d27/d66/d70/d24/d77 0 2024-04-25T16:18:07.866 INFO:tasks.workunit.client.0.smithi059.stdout:3/350: symlink d0/d1e/d31/l76 0 2024-04-25T16:18:07.921 INFO:tasks.workunit.client.0.smithi059.stdout:7/314: symlink d0/d7/d16/d38/l63 0 2024-04-25T16:18:08.244 INFO:tasks.workunit.client.0.smithi059.stdout:4/316: getdents d0/d4/df 0 2024-04-25T16:18:08.293 INFO:tasks.workunit.client.0.smithi059.stdout:8/303: link d7/l18 d7/dd/d33/l62 0 2024-04-25T16:18:08.337 INFO:tasks.workunit.client.0.smithi059.stdout:9/341: unlink d6/c46 0 2024-04-25T16:18:08.467 INFO:tasks.workunit.client.0.smithi059.stdout:3/351: mknod d0/db/d47/d5b/c77 0 2024-04-25T16:18:08.473 INFO:tasks.workunit.client.0.smithi059.stdout:3/352: chown d0/c23 901 1 2024-04-25T16:18:08.509 INFO:tasks.workunit.client.0.smithi059.stdout:5/345: mknod d1/d1e/d27/d66/d70/d3d/d50/c78 0 2024-04-25T16:18:08.555 INFO:tasks.workunit.client.0.smithi059.stdout:7/315: creat d0/d3f/f64 x:0 0 0 2024-04-25T16:18:08.656 INFO:tasks.workunit.client.0.smithi059.stdout:3/353: dwrite d0/db/d2d/f3c [0,4194304] 0 2024-04-25T16:18:08.816 INFO:tasks.workunit.client.0.smithi059.stdout:1/352: dwrite d7/f30 [4194304,4194304] 0 2024-04-25T16:18:08.950 INFO:tasks.workunit.client.0.smithi059.stdout:7/316: dwrite d0/f56 [0,4194304] 0 2024-04-25T16:18:09.097 INFO:tasks.workunit.client.0.smithi059.stdout:5/346: mkdir d1/d1e/d27/d66/d70/d3d/d44/d79 0 2024-04-25T16:18:09.120 INFO:tasks.workunit.client.0.smithi059.stdout:2/317: dwrite de/d2a/d2e/d36/d59/f61 [0,4194304] 0 2024-04-25T16:18:09.187 INFO:tasks.workunit.client.0.smithi059.stdout:4/317: symlink d0/l65 0 2024-04-25T16:18:09.281 INFO:tasks.workunit.client.0.smithi059.stdout:8/304: truncate d7/dd/f3c 344325 0 2024-04-25T16:18:09.297 INFO:tasks.workunit.client.0.smithi059.stdout:1/353: dread - d7/d13/f45 zero size 2024-04-25T16:18:09.708 INFO:tasks.workunit.client.0.smithi059.stdout:1/354: dread d7/f9 [0,4194304] 0 2024-04-25T16:18:09.712 INFO:tasks.workunit.client.0.smithi059.stdout:9/342: link d6/d4e/d54/d5d/d48/d49/f5c d6/d35/d2f/d39/f64 0 2024-04-25T16:18:09.733 INFO:tasks.workunit.client.0.smithi059.stdout:9/343: dread - d6/d4e/d54/f55 zero size 2024-04-25T16:18:09.846 INFO:tasks.workunit.client.0.smithi059.stdout:9/344: sync 2024-04-25T16:18:09.862 INFO:tasks.workunit.client.0.smithi059.stdout:3/354: rmdir d0/db/d2d 39 2024-04-25T16:18:09.899 INFO:tasks.workunit.client.0.smithi059.stdout:9/345: truncate d6/d4e/d54/d5d/d48/d49/f5e 745879 0 2024-04-25T16:18:09.947 INFO:tasks.workunit.client.0.smithi059.stdout:9/346: dread - d6/d35/d28/f40 zero size 2024-04-25T16:18:09.998 INFO:tasks.workunit.client.0.smithi059.stdout:0/311: dwrite f6 [4194304,4194304] 0 2024-04-25T16:18:10.067 INFO:tasks.workunit.client.0.smithi059.stdout:8/305: creat d7/dd/d17/d23/f63 x:0 0 0 2024-04-25T16:18:10.279 INFO:tasks.workunit.client.0.smithi059.stdout:3/355: mknod d0/db/d47/d5b/c78 0 2024-04-25T16:18:10.287 INFO:tasks.workunit.client.0.smithi059.stdout:1/355: mknod d7/d13/d16/c78 0 2024-04-25T16:18:10.436 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:32:23.040 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:18:10.439 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:32:23.043 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:18:10.451 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:32:23.015 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:18:10.452 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:32:23.015 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:18:10.454 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:32:23.017 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:18:10.455 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:32:23.018 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:18:10.569 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:32:23.173 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:18:10.570 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:32:23.133 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:18:10.596 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:32:23.159 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:18:10.619 INFO:tasks.workunit.client.0.smithi059.stdout:5/347: write d1/f63 [1252466,100682] 0 2024-04-25T16:18:10.636 INFO:tasks.workunit.client.0.smithi059.stdout:7/317: write d0/d7/f40 [68010,6332] 0 2024-04-25T16:18:10.652 INFO:tasks.workunit.client.0.smithi059.stdout:6/350: write d9/d16/d24/f3c [1055943,37656] 0 2024-04-25T16:18:10.871 INFO:tasks.workunit.client.0.smithi059.stdout:2/318: dwrite de/d67/f72 [4194304,4194304] 0 2024-04-25T16:18:10.950 INFO:tasks.workunit.client.0.smithi059.stdout:4/318: dwrite d0/d4/f35 [0,4194304] 0 2024-04-25T16:18:11.042 INFO:tasks.workunit.client.0.smithi059.stdout:9/347: fdatasync d6/f4a 0 2024-04-25T16:18:11.069 INFO:tasks.workunit.client.0.smithi059.stdout:2/319: fsync de/d67/f72 0 2024-04-25T16:18:11.071 INFO:tasks.workunit.client.0.smithi059.stdout:0/312: chown dc/df/f10 2 1 2024-04-25T16:18:11.135 INFO:tasks.workunit.client.0.smithi059.stdout:4/319: chown d0/d4/df/c3c 0 1 2024-04-25T16:18:11.160 INFO:tasks.workunit.client.0.smithi059.stdout:5/348: mknod d1/d1e/d27/d66/d70/d42/d6d/c7a 0 2024-04-25T16:18:11.207 INFO:tasks.workunit.client.0.smithi059.stdout:5/349: chown d1 1187 1 2024-04-25T16:18:11.290 INFO:tasks.workunit.client.0.smithi059.stdout:3/356: dread d0/f28 [0,4194304] 0 2024-04-25T16:18:11.302 INFO:tasks.workunit.client.0.smithi059.stdout:0/313: dread dc/f1f [4194304,4194304] 0 2024-04-25T16:18:11.323 INFO:tasks.workunit.client.0.smithi059.stdout:8/306: write d7/f1c [595553,102124] 0 2024-04-25T16:18:11.324 INFO:tasks.workunit.client.0.smithi059.stdout:5/350: stat d1/d1e/d27/d66/d70/d42/d6d/f73 0 2024-04-25T16:18:11.488 INFO:tasks.workunit.client.0.smithi059.stdout:7/318: rename d0/d7/d16/d20/c61 to d0/d7/d16/d20/d2b/d33/d4c/d5c/c65 0 2024-04-25T16:18:11.986 INFO:tasks.workunit.client.0.smithi059.stdout:1/356: dwrite d7/d13/d2d/d41/f6b [0,4194304] 0 2024-04-25T16:18:12.072 INFO:tasks.workunit.client.0.smithi059.stdout:2/320: mknod de/d2a/d2e/d6a/c78 0 2024-04-25T16:18:12.267 INFO:tasks.workunit.client.0.smithi059.stdout:6/351: dwrite f6 [0,4194304] 0 2024-04-25T16:18:12.342 INFO:tasks.workunit.client.0.smithi059.stdout:0/314: mknod dc/dd/d5c/c62 0 2024-04-25T16:18:12.369 INFO:tasks.workunit.client.0.smithi059.stdout:5/351: fsync d1/d1e/d27/d66/d70/d3d/f57 0 2024-04-25T16:18:12.386 INFO:tasks.workunit.client.0.smithi059.stdout:4/320: write d0/d4/df/f42 [3003595,120540] 0 2024-04-25T16:18:12.388 INFO:tasks.workunit.client.0.smithi059.stdout:7/319: dread d0/d7/d16/d20/d2b/f4a [0,4194304] 0 2024-04-25T16:18:12.467 INFO:tasks.workunit.client.0.smithi059.stdout:0/315: stat dc/d44/f50 0 2024-04-25T16:18:12.509 INFO:tasks.workunit.client.0.smithi059.stdout:1/357: fsync d7/d13/d2d/d4a/d4d/f4f 0 2024-04-25T16:18:12.572 INFO:tasks.workunit.client.0.smithi059.stdout:0/316: sync 2024-04-25T16:18:12.595 INFO:tasks.workunit.client.0.smithi059.stdout:9/348: dwrite d6/d4e/d54/d5d/f59 [0,4194304] 0 2024-04-25T16:18:12.716 INFO:tasks.workunit.client.0.smithi059.stdout:7/320: dwrite d0/f56 [0,4194304] 0 2024-04-25T16:18:12.937 INFO:tasks.workunit.client.0.smithi059.stdout:3/357: rmdir d0/db/d47/d5b/d75 0 2024-04-25T16:18:12.955 INFO:tasks.workunit.client.0.smithi059.stdout:6/352: mkdir d9/d27/d68 0 2024-04-25T16:18:12.961 INFO:tasks.workunit.client.0.smithi059.stdout:8/307: creat d7/dd/d17/d23/f64 x:0 0 0 2024-04-25T16:18:12.973 INFO:tasks.workunit.client.0.smithi059.stdout:5/352: read d1/d1e/d27/d66/d70/d3d/f55 [1397852,55406] 0 2024-04-25T16:18:13.062 INFO:tasks.workunit.client.0.smithi059.stdout:1/358: creat d7/d13/d6a/f79 x:0 0 0 2024-04-25T16:18:13.063 INFO:tasks.workunit.client.0.smithi059.stdout:0/317: creat dc/d44/f63 x:0 0 0 2024-04-25T16:18:13.069 INFO:tasks.workunit.client.0.smithi059.stdout:9/349: mknod d6/d4e/d54/d5d/d48/d49/c65 0 2024-04-25T16:18:13.096 INFO:tasks.workunit.client.0.smithi059.stdout:7/321: rmdir d0/d7/d16/d20/d2b/d33/d4c/d4e/d4f 39 2024-04-25T16:18:13.104 INFO:tasks.workunit.client.0.smithi059.stdout:1/359: chown d7/d21/l5b 3112 1 2024-04-25T16:18:13.192 INFO:tasks.workunit.client.0.smithi059.stdout:2/321: creat de/d16/f79 x:0 0 0 2024-04-25T16:18:13.297 INFO:tasks.workunit.client.0.smithi059.stdout:8/308: mkdir d7/dd/d17/d23/d38/d65 0 2024-04-25T16:18:13.357 INFO:tasks.workunit.client.0.smithi059.stdout:8/309: chown d7/dd/c11 2 1 2024-04-25T16:18:13.365 INFO:tasks.workunit.client.0.smithi059.stdout:6/353: dread d9/d16/f42 [0,4194304] 0 2024-04-25T16:18:13.377 INFO:tasks.workunit.client.0.smithi059.stdout:8/310: readlink d7/dd/d17/l1b 0 2024-04-25T16:18:13.391 INFO:tasks.workunit.client.0.smithi059.stdout:5/353: fsync d1/d1e/d27/d66/d70/f61 0 2024-04-25T16:18:13.441 INFO:tasks.workunit.client.0.smithi059.stdout:4/321: creat d0/d4/df/f66 x:0 0 0 2024-04-25T16:18:13.449 INFO:tasks.workunit.client.0.smithi059.stdout:0/318: creat dc/d37/d47/f64 x:0 0 0 2024-04-25T16:18:13.690 INFO:tasks.workunit.client.0.smithi059.stdout:2/322: symlink de/d2a/l7a 0 2024-04-25T16:18:13.705 INFO:tasks.workunit.client.0.smithi059.stdout:2/323: write de/d67/f72 [4174676,115623] 0 2024-04-25T16:18:13.762 INFO:tasks.workunit.client.0.smithi059.stdout:3/358: symlink d0/db/l79 0 2024-04-25T16:18:13.786 INFO:tasks.workunit.client.0.smithi059.stdout:6/354: truncate f8 6341149 0 2024-04-25T16:18:14.326 INFO:tasks.workunit.client.0.smithi059.stdout:7/322: write d0/d7/d16/d20/d2b/d33/d4c/d5c/f48 [962792,104626] 0 2024-04-25T16:18:14.399 INFO:tasks.workunit.client.0.smithi059.stdout:3/359: truncate d0/db/d2d/f4e 427706 0 2024-04-25T16:18:14.459 INFO:tasks.workunit.client.0.smithi059.stdout:9/350: dwrite d6/d35/d28/f50 [0,4194304] 0 2024-04-25T16:18:14.518 INFO:tasks.workunit.client.0.smithi059.stdout:5/354: rmdir d1/d1e/d27/d66/d70/d24/d77 0 2024-04-25T16:18:14.560 INFO:tasks.workunit.client.0.smithi059.stdout:5/355: chown d1/dd/f6e 37462 1 2024-04-25T16:18:14.573 INFO:tasks.workunit.client.0.smithi059.stdout:8/311: write d7/dd/d17/d23/d38/f5d [968258,115475] 0 2024-04-25T16:18:14.586 INFO:tasks.workunit.client.0.smithi059.stdout:1/360: getdents d7/d2a/d62 0 2024-04-25T16:18:14.634 INFO:tasks.workunit.client.0.smithi059.stdout:2/324: creat de/d16/f7b x:0 0 0 2024-04-25T16:18:14.639 INFO:tasks.workunit.client.0.smithi059.stdout:5/356: sync 2024-04-25T16:18:14.793 INFO:tasks.workunit.client.0.smithi059.stdout:6/355: link d9/d27/c47 d9/d16/d24/d5d/c69 0 2024-04-25T16:18:14.800 INFO:tasks.workunit.client.0.smithi059.stdout:6/356: chown d9/f29 6452417 1 2024-04-25T16:18:15.095 INFO:tasks.workunit.client.0.smithi059.stdout:7/323: dwrite d0/d7/f2c [4194304,4194304] 0 2024-04-25T16:18:15.178 INFO:tasks.workunit.client.0.smithi059.stdout:3/360: chown d0/db/d3f/l61 215323415 1 2024-04-25T16:18:15.183 INFO:tasks.workunit.client.0.smithi059.stdout:3/361: stat d0/db/f3a 0 2024-04-25T16:18:15.253 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:18:15.256 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:18:15.291 INFO:tasks.workunit.client.0.smithi059.stdout:9/351: rmdir d6/d4e/d54/d5d/d48 39 2024-04-25T16:18:15.297 INFO:tasks.workunit.client.0.smithi059.stdout:0/319: rename dc/df/c54 to dc/d37/c65 0 2024-04-25T16:18:15.334 INFO:tasks.workunit.client.0.smithi059.stdout:5/357: dread - d1/dd/f6e zero size 2024-04-25T16:18:15.504 INFO:tasks.workunit.client.0.smithi059.stdout:2/325: dread f7 [0,4194304] 0 2024-04-25T16:18:15.556 INFO:tasks.workunit.client.0.smithi059.stdout:0/320: mkdir dc/dd/d3b/d66 0 2024-04-25T16:18:15.576 INFO:tasks.workunit.client.0.smithi059.stdout:1/361: write d7/f12 [3310266,24433] 0 2024-04-25T16:18:15.608 INFO:tasks.workunit.client.0.smithi059.stdout:3/362: mkdir d0/db/d2d/d7a 0 2024-04-25T16:18:15.616 INFO:tasks.workunit.client.0.smithi059.stdout:8/312: dread d7/f1f [0,4194304] 0 2024-04-25T16:18:15.624 INFO:tasks.workunit.client.0.smithi059.stdout:2/326: chown de/d2a/d2e/f3f 2477429 1 2024-04-25T16:18:15.670 INFO:tasks.workunit.client.0.smithi059.stdout:3/363: read d0/db/f3a [922891,56148] 0 2024-04-25T16:18:15.962 INFO:tasks.workunit.client.0.smithi059.stdout:6/357: rmdir d9/d16/d54/d60/d64 0 2024-04-25T16:18:16.061 INFO:tasks.workunit.client.0.smithi059.stdout:4/322: rename d0/d4/df/d1c/d45/f52 to d0/f67 0 2024-04-25T16:18:16.077 INFO:tasks.workunit.client.0.smithi059.stdout:8/313: mkdir d7/d16/d45/d66 0 2024-04-25T16:18:16.086 INFO:tasks.workunit.client.0.smithi059.stdout:7/324: dwrite d0/d7/d16/d20/d2b/d33/f43 [0,4194304] 0 2024-04-25T16:18:16.100 INFO:tasks.workunit.client.0.smithi059.stdout:2/327: mknod de/d2a/d2e/d36/d2c/d40/d57/c7c 0 2024-04-25T16:18:16.171 INFO:tasks.workunit.client.0.smithi059.stdout:3/364: creat d0/db/d3f/d49/f7b x:0 0 0 2024-04-25T16:18:16.209 INFO:tasks.workunit.client.0.smithi059.stdout:8/314: chown d7/d16/d3a/f46 63480241 1 2024-04-25T16:18:16.236 INFO:tasks.workunit.client.0.smithi059.stdout:5/358: mknod d1/d1e/d27/d66/d70/d3d/d44/d79/c7b 0 2024-04-25T16:18:16.242 INFO:tasks.workunit.client.0.smithi059.stdout:6/358: symlink d9/d16/d53/l6a 0 2024-04-25T16:18:16.838 INFO:tasks.workunit.client.0.smithi059.stdout:7/325: dread - d0/d7/d16/f42 zero size 2024-04-25T16:18:16.846 INFO:tasks.workunit.client.0.smithi059.stdout:3/365: read - d0/db/d47/d5b/f5d zero size 2024-04-25T16:18:16.876 INFO:tasks.workunit.client.0.smithi059.stdout:4/323: dread d0/d4/f21 [0,4194304] 0 2024-04-25T16:18:16.887 INFO:tasks.workunit.client.0.smithi059.stdout:8/315: truncate d7/d16/d3a/f46 5019851 0 2024-04-25T16:18:16.925 INFO:tasks.workunit.client.0.smithi059.stdout:7/326: truncate d0/d7/f2c 9127774 0 2024-04-25T16:18:17.591 INFO:tasks.workunit.client.0.smithi059.stdout:1/362: getdents d7/d13/d2d/d4a/d4d 0 2024-04-25T16:18:17.608 INFO:tasks.workunit.client.0.smithi059.stdout:0/321: write dc/f3a [878138,32721] 0 2024-04-25T16:18:17.683 INFO:tasks.workunit.client.0.smithi059.stdout:6/359: truncate d9/fe 5517308 0 2024-04-25T16:18:17.715 INFO:tasks.workunit.client.0.smithi059.stdout:7/327: readlink d0/d7/d51/l58 0 2024-04-25T16:18:17.716 INFO:tasks.workunit.client.0.smithi059.stdout:0/322: sync 2024-04-25T16:18:17.805 INFO:tasks.workunit.client.0.smithi059.stdout:9/352: rename d6/d35/d26/f33 to d6/d35/f66 0 2024-04-25T16:18:18.165 INFO:tasks.workunit.client.0.smithi059.stdout:7/328: readlink d0/d7/d16/d20/l3e 0 2024-04-25T16:18:18.195 INFO:tasks.workunit.client.0.smithi059.stdout:0/323: truncate dc/df/f5d 431236 0 2024-04-25T16:18:18.488 INFO:tasks.workunit.client.0.smithi059.stdout:0/324: symlink dc/df/d24/l67 0 2024-04-25T16:18:18.697 INFO:tasks.workunit.client.0.smithi059.stdout:3/366: creat d0/db/f7c x:0 0 0 2024-04-25T16:18:18.697 INFO:tasks.workunit.client.0.smithi059.stdout:6/360: creat d9/d1b/f6b x:0 0 0 2024-04-25T16:18:18.890 INFO:tasks.workunit.client.0.smithi059.stdout:8/316: dwrite d7/d16/d3a/f3e [0,4194304] 0 2024-04-25T16:18:18.894 INFO:tasks.workunit.client.0.smithi059.stdout:2/328: dwrite de/d2a/d2e/f30 [0,4194304] 0 2024-04-25T16:18:19.077 INFO:tasks.workunit.client.0.smithi059.stdout:4/324: rmdir d0/d4 39 2024-04-25T16:18:19.145 INFO:tasks.workunit.client.0.smithi059.stdout:1/363: dwrite d7/d13/d58/f5e [4194304,4194304] 0 2024-04-25T16:18:19.263 INFO:tasks.workunit.client.0.smithi059.stdout:7/329: creat d0/d7/d16/d20/d2b/d33/d4c/d4e/f66 x:0 0 0 2024-04-25T16:18:19.302 INFO:tasks.workunit.client.0.smithi059.stdout:5/359: unlink d1/f10 0 2024-04-25T16:18:19.462 INFO:tasks.workunit.client.0.smithi059.stdout:8/317: symlink d7/dd/d17/l67 0 2024-04-25T16:18:19.468 INFO:tasks.workunit.client.0.smithi059.stdout:0/325: mkdir dc/d68 0 2024-04-25T16:18:19.588 INFO:tasks.workunit.client.0.smithi059.stdout:2/329: unlink de/d2a/d2e/d36/f28 0 2024-04-25T16:18:19.684 INFO:tasks.workunit.client.0.smithi059.stdout:9/353: dwrite d6/f18 [0,4194304] 0 2024-04-25T16:18:19.778 INFO:tasks.workunit.client.0.smithi059.stdout:1/364: rename d7/c1c to d7/d13/d16/d72/c7a 0 2024-04-25T16:18:19.919 INFO:tasks.workunit.client.0.smithi059.stdout:0/326: fsync dc/df/d24/f39 0 2024-04-25T16:18:19.931 INFO:tasks.workunit.client.0.smithi059.stdout:7/330: dread d0/d7/f23 [0,4194304] 0 2024-04-25T16:18:19.941 INFO:tasks.workunit.client.0.smithi059.stdout:0/327: stat dc/d44/f35 0 2024-04-25T16:18:19.958 INFO:tasks.workunit.client.0.smithi059.stdout:7/331: chown d0/d7/d16/d20/d2b/d33/d4c/d5c 30035726 1 2024-04-25T16:18:20.106 INFO:tasks.workunit.client.0.smithi059.stdout:2/330: mkdir de/d5a/d7d 0 2024-04-25T16:18:20.210 INFO:tasks.workunit.client.0.smithi059.stdout:1/365: rmdir d7/d13/d2d/d4a/d4d 39 2024-04-25T16:18:20.304 INFO:tasks.workunit.client.0.smithi059.stdout:1/366: read d7/d13/d58/f5e [5473756,56932] 0 2024-04-25T16:18:20.309 INFO:tasks.workunit.client.0.smithi059.stdout:3/367: dwrite d0/db/d2d/f38 [0,4194304] 0 2024-04-25T16:18:20.380 INFO:tasks.workunit.client.0.smithi059.stdout:5/360: mkdir d1/d1e/d7c 0 2024-04-25T16:18:20.398 INFO:tasks.workunit.client.0.smithi059.stdout:6/361: dwrite d9/d16/d24/f5e [0,4194304] 0 2024-04-25T16:18:20.506 INFO:tasks.workunit.client.0.smithi059.stdout:7/332: creat d0/d7/d16/d20/f67 x:0 0 0 2024-04-25T16:18:20.554 INFO:tasks.workunit.client.0.smithi059.stdout:7/333: chown d0/d7/f1d 99620 1 2024-04-25T16:18:20.959 INFO:tasks.workunit.client.0.smithi059.stdout:9/354: unlink d6/d4e/d54/d5d/f3f 0 2024-04-25T16:18:20.967 INFO:tasks.workunit.client.0.smithi059.stdout:4/325: rename d0/d4/f5c to d0/d4/df/d48/d5f/f68 0 2024-04-25T16:18:21.003 INFO:tasks.workunit.client.0.smithi059.stdout:3/368: rmdir d0/d1e/d57 39 2024-04-25T16:18:21.005 INFO:tasks.workunit.client.0.smithi059.stdout:8/318: write d7/dd/d17/f42 [3291812,59568] 0 2024-04-25T16:18:21.041 INFO:tasks.workunit.client.0.smithi059.stdout:1/367: truncate d7/f29 3967604 0 2024-04-25T16:18:21.214 INFO:tasks.workunit.client.0.smithi059.stdout:5/361: rename d1/d1e/d27/d66/d70/d3d/d44/f4a to d1/d1e/d27/d66/d70/d75/f7d 0 2024-04-25T16:18:21.246 INFO:tasks.workunit.client.0.smithi059.stdout:4/326: read d0/d4/df/f42 [3493713,69803] 0 2024-04-25T16:18:21.525 INFO:tasks.workunit.client.0.smithi059.stdout:9/355: mknod d6/d35/d26/c67 0 2024-04-25T16:18:21.856 INFO:tasks.workunit.client.0.smithi059.stdout:6/362: dwrite d9/d16/d24/f3f [0,4194304] 0 2024-04-25T16:18:21.919 INFO:tasks.workunit.client.0.smithi059.stdout:7/334: symlink d0/d7/d16/d20/d2b/d33/d4c/d4e/d4f/l68 0 2024-04-25T16:18:21.973 INFO:tasks.workunit.client.0.smithi059.stdout:1/368: creat d7/d13/d2d/d41/f7b x:0 0 0 2024-04-25T16:18:22.117 INFO:tasks.workunit.client.0.smithi059.stdout:8/319: rename d7/dd/d17/l67 to d7/d16/d45/d66/l68 0 2024-04-25T16:18:22.242 INFO:tasks.workunit.client.0.smithi059.stdout:0/328: rename dc/c1a to dc/c69 0 2024-04-25T16:18:22.247 INFO:tasks.workunit.client.0.smithi059.stdout:4/327: fdatasync d0/d4/df/f66 0 2024-04-25T16:18:22.290 INFO:tasks.workunit.client.0.smithi059.stdout:5/362: creat d1/d1e/d27/d66/d70/d3d/d44/d79/f7e x:0 0 0 2024-04-25T16:18:22.798 INFO:tasks.workunit.client.0.smithi059.stdout:7/335: truncate d0/d7/d16/d20/d2b/d33/f39 1385330 0 2024-04-25T16:18:22.810 INFO:tasks.workunit.client.0.smithi059.stdout:3/369: write d0/d1e/f1f [2254365,20017] 0 2024-04-25T16:18:22.811 INFO:tasks.workunit.client.0.smithi059.stdout:1/369: readlink d7/d13/l57 0 2024-04-25T16:18:22.860 INFO:tasks.workunit.client.0.smithi059.stdout:7/336: write d0/d7/d16/d20/f67 [302644,40644] 0 2024-04-25T16:18:22.875 INFO:tasks.workunit.client.0.smithi059.stdout:6/363: rename d9/d16/d54/d60 to d9/d16/d53/d6c 0 2024-04-25T16:18:22.936 INFO:tasks.workunit.client.0.smithi059.stdout:8/320: read d7/f20 [3603175,61251] 0 2024-04-25T16:18:22.992 INFO:tasks.workunit.client.0.smithi059.stdout:0/329: unlink dc/dd/f48 0 2024-04-25T16:18:23.007 INFO:tasks.workunit.client.0.smithi059.stdout:0/330: read dc/df/d24/f2e [3942390,27998] 0 2024-04-25T16:18:23.103 INFO:tasks.workunit.client.0.smithi059.stdout:5/363: truncate d1/d1e/d27/d66/d70/d42/d6d/f73 787119 0 2024-04-25T16:18:23.236 INFO:tasks.workunit.client.0.smithi059.stdout:2/331: link de/d2a/d2e/f58 de/d2a/d33/f7e 0 2024-04-25T16:18:23.399 INFO:tasks.workunit.client.0.smithi059.stdout:3/370: unlink d0/db/d3f/d49/c6d 0 2024-04-25T16:18:23.447 INFO:tasks.workunit.client.0.smithi059.stdout:7/337: symlink d0/d7/d16/d20/d2b/d33/l69 0 2024-04-25T16:18:23.541 INFO:tasks.workunit.client.0.smithi059.stdout:7/338: readlink d0/d7/d16/d20/d2b/d33/l69 0 2024-04-25T16:18:23.544 INFO:tasks.workunit.client.0.smithi059.stdout:1/370: dread d7/d13/d2d/d4a/f56 [0,4194304] 0 2024-04-25T16:18:23.622 INFO:tasks.workunit.client.0.smithi059.stdout:5/364: mkdir d1/d1e/d27/d66/d70/d3d/d44/d7f 0 2024-04-25T16:18:23.655 INFO:tasks.workunit.client.0.smithi059.stdout:4/328: truncate d0/d4/df/d48/d5f/f68 1046639 0 2024-04-25T16:18:23.851 INFO:tasks.workunit.client.0.smithi059.stdout:6/364: creat d9/d27/d68/f6d x:0 0 0 2024-04-25T16:18:23.867 INFO:tasks.workunit.client.0.smithi059.stdout:6/365: chown d9/d1b 255371605 1 2024-04-25T16:18:23.924 INFO:tasks.workunit.client.0.smithi059.stdout:6/366: dread d9/f10 [0,4194304] 0 2024-04-25T16:18:24.028 INFO:tasks.workunit.client.0.smithi059.stdout:1/371: fsync d7/d13/d2d/d41/f73 0 2024-04-25T16:18:24.188 INFO:tasks.workunit.client.0.smithi059.stdout:5/365: fsync d1/d1e/d27/d66/d70/d3d/f40 0 2024-04-25T16:18:24.218 INFO:tasks.workunit.client.0.smithi059.stdout:2/332: mkdir de/d16/d7f 0 2024-04-25T16:18:24.269 INFO:tasks.workunit.client.0.smithi059.stdout:4/329: dread d0/d4/fe [0,4194304] 0 2024-04-25T16:18:24.282 INFO:tasks.workunit.client.0.smithi059.stdout:9/356: creat d6/f68 x:0 0 0 2024-04-25T16:18:24.297 INFO:tasks.workunit.client.0.smithi059.stdout:6/367: rmdir d9/d16/d24 39 2024-04-25T16:18:24.391 INFO:tasks.workunit.client.0.smithi059.stdout:1/372: creat d7/d21/f7c x:0 0 0 2024-04-25T16:18:24.658 INFO:tasks.workunit.client.0.smithi059.stdout:5/366: dread d1/d1e/d27/d66/d70/d3d/d44/f67 [0,4194304] 0 2024-04-25T16:18:24.687 INFO:tasks.workunit.client.0.smithi059.stdout:4/330: read d0/d4/df/d1c/d45/f2d [2698008,75912] 0 2024-04-25T16:18:24.707 INFO:tasks.workunit.client.0.smithi059.stdout:0/331: write dc/dd/f3c [1180735,111826] 0 2024-04-25T16:18:24.741 INFO:tasks.workunit.client.0.smithi059.stdout:6/368: chown d9/d16/d24/f3c 38 1 2024-04-25T16:18:24.759 INFO:tasks.workunit.client.0.smithi059.stdout:7/339: link d0/d7/d16/f2a d0/d3f/f6a 0 2024-04-25T16:18:24.811 INFO:tasks.workunit.client.0.smithi059.stdout:2/333: truncate de/f2d 3025187 0 2024-04-25T16:18:24.817 INFO:tasks.workunit.client.0.smithi059.stdout:2/334: chown f1 205863 1 2024-04-25T16:18:24.827 INFO:tasks.workunit.client.0.smithi059.stdout:2/335: chown de/d2a/d33/c5f 14354 1 2024-04-25T16:18:24.990 INFO:tasks.workunit.client.0.smithi059.stdout:8/321: write d7/d2f/f47 [2275803,83358] 0 2024-04-25T16:18:25.080 INFO:tasks.workunit.client.0.smithi059.stdout:9/357: fsync f2 0 2024-04-25T16:18:25.102 INFO:tasks.workunit.client.0.smithi059.stdout:3/371: dwrite d0/d1e/f53 [0,4194304] 0 2024-04-25T16:18:25.172 INFO:tasks.workunit.client.0.smithi059.stdout:5/367: creat d1/d1e/d27/d66/d70/d3d/f80 x:0 0 0 2024-04-25T16:18:25.200 INFO:tasks.workunit.client.0.smithi059.stdout:5/368: chown d1/d1e/d27/d66/d70/d42/f52 1378538008 1 2024-04-25T16:18:25.269 INFO:tasks.workunit.client.0.smithi059.stdout:0/332: truncate dc/dd/f23 3018205 0 2024-04-25T16:18:25.477 INFO:tasks.workunit.client.0.smithi059.stdout:2/336: dread - de/d16/d3e/f4f zero size 2024-04-25T16:18:25.623 INFO:tasks.workunit.client.0.smithi059.stdout:1/373: dwrite d7/f69 [0,4194304] 0 2024-04-25T16:18:25.695 INFO:tasks.workunit.client.0.smithi059.stdout:9/358: rmdir d6/d4e/d54/d5d 39 2024-04-25T16:18:25.706 INFO:tasks.workunit.client.0.smithi059.stdout:3/372: chown d0/d1e/d57/c70 246 1 2024-04-25T16:18:26.165 INFO:tasks.workunit.client.0.smithi059.stdout:6/369: dwrite f6 [0,4194304] 0 2024-04-25T16:18:26.231 INFO:tasks.workunit.client.0.smithi059.stdout:4/331: dwrite d0/d4/df/d1c/f3d [4194304,4194304] 0 2024-04-25T16:18:26.313 INFO:tasks.workunit.client.0.smithi059.stdout:9/359: creat d6/d35/d28/f69 x:0 0 0 2024-04-25T16:18:26.317 INFO:tasks.workunit.client.0.smithi059.stdout:1/374: creat d7/d13/d16/d72/f7d x:0 0 0 2024-04-25T16:18:26.326 INFO:tasks.workunit.client.0.smithi059.stdout:3/373: mknod d0/db/d68/c7d 0 2024-04-25T16:18:26.386 INFO:tasks.workunit.client.0.smithi059.stdout:0/333: write dc/dd/f58 [79879,107588] 0 2024-04-25T16:18:26.496 INFO:tasks.workunit.client.0.smithi059.stdout:6/370: dread d9/d16/f42 [0,4194304] 0 2024-04-25T16:18:26.512 INFO:tasks.workunit.client.0.smithi059.stdout:5/369: dwrite d1/d1e/d27/f30 [4194304,4194304] 0 2024-04-25T16:18:26.638 INFO:tasks.workunit.client.0.smithi059.stdout:2/337: mkdir de/d5a/d7d/d80 0 2024-04-25T16:18:26.769 INFO:tasks.workunit.client.0.smithi059.stdout:7/340: dwrite d0/d7/fa [8388608,4194304] 0 2024-04-25T16:18:26.889 INFO:tasks.workunit.client.0.smithi059.stdout:7/341: read d0/d7/f29 [3009985,49208] 0 2024-04-25T16:18:26.914 INFO:tasks.workunit.client.0.smithi059.stdout:8/322: dwrite d7/dd/f3c [0,4194304] 0 2024-04-25T16:18:26.991 INFO:tasks.workunit.client.0.smithi059.stdout:4/332: fdatasync d0/f26 0 2024-04-25T16:18:27.085 INFO:tasks.workunit.client.0.smithi059.stdout:1/375: symlink d7/d21/l7e 0 2024-04-25T16:18:27.093 INFO:tasks.workunit.client.0.smithi059.stdout:3/374: readlink d0/db/d47/l44 0 2024-04-25T16:18:27.165 INFO:tasks.workunit.client.0.smithi059.stdout:8/323: dread d7/dd/d33/f4c [4194304,4194304] 0 2024-04-25T16:18:27.348 INFO:tasks.workunit.client.0.smithi059.stdout:6/371: truncate d9/f35 779612 0 2024-04-25T16:18:27.353 INFO:tasks.workunit.client.0.smithi059.stdout:5/370: fsync d1/d1e/d27/d66/d70/f23 0 2024-04-25T16:18:27.860 INFO:tasks.workunit.client.0.smithi059.stdout:6/372: fsync d9/d1b/f6b 0 2024-04-25T16:18:27.925 INFO:tasks.workunit.client.0.smithi059.stdout:7/342: symlink d0/d7/d16/l6b 0 2024-04-25T16:18:27.954 INFO:tasks.workunit.client.0.smithi059.stdout:4/333: symlink d0/d4/df/l69 0 2024-04-25T16:18:28.068 INFO:tasks.workunit.client.0.smithi059.stdout:1/376: mkdir d7/d13/d16/d7f 0 2024-04-25T16:18:28.149 INFO:tasks.workunit.client.0.smithi059.stdout:9/360: write f1 [2953472,56927] 0 2024-04-25T16:18:28.305 INFO:tasks.workunit.client.0.smithi059.stdout:6/373: mkdir d9/d16/d53/d55/d6e 0 2024-04-25T16:18:28.323 INFO:tasks.workunit.client.0.smithi059.stdout:7/343: read d0/f27 [648662,67655] 0 2024-04-25T16:18:28.439 INFO:tasks.workunit.client.0.smithi059.stdout:0/334: dwrite dc/df/f10 [0,4194304] 0 2024-04-25T16:18:28.455 INFO:tasks.workunit.client.0.smithi059.stdout:7/344: sync 2024-04-25T16:18:28.626 INFO:tasks.workunit.client.0.smithi059.stdout:7/345: mknod d0/d7/d51/c6c 0 2024-04-25T16:18:28.894 INFO:tasks.workunit.client.0.smithi059.stdout:2/338: dwrite de/d2a/f35 [4194304,4194304] 0 2024-04-25T16:18:29.059 INFO:tasks.workunit.client.0.smithi059.stdout:7/346: mknod d0/c6d 0 2024-04-25T16:18:29.125 INFO:tasks.workunit.client.0.smithi059.stdout:6/374: unlink d9/d16/l2a 0 2024-04-25T16:18:29.136 INFO:tasks.workunit.client.0.smithi059.stdout:5/371: write d1/d1e/d27/f4e [1112302,103505] 0 2024-04-25T16:18:29.137 INFO:tasks.workunit.client.0.smithi059.stdout:3/375: write d0/db/f19 [486473,119507] 0 2024-04-25T16:18:29.235 INFO:tasks.workunit.client.0.smithi059.stdout:1/377: rename d7/d13/f1b to d7/d13/d16/d7f/f80 0 2024-04-25T16:18:29.278 INFO:tasks.workunit.client.0.smithi059.stdout:0/335: getdents dc 0 2024-04-25T16:18:29.322 INFO:tasks.workunit.client.0.smithi059.stdout:3/376: chown d0/db/d47/d5b/f73 2352 1 2024-04-25T16:18:29.343 INFO:tasks.workunit.client.0.smithi059.stdout:2/339: dread - de/d2a/d2e/d36/d2c/d40/d57/f6c zero size 2024-04-25T16:18:29.364 INFO:tasks.workunit.client.0.smithi059.stdout:7/347: truncate d0/d3f/f5b 420543 0 2024-04-25T16:18:29.413 INFO:tasks.workunit.client.0.smithi059.stdout:8/324: dwrite d7/dd/d33/f41 [0,4194304] 0 2024-04-25T16:18:29.571 INFO:tasks.workunit.client.0.smithi059.stdout:6/375: dread d9/f29 [0,4194304] 0 2024-04-25T16:18:29.616 INFO:tasks.workunit.client.0.smithi059.stdout:5/372: creat d1/d1e/d27/d66/d70/d42/f81 x:0 0 0 2024-04-25T16:18:29.619 INFO:tasks.workunit.client.0.smithi059.stdout:0/336: mkdir dc/d6a 0 2024-04-25T16:18:29.633 INFO:tasks.workunit.client.0.smithi059.stdout:1/378: symlink d7/d13/d58/l81 0 2024-04-25T16:18:29.658 INFO:tasks.workunit.client.0.smithi059.stdout:4/334: dwrite d0/d4/f1b [0,4194304] 0 2024-04-25T16:18:29.863 INFO:tasks.workunit.client.0.smithi059.stdout:2/340: dread - de/d2a/d2e/d36/d2c/d40/f47 zero size 2024-04-25T16:18:29.898 INFO:tasks.workunit.client.0.smithi059.stdout:9/361: dwrite d6/d35/d28/f3e [0,4194304] 0 2024-04-25T16:18:29.969 INFO:tasks.workunit.client.0.smithi059.stdout:9/362: chown d6/d4e/d54 37 1 2024-04-25T16:18:30.040 INFO:tasks.workunit.client.0.smithi059.stdout:6/376: mknod d9/d1b/d58/d49/c6f 0 2024-04-25T16:18:30.177 INFO:tasks.workunit.client.0.smithi059.stdout:1/379: mknod d7/d13/d2d/d41/c82 0 2024-04-25T16:18:30.229 INFO:tasks.workunit.client.0.smithi059.stdout:3/377: dwrite d0/f3e [0,4194304] 0 2024-04-25T16:18:30.288 INFO:tasks.workunit.client.0.smithi059.stdout:1/380: sync 2024-04-25T16:18:30.309 INFO:tasks.workunit.client.0.smithi059.stdout:5/373: creat d1/d1e/d27/d66/d70/d42/d6d/f82 x:0 0 0 2024-04-25T16:18:30.353 INFO:tasks.workunit.client.0.smithi059.stdout:1/381: chown d7/d13/d58 16347030 1 2024-04-25T16:18:30.396 INFO:tasks.workunit.client.0.smithi059.stdout:7/348: write d0/d3f/f50 [1975306,51556] 0 2024-04-25T16:18:30.436 INFO:tasks.workunit.client.0.smithi059.stdout:8/325: dwrite d7/d2f/f3f [0,4194304] 0 2024-04-25T16:18:30.566 INFO:tasks.workunit.client.0.smithi059.stdout:4/335: dread d0/d4/f35 [0,4194304] 0 2024-04-25T16:18:30.663 INFO:tasks.workunit.client.0.smithi059.stdout:2/341: dwrite de/d67/f72 [4194304,4194304] 0 2024-04-25T16:18:30.762 INFO:tasks.workunit.client.0.smithi059.stdout:6/377: creat d9/d16/d53/d55/d6e/f70 x:0 0 0 2024-04-25T16:18:30.778 INFO:tasks.workunit.client.0.smithi059.stdout:3/378: write d0/fa [1146835,89146] 0 2024-04-25T16:18:30.793 INFO:tasks.workunit.client.0.smithi059.stdout:7/349: rmdir d0/d7/d16/d38 39 2024-04-25T16:18:30.818 INFO:tasks.workunit.client.0.smithi059.stdout:8/326: chown d7/dd/d33/l62 430629 1 2024-04-25T16:18:30.936 INFO:tasks.workunit.client.0.smithi059.stdout:1/382: truncate d7/d13/d58/f25 3795697 0 2024-04-25T16:18:30.947 INFO:tasks.workunit.client.0.smithi059.stdout:5/374: rename d1/f63 to d1/d1e/d27/d66/d70/d3d/d44/d79/f83 0 2024-04-25T16:18:31.109 INFO:tasks.workunit.client.0.smithi059.stdout:0/337: dwrite dc/f36 [0,4194304] 0 2024-04-25T16:18:31.235 INFO:tasks.workunit.client.0.smithi059.stdout:9/363: unlink d6/d4e/d54/d5d/d48/d49/c60 0 2024-04-25T16:18:31.239 INFO:tasks.workunit.client.0.smithi059.stdout:6/378: unlink d9/f14 0 2024-04-25T16:18:31.254 INFO:tasks.workunit.client.0.smithi059.stdout:3/379: mkdir d0/db/d47/d7e 0 2024-04-25T16:18:31.272 INFO:tasks.workunit.client.0.smithi059.stdout:8/327: stat d7/d16/d3a/f46 0 2024-04-25T16:18:31.296 INFO:tasks.workunit.client.0.smithi059.stdout:1/383: dread d7/d13/f20 [0,4194304] 0 2024-04-25T16:18:31.310 INFO:tasks.workunit.client.0.smithi059.stdout:7/350: dread d0/d3f/f5b [0,4194304] 0 2024-04-25T16:18:31.342 INFO:tasks.workunit.client.0.smithi059.stdout:1/384: readlink d7/d13/l57 0 2024-04-25T16:18:31.393 INFO:tasks.workunit.client.0.smithi059.stdout:1/385: chown d7/d13/f20 0 1 2024-04-25T16:18:31.394 INFO:tasks.workunit.client.0.smithi059.stdout:8/328: dread d7/d2f/f3f [0,4194304] 0 2024-04-25T16:18:31.403 INFO:tasks.workunit.client.0.smithi059.stdout:2/342: rename de/d5a/f56 to de/d2a/d2e/d36/d2c/d40/d57/f81 0 2024-04-25T16:18:31.411 INFO:tasks.workunit.client.0.smithi059.stdout:5/375: creat d1/d1e/d27/d66/d70/d42/f84 x:0 0 0 2024-04-25T16:18:31.564 INFO:tasks.workunit.client.0.smithi059.stdout:8/329: dread d7/d2f/f53 [0,4194304] 0 2024-04-25T16:18:31.810 INFO:tasks.workunit.client.0.smithi059.stdout:6/379: mkdir d9/d16/d53/d55/d71 0 2024-04-25T16:18:31.822 INFO:tasks.workunit.client.0.smithi059.stdout:1/386: unlink d7/d13/f20 0 2024-04-25T16:18:31.825 INFO:tasks.workunit.client.0.smithi059.stdout:7/351: creat d0/d7/d16/d20/d2b/d33/d4c/d4e/d4f/f6e x:0 0 0 2024-04-25T16:18:31.835 INFO:tasks.workunit.client.0.smithi059.stdout:0/338: dread fa [0,4194304] 0 2024-04-25T16:18:31.858 INFO:tasks.workunit.client.0.smithi059.stdout:7/352: chown d0/l26 481648961 1 2024-04-25T16:18:32.048 INFO:tasks.workunit.client.0.smithi059.stdout:4/336: rename d0/d4/f21 to d0/d4/df/d48/d5f/f6a 0 2024-04-25T16:18:32.057 INFO:tasks.workunit.client.0.smithi059.stdout:8/330: truncate d7/dd/d17/d23/d38/f5d 528664 0 2024-04-25T16:18:32.060 INFO:tasks.workunit.client.0.smithi059.stdout:2/343: fsync f1 0 2024-04-25T16:18:32.615 INFO:tasks.workunit.client.0.smithi059.stdout:3/380: mkdir d0/db/d7f 0 2024-04-25T16:18:32.645 INFO:tasks.workunit.client.0.smithi059.stdout:9/364: symlink d6/d4e/d54/l6a 0 2024-04-25T16:18:33.126 INFO:tasks.workunit.client.0.smithi059.stdout:1/387: readlink d7/d13/l18 0 2024-04-25T16:18:33.187 INFO:tasks.workunit.client.0.smithi059.stdout:6/380: creat d9/f72 x:0 0 0 2024-04-25T16:18:33.287 INFO:tasks.workunit.client.0.smithi059.stdout:7/353: truncate d0/d7/f40 518868 0 2024-04-25T16:18:33.346 INFO:tasks.workunit.client.0.smithi059.stdout:0/339: dread dc/f29 [0,4194304] 0 2024-04-25T16:18:33.633 INFO:tasks.workunit.client.0.smithi059.stdout:8/331: dread d7/d2f/f3f [0,4194304] 0 2024-04-25T16:18:33.686 INFO:tasks.workunit.client.0.smithi059.stdout:8/332: dread d7/d16/d3a/f3e [0,4194304] 0 2024-04-25T16:18:33.751 INFO:tasks.workunit.client.0.smithi059.stdout:1/388: readlink d7/d13/d16/d5c/l65 0 2024-04-25T16:18:33.856 INFO:tasks.workunit.client.0.smithi059.stdout:7/354: fsync d0/d7/f28 0 2024-04-25T16:18:34.040 INFO:tasks.workunit.client.0.smithi059.stdout:2/344: mkdir de/d16/d82 0 2024-04-25T16:18:34.170 INFO:tasks.workunit.client.0.smithi059.stdout:8/333: mkdir d7/d2f/d43/d69 0 2024-04-25T16:18:34.441 INFO:tasks.workunit.client.0.smithi059.stdout:3/381: dwrite d0/db/f1c [4194304,4194304] 0 2024-04-25T16:18:34.461 INFO:tasks.workunit.client.0.smithi059.stdout:5/376: getdents d1/d1e/d27/d66/d70 0 2024-04-25T16:18:34.526 INFO:tasks.workunit.client.0.smithi059.stdout:0/340: creat dc/dd/f6b x:0 0 0 2024-04-25T16:18:34.554 INFO:tasks.workunit.client.0.smithi059.stdout:2/345: truncate de/d2a/d2e/d36/d2c/d40/f47 658535 0 2024-04-25T16:18:34.722 INFO:tasks.workunit.client.0.smithi059.stdout:6/381: dwrite d9/d16/d24/f3c [0,4194304] 0 2024-04-25T16:18:34.731 INFO:tasks.workunit.client.0.smithi059.stdout:1/389: mknod d7/d13/d2d/d4a/d4d/c83 0 2024-04-25T16:18:34.889 INFO:tasks.workunit.client.0.smithi059.stdout:7/355: creat d0/d7/d16/d5a/f6f x:0 0 0 2024-04-25T16:18:34.907 INFO:tasks.workunit.client.0.smithi059.stdout:4/337: creat d0/d4/df/d1c/f6b x:0 0 0 2024-04-25T16:18:34.936 INFO:tasks.workunit.client.0.smithi059.stdout:0/341: read - dc/dd/f4c zero size 2024-04-25T16:18:34.965 INFO:tasks.workunit.client.0.smithi059.stdout:2/346: rmdir de/d5a/d7d 39 2024-04-25T16:18:35.007 INFO:tasks.workunit.client.0.smithi059.stdout:5/377: dread d1/d1e/d27/d66/d70/d3d/f57 [0,4194304] 0 2024-04-25T16:18:35.100 INFO:tasks.workunit.client.0.smithi059.stdout:9/365: dwrite d6/d4e/d54/d5d/d48/d49/f5c [0,4194304] 0 2024-04-25T16:18:35.249 INFO:tasks.workunit.client.0.smithi059.stdout:8/334: dwrite d7/f1c [0,4194304] 0 2024-04-25T16:18:35.355 INFO:tasks.workunit.client.0.smithi059.stdout:1/390: readlink d7/d13/d16/d54/l3b 0 2024-04-25T16:18:35.526 INFO:tasks.workunit.client.0.smithi059.stdout:5/378: rename d1/d1e/d7c to d1/d48/d85 0 2024-04-25T16:18:35.533 INFO:tasks.workunit.client.0.smithi059.stdout:9/366: mkdir d6/d35/d26/d6b 0 2024-04-25T16:18:35.560 INFO:tasks.workunit.client.0.smithi059.stdout:8/335: truncate d7/dd/d17/d23/d37/f44 1028951 0 2024-04-25T16:18:35.694 INFO:tasks.workunit.client.0.smithi059.stdout:1/391: read d7/d13/d2d/d4a/f4b [3018651,120417] 0 2024-04-25T16:18:35.722 INFO:tasks.workunit.client.0.smithi059.stdout:2/347: mknod de/d16/d7f/c83 0 2024-04-25T16:18:35.861 INFO:tasks.workunit.client.0.smithi059.stdout:1/392: dread d7/f9 [0,4194304] 0 2024-04-25T16:18:35.877 INFO:tasks.workunit.client.0.smithi059.stdout:1/393: dread - d7/d13/d2d/d4a/d4d/f76 zero size 2024-04-25T16:18:36.302 INFO:tasks.workunit.client.0.smithi059.stdout:8/336: fdatasync d7/d16/d3a/f50 0 2024-04-25T16:18:36.321 INFO:tasks.workunit.client.0.smithi059.stdout:9/367: truncate d6/d4e/d54/d5d/f59 3914597 0 2024-04-25T16:18:36.329 INFO:tasks.workunit.client.0.smithi059.stdout:6/382: creat d9/d1b/f73 x:0 0 0 2024-04-25T16:18:36.336 INFO:tasks.workunit.client.0.smithi059.stdout:3/382: link d0/db/d68/c7d d0/db/d3f/c80 0 2024-04-25T16:18:36.384 INFO:tasks.workunit.client.0.smithi059.stdout:2/348: rmdir de/d67 39 2024-04-25T16:18:36.404 INFO:tasks.workunit.client.0.smithi059.stdout:4/338: link d0/d4/f56 d0/d4/df/d48/f6c 0 2024-04-25T16:18:36.410 INFO:tasks.workunit.client.0.smithi059.stdout:8/337: readlink d7/dd/d17/d23/d38/l60 0 2024-04-25T16:18:36.509 INFO:tasks.workunit.client.0.smithi059.stdout:0/342: dread dc/df/d24/f25 [4194304,4194304] 0 2024-04-25T16:18:36.521 INFO:tasks.workunit.client.0.smithi059.stdout:4/339: sync 2024-04-25T16:18:36.759 INFO:tasks.workunit.client.0.smithi059.stdout:7/356: write d0/f30 [1332092,77623] 0 2024-04-25T16:18:36.761 INFO:tasks.workunit.client.0.smithi059.stdout:5/379: write d1/d1e/d27/d66/d70/d3d/f5d [3786632,100667] 0 2024-04-25T16:18:37.134 INFO:tasks.workunit.client.0.smithi059.stdout:1/394: fdatasync d7/d13/d16/f46 0 2024-04-25T16:18:37.141 INFO:tasks.workunit.client.0.smithi059.stdout:0/343: mknod dc/df/d24/c6c 0 2024-04-25T16:18:37.163 INFO:tasks.workunit.client.0.smithi059.stdout:5/380: truncate d1/dd/f6e 525001 0 2024-04-25T16:18:37.210 INFO:tasks.workunit.client.0.smithi059.stdout:9/368: mkdir d6/d35/d6c 0 2024-04-25T16:18:37.320 INFO:tasks.workunit.client.0.smithi059.stdout:8/338: dread d7/d2f/f47 [0,4194304] 0 2024-04-25T16:18:37.384 INFO:tasks.workunit.client.0.smithi059.stdout:0/344: creat dc/df/d24/f6d x:0 0 0 2024-04-25T16:18:37.420 INFO:tasks.workunit.client.0.smithi059.stdout:9/369: dwrite d6/d4e/d54/d5d/d48/d49/f5c [0,4194304] 0 2024-04-25T16:18:37.515 INFO:tasks.workunit.client.0.smithi059.stdout:1/395: creat d7/d13/d16/d54/f84 x:0 0 0 2024-04-25T16:18:37.636 INFO:tasks.workunit.client.0.smithi059.stdout:3/383: creat d0/d1e/f81 x:0 0 0 2024-04-25T16:18:37.659 INFO:tasks.workunit.client.0.smithi059.stdout:1/396: dread d7/d13/d2d/d4a/f4b [0,4194304] 0 2024-04-25T16:18:37.661 INFO:tasks.workunit.client.0.smithi059.stdout:3/384: chown d0/l8 0 1 2024-04-25T16:18:37.955 INFO:tasks.workunit.client.0.smithi059.stdout:8/339: dread d7/f15 [4194304,4194304] 0 2024-04-25T16:18:38.089 INFO:tasks.workunit.client.0.smithi059.stdout:6/383: getdents d9/d16 0 2024-04-25T16:18:38.439 INFO:tasks.workunit.client.0.smithi059.stdout:4/340: write d0/f2a [147348,70303] 0 2024-04-25T16:18:38.526 INFO:tasks.workunit.client.0.smithi059.stdout:2/349: dwrite fb [0,4194304] 0 2024-04-25T16:18:38.763 INFO:tasks.workunit.client.0.smithi059.stdout:3/385: symlink d0/db/d2d/l82 0 2024-04-25T16:18:38.795 INFO:tasks.workunit.client.0.smithi059.stdout:7/357: link d0/d7/d16/d20/d2b/f5f d0/d7/d16/d20/d2b/d33/d4c/d5c/f70 0 2024-04-25T16:18:38.801 INFO:tasks.workunit.client.0.smithi059.stdout:0/345: mkdir dc/d37/d47/d60/d6e 0 2024-04-25T16:18:38.832 INFO:tasks.workunit.client.0.smithi059.stdout:9/370: write f1 [263453,114881] 0 2024-04-25T16:18:38.845 INFO:tasks.workunit.client.0.smithi059.stdout:3/386: chown d0/db/d47/d5b 466260 1 2024-04-25T16:18:38.870 INFO:tasks.workunit.client.0.smithi059.stdout:4/341: mknod d0/d4/df/d48/c6d 0 2024-04-25T16:18:38.882 INFO:tasks.workunit.client.0.smithi059.stdout:1/397: rmdir d7 39 2024-04-25T16:18:38.978 INFO:tasks.workunit.client.0.smithi059.stdout:5/381: dwrite d1/d1e/d27/d66/d70/f39 [4194304,4194304] 0 2024-04-25T16:18:39.163 INFO:tasks.workunit.client.0.smithi059.stdout:2/350: creat de/d16/d82/f84 x:0 0 0 2024-04-25T16:18:39.171 INFO:tasks.workunit.client.0.smithi059.stdout:3/387: chown d0/db/d68/c7d 1189 1 2024-04-25T16:18:39.225 INFO:tasks.workunit.client.0.smithi059.stdout:7/358: mkdir d0/d7/d16/d20/d71 0 2024-04-25T16:18:39.314 INFO:tasks.workunit.client.0.smithi059.stdout:4/342: chown d0/d4/df/f12 3655 1 2024-04-25T16:18:39.369 INFO:tasks.workunit.client.0.smithi059.stdout:1/398: mkdir d7/d2a/d85 0 2024-04-25T16:18:39.378 INFO:tasks.workunit.client.0.smithi059.stdout:1/399: chown d7/d21/f7c 0 1 2024-04-25T16:18:39.415 INFO:tasks.workunit.client.0.smithi059.stdout:5/382: symlink d1/d1e/d27/d66/l86 0 2024-04-25T16:18:39.436 INFO:tasks.workunit.client.0.smithi059.stdout:5/383: rename d1/d1e/d27/d66/d70 to d1/d1e/d27/d66/d70/d75/d87 22 2024-04-25T16:18:39.471 INFO:tasks.workunit.client.0.smithi059.stdout:0/346: creat dc/dd/d3b/d66/f6f x:0 0 0 2024-04-25T16:18:39.556 INFO:tasks.workunit.client.0.smithi059.stdout:8/340: write d7/dd/f3c [1947231,37003] 0 2024-04-25T16:18:39.580 INFO:tasks.workunit.client.0.smithi059.stdout:7/359: mknod d0/d7/d16/d20/c72 0 2024-04-25T16:18:39.588 INFO:tasks.workunit.client.0.smithi059.stdout:6/384: write d9/f56 [384005,26023] 0 2024-04-25T16:18:39.612 INFO:tasks.workunit.client.0.smithi059.stdout:4/343: rmdir d0/d4/df/d48 39 2024-04-25T16:18:39.674 INFO:tasks.workunit.client.0.smithi059.stdout:1/400: dread d7/d13/d58/f5e [4194304,4194304] 0 2024-04-25T16:18:39.684 INFO:tasks.workunit.client.0.smithi059.stdout:1/401: chown d7/d13/d16/d5c 208827754 1 2024-04-25T16:18:39.691 INFO:tasks.workunit.client.0.smithi059.stdout:1/402: chown d7/d13/d77 509 1 2024-04-25T16:18:39.702 INFO:tasks.workunit.client.0.smithi059.stdout:5/384: creat d1/d1e/d27/d66/d70/d3d/d44/f88 x:0 0 0 2024-04-25T16:18:39.803 INFO:tasks.workunit.client.0.smithi059.stdout:3/388: getdents d0/db/d47/d7e 0 2024-04-25T16:18:39.952 INFO:tasks.workunit.client.0.smithi059.stdout:6/385: mkdir d9/d16/d53/d74 0 2024-04-25T16:18:39.977 INFO:tasks.workunit.client.0.smithi059.stdout:3/389: dread d0/db/f14 [0,4194304] 0 2024-04-25T16:18:39.994 INFO:tasks.workunit.client.0.smithi059.stdout:8/341: dread d7/dd/d17/d23/f2a [0,4194304] 0 2024-04-25T16:18:40.530 INFO:tasks.workunit.client.0.smithi059.stdout:2/351: dwrite de/d16/f19 [0,4194304] 0 2024-04-25T16:18:40.595 INFO:tasks.workunit.client.0.smithi059.stdout:3/390: mknod d0/db/d47/c83 0 2024-04-25T16:18:40.607 INFO:tasks.workunit.client.0.smithi059.stdout:8/342: symlink d7/d16/d45/d66/l6a 0 2024-04-25T16:18:40.609 INFO:tasks.workunit.client.0.smithi059.stdout:7/360: write d0/d7/d16/d20/f35 [243079,116218] 0 2024-04-25T16:18:40.674 INFO:tasks.workunit.client.0.smithi059.stdout:5/385: write d1/d1e/d27/d66/d70/d24/f5e [76452,41270] 0 2024-04-25T16:18:40.799 INFO:tasks.workunit.client.0.smithi059.stdout:6/386: mknod d9/d1b/c75 0 2024-04-25T16:18:40.936 INFO:tasks.workunit.client.0.smithi059.stdout:1/403: dwrite d7/f69 [0,4194304] 0 2024-04-25T16:18:41.029 INFO:tasks.workunit.client.0.smithi059.stdout:3/391: dread - d0/db/d3f/d49/f7b zero size 2024-04-25T16:18:41.038 INFO:tasks.workunit.client.0.smithi059.stdout:7/361: rmdir d0/d7/d16/d20/d2b/d33/d4c 39 2024-04-25T16:18:41.052 INFO:tasks.workunit.client.0.smithi059.stdout:0/347: dwrite dc/df/f1d [0,4194304] 0 2024-04-25T16:18:41.060 INFO:tasks.workunit.client.0.smithi059.stdout:4/344: write d0/d4/df/d44/f4d [321086,46529] 0 2024-04-25T16:18:41.061 INFO:tasks.workunit.client.0.smithi059.stdout:5/386: truncate d1/dd/f34 4498311 0 2024-04-25T16:18:41.064 INFO:tasks.workunit.client.0.smithi059.stdout:9/371: dwrite d6/d4e/d54/d5d/f59 [0,4194304] 0 2024-04-25T16:18:41.196 INFO:tasks.workunit.client.0.smithi059.stdout:4/345: sync 2024-04-25T16:18:41.226 INFO:tasks.workunit.client.0.smithi059.stdout:2/352: rename de/d2a/d2e/l66 to de/d16/d7f/l85 0 2024-04-25T16:18:41.295 INFO:tasks.workunit.client.0.smithi059.stdout:3/392: chown d0/db/d3f/l61 24 1 2024-04-25T16:18:41.338 INFO:tasks.workunit.client.0.smithi059.stdout:2/353: chown de/d2a/d2e/d36/d59 44831852 1 2024-04-25T16:18:41.401 INFO:tasks.workunit.client.0.smithi059.stdout:1/404: fdatasync d7/d13/d2d/d41/f7b 0 2024-04-25T16:18:41.406 INFO:tasks.workunit.client.0.smithi059.stdout:5/387: fdatasync d1/f5b 0 2024-04-25T16:18:41.408 INFO:tasks.workunit.client.0.smithi059.stdout:8/343: dwrite d7/f20 [0,4194304] 0 2024-04-25T16:18:41.514 INFO:tasks.workunit.client.0.smithi059.stdout:3/393: mknod d0/db/d47/c84 0 2024-04-25T16:18:41.536 INFO:tasks.workunit.client.0.smithi059.stdout:9/372: dwrite f1 [0,4194304] 0 2024-04-25T16:18:41.641 INFO:tasks.workunit.client.0.smithi059.stdout:3/394: chown d0/db/d3f/d49/f7b 1413449 1 2024-04-25T16:18:41.655 INFO:tasks.workunit.client.0.smithi059.stdout:5/388: stat d1/d1e/d27/d66/d70/d3d/d44/d79/c7b 0 2024-04-25T16:18:41.661 INFO:tasks.workunit.client.0.smithi059.stdout:9/373: stat d6/d4e/d54/d5d/d48/d49/l57 0 2024-04-25T16:18:41.688 INFO:tasks.workunit.client.0.smithi059.stdout:3/395: truncate d0/d1e/f81 44729 0 2024-04-25T16:18:41.820 INFO:tasks.workunit.client.0.smithi059.stdout:6/387: creat d9/d1b/d58/f76 x:0 0 0 2024-04-25T16:18:41.836 INFO:tasks.workunit.client.0.smithi059.stdout:6/388: read d9/d1b/f2c [62756,5246] 0 2024-04-25T16:18:42.000 INFO:tasks.workunit.client.0.smithi059.stdout:1/405: dread - d7/d21/f7c zero size 2024-04-25T16:18:42.064 INFO:tasks.workunit.client.0.smithi059.stdout:2/354: dwrite f7 [0,4194304] 0 2024-04-25T16:18:42.141 INFO:tasks.workunit.client.0.smithi059.stdout:2/355: chown de/d2a/d33/f41 6394635 1 2024-04-25T16:18:42.166 INFO:tasks.workunit.client.0.smithi059.stdout:4/346: chown d0/d4/df/d48/d5f/f68 37 1 2024-04-25T16:18:42.243 INFO:tasks.workunit.client.0.smithi059.stdout:8/344: rename d7/d16/d45/d66/l6a to d7/dd/d17/d23/d37/l6b 0 2024-04-25T16:18:42.431 INFO:tasks.workunit.client.0.smithi059.stdout:3/396: fdatasync d0/fa 0 2024-04-25T16:18:42.730 INFO:tasks.workunit.client.0.smithi059.stdout:0/348: creat dc/d68/f70 x:0 0 0 2024-04-25T16:18:42.811 INFO:tasks.workunit.client.0.smithi059.stdout:2/356: dread - de/d2a/d2e/d36/d2c/d40/f75 zero size 2024-04-25T16:18:42.918 INFO:tasks.workunit.client.0.smithi059.stdout:5/389: mknod d1/d1e/c89 0 2024-04-25T16:18:43.082 INFO:tasks.workunit.client.0.smithi059.stdout:6/389: unlink d9/fe 0 2024-04-25T16:18:43.184 INFO:tasks.workunit.client.0.smithi059.stdout:9/374: dwrite d6/d35/d28/f69 [0,4194304] 0 2024-04-25T16:18:43.424 INFO:tasks.workunit.client.0.smithi059.stdout:7/362: creat d0/d7/f73 x:0 0 0 2024-04-25T16:18:43.429 INFO:tasks.workunit.client.0.smithi059.stdout:1/406: write d7/d21/f7c [997757,47464] 0 2024-04-25T16:18:43.437 INFO:tasks.workunit.client.0.smithi059.stdout:3/397: creat d0/db/d3f/d49/d65/f85 x:0 0 0 2024-04-25T16:18:43.474 INFO:tasks.workunit.client.0.smithi059.stdout:3/398: dread - d0/db/d3f/d49/f7b zero size 2024-04-25T16:18:43.558 INFO:tasks.workunit.client.0.smithi059.stdout:0/349: mkdir dc/d37/d47/d71 0 2024-04-25T16:18:43.565 INFO:tasks.workunit.client.0.smithi059.stdout:4/347: mknod d0/d4/df/c6e 0 2024-04-25T16:18:43.577 INFO:tasks.workunit.client.0.smithi059.stdout:5/390: read - d1/f5b zero size 2024-04-25T16:18:43.591 INFO:tasks.workunit.client.0.smithi059.stdout:5/391: readlink d1/l7 0 2024-04-25T16:18:43.880 INFO:tasks.workunit.client.0.smithi059.stdout:6/390: unlink d9/d27/f30 0 2024-04-25T16:18:43.897 INFO:tasks.workunit.client.0.smithi059.stdout:9/375: unlink d6/d4e/d54/d5d/d48/d49/l57 0 2024-04-25T16:18:43.920 INFO:tasks.workunit.client.0.smithi059.stdout:4/348: mkdir d0/d4/df/d1c/d45/d6f 0 2024-04-25T16:18:44.009 INFO:tasks.workunit.client.0.smithi059.stdout:0/350: dread dc/df/f5d [0,4194304] 0 2024-04-25T16:18:44.098 INFO:tasks.workunit.client.0.smithi059.stdout:0/351: dread - dc/d68/f70 zero size 2024-04-25T16:18:44.117 INFO:tasks.workunit.client.0.smithi059.stdout:1/407: dread d7/f22 [4194304,4194304] 0 2024-04-25T16:18:44.127 INFO:tasks.workunit.client.0.smithi059.stdout:3/399: mkdir d0/db/d2d/d7a/d86 0 2024-04-25T16:18:44.139 INFO:tasks.workunit.client.0.smithi059.stdout:2/357: creat de/f86 x:0 0 0 2024-04-25T16:18:44.183 INFO:tasks.workunit.client.0.smithi059.stdout:1/408: chown d7/d21/f49 0 1 2024-04-25T16:18:44.226 INFO:tasks.workunit.client.0.smithi059.stdout:0/352: dread dc/df/f1d [0,4194304] 0 2024-04-25T16:18:44.254 INFO:tasks.workunit.client.0.smithi059.stdout:8/345: truncate d7/f20 1600415 0 2024-04-25T16:18:44.665 INFO:tasks.workunit.client.0.smithi059.stdout:2/358: mkdir de/d16/d3e/d87 0 2024-04-25T16:18:44.670 INFO:tasks.workunit.client.0.smithi059.stdout:3/400: unlink d0/db/d47/d5b/f73 0 2024-04-25T16:18:44.717 INFO:tasks.workunit.client.0.smithi059.stdout:1/409: read - d7/d13/d16/f50 zero size 2024-04-25T16:18:44.730 INFO:tasks.workunit.client.0.smithi059.stdout:5/392: write d1/d1e/d27/d66/d70/d3d/f55 [1288600,110063] 0 2024-04-25T16:18:44.762 INFO:tasks.workunit.client.0.smithi059.stdout:5/393: dread - d1/d1e/d27/d66/d70/d3d/d44/f88 zero size 2024-04-25T16:18:44.805 INFO:tasks.workunit.client.0.smithi059.stdout:9/376: creat d6/d35/d6c/f6d x:0 0 0 2024-04-25T16:18:44.830 INFO:tasks.workunit.client.0.smithi059.stdout:5/394: stat d1/d1e/d27/d66/d70/d3d/l45 0 2024-04-25T16:18:44.855 INFO:tasks.workunit.client.0.smithi059.stdout:0/353: dread dc/dd/f20 [0,4194304] 0 2024-04-25T16:18:44.878 INFO:tasks.workunit.client.0.smithi059.stdout:5/395: chown d1/d1e/d27/d66/d70/d3d/d44/l51 228 1 2024-04-25T16:18:44.969 INFO:tasks.workunit.client.0.smithi059.stdout:6/391: mkdir d9/d16/d24/d5d/d77 0 2024-04-25T16:18:45.026 INFO:tasks.workunit.client.0.smithi059.stdout:4/349: write d0/d4/df/d44/f5e [357668,111659] 0 2024-04-25T16:18:45.070 INFO:tasks.workunit.client.0.smithi059.stdout:7/363: link d0/d3f/f5b d0/d7/d16/d38/d5d/f74 0 2024-04-25T16:18:45.123 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:32:57.727 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:18:45.128 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:32:57.732 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:18:45.154 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:32:57.717 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:18:45.161 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:32:57.724 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:18:45.164 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:32:57.769 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:18:45.196 INFO:tasks.workunit.client.0.smithi059.stdout:3/401: truncate d0/fa 4740381 0 2024-04-25T16:18:45.197 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:32:57.760 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:18:45.211 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:32:57.774 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:18:45.223 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:32:57.786 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:18:45.254 INFO:tasks.workunit.client.0.smithi059.stdout:9/377: mkdir d6/d4e/d54/d5d/d48/d6e 0 2024-04-25T16:18:45.269 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:32:57.832 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:18:45.310 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:18:45.314 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:18:45.362 INFO:tasks.workunit.client.0.smithi059.stdout:5/396: rmdir d1/d48 39 2024-04-25T16:18:45.412 INFO:tasks.workunit.client.0.smithi059.stdout:8/346: write d7/d16/d3a/f46 [4097804,126674] 0 2024-04-25T16:18:45.881 INFO:tasks.workunit.client.0.smithi059.stdout:1/410: getdents d7/d21/d51 0 2024-04-25T16:18:45.904 INFO:tasks.workunit.client.0.smithi059.stdout:5/397: mkdir d1/d1e/d27/d66/d70/d3d/d50/d8a 0 2024-04-25T16:18:45.939 INFO:tasks.workunit.client.0.smithi059.stdout:1/411: stat d7/f22 0 2024-04-25T16:18:46.042 INFO:tasks.workunit.client.0.smithi059.stdout:4/350: dwrite d0/d4/df/f19 [0,4194304] 0 2024-04-25T16:18:46.048 INFO:tasks.workunit.client.0.smithi059.stdout:5/398: write d1/d1e/d27/d66/d70/d3d/d44/f88 [333291,106887] 0 2024-04-25T16:18:46.114 INFO:tasks.workunit.client.0.smithi059.stdout:0/354: mkdir dc/d44/d5f/d72 0 2024-04-25T16:18:46.130 INFO:tasks.workunit.client.0.smithi059.stdout:9/378: symlink d6/l6f 0 2024-04-25T16:18:46.202 INFO:tasks.workunit.client.0.smithi059.stdout:8/347: unlink d7/f20 0 2024-04-25T16:18:46.209 INFO:tasks.workunit.client.0.smithi059.stdout:6/392: write d9/d16/f17 [1744298,115550] 0 2024-04-25T16:18:46.238 INFO:tasks.workunit.client.0.smithi059.stdout:6/393: chown d9/d27/d39/c50 0 1 2024-04-25T16:18:46.272 INFO:tasks.workunit.client.0.smithi059.stdout:1/412: symlink d7/d21/l86 0 2024-04-25T16:18:46.452 INFO:tasks.workunit.client.0.smithi059.stdout:2/359: write de/d2a/d33/f7e [4977393,127358] 0 2024-04-25T16:18:46.455 INFO:tasks.workunit.client.0.smithi059.stdout:3/402: write d0/f3e [5241810,66996] 0 2024-04-25T16:18:46.537 INFO:tasks.workunit.client.0.smithi059.stdout:0/355: fdatasync dc/d37/f4b 0 2024-04-25T16:18:46.673 INFO:tasks.workunit.client.0.smithi059.stdout:0/356: sync 2024-04-25T16:18:46.787 INFO:tasks.workunit.client.0.smithi059.stdout:0/357: sync 2024-04-25T16:18:46.840 INFO:tasks.workunit.client.0.smithi059.stdout:8/348: creat d7/dd/d33/f6c x:0 0 0 2024-04-25T16:18:47.201 INFO:tasks.workunit.client.0.smithi059.stdout:4/351: symlink d0/l70 0 2024-04-25T16:18:47.240 INFO:tasks.workunit.client.0.smithi059.stdout:2/360: read de/d2a/d2e/d36/d2c/d40/f47 [276659,45756] 0 2024-04-25T16:18:47.367 INFO:tasks.workunit.client.0.smithi059.stdout:9/379: symlink d6/d4e/d54/l70 0 2024-04-25T16:18:47.522 INFO:tasks.workunit.client.0.smithi059.stdout:8/349: dread d7/dd/d33/f41 [0,4194304] 0 2024-04-25T16:18:47.545 INFO:tasks.workunit.client.0.smithi059.stdout:6/394: symlink d9/d1b/d58/l78 0 2024-04-25T16:18:47.950 INFO:tasks.workunit.client.0.smithi059.stdout:5/399: write d1/d1e/d27/d66/d70/d3d/d44/d79/f83 [1308643,58900] 0 2024-04-25T16:18:48.002 INFO:tasks.workunit.client.0.smithi059.stdout:3/403: dwrite d0/db/f19 [0,4194304] 0 2024-04-25T16:18:48.301 INFO:tasks.workunit.client.0.smithi059.stdout:7/364: getdents d0/d7/d16/d20/d2b/d33/d4c/d4e 0 2024-04-25T16:18:48.306 INFO:tasks.workunit.client.0.smithi059.stdout:4/352: mknod d0/d4/df/d48/c71 0 2024-04-25T16:18:48.312 INFO:tasks.workunit.client.0.smithi059.stdout:2/361: mkdir de/d2a/d33/d88 0 2024-04-25T16:18:48.320 INFO:tasks.workunit.client.0.smithi059.stdout:0/358: unlink dc/df/l31 0 2024-04-25T16:18:48.331 INFO:tasks.workunit.client.0.smithi059.stdout:8/350: mknod d7/dd/d33/c6d 0 2024-04-25T16:18:48.506 INFO:tasks.workunit.client.0.smithi059.stdout:1/413: creat d7/d13/f87 x:0 0 0 2024-04-25T16:18:48.520 INFO:tasks.workunit.client.0.smithi059.stdout:4/353: dread d0/d4/df/d44/f46 [0,4194304] 0 2024-04-25T16:18:48.540 INFO:tasks.workunit.client.0.smithi059.stdout:1/414: chown d7/d13/d2d/d4a/f4b 237887 1 2024-04-25T16:18:48.789 INFO:tasks.workunit.client.0.smithi059.stdout:7/365: read d0/d3f/f50 [1514758,15502] 0 2024-04-25T16:18:49.027 INFO:tasks.workunit.client.0.smithi059.stdout:5/400: write d1/d1e/d27/d66/d70/d3d/f5d [11622,108665] 0 2024-04-25T16:18:49.062 INFO:tasks.workunit.client.0.smithi059.stdout:4/354: stat d0/d4/df/c31 0 2024-04-25T16:18:49.093 INFO:tasks.workunit.client.0.smithi059.stdout:9/380: rename d6/d35/d26/f2d to d6/d4e/d54/d5d/f71 0 2024-04-25T16:18:49.174 INFO:tasks.workunit.client.0.smithi059.stdout:2/362: fsync de/d2a/d2e/f6e 0 2024-04-25T16:18:49.357 INFO:tasks.workunit.client.0.smithi059.stdout:6/395: rename d9/d27/f51 to d9/f79 0 2024-04-25T16:18:49.384 INFO:tasks.workunit.client.0.smithi059.stdout:0/359: write dc/df/d24/f25 [4463882,121004] 0 2024-04-25T16:18:49.556 INFO:tasks.workunit.client.0.smithi059.stdout:5/401: write d1/d1e/d27/d66/d70/d24/f38 [2170910,27314] 0 2024-04-25T16:18:49.558 INFO:tasks.workunit.client.0.smithi059.stdout:1/415: write d7/d13/d58/f5e [3962657,41234] 0 2024-04-25T16:18:49.627 INFO:tasks.workunit.client.0.smithi059.stdout:2/363: unlink de/d2a/d33/l34 0 2024-04-25T16:18:49.886 INFO:tasks.workunit.client.0.smithi059.stdout:4/355: getdents d0/d4/df/d1c 0 2024-04-25T16:18:49.898 INFO:tasks.workunit.client.0.smithi059.stdout:2/364: creat de/d2a/d33/f89 x:0 0 0 2024-04-25T16:18:49.899 INFO:tasks.workunit.client.0.smithi059.stdout:3/404: rename d0/db/f1c to d0/db/d2d/f87 0 2024-04-25T16:18:50.127 INFO:tasks.workunit.client.0.smithi059.stdout:5/402: link d1/dd/f12 d1/d1e/d27/d66/f8b 0 2024-04-25T16:18:50.132 INFO:tasks.workunit.client.0.smithi059.stdout:8/351: rename d7/d16/d36/c4f to d7/dd/d33/d57/c6e 0 2024-04-25T16:18:50.167 INFO:tasks.workunit.client.0.smithi059.stdout:5/403: dread - d1/d1e/d27/d66/d70/f61 zero size 2024-04-25T16:18:50.239 INFO:tasks.workunit.client.0.smithi059.stdout:3/405: dread d0/d1e/f53 [0,4194304] 0 2024-04-25T16:18:50.458 INFO:tasks.workunit.client.0.smithi059.stdout:4/356: creat d0/d4/df/d1c/d45/d54/f72 x:0 0 0 2024-04-25T16:18:50.462 INFO:tasks.workunit.client.0.smithi059.stdout:6/396: write d9/f35 [1071005,74526] 0 2024-04-25T16:18:50.475 INFO:tasks.workunit.client.0.smithi059.stdout:0/360: getdents dc/dd/d3b 0 2024-04-25T16:18:50.564 INFO:tasks.workunit.client.0.smithi059.stdout:7/366: rename d0/d3f/f64 to d0/d7/d16/d38/d5d/f75 0 2024-04-25T16:18:50.792 INFO:tasks.workunit.client.0.smithi059.stdout:3/406: creat d0/db/d47/d5b/f88 x:0 0 0 2024-04-25T16:18:50.794 INFO:tasks.workunit.client.0.smithi059.stdout:1/416: write d7/d13/f5a [870152,57068] 0 2024-04-25T16:18:50.898 INFO:tasks.workunit.client.0.smithi059.stdout:6/397: fsync d9/f29 0 2024-04-25T16:18:50.931 INFO:tasks.workunit.client.0.smithi059.stdout:0/361: dread - dc/d37/d47/d60/f61 zero size 2024-04-25T16:18:50.981 INFO:tasks.workunit.client.0.smithi059.stdout:6/398: readlink d9/d1b/d58/d49/l4f 0 2024-04-25T16:18:51.022 INFO:tasks.workunit.client.0.smithi059.stdout:2/365: dwrite de/d2a/f35 [8388608,4194304] 0 2024-04-25T16:18:51.220 INFO:tasks.workunit.client.0.smithi059.stdout:9/381: rename d6/d4e/d54/d5d/f61 to d6/d4e/d54/d5d/d48/d49/f72 0 2024-04-25T16:18:51.429 INFO:tasks.workunit.client.0.smithi059.stdout:4/357: symlink d0/d4/df/d1c/d45/d6f/l73 0 2024-04-25T16:18:51.439 INFO:tasks.workunit.client.0.smithi059.stdout:8/352: write d7/d16/d3a/f3e [1980489,117738] 0 2024-04-25T16:18:51.446 INFO:tasks.workunit.client.0.smithi059.stdout:2/366: read - de/f76 zero size 2024-04-25T16:18:51.562 INFO:tasks.workunit.client.0.smithi059.stdout:5/404: link d1/d1e/l32 d1/d1e/d27/d66/d70/d42/l8c 0 2024-04-25T16:18:51.567 INFO:tasks.workunit.client.0.smithi059.stdout:5/405: readlink d1/l1b 0 2024-04-25T16:18:51.587 INFO:tasks.workunit.client.0.smithi059.stdout:7/367: write d0/d7/d16/d20/d2b/d33/d4c/d5c/f48 [1774462,126412] 0 2024-04-25T16:18:51.904 INFO:tasks.workunit.client.0.smithi059.stdout:0/362: rename dc/df/d24/f25 to dc/d44/f73 0 2024-04-25T16:18:52.017 INFO:tasks.workunit.client.0.smithi059.stdout:1/417: dwrite d7/d13/d16/d72/f7d [0,4194304] 0 2024-04-25T16:18:52.145 INFO:tasks.workunit.client.0.smithi059.stdout:8/353: read d7/dd/f3c [3242875,87852] 0 2024-04-25T16:18:52.148 INFO:tasks.workunit.client.0.smithi059.stdout:2/367: creat de/d2a/d2e/d36/d2c/d40/d57/f8a x:0 0 0 2024-04-25T16:18:52.371 INFO:tasks.workunit.client.0.smithi059.stdout:4/358: dread d0/d4/df/f3a [0,4194304] 0 2024-04-25T16:18:52.387 INFO:tasks.workunit.client.0.smithi059.stdout:3/407: dwrite d0/d1e/f52 [0,4194304] 0 2024-04-25T16:18:52.457 INFO:tasks.workunit.client.0.smithi059.stdout:0/363: creat dc/df/d24/f74 x:0 0 0 2024-04-25T16:18:52.771 INFO:tasks.workunit.client.0.smithi059.stdout:9/382: dwrite d6/d35/d28/f5b [0,4194304] 0 2024-04-25T16:18:52.922 INFO:tasks.workunit.client.0.smithi059.stdout:8/354: fsync d7/dd/ff 0 2024-04-25T16:18:52.932 INFO:tasks.workunit.client.0.smithi059.stdout:7/368: getdents d0/d7/d16/d20/d71 0 2024-04-25T16:18:53.101 INFO:tasks.workunit.client.0.smithi059.stdout:0/364: fsync dc/dd/f20 0 2024-04-25T16:18:53.167 INFO:tasks.workunit.client.0.smithi059.stdout:5/406: link d1/d1e/d27/f59 d1/d1e/d27/d66/d70/d3d/d50/f8d 0 2024-04-25T16:18:53.452 INFO:tasks.workunit.client.0.smithi059.stdout:6/399: rename f3 to d9/d1b/f7a 0 2024-04-25T16:18:53.459 INFO:tasks.workunit.client.0.smithi059.stdout:4/359: mkdir d0/d4/df/d74 0 2024-04-25T16:18:53.498 INFO:tasks.workunit.client.0.smithi059.stdout:9/383: write d6/d35/d2f/d39/f52 [426599,96675] 0 2024-04-25T16:18:53.626 INFO:tasks.workunit.client.0.smithi059.stdout:5/407: creat d1/dd/f8e x:0 0 0 2024-04-25T16:18:53.636 INFO:tasks.workunit.client.0.smithi059.stdout:2/368: creat de/d2a/d2e/f8b x:0 0 0 2024-04-25T16:18:53.708 INFO:tasks.workunit.client.0.smithi059.stdout:7/369: symlink d0/d7/d16/d20/d2b/l76 0 2024-04-25T16:18:53.710 INFO:tasks.workunit.client.0.smithi059.stdout:1/418: rename d7/d13 to d7/d13/d16/d88 22 2024-04-25T16:18:53.715 INFO:tasks.workunit.client.0.smithi059.stdout:6/400: mkdir d9/d27/d39/d7b 0 2024-04-25T16:18:53.742 INFO:tasks.workunit.client.0.smithi059.stdout:7/370: chown d0/d7/f23 124720852 1 2024-04-25T16:18:53.744 INFO:tasks.workunit.client.0.smithi059.stdout:6/401: chown d9/d16/d24/f2b 0 1 2024-04-25T16:18:53.802 INFO:tasks.workunit.client.0.smithi059.stdout:4/360: fsync d0/d4/df/d48/f4e 0 2024-04-25T16:18:53.848 INFO:tasks.workunit.client.0.smithi059.stdout:7/371: dread d0/d7/d16/d20/d2b/d33/d4c/d5c/f48 [0,4194304] 0 2024-04-25T16:18:53.938 INFO:tasks.workunit.client.0.smithi059.stdout:2/369: creat de/d2a/d2e/d36/d2c/f8c x:0 0 0 2024-04-25T16:18:54.110 INFO:tasks.workunit.client.0.smithi059.stdout:8/355: getdents d7/d16/d45 0 2024-04-25T16:18:54.131 INFO:tasks.workunit.client.0.smithi059.stdout:5/408: dread d1/dd/f1d [0,4194304] 0 2024-04-25T16:18:54.426 INFO:tasks.workunit.client.0.smithi059.stdout:1/419: truncate d7/d13/d16/f24 278803 0 2024-04-25T16:18:54.426 INFO:tasks.workunit.client.0.smithi059.stdout:2/370: creat de/d16/d3e/f8d x:0 0 0 2024-04-25T16:18:54.487 INFO:tasks.workunit.client.0.smithi059.stdout:1/420: chown d7/d13/f5a 299 1 2024-04-25T16:18:54.579 INFO:tasks.workunit.client.0.smithi059.stdout:1/421: dread - d7/d13/d2d/d41/f73 zero size 2024-04-25T16:18:54.593 INFO:tasks.workunit.client.0.smithi059.stdout:6/402: dwrite d9/f59 [0,4194304] 0 2024-04-25T16:18:54.720 INFO:tasks.workunit.client.0.smithi059.stdout:4/361: truncate d0/d4/df/f41 2605264 0 2024-04-25T16:18:54.838 INFO:tasks.workunit.client.0.smithi059.stdout:8/356: dread d7/f1c [0,4194304] 0 2024-04-25T16:18:54.860 INFO:tasks.workunit.client.0.smithi059.stdout:9/384: dwrite d6/d4e/d54/d5d/f45 [0,4194304] 0 2024-04-25T16:18:54.930 INFO:tasks.workunit.client.0.smithi059.stdout:3/408: rename d0/db/d68 to d0/db/d3f/d89 0 2024-04-25T16:18:54.968 INFO:tasks.workunit.client.0.smithi059.stdout:5/409: truncate d1/d1e/d27/d66/d70/d42/d6d/f73 228168 0 2024-04-25T16:18:54.993 INFO:tasks.workunit.client.0.smithi059.stdout:3/409: chown d0/db/d3f/d89/f71 249471 1 2024-04-25T16:18:55.088 INFO:tasks.workunit.client.0.smithi059.stdout:5/410: sync 2024-04-25T16:18:55.236 INFO:tasks.workunit.client.0.smithi059.stdout:7/372: write d0/d7/d16/d20/d2b/d33/d4c/d5c/f70 [4804642,121644] 0 2024-04-25T16:18:55.254 INFO:tasks.workunit.client.0.smithi059.stdout:8/357: creat d7/d2f/d43/f6f x:0 0 0 2024-04-25T16:18:55.261 INFO:tasks.workunit.client.0.smithi059.stdout:1/422: write d7/f12 [4092738,21640] 0 2024-04-25T16:18:55.262 INFO:tasks.workunit.client.0.smithi059.stdout:2/371: write de/d2a/d33/f41 [364824,68238] 0 2024-04-25T16:18:55.314 INFO:tasks.workunit.client.0.smithi059.stdout:8/358: fdatasync d7/d2f/d43/f6f 0 2024-04-25T16:18:55.434 INFO:tasks.workunit.client.0.smithi059.stdout:0/365: rename dc/df/d24/f51 to dc/d37/d47/f75 0 2024-04-25T16:18:55.613 INFO:tasks.workunit.client.0.smithi059.stdout:4/362: getdents d0/d4/df/d1c 0 2024-04-25T16:18:55.622 INFO:tasks.workunit.client.0.smithi059.stdout:5/411: mkdir d1/d1e/d8f 0 2024-04-25T16:18:55.627 INFO:tasks.workunit.client.0.smithi059.stdout:3/410: getdents d0/db/d47/d7e 0 2024-04-25T16:18:55.676 INFO:tasks.workunit.client.0.smithi059.stdout:5/412: chown d1/d1e/d27/d66/d70/d3d/d44 11751297 1 2024-04-25T16:18:55.779 INFO:tasks.workunit.client.0.smithi059.stdout:6/403: getdents d9/d16/d53 0 2024-04-25T16:18:55.791 INFO:tasks.workunit.client.0.smithi059.stdout:3/411: mknod d0/d1e/d57/c8a 0 2024-04-25T16:18:55.891 INFO:tasks.workunit.client.0.smithi059.stdout:4/363: truncate d0/d4/df/d44/f4d 2831123 0 2024-04-25T16:18:55.904 INFO:tasks.workunit.client.0.smithi059.stdout:4/364: stat d0/d4/df/d48/c71 0 2024-04-25T16:18:56.408 INFO:tasks.workunit.client.0.smithi059.stdout:1/423: dwrite d7/d13/d58/f59 [0,4194304] 0 2024-04-25T16:18:56.412 INFO:tasks.workunit.client.0.smithi059.stdout:9/385: rename d6/d35/d26/f44 to d6/d4e/d54/f73 0 2024-04-25T16:18:56.416 INFO:tasks.workunit.client.0.smithi059.stdout:7/373: dwrite d0/d7/f73 [0,4194304] 0 2024-04-25T16:18:56.424 INFO:tasks.workunit.client.0.smithi059.stdout:0/366: dwrite dc/dd/f6b [0,4194304] 0 2024-04-25T16:18:56.565 INFO:tasks.workunit.client.0.smithi059.stdout:1/424: chown d7/d13/d16/d54 1317712499 1 2024-04-25T16:18:56.697 INFO:tasks.workunit.client.0.smithi059.stdout:1/425: dread d7/d13/d2d/d4a/f56 [0,4194304] 0 2024-04-25T16:18:56.718 INFO:tasks.workunit.client.0.smithi059.stdout:5/413: write d1/dd/f1d [2922370,45949] 0 2024-04-25T16:18:57.061 INFO:tasks.workunit.client.0.smithi059.stdout:4/365: dwrite d0/d4/f2e [4194304,4194304] 0 2024-04-25T16:18:57.142 INFO:tasks.workunit.client.0.smithi059.stdout:6/404: dwrite d9/f56 [0,4194304] 0 2024-04-25T16:18:57.158 INFO:tasks.workunit.client.0.smithi059.stdout:9/386: creat d6/d35/d28/f74 x:0 0 0 2024-04-25T16:18:57.225 INFO:tasks.workunit.client.0.smithi059.stdout:7/374: truncate d0/d7/f29 658621 0 2024-04-25T16:18:57.311 INFO:tasks.workunit.client.0.smithi059.stdout:9/387: dread - d6/d4e/d54/f55 zero size 2024-04-25T16:18:57.389 INFO:tasks.workunit.client.0.smithi059.stdout:7/375: dread d0/d3f/f50 [0,4194304] 0 2024-04-25T16:18:57.438 INFO:tasks.workunit.client.0.smithi059.stdout:9/388: sync 2024-04-25T16:18:57.945 INFO:tasks.workunit.client.0.smithi059.stdout:1/426: write d7/d13/d16/f33 [28745,43637] 0 2024-04-25T16:18:58.021 INFO:tasks.workunit.client.0.smithi059.stdout:3/412: dwrite d0/fa [0,4194304] 0 2024-04-25T16:18:58.347 INFO:tasks.workunit.client.0.smithi059.stdout:0/367: write dc/f4e [847402,124949] 0 2024-04-25T16:18:58.564 INFO:tasks.workunit.client.0.smithi059.stdout:1/427: chown d7/d13/d16/c3f 550 1 2024-04-25T16:18:58.742 INFO:tasks.workunit.client.0.smithi059.stdout:6/405: mknod d9/d16/d53/d74/c7c 0 2024-04-25T16:18:58.850 INFO:tasks.workunit.client.0.smithi059.stdout:0/368: mknod dc/d44/c76 0 2024-04-25T16:18:58.911 INFO:tasks.workunit.client.0.smithi059.stdout:7/376: fdatasync d0/d7/d16/d20/d2b/d33/d4c/d4e/d4f/f52 0 2024-04-25T16:18:59.024 INFO:tasks.workunit.client.0.smithi059.stdout:2/372: rename de/d16/d3e/f5d to de/d16/f8e 0 2024-04-25T16:18:59.094 INFO:tasks.workunit.client.0.smithi059.stdout:1/428: fsync d7/d13/d16/d72/f7d 0 2024-04-25T16:18:59.102 INFO:tasks.workunit.client.0.smithi059.stdout:1/429: chown d7/d13 84 1 2024-04-25T16:18:59.146 INFO:tasks.workunit.client.0.smithi059.stdout:1/430: dread d7/d13/d16/f46 [0,4194304] 0 2024-04-25T16:18:59.195 INFO:tasks.workunit.client.0.smithi059.stdout:6/406: rmdir d9/d1b/d58 39 2024-04-25T16:18:59.220 INFO:tasks.workunit.client.0.smithi059.stdout:5/414: link d1/dd/f34 d1/d1e/d27/d66/d70/d3d/d44/d79/f90 0 2024-04-25T16:18:59.319 INFO:tasks.workunit.client.0.smithi059.stdout:7/377: creat d0/d7/d16/d20/d2b/d33/d4c/d4e/f77 x:0 0 0 2024-04-25T16:18:59.408 INFO:tasks.workunit.client.0.smithi059.stdout:8/359: rename d7/dd/c1e to d7/d16/d45/d66/c70 0 2024-04-25T16:18:59.435 INFO:tasks.workunit.client.0.smithi059.stdout:9/389: dwrite d6/d4e/d54/d5d/f38 [0,4194304] 0 2024-04-25T16:18:59.564 INFO:tasks.workunit.client.0.smithi059.stdout:6/407: mknod d9/c7d 0 2024-04-25T16:18:59.651 INFO:tasks.workunit.client.0.smithi059.stdout:4/366: dwrite d0/d4/df/d1c/d45/f27 [0,4194304] 0 2024-04-25T16:18:59.717 INFO:tasks.workunit.client.0.smithi059.stdout:0/369: mkdir dc/d37/d47/d71/d77 0 2024-04-25T16:18:59.805 INFO:tasks.workunit.client.0.smithi059.stdout:0/370: sync 2024-04-25T16:18:59.932 INFO:tasks.workunit.client.0.smithi059.stdout:3/413: getdents d0/db/d3f/d49/d65 0 2024-04-25T16:19:00.104 INFO:tasks.workunit.client.0.smithi059.stdout:7/378: creat d0/d7/d16/d38/d5d/f78 x:0 0 0 2024-04-25T16:19:00.135 INFO:tasks.workunit.client.0.smithi059.stdout:9/390: chown d6/d4e/d54/f73 1064934 1 2024-04-25T16:19:00.179 INFO:tasks.workunit.client.0.smithi059.stdout:8/360: dread d7/d2f/f3f [0,4194304] 0 2024-04-25T16:19:00.219 INFO:tasks.workunit.client.0.smithi059.stdout:8/361: dread d7/dd/ff [0,4194304] 0 2024-04-25T16:19:00.230 INFO:tasks.workunit.client.0.smithi059.stdout:8/362: stat d7/d16/d3a/f3e 0 2024-04-25T16:19:00.238 INFO:tasks.workunit.client.0.smithi059.stdout:1/431: write d7/d13/f87 [212749,74825] 0 2024-04-25T16:19:00.287 INFO:tasks.workunit.client.0.smithi059.stdout:2/373: truncate de/d2a/d33/f53 1030928 0 2024-04-25T16:19:00.337 INFO:tasks.workunit.client.0.smithi059.stdout:4/367: fsync d0/f2a 0 2024-04-25T16:19:00.398 INFO:tasks.workunit.client.0.smithi059.stdout:0/371: symlink dc/d37/d47/d60/l78 0 2024-04-25T16:19:00.636 INFO:tasks.workunit.client.0.smithi059.stdout:5/415: rmdir d1/d1e/d27/d66/d70/d3d/d44/d7f 0 2024-04-25T16:19:00.709 INFO:tasks.workunit.client.0.smithi059.stdout:1/432: dread d7/f69 [0,4194304] 0 2024-04-25T16:19:01.058 INFO:tasks.workunit.client.0.smithi059.stdout:6/408: mkdir d9/d16/d53/d55/d71/d7e 0 2024-04-25T16:19:01.076 INFO:tasks.workunit.client.0.smithi059.stdout:4/368: mkdir d0/d4/df/d1c/d45/d54/d75 0 2024-04-25T16:19:01.091 INFO:tasks.workunit.client.0.smithi059.stdout:9/391: truncate d6/d35/f66 4038142 0 2024-04-25T16:19:01.116 INFO:tasks.workunit.client.0.smithi059.stdout:1/433: mknod d7/d13/d16/d5c/c89 0 2024-04-25T16:19:01.145 INFO:tasks.workunit.client.0.smithi059.stdout:9/392: chown d6/d35/d26/c41 17 1 2024-04-25T16:19:01.178 INFO:tasks.workunit.client.0.smithi059.stdout:3/414: link d0/db/f1a d0/db/d47/f8b 0 2024-04-25T16:19:01.244 INFO:tasks.workunit.client.0.smithi059.stdout:7/379: rename d0/d7/d16/d38 to d0/d7/d16/d20/d2b/d33/d79 0 2024-04-25T16:19:01.308 INFO:tasks.workunit.client.0.smithi059.stdout:0/372: symlink dc/d37/l79 0 2024-04-25T16:19:01.444 INFO:tasks.workunit.client.0.smithi059.stdout:8/363: creat d7/dd/d17/d23/f71 x:0 0 0 2024-04-25T16:19:01.489 INFO:tasks.workunit.client.0.smithi059.stdout:1/434: truncate d7/f26 911407 0 2024-04-25T16:19:01.578 INFO:tasks.workunit.client.0.smithi059.stdout:4/369: truncate d0/d4/df/d1c/d45/d54/f63 1029745 0 2024-04-25T16:19:01.693 INFO:tasks.workunit.client.0.smithi059.stdout:5/416: rename d1/d1e/d27/d66/d70/d42/f84 to d1/d1e/d27/d66/d70/d75/f91 0 2024-04-25T16:19:01.694 INFO:tasks.workunit.client.0.smithi059.stdout:9/393: dread d6/f47 [0,4194304] 0 2024-04-25T16:19:01.713 INFO:tasks.workunit.client.0.smithi059.stdout:5/417: stat d1/f29 0 2024-04-25T16:19:01.813 INFO:tasks.workunit.client.0.smithi059.stdout:5/418: sync 2024-04-25T16:19:01.883 INFO:tasks.workunit.client.0.smithi059.stdout:7/380: chown d0/d3f/f5b 2856113 1 2024-04-25T16:19:02.340 INFO:tasks.workunit.client.0.smithi059.stdout:6/409: write d9/d16/f1f [907097,78552] 0 2024-04-25T16:19:02.441 INFO:tasks.workunit.client.0.smithi059.stdout:1/435: rename d7/d13/d2d/d41/f6b to d7/d13/d6a/f8a 0 2024-04-25T16:19:02.448 INFO:tasks.workunit.client.0.smithi059.stdout:1/436: readlink d7/d21/l5b 0 2024-04-25T16:19:03.141 INFO:tasks.workunit.client.0.smithi059.stdout:2/374: link de/d2a/d2e/d36/d2c/d40/d57/f81 de/d2a/d2e/d6a/f8f 0 2024-04-25T16:19:03.431 INFO:tasks.workunit.client.0.smithi059.stdout:0/373: link dc/dd/f4c dc/d37/d47/d71/f7a 0 2024-04-25T16:19:03.483 INFO:tasks.workunit.client.0.smithi059.stdout:2/375: mknod de/d16/d82/c90 0 2024-04-25T16:19:03.578 INFO:tasks.workunit.client.0.smithi059.stdout:3/415: getdents d0/db/d2d 0 2024-04-25T16:19:03.580 INFO:tasks.workunit.client.0.smithi059.stdout:4/370: link d0/d4/df/d48/c6d d0/d4/df/d48/d5f/c76 0 2024-04-25T16:19:03.642 INFO:tasks.workunit.client.0.smithi059.stdout:8/364: dwrite d7/dd/f3c [4194304,4194304] 0 2024-04-25T16:19:03.714 INFO:tasks.workunit.client.0.smithi059.stdout:3/416: stat d0/db/d47/c84 0 2024-04-25T16:19:03.806 INFO:tasks.workunit.client.0.smithi059.stdout:9/394: dwrite d6/d35/d2f/d39/f64 [0,4194304] 0 2024-04-25T16:19:04.064 INFO:tasks.workunit.client.0.smithi059.stdout:4/371: creat d0/d4/df/d1c/d45/d54/f77 x:0 0 0 2024-04-25T16:19:04.120 INFO:tasks.workunit.client.0.smithi059.stdout:4/372: dread d0/d4/df/d1c/d45/f27 [0,4194304] 0 2024-04-25T16:19:04.161 INFO:tasks.workunit.client.0.smithi059.stdout:3/417: creat d0/db/d47/d5b/f8c x:0 0 0 2024-04-25T16:19:04.219 INFO:tasks.workunit.client.0.smithi059.stdout:1/437: creat d7/d13/f8b x:0 0 0 2024-04-25T16:19:04.272 INFO:tasks.workunit.client.0.smithi059.stdout:5/419: getdents d1/d1e 0 2024-04-25T16:19:04.282 INFO:tasks.workunit.client.0.smithi059.stdout:9/395: fsync d6/d35/d28/f74 0 2024-04-25T16:19:04.305 INFO:tasks.workunit.client.0.smithi059.stdout:9/396: chown d6/f68 32446 1 2024-04-25T16:19:04.319 INFO:tasks.workunit.client.0.smithi059.stdout:9/397: dread - d6/d35/d28/f74 zero size 2024-04-25T16:19:04.352 INFO:tasks.workunit.client.0.smithi059.stdout:9/398: stat d6/d35/d2f 0 2024-04-25T16:19:04.356 INFO:tasks.workunit.client.0.smithi059.stdout:7/381: symlink d0/d7/d16/d20/l7a 0 2024-04-25T16:19:04.496 INFO:tasks.workunit.client.0.smithi059.stdout:8/365: symlink d7/l72 0 2024-04-25T16:19:04.523 INFO:tasks.workunit.client.0.smithi059.stdout:4/373: chown d0/d4/df/c61 524 1 2024-04-25T16:19:04.548 INFO:tasks.workunit.client.0.smithi059.stdout:6/410: getdents d9/d16/d54 0 2024-04-25T16:19:04.611 INFO:tasks.workunit.client.0.smithi059.stdout:3/418: rename d0/db/d2d/c42 to d0/db/d3f/d89/c8d 0 2024-04-25T16:19:04.671 INFO:tasks.workunit.client.0.smithi059.stdout:3/419: dread d0/d1e/f53 [0,4194304] 0 2024-04-25T16:19:04.866 INFO:tasks.workunit.client.0.smithi059.stdout:0/374: creat dc/f7b x:0 0 0 2024-04-25T16:19:05.038 INFO:tasks.workunit.client.0.smithi059.stdout:8/366: unlink d7/dd/d33/f4c 0 2024-04-25T16:19:05.097 INFO:tasks.workunit.client.0.smithi059.stdout:4/374: read d0/d4/df/d1c/d45/f27 [1885874,25992] 0 2024-04-25T16:19:05.185 INFO:tasks.workunit.client.0.smithi059.stdout:2/376: dwrite de/d2a/d33/f74 [0,4194304] 0 2024-04-25T16:19:05.213 INFO:tasks.workunit.client.0.smithi059.stdout:4/375: sync 2024-04-25T16:19:05.308 INFO:tasks.workunit.client.0.smithi059.stdout:1/438: mknod d7/d13/d16/d5c/d74/c8c 0 2024-04-25T16:19:05.312 INFO:tasks.workunit.client.0.smithi059.stdout:3/420: truncate d0/f37 76337 0 2024-04-25T16:19:05.342 INFO:tasks.workunit.client.0.smithi059.stdout:5/420: fdatasync d1/d1e/d27/d66/d70/d3d/d44/d79/f90 0 2024-04-25T16:19:05.441 INFO:tasks.workunit.client.0.smithi059.stdout:8/367: creat d7/dd/d33/f73 x:0 0 0 2024-04-25T16:19:05.489 INFO:tasks.workunit.client.0.smithi059.stdout:0/375: dread dc/f2a [0,4194304] 0 2024-04-25T16:19:05.665 INFO:tasks.workunit.client.0.smithi059.stdout:7/382: write d0/d7/d16/f44 [476531,114951] 0 2024-04-25T16:19:05.676 INFO:tasks.workunit.client.0.smithi059.stdout:9/399: write d6/f18 [2493974,42031] 0 2024-04-25T16:19:05.794 INFO:tasks.workunit.client.0.smithi059.stdout:6/411: dwrite d9/d16/f22 [0,4194304] 0 2024-04-25T16:19:05.878 INFO:tasks.workunit.client.0.smithi059.stdout:3/421: mknod d0/db/d3f/d49/c8e 0 2024-04-25T16:19:06.016 INFO:tasks.workunit.client.0.smithi059.stdout:1/439: dread d7/d13/d6a/f8a [0,4194304] 0 2024-04-25T16:19:06.160 INFO:tasks.workunit.client.0.smithi059.stdout:4/376: creat d0/d4/df/d74/f78 x:0 0 0 2024-04-25T16:19:06.182 INFO:tasks.workunit.client.0.smithi059.stdout:4/377: dread - d0/d4/df/d1c/d45/d54/f77 zero size 2024-04-25T16:19:06.315 INFO:tasks.workunit.client.0.smithi059.stdout:2/377: write de/d2a/d2e/d36/d2c/d40/f52 [61822,24372] 0 2024-04-25T16:19:06.544 INFO:tasks.workunit.client.0.smithi059.stdout:1/440: fsync d7/d21/f49 0 2024-04-25T16:19:06.545 INFO:tasks.workunit.client.0.smithi059.stdout:8/368: rename d7/d16/d45/c56 to d7/dd/d17/d23/d37/c74 0 2024-04-25T16:19:06.562 INFO:tasks.workunit.client.0.smithi059.stdout:0/376: dread - dc/dd/d3b/d66/f6f zero size 2024-04-25T16:19:06.752 INFO:tasks.workunit.client.0.smithi059.stdout:3/422: write d0/db/d47/d5b/f5d [896957,89594] 0 2024-04-25T16:19:06.759 INFO:tasks.workunit.client.0.smithi059.stdout:8/369: dwrite d7/dd/d33/f73 [0,4194304] 0 2024-04-25T16:19:06.888 INFO:tasks.workunit.client.0.smithi059.stdout:7/383: rename d0/d7/d16/d5a/f6f to d0/d7/d16/d20/d2b/d33/d79/f7b 0 2024-04-25T16:19:06.892 INFO:tasks.workunit.client.0.smithi059.stdout:6/412: dwrite d9/d16/d24/f3c [0,4194304] 0 2024-04-25T16:19:07.478 INFO:tasks.workunit.client.0.smithi059.stdout:9/400: creat d6/d4e/d54/d5d/f75 x:0 0 0 2024-04-25T16:19:07.506 INFO:tasks.workunit.client.0.smithi059.stdout:5/421: getdents d1/d1e/d27/d66/d70/d3d/d50 0 2024-04-25T16:19:07.615 INFO:tasks.workunit.client.0.smithi059.stdout:2/378: dwrite de/d2a/d2e/f58 [0,4194304] 0 2024-04-25T16:19:07.704 INFO:tasks.workunit.client.0.smithi059.stdout:2/379: write de/d2a/d2e/d36/d2c/d40/f52 [244330,100592] 0 2024-04-25T16:19:08.003 INFO:tasks.workunit.client.0.smithi059.stdout:1/441: mkdir d7/d2a/d85/d8d 0 2024-04-25T16:19:08.078 INFO:tasks.workunit.client.0.smithi059.stdout:6/413: creat d9/d16/d53/d55/d71/d7e/f7f x:0 0 0 2024-04-25T16:19:08.086 INFO:tasks.workunit.client.0.smithi059.stdout:6/414: readlink d9/d16/l1d 0 2024-04-25T16:19:08.326 INFO:tasks.workunit.client.0.smithi059.stdout:5/422: mkdir d1/d1e/d27/d66/d70/d3d/d44/d79/d92 0 2024-04-25T16:19:08.327 INFO:tasks.workunit.client.0.smithi059.stdout:9/401: creat d6/d35/d28/f76 x:0 0 0 2024-04-25T16:19:08.331 INFO:tasks.workunit.client.0.smithi059.stdout:0/377: creat dc/d37/d47/f7c x:0 0 0 2024-04-25T16:19:08.353 INFO:tasks.workunit.client.0.smithi059.stdout:0/378: readlink dc/dd/l5a 0 2024-04-25T16:19:08.524 INFO:tasks.workunit.client.0.smithi059.stdout:2/380: dread de/f1d [0,4194304] 0 2024-04-25T16:19:08.539 INFO:tasks.workunit.client.0.smithi059.stdout:2/381: chown de/d2a/d2e/d36/d2c/d40/d57 3 1 2024-04-25T16:19:08.577 INFO:tasks.workunit.client.0.smithi059.stdout:5/423: truncate d1/f3 8640740 0 2024-04-25T16:19:08.635 INFO:tasks.workunit.client.0.smithi059.stdout:0/379: creat dc/dd/d3b/f7d x:0 0 0 2024-04-25T16:19:08.732 INFO:tasks.workunit.client.0.smithi059.stdout:8/370: write d7/dd/d17/d23/f63 [467536,115215] 0 2024-04-25T16:19:08.774 INFO:tasks.workunit.client.0.smithi059.stdout:4/378: dwrite d0/d4/df/f66 [0,4194304] 0 2024-04-25T16:19:08.838 INFO:tasks.workunit.client.0.smithi059.stdout:2/382: mknod de/d67/c91 0 2024-04-25T16:19:08.870 INFO:tasks.workunit.client.0.smithi059.stdout:2/383: stat de/d2a/d2e/d36/d2c/d40/d57/f71 0 2024-04-25T16:19:08.975 INFO:tasks.workunit.client.0.smithi059.stdout:6/415: creat d9/d1b/f80 x:0 0 0 2024-04-25T16:19:09.104 INFO:tasks.workunit.client.0.smithi059.stdout:2/384: dread - de/d2a/d2e/d36/d2c/f8c zero size 2024-04-25T16:19:09.215 INFO:tasks.workunit.client.0.smithi059.stdout:4/379: mkdir d0/d79 0 2024-04-25T16:19:09.392 INFO:tasks.workunit.client.0.smithi059.stdout:2/385: dread f7 [0,4194304] 0 2024-04-25T16:19:09.439 INFO:tasks.workunit.client.0.smithi059.stdout:8/371: symlink d7/d2f/d43/l75 0 2024-04-25T16:19:09.454 INFO:tasks.workunit.client.0.smithi059.stdout:8/372: read d7/dd/d17/d23/d37/f44 [621840,8247] 0 2024-04-25T16:19:09.461 INFO:tasks.workunit.client.0.smithi059.stdout:0/380: link dc/f2a dc/d44/d5f/f7e 0 2024-04-25T16:19:09.485 INFO:tasks.workunit.client.0.smithi059.stdout:0/381: write dc/f7b [589084,125045] 0 2024-04-25T16:19:09.540 INFO:tasks.workunit.client.0.smithi059.stdout:2/386: mknod de/d67/c92 0 2024-04-25T16:19:09.540 INFO:tasks.workunit.client.0.smithi059.stdout:2/387: truncate de/d2a/d33/f74 4552266 0 2024-04-25T16:19:09.755 INFO:tasks.workunit.client.0.smithi059.stdout:8/373: dread - d7/dd/d17/d23/f64 zero size 2024-04-25T16:19:10.015 INFO:tasks.workunit.client.0.smithi059.stdout:9/402: symlink d6/d4e/d54/l77 0 2024-04-25T16:19:10.058 INFO:tasks.workunit.client.0.smithi059.stdout:7/384: rename d0/d7/d16/d20/d2b/d33/d4c/d5c/f48 to d0/d7/f7c 0 2024-04-25T16:19:10.134 INFO:tasks.workunit.client.0.smithi059.stdout:0/382: fdatasync dc/df/d24/f6d 0 2024-04-25T16:19:10.184 INFO:tasks.workunit.client.0.smithi059.stdout:1/442: dwrite d7/d13/d16/d7f/f80 [8388608,4194304] 0 2024-04-25T16:19:10.258 INFO:tasks.workunit.client.0.smithi059.stdout:9/403: creat d6/d4e/d54/d5d/d48/f78 x:0 0 0 2024-04-25T16:19:10.262 INFO:tasks.workunit.client.0.smithi059.stdout:6/416: write d9/d27/f5f [331216,57565] 0 2024-04-25T16:19:10.339 INFO:tasks.workunit.client.0.smithi059.stdout:1/443: dread d7/d13/d16/f46 [0,4194304] 0 2024-04-25T16:19:10.363 INFO:tasks.workunit.client.0.smithi059.stdout:9/404: sync 2024-04-25T16:19:10.453 INFO:tasks.workunit.client.0.smithi059.stdout:6/417: mknod d9/d27/d39/c81 0 2024-04-25T16:19:10.479 INFO:tasks.workunit.client.0.smithi059.stdout:7/385: dread d0/d7/d16/d20/d2b/f2e [0,4194304] 0 2024-04-25T16:19:10.768 INFO:tasks.workunit.client.0.smithi059.stdout:1/444: truncate d7/d2a/f3d 604447 0 2024-04-25T16:19:10.843 INFO:tasks.workunit.client.0.smithi059.stdout:2/388: dwrite fd [0,4194304] 0 2024-04-25T16:19:10.908 INFO:tasks.workunit.client.0.smithi059.stdout:1/445: dread d7/d13/d16/f46 [0,4194304] 0 2024-04-25T16:19:10.933 INFO:tasks.workunit.client.0.smithi059.stdout:9/405: write d6/f4a [1667225,31929] 0 2024-04-25T16:19:10.968 INFO:tasks.workunit.client.0.smithi059.stdout:3/423: rename d0/db/d2d/f38 to d0/d1e/f8f 0 2024-04-25T16:19:10.976 INFO:tasks.workunit.client.0.smithi059.stdout:6/418: write d9/d27/f34 [4996991,8325] 0 2024-04-25T16:19:11.040 INFO:tasks.workunit.client.0.smithi059.stdout:1/446: mkdir d7/d13/d2d/d4a/d4d/d8e 0 2024-04-25T16:19:11.176 INFO:tasks.workunit.client.0.smithi059.stdout:5/424: rename d1/d1e/d27/d66/d70/d3d/f40 to d1/d1e/d27/d66/d70/d3d/d44/d79/f93 0 2024-04-25T16:19:11.253 INFO:tasks.workunit.client.0.smithi059.stdout:2/389: symlink de/d16/l93 0 2024-04-25T16:19:11.296 INFO:tasks.workunit.client.0.smithi059.stdout:1/447: dread - d7/d13/d6a/f79 zero size 2024-04-25T16:19:11.330 INFO:tasks.workunit.client.0.smithi059.stdout:7/386: write d0/d7/f1f [648488,53275] 0 2024-04-25T16:19:11.394 INFO:tasks.workunit.client.0.smithi059.stdout:6/419: unlink d9/d1b/d58/c38 0 2024-04-25T16:19:11.400 INFO:tasks.workunit.client.0.smithi059.stdout:6/420: chown d9/f35 875355697 1 2024-04-25T16:19:11.410 INFO:tasks.workunit.client.0.smithi059.stdout:9/406: write d6/d35/d28/f5b [585810,28208] 0 2024-04-25T16:19:11.456 INFO:tasks.workunit.client.0.smithi059.stdout:9/407: write d6/d35/d28/f76 [767657,42900] 0 2024-04-25T16:19:11.585 INFO:tasks.workunit.client.0.smithi059.stdout:4/380: rename d0/d4/df/l69 to d0/d4/df/d1c/l7a 0 2024-04-25T16:19:11.766 INFO:tasks.workunit.client.0.smithi059.stdout:3/424: creat d0/d1e/f90 x:0 0 0 2024-04-25T16:19:11.766 INFO:tasks.workunit.client.0.smithi059.stdout:7/387: rmdir d0 39 2024-04-25T16:19:11.775 INFO:tasks.workunit.client.0.smithi059.stdout:6/421: creat d9/d16/d53/f82 x:0 0 0 2024-04-25T16:19:11.778 INFO:tasks.workunit.client.0.smithi059.stdout:9/408: rmdir d6/d4e/d54/d5d/d48/d49 39 2024-04-25T16:19:11.811 INFO:tasks.workunit.client.0.smithi059.stdout:3/425: chown d0/db/f7c 16037627 1 2024-04-25T16:19:11.867 INFO:tasks.workunit.client.0.smithi059.stdout:9/409: dread d6/d35/d28/f5b [0,4194304] 0 2024-04-25T16:19:12.109 INFO:tasks.workunit.client.0.smithi059.stdout:4/381: rmdir d0/d4/df/d48 39 2024-04-25T16:19:12.120 INFO:tasks.workunit.client.0.smithi059.stdout:2/390: mknod de/d16/d3e/d87/c94 0 2024-04-25T16:19:12.244 INFO:tasks.workunit.client.0.smithi059.stdout:5/425: getdents d1/d1e/d27 0 2024-04-25T16:19:12.597 INFO:tasks.workunit.client.0.smithi059.stdout:2/391: mkdir de/d2a/d2e/d36/d2c/d40/d57/d95 0 2024-04-25T16:19:12.846 INFO:tasks.workunit.client.0.smithi059.stdout:1/448: dwrite d7/f29 [0,4194304] 0 2024-04-25T16:19:12.908 INFO:tasks.workunit.client.0.smithi059.stdout:1/449: chown d7/d13 623123 1 2024-04-25T16:19:12.968 INFO:tasks.workunit.client.0.smithi059.stdout:8/374: rename d7/d16/d36/d5e to d7/d2f/d76 0 2024-04-25T16:19:12.972 INFO:tasks.workunit.client.0.smithi059.stdout:6/422: link d9/d16/d24/l45 d9/d16/d53/d55/l83 0 2024-04-25T16:19:13.143 INFO:tasks.workunit.client.0.smithi059.stdout:3/426: mknod d0/db/c91 0 2024-04-25T16:19:13.147 INFO:tasks.workunit.client.0.smithi059.stdout:5/426: symlink d1/d1e/d27/d66/d70/d3d/l94 0 2024-04-25T16:19:13.383 INFO:tasks.workunit.client.0.smithi059.stdout:9/410: write d6/d4e/d54/d5d/f71 [232594,53944] 0 2024-04-25T16:19:13.552 INFO:tasks.workunit.client.0.smithi059.stdout:5/427: dread - d1/dd/f8e zero size 2024-04-25T16:19:13.720 INFO:tasks.workunit.client.0.smithi059.stdout:9/411: creat d6/d35/d6c/f79 x:0 0 0 2024-04-25T16:19:13.784 INFO:tasks.workunit.client.0.smithi059.stdout:9/412: dread d6/d4e/d54/d5d/f71 [0,4194304] 0 2024-04-25T16:19:13.948 INFO:tasks.workunit.client.0.smithi059.stdout:7/388: write d0/d7/f7c [613019,31693] 0 2024-04-25T16:19:14.079 INFO:tasks.workunit.client.0.smithi059.stdout:0/383: rename dc/df/l4f to dc/dd/d5c/l7f 0 2024-04-25T16:19:14.231 INFO:tasks.workunit.client.0.smithi059.stdout:2/392: dwrite de/d2a/d2e/d36/d2c/f8c [0,4194304] 0 2024-04-25T16:19:14.236 INFO:tasks.workunit.client.0.smithi059.stdout:9/413: mkdir d6/d4e/d7a 0 2024-04-25T16:19:14.312 INFO:tasks.workunit.client.0.smithi059.stdout:3/427: write d0/d1e/f81 [771601,60713] 0 2024-04-25T16:19:14.336 INFO:tasks.workunit.client.0.smithi059.stdout:9/414: readlink d6/d35/d2f/l5f 0 2024-04-25T16:19:14.408 INFO:tasks.workunit.client.0.smithi059.stdout:0/384: creat dc/dd/d3b/f80 x:0 0 0 2024-04-25T16:19:14.523 INFO:tasks.workunit.client.0.smithi059.stdout:1/450: getdents d7/d13/d58 0 2024-04-25T16:19:14.714 INFO:tasks.workunit.client.0.smithi059.stdout:4/382: rename d0/d4/df/f41 to d0/d4/df/d48/d5f/f7b 0 2024-04-25T16:19:14.721 INFO:tasks.workunit.client.0.smithi059.stdout:8/375: rename d7/dd to d7/dd/d17/d23/d37/d5c/d77 22 2024-04-25T16:19:14.795 INFO:tasks.workunit.client.0.smithi059.stdout:9/415: stat d6/d4e/d54/d5d/d48/d49/c65 0 2024-04-25T16:19:14.818 INFO:tasks.workunit.client.0.smithi059.stdout:3/428: truncate d0/db/d3f/d49/d65/f85 364952 0 2024-04-25T16:19:14.882 INFO:tasks.workunit.client.0.smithi059.stdout:0/385: mkdir dc/d37/d47/d81 0 2024-04-25T16:19:14.977 INFO:tasks.workunit.client.0.smithi059.stdout:4/383: dread d0/d4/df/d48/f4e [0,4194304] 0 2024-04-25T16:19:15.064 INFO:tasks.workunit.client.0.smithi059.stdout:6/423: dwrite d9/f79 [4194304,4194304] 0 2024-04-25T16:19:15.155 INFO:tasks.workunit.client.0.smithi059.stdout:7/389: dwrite d0/d7/d16/d20/f35 [0,4194304] 0 2024-04-25T16:19:15.221 INFO:tasks.workunit.client.0.smithi059.stdout:5/428: link d1/d1e/d27/d66/d70/d3d/f55 d1/d1e/d27/d66/d70/d75/f95 0 2024-04-25T16:19:15.223 INFO:tasks.workunit.client.0.smithi059.stdout:1/451: unlink d7/d13/d2d/f61 0 2024-04-25T16:19:15.259 INFO:tasks.workunit.client.0.smithi059.stdout:5/429: chown d1/d1e/l2f 321983661 1 2024-04-25T16:19:15.286 INFO:tasks.workunit.client.0.smithi059.stdout:3/429: unlink d0/db/d47/l44 0 2024-04-25T16:19:15.369 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:19:15.372 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:19:15.408 INFO:tasks.workunit.client.0.smithi059.stdout:6/424: creat d9/d27/f84 x:0 0 0 2024-04-25T16:19:15.438 INFO:tasks.workunit.client.0.smithi059.stdout:9/416: dread d6/d35/d28/f50 [0,4194304] 0 2024-04-25T16:19:15.466 INFO:tasks.workunit.client.0.smithi059.stdout:8/376: mkdir d7/dd/d17/d23/d37/d5c/d78 0 2024-04-25T16:19:15.564 INFO:tasks.workunit.client.0.smithi059.stdout:0/386: creat dc/d68/f82 x:0 0 0 2024-04-25T16:19:15.606 INFO:tasks.workunit.client.0.smithi059.stdout:6/425: dwrite d9/d27/f5f [0,4194304] 0 2024-04-25T16:19:15.889 INFO:tasks.workunit.client.0.smithi059.stdout:0/387: dread dc/d37/f4b [0,4194304] 0 2024-04-25T16:19:15.902 INFO:tasks.workunit.client.0.smithi059.stdout:9/417: dread d6/d35/d28/f69 [0,4194304] 0 2024-04-25T16:19:16.139 INFO:tasks.workunit.client.0.smithi059.stdout:2/393: rename de/d2a/d2e/d36/d2c/d40/d57/f81 to de/f96 0 2024-04-25T16:19:16.251 INFO:tasks.workunit.client.0.smithi059.stdout:7/390: dwrite d0/d3f/f50 [0,4194304] 0 2024-04-25T16:19:16.382 INFO:tasks.workunit.client.0.smithi059.stdout:4/384: rename d0/d4/l43 to d0/d4/df/d1c/d45/l7c 0 2024-04-25T16:19:16.446 INFO:tasks.workunit.client.0.smithi059.stdout:2/394: mknod de/d2a/d33/c97 0 2024-04-25T16:19:16.611 INFO:tasks.workunit.client.0.smithi059.stdout:7/391: rmdir d0/d7 39 2024-04-25T16:19:16.689 INFO:tasks.workunit.client.0.smithi059.stdout:8/377: dwrite d7/d16/d3a/f46 [0,4194304] 0 2024-04-25T16:19:16.760 INFO:tasks.workunit.client.0.smithi059.stdout:1/452: rename d7/d13/d58 to d7/d13/d2d/d41/d8f 0 2024-04-25T16:19:16.828 INFO:tasks.workunit.client.0.smithi059.stdout:4/385: readlink d0/d4/df/l51 0 2024-04-25T16:19:16.830 INFO:tasks.workunit.client.0.smithi059.stdout:3/430: dwrite d0/db/f1a [0,4194304] 0 2024-04-25T16:19:16.902 INFO:tasks.workunit.client.0.smithi059.stdout:1/453: write d7/f29 [3765483,42291] 0 2024-04-25T16:19:17.112 INFO:tasks.workunit.client.0.smithi059.stdout:6/426: dwrite d9/f35 [0,4194304] 0 2024-04-25T16:19:17.120 INFO:tasks.workunit.client.0.smithi059.stdout:0/388: dwrite dc/df/f10 [8388608,4194304] 0 2024-04-25T16:19:17.285 INFO:tasks.workunit.client.0.smithi059.stdout:9/418: write d6/d35/d2f/f4d [16438,120662] 0 2024-04-25T16:19:17.462 INFO:tasks.workunit.client.0.smithi059.stdout:2/395: dwrite de/d2a/d2e/f30 [4194304,4194304] 0 2024-04-25T16:19:17.527 INFO:tasks.workunit.client.0.smithi059.stdout:7/392: fdatasync d0/d3f/f5b 0 2024-04-25T16:19:17.809 INFO:tasks.workunit.client.0.smithi059.stdout:1/454: fsync d7/d13/d16/d54/f71 0 2024-04-25T16:19:17.950 INFO:tasks.workunit.client.0.smithi059.stdout:6/427: dread - d9/d16/d53/d55/d71/d7e/f7f zero size 2024-04-25T16:19:18.060 INFO:tasks.workunit.client.0.smithi059.stdout:7/393: read d0/f56 [2087524,94246] 0 2024-04-25T16:19:18.238 INFO:tasks.workunit.client.0.smithi059.stdout:3/431: creat d0/db/d2d/d7a/f92 x:0 0 0 2024-04-25T16:19:18.282 INFO:tasks.workunit.client.0.smithi059.stdout:1/455: symlink d7/d13/d2d/d41/d8f/l90 0 2024-04-25T16:19:18.370 INFO:tasks.workunit.client.0.smithi059.stdout:9/419: mknod d6/d4e/d54/d5d/d48/d6e/c7b 0 2024-04-25T16:19:18.449 INFO:tasks.workunit.client.0.smithi059.stdout:6/428: mknod d9/d16/d53/d55/d71/d7e/c85 0 2024-04-25T16:19:18.602 INFO:tasks.workunit.client.0.smithi059.stdout:8/378: link d7/d16/l2d d7/dd/d17/d23/d37/d5c/l79 0 2024-04-25T16:19:18.709 INFO:tasks.workunit.client.0.smithi059.stdout:6/429: creat d9/d27/d39/f86 x:0 0 0 2024-04-25T16:19:18.717 INFO:tasks.workunit.client.0.smithi059.stdout:6/430: stat d9/d16/d54 0 2024-04-25T16:19:18.810 INFO:tasks.workunit.client.0.smithi059.stdout:2/396: creat de/d2a/d2e/f98 x:0 0 0 2024-04-25T16:19:18.818 INFO:tasks.workunit.client.0.smithi059.stdout:2/397: readlink de/d16/l17 0 2024-04-25T16:19:19.373 INFO:tasks.workunit.client.0.smithi059.stdout:0/389: truncate dc/d44/f73 6541031 0 2024-04-25T16:19:19.399 INFO:tasks.workunit.client.0.smithi059.stdout:9/420: getdents d6 0 2024-04-25T16:19:19.461 INFO:tasks.workunit.client.0.smithi059.stdout:9/421: stat d6/d4e/d54/d5d/d48/c51 0 2024-04-25T16:19:19.515 INFO:tasks.workunit.client.0.smithi059.stdout:1/456: dwrite d7/fc [0,4194304] 0 2024-04-25T16:19:19.625 INFO:tasks.workunit.client.0.smithi059.stdout:5/430: rename d1/f29 to d1/d1e/d27/d66/d70/d42/f96 0 2024-04-25T16:19:19.643 INFO:tasks.workunit.client.0.smithi059.stdout:2/398: write de/d16/f43 [1351200,49211] 0 2024-04-25T16:19:19.858 INFO:tasks.workunit.client.0.smithi059.stdout:3/432: dwrite d0/db/f5a [4194304,4194304] 0 2024-04-25T16:19:19.947 INFO:tasks.workunit.client.0.smithi059.stdout:9/422: truncate d6/d4e/d54/d5d/f71 1637005 0 2024-04-25T16:19:19.950 INFO:tasks.workunit.client.0.smithi059.stdout:8/379: dwrite d7/dd/d17/d23/d37/f44 [0,4194304] 0 2024-04-25T16:19:20.026 INFO:tasks.workunit.client.0.smithi059.stdout:2/399: unlink de/d2a/d33/f41 0 2024-04-25T16:19:20.043 INFO:tasks.workunit.client.0.smithi059.stdout:9/423: read - d6/f68 zero size 2024-04-25T16:19:20.328 INFO:tasks.workunit.client.0.smithi059.stdout:9/424: creat d6/d4e/d54/d5d/d48/d49/f7c x:0 0 0 2024-04-25T16:19:20.407 INFO:tasks.workunit.client.0.smithi059.stdout:5/431: creat d1/d1e/d27/d66/d70/d3d/d44/d79/d92/f97 x:0 0 0 2024-04-25T16:19:20.479 INFO:tasks.workunit.client.0.smithi059.stdout:0/390: getdents dc/dd 0 2024-04-25T16:19:20.490 INFO:tasks.workunit.client.0.smithi059.stdout:0/391: chown dc/d44/f35 3378 1 2024-04-25T16:19:20.642 INFO:tasks.workunit.client.0.smithi059.stdout:4/386: rename d0/d4/df/d1c/c64 to d0/d4/c7d 0 2024-04-25T16:19:20.642 INFO:tasks.workunit.client.0.smithi059.stdout:1/457: creat d7/d13/d2d/d4a/f91 x:0 0 0 2024-04-25T16:19:20.671 INFO:tasks.workunit.client.0.smithi059.stdout:1/458: chown d7/d2a/d62/l75 1991997 1 2024-04-25T16:19:20.728 INFO:tasks.workunit.client.0.smithi059.stdout:9/425: dread - d6/d4e/d54/d5d/f75 zero size 2024-04-25T16:19:20.829 INFO:tasks.workunit.client.0.smithi059.stdout:3/433: write d0/d1e/f32 [5398469,33662] 0 2024-04-25T16:19:20.874 INFO:tasks.workunit.client.0.smithi059.stdout:2/400: write de/f76 [444474,89686] 0 2024-04-25T16:19:20.896 INFO:tasks.workunit.client.0.smithi059.stdout:2/401: truncate de/d16/f43 4891533 0 2024-04-25T16:19:20.997 INFO:tasks.workunit.client.0.smithi059.stdout:3/434: sync 2024-04-25T16:19:21.067 INFO:tasks.workunit.client.0.smithi059.stdout:8/380: write d7/d16/d3a/f3e [606785,18922] 0 2024-04-25T16:19:21.130 INFO:tasks.workunit.client.0.smithi059.stdout:1/459: dread d7/d2a/f67 [0,4194304] 0 2024-04-25T16:19:21.320 INFO:tasks.workunit.client.0.smithi059.stdout:0/392: dwrite dc/d37/d47/f75 [0,4194304] 0 2024-04-25T16:19:21.387 INFO:tasks.workunit.client.0.smithi059.stdout:2/402: fdatasync de/d2a/d33/f89 0 2024-04-25T16:19:21.398 INFO:tasks.workunit.client.0.smithi059.stdout:4/387: mkdir d0/d4/df/d1c/d45/d54/d75/d7e 0 2024-04-25T16:19:21.399 INFO:tasks.workunit.client.0.smithi059.stdout:3/435: creat d0/db/d3f/d6c/f93 x:0 0 0 2024-04-25T16:19:21.421 INFO:tasks.workunit.client.0.smithi059.stdout:3/436: stat d0/ff 0 2024-04-25T16:19:21.421 INFO:tasks.workunit.client.0.smithi059.stdout:2/403: chown de/d5a 786 1 2024-04-25T16:19:21.532 INFO:tasks.workunit.client.0.smithi059.stdout:6/431: rename f8 to d9/d16/d24/d5d/d77/f87 0 2024-04-25T16:19:21.538 INFO:tasks.workunit.client.0.smithi059.stdout:8/381: truncate d7/f1c 470828 0 2024-04-25T16:19:21.690 INFO:tasks.workunit.client.0.smithi059.stdout:3/437: mknod d0/db/d3f/d49/c94 0 2024-04-25T16:19:21.818 INFO:tasks.workunit.client.0.smithi059.stdout:2/404: dread de/d67/f72 [0,4194304] 0 2024-04-25T16:19:21.885 INFO:tasks.workunit.client.0.smithi059.stdout:9/426: link d6/c25 d6/d35/d28/c7d 0 2024-04-25T16:19:21.890 INFO:tasks.workunit.client.0.smithi059.stdout:7/394: rename d0/c34 to d0/d7/d16/d20/d2b/d33/d4c/d4e/d4f/c7d 0 2024-04-25T16:19:21.897 INFO:tasks.workunit.client.0.smithi059.stdout:2/405: sync 2024-04-25T16:19:21.906 INFO:tasks.workunit.client.0.smithi059.stdout:6/432: creat d9/d27/d39/f88 x:0 0 0 2024-04-25T16:19:21.913 INFO:tasks.workunit.client.0.smithi059.stdout:8/382: readlink d7/dd/l54 0 2024-04-25T16:19:22.210 INFO:tasks.workunit.client.0.smithi059.stdout:5/432: link d1/d1e/l32 d1/d1e/d8f/l98 0 2024-04-25T16:19:22.292 INFO:tasks.workunit.client.0.smithi059.stdout:0/393: creat dc/d37/d47/d81/f83 x:0 0 0 2024-04-25T16:19:22.734 INFO:tasks.workunit.client.0.smithi059.stdout:5/433: rmdir d1/d1e/d27/d66/d70/d3d/d44/d79/d92 39 2024-04-25T16:19:23.365 INFO:tasks.workunit.client.0.smithi059.stdout:0/394: unlink dc/dd/f6b 0 2024-04-25T16:19:23.368 INFO:tasks.workunit.client.0.smithi059.stdout:8/383: mknod d7/d2f/c7a 0 2024-04-25T16:19:23.440 INFO:tasks.workunit.client.0.smithi059.stdout:8/384: sync 2024-04-25T16:19:23.471 INFO:tasks.workunit.client.0.smithi059.stdout:7/395: mkdir d0/d7/d16/d20/d71/d7e 0 2024-04-25T16:19:23.659 INFO:tasks.workunit.client.0.smithi059.stdout:8/385: creat d7/dd/d17/d23/d38/f7b x:0 0 0 2024-04-25T16:19:23.661 INFO:tasks.workunit.client.0.smithi059.stdout:1/460: write d7/d13/d16/f24 [437147,74995] 0 2024-04-25T16:19:23.804 INFO:tasks.workunit.client.0.smithi059.stdout:7/396: creat d0/d7/d16/d20/d2b/d33/d79/d5d/f7f x:0 0 0 2024-04-25T16:19:23.887 INFO:tasks.workunit.client.0.smithi059.stdout:7/397: chown d0/d7/d16/d20/d2b/d33 78 1 2024-04-25T16:19:23.931 INFO:tasks.workunit.client.0.smithi059.stdout:4/388: dwrite d0/d4/df/d48/d5f/f6a [0,4194304] 0 2024-04-25T16:19:24.103 INFO:tasks.workunit.client.0.smithi059.stdout:3/438: write d0/db/d2d/f87 [4117759,64663] 0 2024-04-25T16:19:24.111 INFO:tasks.workunit.client.0.smithi059.stdout:6/433: write d9/f10 [2115670,69830] 0 2024-04-25T16:19:24.118 INFO:tasks.workunit.client.0.smithi059.stdout:0/395: mkdir dc/d84 0 2024-04-25T16:19:24.132 INFO:tasks.workunit.client.0.smithi059.stdout:5/434: getdents d1/d1e/d27/d66/d70/d3d/d50 0 2024-04-25T16:19:24.195 INFO:tasks.workunit.client.0.smithi059.stdout:2/406: getdents de/d5a/d7d 0 2024-04-25T16:19:24.198 INFO:tasks.workunit.client.0.smithi059.stdout:5/435: sync 2024-04-25T16:19:24.341 INFO:tasks.workunit.client.0.smithi059.stdout:8/386: link d7/dd/d17/d23/d38/f7b d7/dd/d17/d23/d37/d5c/f7c 0 2024-04-25T16:19:24.455 INFO:tasks.workunit.client.0.smithi059.stdout:0/396: chown dc/dd/f3c 0 1 2024-04-25T16:19:24.505 INFO:tasks.workunit.client.0.smithi059.stdout:6/434: dread d9/d1b/f48 [0,4194304] 0 2024-04-25T16:19:24.586 INFO:tasks.workunit.client.0.smithi059.stdout:9/427: creat d6/f7e x:0 0 0 2024-04-25T16:19:24.647 INFO:tasks.workunit.client.0.smithi059.stdout:7/398: fdatasync d0/d7/f29 0 2024-04-25T16:19:24.962 INFO:tasks.workunit.client.0.smithi059.stdout:3/439: mkdir d0/d1e/d95 0 2024-04-25T16:19:25.082 INFO:tasks.workunit.client.0.smithi059.stdout:6/435: dread d9/d16/d24/d5d/d77/f87 [4194304,4194304] 0 2024-04-25T16:19:25.146 INFO:tasks.workunit.client.0.smithi059.stdout:7/399: creat d0/d7/d16/d5a/f80 x:0 0 0 2024-04-25T16:19:25.178 INFO:tasks.workunit.client.0.smithi059.stdout:1/461: dwrite d7/d13/d2d/d41/f73 [0,4194304] 0 2024-04-25T16:19:25.239 INFO:tasks.workunit.client.0.smithi059.stdout:8/387: unlink d7/d16/d45/d66/l68 0 2024-04-25T16:19:25.274 INFO:tasks.workunit.client.0.smithi059.stdout:0/397: creat dc/d37/d47/d71/d77/f85 x:0 0 0 2024-04-25T16:19:25.317 INFO:tasks.workunit.client.0.smithi059.stdout:0/398: dread dc/dd/d3b/f45 [0,4194304] 0 2024-04-25T16:19:25.468 INFO:tasks.workunit.client.0.smithi059.stdout:6/436: fdatasync d9/d1b/f6b 0 2024-04-25T16:19:25.484 INFO:tasks.workunit.client.0.smithi059.stdout:6/437: dread - d9/d1b/f6b zero size 2024-04-25T16:19:25.642 INFO:tasks.workunit.client.0.smithi059.stdout:3/440: truncate d0/db/d2d/f4e 185307 0 2024-04-25T16:19:25.679 INFO:tasks.workunit.client.0.smithi059.stdout:0/399: dread dc/df/d24/f39 [8388608,4194304] 0 2024-04-25T16:19:25.712 INFO:tasks.workunit.client.0.smithi059.stdout:4/389: write d0/d4/f35 [13171,26724] 0 2024-04-25T16:19:25.724 INFO:tasks.workunit.client.0.smithi059.stdout:2/407: dwrite de/d2a/f35 [8388608,4194304] 0 2024-04-25T16:19:25.808 INFO:tasks.workunit.client.0.smithi059.stdout:6/438: rmdir d9/d27/d68 39 2024-04-25T16:19:25.824 INFO:tasks.workunit.client.0.smithi059.stdout:8/388: mkdir d7/dd/d17/d23/d38/d65/d7d 0 2024-04-25T16:19:25.936 INFO:tasks.workunit.client.0.smithi059.stdout:5/436: dwrite d1/d1e/d27/d66/d70/d75/f91 [0,4194304] 0 2024-04-25T16:19:26.324 INFO:tasks.workunit.client.0.smithi059.stdout:3/441: rename d0/l5f to d0/db/d47/d5b/l96 0 2024-04-25T16:19:26.360 INFO:tasks.workunit.client.0.smithi059.stdout:3/442: chown d0/f3e 1075655429 1 2024-04-25T16:19:26.460 INFO:tasks.workunit.client.0.smithi059.stdout:7/400: dwrite d0/d7/f2c [0,4194304] 0 2024-04-25T16:19:26.617 INFO:tasks.workunit.client.0.smithi059.stdout:1/462: dwrite d7/f30 [0,4194304] 0 2024-04-25T16:19:26.729 INFO:tasks.workunit.client.0.smithi059.stdout:4/390: creat d0/d4/f7f x:0 0 0 2024-04-25T16:19:26.773 INFO:tasks.workunit.client.0.smithi059.stdout:3/443: rename d0/db/d47/c69 to d0/db/d3f/d49/d65/c97 0 2024-04-25T16:19:26.860 INFO:tasks.workunit.client.0.smithi059.stdout:6/439: dread d9/d16/d24/f3f [0,4194304] 0 2024-04-25T16:19:26.881 INFO:tasks.workunit.client.0.smithi059.stdout:7/401: truncate d0/f30 989438 0 2024-04-25T16:19:26.974 INFO:tasks.workunit.client.0.smithi059.stdout:4/391: dread d0/d4/f35 [0,4194304] 0 2024-04-25T16:19:27.049 INFO:tasks.workunit.client.0.smithi059.stdout:0/400: dwrite dc/df/f1d [0,4194304] 0 2024-04-25T16:19:27.401 INFO:tasks.workunit.client.0.smithi059.stdout:2/408: dwrite de/d16/f19 [0,4194304] 0 2024-04-25T16:19:27.468 INFO:tasks.workunit.client.0.smithi059.stdout:9/428: write d6/d35/d28/f69 [4010102,116117] 0 2024-04-25T16:19:27.515 INFO:tasks.workunit.client.0.smithi059.stdout:8/389: write d7/f1c [1051968,59807] 0 2024-04-25T16:19:27.516 INFO:tasks.workunit.client.0.smithi059.stdout:9/429: read d6/d35/d28/f69 [3744215,86935] 0 2024-04-25T16:19:27.527 INFO:tasks.workunit.client.0.smithi059.stdout:6/440: rmdir d9/d27 39 2024-04-25T16:19:27.675 INFO:tasks.workunit.client.0.smithi059.stdout:5/437: getdents d1/d1e/d27/d66/d70/d3d/d44/d79 0 2024-04-25T16:19:27.686 INFO:tasks.workunit.client.0.smithi059.stdout:7/402: read d0/d7/d16/d20/d2b/d33/f43 [1497061,97327] 0 2024-04-25T16:19:27.743 INFO:tasks.workunit.client.0.smithi059.stdout:4/392: creat d0/d4/df/d1c/d45/d54/d75/f80 x:0 0 0 2024-04-25T16:19:27.809 INFO:tasks.workunit.client.0.smithi059.stdout:0/401: mkdir dc/dd/d3b/d86 0 2024-04-25T16:19:28.554 INFO:tasks.workunit.client.0.smithi059.stdout:7/403: creat d0/d7/d16/d20/d2b/d33/d4c/f81 x:0 0 0 2024-04-25T16:19:28.576 INFO:tasks.workunit.client.0.smithi059.stdout:5/438: dread d1/d1e/d27/d66/d70/d42/f96 [0,4194304] 0 2024-04-25T16:19:28.631 INFO:tasks.workunit.client.0.smithi059.stdout:0/402: creat dc/dd/d3b/d66/f87 x:0 0 0 2024-04-25T16:19:28.649 INFO:tasks.workunit.client.0.smithi059.stdout:4/393: dread d0/d4/df/d44/f4d [0,4194304] 0 2024-04-25T16:19:28.677 INFO:tasks.workunit.client.0.smithi059.stdout:2/409: mknod de/d2a/d2e/c99 0 2024-04-25T16:19:28.772 INFO:tasks.workunit.client.0.smithi059.stdout:1/463: rename d7/d13/d6a/f8a to d7/d13/f92 0 2024-04-25T16:19:29.167 INFO:tasks.workunit.client.0.smithi059.stdout:8/390: mkdir d7/dd/d17/d23/d38/d65/d7d/d7e 0 2024-04-25T16:19:29.252 INFO:tasks.workunit.client.0.smithi059.stdout:0/403: creat dc/d44/d5f/f88 x:0 0 0 2024-04-25T16:19:29.372 INFO:tasks.workunit.client.0.smithi059.stdout:4/394: unlink d0/d4/l16 0 2024-04-25T16:19:29.490 INFO:tasks.workunit.client.0.smithi059.stdout:6/441: write d9/d16/d24/f2b [575775,15059] 0 2024-04-25T16:19:29.619 INFO:tasks.workunit.client.0.smithi059.stdout:1/464: dread d7/f12 [0,4194304] 0 2024-04-25T16:19:29.704 INFO:tasks.workunit.client.0.smithi059.stdout:8/391: unlink d7/dd/d17/f2e 0 2024-04-25T16:19:29.726 INFO:tasks.workunit.client.0.smithi059.stdout:3/444: truncate d0/db/d2d/f4e 5800 0 2024-04-25T16:19:29.778 INFO:tasks.workunit.client.0.smithi059.stdout:0/404: stat dc/df/c21 0 2024-04-25T16:19:29.923 INFO:tasks.workunit.client.0.smithi059.stdout:5/439: getdents d1/d1e/d27/d66/d70/d3d/d44/d79 0 2024-04-25T16:19:29.944 INFO:tasks.workunit.client.0.smithi059.stdout:5/440: read d1/d1e/d27/d66/d70/d3d/f57 [2182296,55799] 0 2024-04-25T16:19:30.005 INFO:tasks.workunit.client.0.smithi059.stdout:8/392: mkdir d7/d16/d45/d7f 0 2024-04-25T16:19:30.249 INFO:tasks.workunit.client.0.smithi059.stdout:0/405: rmdir dc/df 39 2024-04-25T16:19:30.269 INFO:tasks.workunit.client.0.smithi059.stdout:9/430: write d6/f1b [1099193,61959] 0 2024-04-25T16:19:30.329 INFO:tasks.workunit.client.0.smithi059.stdout:5/441: truncate d1/f8 1691011 0 2024-04-25T16:19:30.330 INFO:tasks.workunit.client.0.smithi059.stdout:9/431: dread d6/f1b [0,4194304] 0 2024-04-25T16:19:30.332 INFO:tasks.workunit.client.0.smithi059.stdout:6/442: read - d9/d27/d39/f66 zero size 2024-04-25T16:19:30.368 INFO:tasks.workunit.client.0.smithi059.stdout:5/442: readlink d1/d1e/d27/d66/d70/l3c 0 2024-04-25T16:19:30.384 INFO:tasks.workunit.client.0.smithi059.stdout:5/443: stat d1/d1e/d27/d66/d70/d3d/d44/d79/f83 0 2024-04-25T16:19:30.587 INFO:tasks.workunit.client.0.smithi059.stdout:2/410: write de/d16/f79 [238005,91633] 0 2024-04-25T16:19:30.629 INFO:tasks.workunit.client.0.smithi059.stdout:6/443: symlink d9/d16/d53/d55/l89 0 2024-04-25T16:19:30.647 INFO:tasks.workunit.client.0.smithi059.stdout:2/411: dread de/f1d [0,4194304] 0 2024-04-25T16:19:30.690 INFO:tasks.workunit.client.0.smithi059.stdout:5/444: chown d1/f3 758780325 1 2024-04-25T16:19:30.770 INFO:tasks.workunit.client.0.smithi059.stdout:1/465: rename d7/d13/d2d/d4a/d4d to d7/d93 0 2024-04-25T16:19:30.781 INFO:tasks.workunit.client.0.smithi059.stdout:1/466: readlink d7/d13/d2d/d41/d8f/l81 0 2024-04-25T16:19:30.844 INFO:tasks.workunit.client.0.smithi059.stdout:7/404: write d0/d7/d16/d20/d2b/d33/f41 [4391722,128265] 0 2024-04-25T16:19:30.867 INFO:tasks.workunit.client.0.smithi059.stdout:6/444: rmdir d9/d16/d53/d6c 39 2024-04-25T16:19:30.929 INFO:tasks.workunit.client.0.smithi059.stdout:2/412: truncate f1 1679713 0 2024-04-25T16:19:31.124 INFO:tasks.workunit.client.0.smithi059.stdout:4/395: dwrite d0/d4/fe [0,4194304] 0 2024-04-25T16:19:31.204 INFO:tasks.workunit.client.0.smithi059.stdout:1/467: symlink d7/d13/d16/d72/l94 0 2024-04-25T16:19:31.215 INFO:tasks.workunit.client.0.smithi059.stdout:9/432: getdents d6/d4e/d7a 0 2024-04-25T16:19:31.328 INFO:tasks.workunit.client.0.smithi059.stdout:6/445: creat d9/d16/d53/d55/d71/d7e/f8a x:0 0 0 2024-04-25T16:19:31.415 INFO:tasks.workunit.client.0.smithi059.stdout:5/445: creat d1/d1e/d27/d66/d70/d3d/d50/d8a/f99 x:0 0 0 2024-04-25T16:19:31.442 INFO:tasks.workunit.client.0.smithi059.stdout:7/405: dwrite d0/d7/d16/d5a/f80 [0,4194304] 0 2024-04-25T16:19:31.696 INFO:tasks.workunit.client.0.smithi059.stdout:3/445: dwrite d0/db/d47/f48 [0,4194304] 0 2024-04-25T16:19:31.861 INFO:tasks.workunit.client.0.smithi059.stdout:2/413: dread de/d16/f8e [0,4194304] 0 2024-04-25T16:19:31.972 INFO:tasks.workunit.client.0.smithi059.stdout:7/406: chown d0/d7/d16/d20/d2b/d33/d4c/d5c/f70 45494938 1 2024-04-25T16:19:32.027 INFO:tasks.workunit.client.0.smithi059.stdout:0/406: dwrite dc/d68/f82 [0,4194304] 0 2024-04-25T16:19:32.121 INFO:tasks.workunit.client.0.smithi059.stdout:8/393: dwrite d7/dd/d17/d23/f2a [0,4194304] 0 2024-04-25T16:19:32.134 INFO:tasks.workunit.client.0.smithi059.stdout:5/446: dread d1/d1e/d27/d66/d70/d42/f52 [0,4194304] 0 2024-04-25T16:19:32.143 INFO:tasks.workunit.client.0.smithi059.stdout:7/407: chown d0/l18 1991 1 2024-04-25T16:19:32.228 INFO:tasks.workunit.client.0.smithi059.stdout:2/414: dread de/d16/f31 [0,4194304] 0 2024-04-25T16:19:32.273 INFO:tasks.workunit.client.0.smithi059.stdout:5/447: dread - d1/d1e/d27/d66/d70/f61 zero size 2024-04-25T16:19:32.382 INFO:tasks.workunit.client.0.smithi059.stdout:3/446: fdatasync d0/db/f14 0 2024-04-25T16:19:32.483 INFO:tasks.workunit.client.0.smithi059.stdout:9/433: truncate d6/fb 798637 0 2024-04-25T16:19:32.729 INFO:tasks.workunit.client.0.smithi059.stdout:7/408: dread - d0/d7/d16/d20/d2b/d33/d4c/d4e/f66 zero size 2024-04-25T16:19:32.781 INFO:tasks.workunit.client.0.smithi059.stdout:2/415: rmdir de/d2a/d2e/d36/d2c 39 2024-04-25T16:19:32.850 INFO:tasks.workunit.client.0.smithi059.stdout:0/407: truncate dc/d37/d47/d81/f83 141816 0 2024-04-25T16:19:32.860 INFO:tasks.workunit.client.0.smithi059.stdout:6/446: dwrite d9/d27/d39/f86 [0,4194304] 0 2024-04-25T16:19:32.929 INFO:tasks.workunit.client.0.smithi059.stdout:5/448: mknod d1/d1e/c9a 0 2024-04-25T16:19:32.936 INFO:tasks.workunit.client.0.smithi059.stdout:1/468: link d7/d13/f8b d7/d2a/d85/d8d/f95 0 2024-04-25T16:19:32.940 INFO:tasks.workunit.client.0.smithi059.stdout:4/396: write d0/d4/df/d48/d5f/f7b [2590459,118422] 0 2024-04-25T16:19:33.588 INFO:tasks.workunit.client.0.smithi059.stdout:0/408: read - dc/d37/d47/f7c zero size 2024-04-25T16:19:33.701 INFO:tasks.workunit.client.0.smithi059.stdout:6/447: symlink d9/d16/d53/d55/d6e/l8b 0 2024-04-25T16:19:33.862 INFO:tasks.workunit.client.0.smithi059.stdout:7/409: symlink d0/d7/d16/d20/d71/d7e/l82 0 2024-04-25T16:19:33.863 INFO:tasks.workunit.client.0.smithi059.stdout:4/397: dread d0/d4/f1b [0,4194304] 0 2024-04-25T16:19:33.869 INFO:tasks.workunit.client.0.smithi059.stdout:1/469: dread d7/d13/d2d/d41/f73 [0,4194304] 0 2024-04-25T16:19:34.089 INFO:tasks.workunit.client.0.smithi059.stdout:8/394: mknod d7/dd/d17/d23/d37/d5c/d78/c80 0 2024-04-25T16:19:34.159 INFO:tasks.workunit.client.0.smithi059.stdout:8/395: dread d7/dd/d17/d23/d37/f44 [0,4194304] 0 2024-04-25T16:19:34.374 INFO:tasks.workunit.client.0.smithi059.stdout:4/398: rename d0/f39 to d0/d4/df/d48/f81 0 2024-04-25T16:19:34.468 INFO:tasks.workunit.client.0.smithi059.stdout:0/409: dwrite dc/df/f1d [0,4194304] 0 2024-04-25T16:19:34.572 INFO:tasks.workunit.client.0.smithi059.stdout:5/449: symlink d1/d1e/d27/d66/d70/l9b 0 2024-04-25T16:19:34.581 INFO:tasks.workunit.client.0.smithi059.stdout:3/447: write d0/f3e [5605407,115502] 0 2024-04-25T16:19:34.661 INFO:tasks.workunit.client.0.smithi059.stdout:9/434: write d6/d4e/d54/d5d/d48/f78 [760673,74233] 0 2024-04-25T16:19:34.688 INFO:tasks.workunit.client.0.smithi059.stdout:9/435: chown d6/d4e/d54/d5d/d48/d6e 29137727 1 2024-04-25T16:19:34.698 INFO:tasks.workunit.client.0.smithi059.stdout:9/436: read f2 [1094698,23830] 0 2024-04-25T16:19:34.868 INFO:tasks.workunit.client.0.smithi059.stdout:2/416: write de/f86 [345888,112787] 0 2024-04-25T16:19:34.972 INFO:tasks.workunit.client.0.smithi059.stdout:7/410: write d0/f56 [2961104,13416] 0 2024-04-25T16:19:34.973 INFO:tasks.workunit.client.0.smithi059.stdout:4/399: dread d0/d4/df/d1c/d45/f62 [0,4194304] 0 2024-04-25T16:19:34.993 INFO:tasks.workunit.client.0.smithi059.stdout:0/410: dread - dc/dd/d3b/f80 zero size 2024-04-25T16:19:35.011 INFO:tasks.workunit.client.0.smithi059.stdout:7/411: chown d0/d7/d16/d20/d71 21003377 1 2024-04-25T16:19:35.054 INFO:tasks.workunit.client.0.smithi059.stdout:0/411: dread dc/f2a [0,4194304] 0 2024-04-25T16:19:35.173 INFO:tasks.workunit.client.0.smithi059.stdout:3/448: mkdir d0/db/d47/d98 0 2024-04-25T16:19:35.230 INFO:tasks.workunit.client.0.smithi059.stdout:9/437: mknod d6/d4e/c7f 0 2024-04-25T16:19:35.390 INFO:tasks.workunit.client.0.smithi059.stdout:1/470: dwrite d7/d2a/d85/d8d/f95 [0,4194304] 0 2024-04-25T16:19:35.468 INFO:tasks.workunit.client.0.smithi059.stdout:6/448: getdents d9/d27/d39 0 2024-04-25T16:19:35.782 INFO:tasks.workunit.client.0.smithi059.stdout:8/396: creat d7/dd/d17/d23/f81 x:0 0 0 2024-04-25T16:19:35.789 INFO:tasks.workunit.client.0.smithi059.stdout:7/412: creat d0/d7/d16/d20/f83 x:0 0 0 2024-04-25T16:19:35.850 INFO:tasks.workunit.client.0.smithi059.stdout:9/438: dread - d6/d4e/d54/d5d/d48/d49/f58 zero size 2024-04-25T16:19:35.972 INFO:tasks.workunit.client.0.smithi059.stdout:5/450: dwrite d1/d1e/f5c [0,4194304] 0 2024-04-25T16:19:36.070 INFO:tasks.workunit.client.0.smithi059.stdout:0/412: symlink dc/d84/l89 0 2024-04-25T16:19:36.105 INFO:tasks.workunit.client.0.smithi059.stdout:1/471: write d7/d13/d16/d54/f71 [986077,102613] 0 2024-04-25T16:19:36.141 INFO:tasks.workunit.client.0.smithi059.stdout:4/400: dwrite d0/d4/f1b [0,4194304] 0 2024-04-25T16:19:36.156 INFO:tasks.workunit.client.0.smithi059.stdout:5/451: sync 2024-04-25T16:19:36.302 INFO:tasks.workunit.client.0.smithi059.stdout:3/449: write d0/f37 [840255,11720] 0 2024-04-25T16:19:36.594 INFO:tasks.workunit.client.0.smithi059.stdout:2/417: dwrite de/d16/f6b [0,4194304] 0 2024-04-25T16:19:36.761 INFO:tasks.workunit.client.0.smithi059.stdout:4/401: fsync d0/d4/f56 0 2024-04-25T16:19:36.801 INFO:tasks.workunit.client.0.smithi059.stdout:6/449: dread d9/d1b/f7a [0,4194304] 0 2024-04-25T16:19:36.812 INFO:tasks.workunit.client.0.smithi059.stdout:9/439: link l4 d6/l80 0 2024-04-25T16:19:36.843 INFO:tasks.workunit.client.0.smithi059.stdout:7/413: link d0/f30 d0/d7/d16/d20/d71/f84 0 2024-04-25T16:19:36.858 INFO:tasks.workunit.client.0.smithi059.stdout:8/397: dread d7/f15 [4194304,4194304] 0 2024-04-25T16:19:36.871 INFO:tasks.workunit.client.0.smithi059.stdout:1/472: link d7/f9 d7/d13/d2d/f96 0 2024-04-25T16:19:36.894 INFO:tasks.workunit.client.0.smithi059.stdout:0/413: dread dc/f3a [0,4194304] 0 2024-04-25T16:19:37.005 INFO:tasks.workunit.client.0.smithi059.stdout:6/450: dread - d9/d16/d54/f5c zero size 2024-04-25T16:19:37.033 INFO:tasks.workunit.client.0.smithi059.stdout:5/452: dwrite d1/dd/f12 [0,4194304] 0 2024-04-25T16:19:37.113 INFO:tasks.workunit.client.0.smithi059.stdout:2/418: mkdir de/d5a/d9a 0 2024-04-25T16:19:37.199 INFO:tasks.workunit.client.0.smithi059.stdout:3/450: dwrite d0/f27 [0,4194304] 0 2024-04-25T16:19:37.208 INFO:tasks.workunit.client.0.smithi059.stdout:4/402: mkdir d0/d4/df/d1c/d45/d54/d75/d82 0 2024-04-25T16:19:37.347 INFO:tasks.workunit.client.0.smithi059.stdout:4/403: stat d0/d4/df/d48/c4a 0 2024-04-25T16:19:37.410 INFO:tasks.workunit.client.0.smithi059.stdout:8/398: dread d7/dd/d33/f73 [0,4194304] 0 2024-04-25T16:19:37.543 INFO:tasks.workunit.client.0.smithi059.stdout:4/404: dread d0/d4/df/d1c/f37 [0,4194304] 0 2024-04-25T16:19:37.554 INFO:tasks.workunit.client.0.smithi059.stdout:4/405: readlink d0/d4/df/d48/l50 0 2024-04-25T16:19:37.621 INFO:tasks.workunit.client.0.smithi059.stdout:7/414: mkdir d0/d7/d16/d20/d2b/d33/d79/d5d/d85 0 2024-04-25T16:19:37.933 INFO:tasks.workunit.client.0.smithi059.stdout:8/399: fdatasync d7/dd/f3c 0 2024-04-25T16:19:38.027 INFO:tasks.workunit.client.0.smithi059.stdout:1/473: mknod d7/d13/d16/c97 0 2024-04-25T16:19:38.036 INFO:tasks.workunit.client.0.smithi059.stdout:1/474: dread - d7/d13/f45 zero size 2024-04-25T16:19:38.102 INFO:tasks.workunit.client.0.smithi059.stdout:4/406: creat d0/d4/df/d44/f83 x:0 0 0 2024-04-25T16:19:38.407 INFO:tasks.workunit.client.0.smithi059.stdout:9/440: rename d6/ca to d6/d35/d26/c81 0 2024-04-25T16:19:38.617 INFO:tasks.workunit.client.0.smithi059.stdout:8/400: rmdir d7/dd/d17/d23/d38 39 2024-04-25T16:19:38.705 INFO:tasks.workunit.client.0.smithi059.stdout:0/414: write dc/dd/d3b/d66/f6f [1027444,8356] 0 2024-04-25T16:19:38.732 INFO:tasks.workunit.client.0.smithi059.stdout:7/415: fdatasync d0/d7/d16/d20/d2b/d33/d79/d5d/f75 0 2024-04-25T16:19:38.926 INFO:tasks.workunit.client.0.smithi059.stdout:8/401: creat d7/dd/d17/d23/d37/f82 x:0 0 0 2024-04-25T16:19:38.950 INFO:tasks.workunit.client.0.smithi059.stdout:4/407: mknod d0/d4/df/d1c/d45/d54/d75/d82/c84 0 2024-04-25T16:19:39.031 INFO:tasks.workunit.client.0.smithi059.stdout:2/419: dwrite fd [0,4194304] 0 2024-04-25T16:19:39.033 INFO:tasks.workunit.client.0.smithi059.stdout:6/451: write d9/d16/d53/d55/d71/d7e/f8a [795705,64070] 0 2024-04-25T16:19:39.146 INFO:tasks.workunit.client.0.smithi059.stdout:7/416: mknod d0/d7/d16/d20/d2b/d33/d4c/d4e/d4f/c86 0 2024-04-25T16:19:39.209 INFO:tasks.workunit.client.0.smithi059.stdout:7/417: dread d0/d3f/f5b [0,4194304] 0 2024-04-25T16:19:39.277 INFO:tasks.workunit.client.0.smithi059.stdout:3/451: dwrite d0/db/f30 [4194304,4194304] 0 2024-04-25T16:19:39.337 INFO:tasks.workunit.client.0.smithi059.stdout:7/418: chown d0/d7/d16/d20/f83 1689136159 1 2024-04-25T16:19:39.565 INFO:tasks.workunit.client.0.smithi059.stdout:0/415: creat dc/d37/d47/d60/d6e/f8a x:0 0 0 2024-04-25T16:19:39.696 INFO:tasks.workunit.client.0.smithi059.stdout:3/452: read d0/d1e/f6e [162647,78632] 0 2024-04-25T16:19:39.699 INFO:tasks.workunit.client.0.smithi059.stdout:5/453: dwrite d1/d1e/d27/d66/d70/d42/d6d/f73 [0,4194304] 0 2024-04-25T16:19:39.774 INFO:tasks.workunit.client.0.smithi059.stdout:2/420: mknod de/d5a/c9b 0 2024-04-25T16:19:39.798 INFO:tasks.workunit.client.0.smithi059.stdout:6/452: dread - d9/d27/d68/f6d zero size 2024-04-25T16:19:39.817 INFO:tasks.workunit.client.0.smithi059.stdout:3/453: chown d0/d1e/f90 711638 1 2024-04-25T16:19:39.951 INFO:tasks.workunit.client.0.smithi059.stdout:1/475: dwrite d7/f53 [0,4194304] 0 2024-04-25T16:19:40.018 INFO:tasks.workunit.client.0.smithi059.stdout:1/476: chown d7/d13/d16/d5c/c89 2213565 1 2024-04-25T16:19:40.030 INFO:tasks.workunit.client.0.smithi059.stdout:7/419: mkdir d0/d7/d16/d20/d2b/d33/d87 0 2024-04-25T16:19:40.037 INFO:tasks.workunit.client.0.smithi059.stdout:0/416: fdatasync dc/f29 0 2024-04-25T16:19:40.111 INFO:tasks.workunit.client.0.smithi059.stdout:6/453: read d9/d16/f1f [571697,70999] 0 2024-04-25T16:19:40.143 INFO:tasks.workunit.client.0.smithi059.stdout:5/454: mknod d1/d1e/d27/d66/d70/d3d/d44/c9c 0 2024-04-25T16:19:40.479 INFO:tasks.workunit.client.0.smithi059.stdout:2/421: fsync de/d2a/d33/f53 0 2024-04-25T16:19:40.531 INFO:tasks.workunit.client.0.smithi059.stdout:9/441: dwrite d6/f47 [0,4194304] 0 2024-04-25T16:19:40.640 INFO:tasks.workunit.client.0.smithi059.stdout:6/454: fdatasync d9/d16/d53/d55/d71/d7e/f7f 0 2024-04-25T16:19:40.653 INFO:tasks.workunit.client.0.smithi059.stdout:4/408: dwrite d0/d4/f56 [0,4194304] 0 2024-04-25T16:19:40.728 INFO:tasks.workunit.client.0.smithi059.stdout:5/455: dread - d1/d1e/d27/d66/d70/d42/d6d/f82 zero size 2024-04-25T16:19:40.741 INFO:tasks.workunit.client.0.smithi059.stdout:6/455: readlink d9/d16/d54/l61 0 2024-04-25T16:19:40.910 INFO:tasks.workunit.client.0.smithi059.stdout:1/477: mknod d7/d2a/d85/d8d/c98 0 2024-04-25T16:19:41.049 INFO:tasks.workunit.client.0.smithi059.stdout:3/454: write d0/d1e/d31/f40 [202695,116710] 0 2024-04-25T16:19:41.137 INFO:tasks.workunit.client.0.smithi059.stdout:8/402: dwrite d7/d2f/f53 [4194304,4194304] 0 2024-04-25T16:19:41.218 INFO:tasks.workunit.client.0.smithi059.stdout:5/456: fdatasync d1/d1e/d27/d66/d70/f39 0 2024-04-25T16:19:41.237 INFO:tasks.workunit.client.0.smithi059.stdout:2/422: dread fb [0,4194304] 0 2024-04-25T16:19:41.350 INFO:tasks.workunit.client.0.smithi059.stdout:1/478: symlink d7/d13/d16/d54/l99 0 2024-04-25T16:19:41.430 INFO:tasks.workunit.client.0.smithi059.stdout:7/420: dwrite d0/d7/fa [12582912,4194304] 0 2024-04-25T16:19:41.547 INFO:tasks.workunit.client.0.smithi059.stdout:7/421: sync 2024-04-25T16:19:41.604 INFO:tasks.workunit.client.0.smithi059.stdout:0/417: dwrite f9 [0,4194304] 0 2024-04-25T16:19:41.612 INFO:tasks.workunit.client.0.smithi059.stdout:5/457: mknod d1/d1e/d27/d66/d70/d3d/d50/d8a/c9d 0 2024-04-25T16:19:41.672 INFO:tasks.workunit.client.0.smithi059.stdout:9/442: mknod d6/d4e/d7a/c82 0 2024-04-25T16:19:41.701 INFO:tasks.workunit.client.0.smithi059.stdout:5/458: stat d1/d1e/d27/d66/d70/d24/f62 0 2024-04-25T16:19:41.739 INFO:tasks.workunit.client.0.smithi059.stdout:4/409: link d0/fc d0/d4/df/d1c/f85 0 2024-04-25T16:19:41.814 INFO:tasks.workunit.client.0.smithi059.stdout:4/410: sync 2024-04-25T16:19:41.852 INFO:tasks.workunit.client.0.smithi059.stdout:3/455: creat d0/db/d47/d7e/f99 x:0 0 0 2024-04-25T16:19:41.870 INFO:tasks.workunit.client.0.smithi059.stdout:2/423: symlink de/d5a/d7d/d80/l9c 0 2024-04-25T16:19:41.879 INFO:tasks.workunit.client.0.smithi059.stdout:3/456: sync 2024-04-25T16:19:41.993 INFO:tasks.workunit.client.0.smithi059.stdout:7/422: fsync d0/f27 0 2024-04-25T16:19:42.128 INFO:tasks.workunit.client.0.smithi059.stdout:8/403: write d7/dd/d17/d23/d37/d5c/f7c [474844,113252] 0 2024-04-25T16:19:42.134 INFO:tasks.workunit.client.0.smithi059.stdout:9/443: fdatasync d6/d4e/d54/d5d/d48/d49/f7c 0 2024-04-25T16:19:42.168 INFO:tasks.workunit.client.0.smithi059.stdout:1/479: creat d7/d93/d8e/f9a x:0 0 0 2024-04-25T16:19:42.174 INFO:tasks.workunit.client.0.smithi059.stdout:6/456: getdents d9/d16/d53/d55/d71 0 2024-04-25T16:19:42.213 INFO:tasks.workunit.client.0.smithi059.stdout:3/457: fsync d0/d1e/f45 0 2024-04-25T16:19:42.281 INFO:tasks.workunit.client.0.smithi059.stdout:3/458: sync 2024-04-25T16:19:42.284 INFO:tasks.workunit.client.0.smithi059.stdout:5/459: dread d1/d1e/d27/f4e [0,4194304] 0 2024-04-25T16:19:42.285 INFO:tasks.workunit.client.0.smithi059.stdout:9/444: dread - d6/d4e/d54/d5d/f75 zero size 2024-04-25T16:19:42.322 INFO:tasks.workunit.client.0.smithi059.stdout:5/460: read d1/f15 [3552045,125365] 0 2024-04-25T16:19:42.373 INFO:tasks.workunit.client.0.smithi059.stdout:9/445: sync 2024-04-25T16:19:42.712 INFO:tasks.workunit.client.0.smithi059.stdout:1/480: symlink d7/d13/d6a/l9b 0 2024-04-25T16:19:42.738 INFO:tasks.workunit.client.0.smithi059.stdout:8/404: rmdir d7/dd/d17/d23/d37/d5c/d78 39 2024-04-25T16:19:42.832 INFO:tasks.workunit.client.0.smithi059.stdout:6/457: rename d9/d16/c4e to d9/d16/d54/c8c 0 2024-04-25T16:19:43.128 INFO:tasks.workunit.client.0.smithi059.stdout:5/461: chown d1/d1e/l32 959997 1 2024-04-25T16:19:43.270 INFO:tasks.workunit.client.0.smithi059.stdout:4/411: dwrite d0/f67 [0,4194304] 0 2024-04-25T16:19:43.358 INFO:tasks.workunit.client.0.smithi059.stdout:1/481: mkdir d7/d13/d16/d7f/d9c 0 2024-04-25T16:19:43.542 INFO:tasks.workunit.client.0.smithi059.stdout:6/458: stat d9/d16/d53/d6c 0 2024-04-25T16:19:43.548 INFO:tasks.workunit.client.0.smithi059.stdout:5/462: creat d1/d1e/d27/d66/d70/d3d/f9e x:0 0 0 2024-04-25T16:19:43.586 INFO:tasks.workunit.client.0.smithi059.stdout:7/423: creat d0/f88 x:0 0 0 2024-04-25T16:19:43.644 INFO:tasks.workunit.client.0.smithi059.stdout:2/424: getdents de/d16/d7f 0 2024-04-25T16:19:43.771 INFO:tasks.workunit.client.0.smithi059.stdout:0/418: link dc/df/c22 dc/d37/d47/c8b 0 2024-04-25T16:19:43.821 INFO:tasks.workunit.client.0.smithi059.stdout:1/482: creat d7/d2a/d85/f9d x:0 0 0 2024-04-25T16:19:43.978 INFO:tasks.workunit.client.0.smithi059.stdout:8/405: write d7/dd/d33/f73 [1904121,105778] 0 2024-04-25T16:19:44.017 INFO:tasks.workunit.client.0.smithi059.stdout:6/459: creat d9/d27/d68/f8d x:0 0 0 2024-04-25T16:19:44.023 INFO:tasks.workunit.client.0.smithi059.stdout:5/463: read d1/f8 [743529,80614] 0 2024-04-25T16:19:44.034 INFO:tasks.workunit.client.0.smithi059.stdout:5/464: readlink l0 0 2024-04-25T16:19:44.049 INFO:tasks.workunit.client.0.smithi059.stdout:7/424: read d0/d7/d16/d20/f67 [106492,99628] 0 2024-04-25T16:19:44.175 INFO:tasks.workunit.client.0.smithi059.stdout:4/412: fsync d0/d4/df/d1c/f85 0 2024-04-25T16:19:44.290 INFO:tasks.workunit.client.0.smithi059.stdout:3/459: link d0/db/d47/d5b/f5d d0/db/d2d/f9a 0 2024-04-25T16:19:44.299 INFO:tasks.workunit.client.0.smithi059.stdout:9/446: getdents d6/d35/d6c 0 2024-04-25T16:19:44.673 INFO:tasks.workunit.client.0.smithi059.stdout:1/483: dwrite d7/d93/f4f [0,4194304] 0 2024-04-25T16:19:44.736 INFO:tasks.workunit.client.0.smithi059.stdout:5/465: unlink d1/d1e/l3f 0 2024-04-25T16:19:44.741 INFO:tasks.workunit.client.0.smithi059.stdout:7/425: rename d0/d7/d16/d20/f83 to d0/d7/d16/d20/d2b/d33/d4c/d5c/f89 0 2024-04-25T16:19:44.772 INFO:tasks.workunit.client.0.smithi059.stdout:5/466: chown d1/l1f 0 1 2024-04-25T16:19:44.800 INFO:tasks.workunit.client.0.smithi059.stdout:5/467: chown d1/d1e/c89 57846411 1 2024-04-25T16:19:44.828 INFO:tasks.workunit.client.0.smithi059.stdout:0/419: truncate dc/f36 2953274 0 2024-04-25T16:19:44.967 INFO:tasks.workunit.client.0.smithi059.stdout:6/460: dwrite d9/d16/f52 [0,4194304] 0 2024-04-25T16:19:45.135 INFO:tasks.workunit.client.0.smithi059.stdout:9/447: rmdir d6/d35/d26 39 2024-04-25T16:19:45.153 INFO:tasks.workunit.client.0.smithi059.stdout:1/484: truncate d7/d13/d2d/d4a/f4b 2862088 0 2024-04-25T16:19:45.158 INFO:tasks.workunit.client.0.smithi059.stdout:5/468: symlink d1/d1e/d27/d66/d70/d3d/d44/d79/d92/l9f 0 2024-04-25T16:19:45.171 INFO:tasks.workunit.client.0.smithi059.stdout:4/413: getdents d0/d79 0 2024-04-25T16:19:45.210 INFO:tasks.workunit.client.0.smithi059.stdout:1/485: readlink d7/d13/d2d/d41/l52 0 2024-04-25T16:19:45.464 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:19:45.467 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:19:45.509 INFO:tasks.workunit.client.0.smithi059.stdout:8/406: write d7/d16/f52 [106266,122183] 0 2024-04-25T16:19:45.620 INFO:tasks.workunit.client.0.smithi059.stdout:0/420: dwrite dc/d44/f63 [0,4194304] 0 2024-04-25T16:19:45.703 INFO:tasks.workunit.client.0.smithi059.stdout:2/425: getdents de/d2a/d2e 0 2024-04-25T16:19:45.726 INFO:tasks.workunit.client.0.smithi059.stdout:2/426: stat de/d2a/d33/f53 0 2024-04-25T16:19:45.731 INFO:tasks.workunit.client.0.smithi059.stdout:4/414: unlink d0/f26 0 2024-04-25T16:19:45.736 INFO:tasks.workunit.client.0.smithi059.stdout:2/427: stat de/d67 0 2024-04-25T16:19:45.801 INFO:tasks.workunit.client.0.smithi059.stdout:5/469: fdatasync d1/d1e/d27/d66/d70/f39 0 2024-04-25T16:19:45.845 INFO:tasks.workunit.client.0.smithi059.stdout:1/486: creat d7/d13/d16/d7f/f9e x:0 0 0 2024-04-25T16:19:45.919 INFO:tasks.workunit.client.0.smithi059.stdout:5/470: sync 2024-04-25T16:19:45.962 INFO:tasks.workunit.client.0.smithi059.stdout:7/426: rename d0/d3f/f5b to d0/d7/f8a 0 2024-04-25T16:19:45.985 INFO:tasks.workunit.client.0.smithi059.stdout:3/460: link d0/db/d2d/c64 d0/db/d7f/c9b 0 2024-04-25T16:19:46.077 INFO:tasks.workunit.client.0.smithi059.stdout:0/421: dread dc/f2d [0,4194304] 0 2024-04-25T16:19:46.496 INFO:tasks.workunit.client.0.smithi059.stdout:7/427: symlink d0/d7/d16/d20/d71/l8b 0 2024-04-25T16:19:46.599 INFO:tasks.workunit.client.0.smithi059.stdout:2/428: write de/d67/f72 [4297264,106919] 0 2024-04-25T16:19:46.654 INFO:tasks.workunit.client.0.smithi059.stdout:8/407: write d7/f1f [2371436,55740] 0 2024-04-25T16:19:46.703 INFO:tasks.workunit.client.0.smithi059.stdout:3/461: dread d0/f6 [0,4194304] 0 2024-04-25T16:19:46.739 INFO:tasks.workunit.client.0.smithi059.stdout:4/415: mknod d0/c86 0 2024-04-25T16:19:46.833 INFO:tasks.workunit.client.0.smithi059.stdout:5/471: dwrite d1/d1e/d27/d66/f8b [0,4194304] 0 2024-04-25T16:19:46.907 INFO:tasks.workunit.client.0.smithi059.stdout:0/422: write dc/dd/d3b/d66/f6f [2022818,87664] 0 2024-04-25T16:19:46.939 INFO:tasks.workunit.client.0.smithi059.stdout:0/423: read dc/f2a [2356416,4240] 0 2024-04-25T16:19:46.953 INFO:tasks.workunit.client.0.smithi059.stdout:9/448: getdents d6/d4e/d54 0 2024-04-25T16:19:47.106 INFO:tasks.workunit.client.0.smithi059.stdout:3/462: unlink d0/l33 0 2024-04-25T16:19:47.129 INFO:tasks.workunit.client.0.smithi059.stdout:6/461: rename d9/d16/d53/d55/d71/d7e/f7f to d9/d1b/f8e 0 2024-04-25T16:19:47.131 INFO:tasks.workunit.client.0.smithi059.stdout:1/487: dwrite d7/d13/f5a [0,4194304] 0 2024-04-25T16:19:47.215 INFO:tasks.workunit.client.0.smithi059.stdout:8/408: chown d7/l12 196361137 1 2024-04-25T16:19:47.253 INFO:tasks.workunit.client.0.smithi059.stdout:2/429: mkdir de/d16/d9d 0 2024-04-25T16:19:47.263 INFO:tasks.workunit.client.0.smithi059.stdout:9/449: rmdir d6/d35/d2f/d39 39 2024-04-25T16:19:47.276 INFO:tasks.workunit.client.0.smithi059.stdout:0/424: chown dc/f1f 10406141 1 2024-04-25T16:19:47.470 INFO:tasks.workunit.client.0.smithi059.stdout:5/472: truncate d1/d1e/d27/d66/d70/d24/f4b 224194 0 2024-04-25T16:19:47.769 INFO:tasks.workunit.client.0.smithi059.stdout:4/416: write d0/d4/f4b [3037033,100129] 0 2024-04-25T16:19:48.117 INFO:tasks.workunit.client.0.smithi059.stdout:9/450: truncate d6/d4e/d54/d5d/f75 442605 0 2024-04-25T16:19:48.144 INFO:tasks.workunit.client.0.smithi059.stdout:3/463: dread d0/d1e/f52 [0,4194304] 0 2024-04-25T16:19:48.205 INFO:tasks.workunit.client.0.smithi059.stdout:1/488: truncate d7/f28 2215710 0 2024-04-25T16:19:48.307 INFO:tasks.workunit.client.0.smithi059.stdout:1/489: sync 2024-04-25T16:19:48.471 INFO:tasks.workunit.client.0.smithi059.stdout:4/417: mknod d0/d4/df/d1c/d45/d54/d75/d82/c87 0 2024-04-25T16:19:48.671 INFO:tasks.workunit.client.0.smithi059.stdout:9/451: symlink d6/d4e/d54/l83 0 2024-04-25T16:19:48.715 INFO:tasks.workunit.client.0.smithi059.stdout:2/430: creat de/d2a/f9e x:0 0 0 2024-04-25T16:19:48.728 INFO:tasks.workunit.client.0.smithi059.stdout:2/431: chown de/d2a/d2e/d6a/c78 292227 1 2024-04-25T16:19:48.868 INFO:tasks.workunit.client.0.smithi059.stdout:1/490: mkdir d7/d13/d2d/d41/d8f/d9f 0 2024-04-25T16:19:48.911 INFO:tasks.workunit.client.0.smithi059.stdout:4/418: rmdir d0/d4/df/d48 39 2024-04-25T16:19:49.018 INFO:tasks.workunit.client.0.smithi059.stdout:2/432: symlink de/d67/l9f 0 2024-04-25T16:19:49.048 INFO:tasks.workunit.client.0.smithi059.stdout:5/473: link d1/d1e/d27/d66/d70/d42/d6d/c7a d1/d1e/d8f/ca0 0 2024-04-25T16:19:49.200 INFO:tasks.workunit.client.0.smithi059.stdout:4/419: fsync d0/d4/df/d74/f78 0 2024-04-25T16:19:49.266 INFO:tasks.workunit.client.0.smithi059.stdout:2/433: dread de/d16/f1a [0,4194304] 0 2024-04-25T16:19:49.312 INFO:tasks.workunit.client.0.smithi059.stdout:5/474: truncate d1/dd/f8e 375318 0 2024-04-25T16:19:49.441 INFO:tasks.workunit.client.0.smithi059.stdout:6/462: dwrite d9/f4b [0,4194304] 0 2024-04-25T16:19:49.688 INFO:tasks.workunit.client.0.smithi059.stdout:4/420: dread - d0/d4/f7f zero size 2024-04-25T16:19:49.801 INFO:tasks.workunit.client.0.smithi059.stdout:8/409: rename d7/dd/d17/f42 to d7/dd/f83 0 2024-04-25T16:19:49.820 INFO:tasks.workunit.client.0.smithi059.stdout:8/410: write d7/d16/f52 [1109957,105335] 0 2024-04-25T16:19:49.828 INFO:tasks.workunit.client.0.smithi059.stdout:2/434: rmdir de/d2a/d2e/d36/d59 39 2024-04-25T16:19:49.850 INFO:tasks.workunit.client.0.smithi059.stdout:2/435: chown de/d2a/d2e/c99 3716 1 2024-04-25T16:19:49.967 INFO:tasks.workunit.client.0.smithi059.stdout:5/475: creat d1/d1e/d27/d66/d70/d3d/d50/d8a/fa1 x:0 0 0 2024-04-25T16:19:50.063 INFO:tasks.workunit.client.0.smithi059.stdout:4/421: fsync d0/d4/df/d44/f4d 0 2024-04-25T16:19:50.183 INFO:tasks.workunit.client.0.smithi059.stdout:4/422: dwrite d0/d4/f4b [4194304,4194304] 0 2024-04-25T16:19:50.252 INFO:tasks.workunit.client.0.smithi059.stdout:0/425: write dc/d44/f73 [3090398,3572] 0 2024-04-25T16:19:50.256 INFO:tasks.workunit.client.0.smithi059.stdout:2/436: symlink de/d16/d3e/la0 0 2024-04-25T16:19:50.390 INFO:tasks.workunit.client.0.smithi059.stdout:5/476: creat d1/d1e/d27/d66/d70/d3d/d50/fa2 x:0 0 0 2024-04-25T16:19:50.427 INFO:tasks.workunit.client.0.smithi059.stdout:6/463: mknod d9/d27/c8f 0 2024-04-25T16:19:50.491 INFO:tasks.workunit.client.0.smithi059.stdout:5/477: sync 2024-04-25T16:19:50.718 INFO:tasks.workunit.client.0.smithi059.stdout:7/428: link d0/d7/d16/d20/d2b/d33/d79/d5d/f74 d0/d7/d16/d20/d2b/d33/f8c 0 2024-04-25T16:19:50.719 INFO:tasks.workunit.client.0.smithi059.stdout:4/423: creat d0/d4/df/d44/f88 x:0 0 0 2024-04-25T16:19:50.813 INFO:tasks.workunit.client.0.smithi059.stdout:6/464: mknod d9/d27/d39/c90 0 2024-04-25T16:19:50.879 INFO:tasks.workunit.client.0.smithi059.stdout:3/464: dwrite d0/db/d2d/f9a [0,4194304] 0 2024-04-25T16:19:50.944 INFO:tasks.workunit.client.0.smithi059.stdout:2/437: mkdir de/da1 0 2024-04-25T16:19:50.962 INFO:tasks.workunit.client.0.smithi059.stdout:0/426: creat dc/df/d5e/f8c x:0 0 0 2024-04-25T16:19:51.016 INFO:tasks.workunit.client.0.smithi059.stdout:2/438: sync 2024-04-25T16:19:51.020 INFO:tasks.workunit.client.0.smithi059.stdout:2/439: chown de/d2a 0 1 2024-04-25T16:19:51.070 INFO:tasks.workunit.client.0.smithi059.stdout:7/429: dread - d0/d7/d16/d20/d2b/d33/d79/d5d/f78 zero size 2024-04-25T16:19:51.148 INFO:tasks.workunit.client.0.smithi059.stdout:6/465: fsync d9/d16/d24/d5d/d77/f87 0 2024-04-25T16:19:51.225 INFO:tasks.workunit.client.0.smithi059.stdout:9/452: creat d6/d4e/d54/f84 x:0 0 0 2024-04-25T16:19:51.269 INFO:tasks.workunit.client.0.smithi059.stdout:3/465: creat d0/db/d47/d7e/f9c x:0 0 0 2024-04-25T16:19:51.327 INFO:tasks.workunit.client.0.smithi059.stdout:0/427: unlink dc/dd/l5a 0 2024-04-25T16:19:51.365 INFO:tasks.workunit.client.0.smithi059.stdout:2/440: truncate de/f76 617811 0 2024-04-25T16:19:51.503 INFO:tasks.workunit.client.0.smithi059.stdout:7/430: mknod d0/d3f/c8d 0 2024-04-25T16:19:51.546 INFO:tasks.workunit.client.0.smithi059.stdout:1/491: dwrite d7/d13/d2d/d41/d8f/f25 [0,4194304] 0 2024-04-25T16:19:51.632 INFO:tasks.workunit.client.0.smithi059.stdout:1/492: sync 2024-04-25T16:19:51.637 INFO:tasks.workunit.client.0.smithi059.stdout:5/478: rename d1/d1e/d27/d66/d70/d42 to d1/d48/da3 0 2024-04-25T16:19:51.787 INFO:tasks.workunit.client.0.smithi059.stdout:3/466: creat d0/db/d3f/d49/f9d x:0 0 0 2024-04-25T16:19:51.910 INFO:tasks.workunit.client.0.smithi059.stdout:7/431: fsync d0/d7/fa 0 2024-04-25T16:19:52.100 INFO:tasks.workunit.client.0.smithi059.stdout:9/453: mkdir d6/d35/d2f/d39/d85 0 2024-04-25T16:19:52.113 INFO:tasks.workunit.client.0.smithi059.stdout:9/454: dread - d6/d35/d6c/f6d zero size 2024-04-25T16:19:52.283 INFO:tasks.workunit.client.0.smithi059.stdout:3/467: unlink d0/db/f3a 0 2024-04-25T16:19:52.288 INFO:tasks.workunit.client.0.smithi059.stdout:2/441: getdents de/da1 0 2024-04-25T16:19:52.293 INFO:tasks.workunit.client.0.smithi059.stdout:7/432: symlink d0/d7/d16/d20/d2b/d33/d4c/l8e 0 2024-04-25T16:19:52.366 INFO:tasks.workunit.client.0.smithi059.stdout:7/433: sync 2024-04-25T16:19:52.377 INFO:tasks.workunit.client.0.smithi059.stdout:6/466: link d9/d16/l3a d9/d27/d39/d7b/l91 0 2024-04-25T16:19:52.408 INFO:tasks.workunit.client.0.smithi059.stdout:8/411: dwrite d7/dd/d17/d23/f2a [0,4194304] 0 2024-04-25T16:19:52.790 INFO:tasks.workunit.client.0.smithi059.stdout:3/468: symlink d0/db/d3f/d49/l9e 0 2024-04-25T16:19:52.812 INFO:tasks.workunit.client.0.smithi059.stdout:3/469: write d0/db/d3f/d49/f9d [560143,50888] 0 2024-04-25T16:19:53.046 INFO:tasks.workunit.client.0.smithi059.stdout:3/470: truncate d0/f37 317526 0 2024-04-25T16:19:53.140 INFO:tasks.workunit.client.0.smithi059.stdout:9/455: fdatasync d6/d4e/d54/d5d/f71 0 2024-04-25T16:19:53.185 INFO:tasks.workunit.client.0.smithi059.stdout:3/471: mkdir d0/db/d3f/d6c/d9f 0 2024-04-25T16:19:53.550 INFO:tasks.workunit.client.0.smithi059.stdout:1/493: write d7/d13/d16/d5c/f70 [904032,20438] 0 2024-04-25T16:19:53.555 INFO:tasks.workunit.client.0.smithi059.stdout:4/424: dwrite d0/d4/df/d1c/d45/d54/f63 [0,4194304] 0 2024-04-25T16:19:53.707 INFO:tasks.workunit.client.0.smithi059.stdout:0/428: dwrite dc/d68/f82 [0,4194304] 0 2024-04-25T16:19:53.938 INFO:tasks.workunit.client.0.smithi059.stdout:8/412: link c6 d7/dd/d17/d23/d37/d5c/c84 0 2024-04-25T16:19:53.944 INFO:tasks.workunit.client.0.smithi059.stdout:5/479: write d1/dd/f6e [207108,66864] 0 2024-04-25T16:19:53.992 INFO:tasks.workunit.client.0.smithi059.stdout:1/494: creat d7/d13/d2d/d41/d8f/fa0 x:0 0 0 2024-04-25T16:19:54.318 INFO:tasks.workunit.client.0.smithi059.stdout:6/467: write d9/f23 [591411,66681] 0 2024-04-25T16:19:54.320 INFO:tasks.workunit.client.0.smithi059.stdout:2/442: write de/d2a/d33/f89 [534700,100113] 0 2024-04-25T16:19:54.337 INFO:tasks.workunit.client.0.smithi059.stdout:4/425: truncate d0/d4/df/d1c/d45/f60 909559 0 2024-04-25T16:19:54.387 INFO:tasks.workunit.client.0.smithi059.stdout:9/456: creat d6/d4e/d54/d5d/d48/f86 x:0 0 0 2024-04-25T16:19:54.388 INFO:tasks.workunit.client.0.smithi059.stdout:8/413: mkdir d7/d2f/d76/d85 0 2024-04-25T16:19:54.439 INFO:tasks.workunit.client.0.smithi059.stdout:9/457: chown d6/d35 0 1 2024-04-25T16:19:54.520 INFO:tasks.workunit.client.0.smithi059.stdout:6/468: dread d9/d1b/f48 [0,4194304] 0 2024-04-25T16:19:54.534 INFO:tasks.workunit.client.0.smithi059.stdout:7/434: dwrite d0/f27 [0,4194304] 0 2024-04-25T16:19:54.708 INFO:tasks.workunit.client.0.smithi059.stdout:4/426: symlink d0/d4/df/d1c/d45/l89 0 2024-04-25T16:19:54.737 INFO:tasks.workunit.client.0.smithi059.stdout:3/472: write d0/db/f30 [8545498,107475] 0 2024-04-25T16:19:54.970 INFO:tasks.workunit.client.0.smithi059.stdout:9/458: symlink d6/d4e/d54/d5d/d48/d6e/l87 0 2024-04-25T16:19:55.052 INFO:tasks.workunit.client.0.smithi059.stdout:6/469: creat d9/d27/d39/f92 x:0 0 0 2024-04-25T16:19:55.171 INFO:tasks.workunit.client.0.smithi059.stdout:8/414: mknod d7/d2f/c86 0 2024-04-25T16:19:55.199 INFO:tasks.workunit.client.0.smithi059.stdout:6/470: dread d9/d16/f26 [4194304,4194304] 0 2024-04-25T16:19:55.353 INFO:tasks.workunit.client.0.smithi059.stdout:3/473: truncate d0/db/d47/f26 310584 0 2024-04-25T16:19:55.360 INFO:tasks.workunit.client.0.smithi059.stdout:5/480: link d1/d1e/d27/d66/d70/d3d/d44/d79/f90 d1/d1e/d27/d66/d70/d3d/d44/fa4 0 2024-04-25T16:19:55.361 INFO:tasks.workunit.client.0.smithi059.stdout:1/495: symlink d7/la1 0 2024-04-25T16:19:55.466 INFO:tasks.workunit.client.0.smithi059.stdout:3/474: sync 2024-04-25T16:19:55.511 INFO:tasks.workunit.client.0.smithi059.stdout:7/435: mknod d0/d7/d16/d20/d2b/d33/d79/d5d/d85/c8f 0 2024-04-25T16:19:55.533 INFO:tasks.workunit.client.0.smithi059.stdout:3/475: dread d0/f6 [0,4194304] 0 2024-04-25T16:19:55.592 INFO:tasks.workunit.client.0.smithi059.stdout:3/476: sync 2024-04-25T16:19:55.624 INFO:tasks.workunit.client.0.smithi059.stdout:0/429: write dc/d37/d47/d71/f7a [768539,59713] 0 2024-04-25T16:19:55.660 INFO:tasks.workunit.client.0.smithi059.stdout:6/471: creat d9/d16/d53/d55/f93 x:0 0 0 2024-04-25T16:19:55.725 INFO:tasks.workunit.client.0.smithi059.stdout:5/481: creat d1/dd/fa5 x:0 0 0 2024-04-25T16:19:55.759 INFO:tasks.workunit.client.0.smithi059.stdout:1/496: rmdir d7/d13/d6a 39 2024-04-25T16:19:55.799 INFO:tasks.workunit.client.0.smithi059.stdout:5/482: sync 2024-04-25T16:19:55.825 INFO:tasks.workunit.client.0.smithi059.stdout:2/443: dwrite de/f1d [0,4194304] 0 2024-04-25T16:19:56.042 INFO:tasks.workunit.client.0.smithi059.stdout:0/430: unlink dc/df/f10 0 2024-04-25T16:19:56.140 INFO:tasks.workunit.client.0.smithi059.stdout:6/472: dread d9/d16/d24/f2b [0,4194304] 0 2024-04-25T16:19:56.183 INFO:tasks.workunit.client.0.smithi059.stdout:1/497: dread d7/d93/f4f [0,4194304] 0 2024-04-25T16:19:56.226 INFO:tasks.workunit.client.0.smithi059.stdout:5/483: creat d1/d1e/d27/d66/d70/d24/fa6 x:0 0 0 2024-04-25T16:19:56.281 INFO:tasks.workunit.client.0.smithi059.stdout:2/444: symlink de/d16/d3e/la2 0 2024-04-25T16:19:56.317 INFO:tasks.workunit.client.0.smithi059.stdout:9/459: write d6/d4e/d54/d5d/d48/f78 [1571705,95917] 0 2024-04-25T16:19:56.359 INFO:tasks.workunit.client.0.smithi059.stdout:3/477: unlink d0/ce 0 2024-04-25T16:19:56.473 INFO:tasks.workunit.client.0.smithi059.stdout:0/431: rename dc/d37/f4b to dc/d37/d47/d71/f8d 0 2024-04-25T16:19:56.579 INFO:tasks.workunit.client.0.smithi059.stdout:6/473: fdatasync d9/d16/f42 0 2024-04-25T16:19:56.650 INFO:tasks.workunit.client.0.smithi059.stdout:1/498: creat d7/d93/d8e/fa2 x:0 0 0 2024-04-25T16:19:56.740 INFO:tasks.workunit.client.0.smithi059.stdout:8/415: dwrite d7/dd/d33/f41 [0,4194304] 0 2024-04-25T16:19:56.948 INFO:tasks.workunit.client.0.smithi059.stdout:2/445: truncate de/d16/f6b 4706152 0 2024-04-25T16:19:56.972 INFO:tasks.workunit.client.0.smithi059.stdout:7/436: dwrite d0/f88 [0,4194304] 0 2024-04-25T16:19:57.059 INFO:tasks.workunit.client.0.smithi059.stdout:9/460: mknod d6/d4e/d7a/c88 0 2024-04-25T16:19:57.168 INFO:tasks.workunit.client.0.smithi059.stdout:0/432: symlink dc/d68/l8e 0 2024-04-25T16:19:57.235 INFO:tasks.workunit.client.0.smithi059.stdout:4/427: link d0/d4/df/d48/l50 d0/d4/df/l8a 0 2024-04-25T16:19:57.332 INFO:tasks.workunit.client.0.smithi059.stdout:6/474: fsync f6 0 2024-04-25T16:19:57.531 INFO:tasks.workunit.client.0.smithi059.stdout:1/499: dread d7/d13/d16/d7f/f80 [8388608,4194304] 0 2024-04-25T16:19:57.543 INFO:tasks.workunit.client.0.smithi059.stdout:8/416: dread d7/f1c [0,4194304] 0 2024-04-25T16:19:57.555 INFO:tasks.workunit.client.0.smithi059.stdout:7/437: symlink d0/d7/d16/d20/d2b/d33/d79/l90 0 2024-04-25T16:19:57.580 INFO:tasks.workunit.client.0.smithi059.stdout:8/417: readlink d7/d2f/d43/l75 0 2024-04-25T16:19:58.133 INFO:tasks.workunit.client.0.smithi059.stdout:3/478: dwrite d0/db/d2d/f87 [8388608,4194304] 0 2024-04-25T16:19:58.213 INFO:tasks.workunit.client.0.smithi059.stdout:3/479: rename d0/db/d3f/d49/d65 to d0/db/d3f/d49/d65/da0 22 2024-04-25T16:19:58.313 INFO:tasks.workunit.client.0.smithi059.stdout:4/428: rmdir d0/d4/df/d1c/d45/d54/d75 39 2024-04-25T16:19:58.402 INFO:tasks.workunit.client.0.smithi059.stdout:4/429: dwrite d0/d4/df/d1c/d45/d54/f63 [0,4194304] 0 2024-04-25T16:19:58.554 INFO:tasks.workunit.client.0.smithi059.stdout:4/430: dread d0/d4/df/f19 [0,4194304] 0 2024-04-25T16:19:58.827 INFO:tasks.workunit.client.0.smithi059.stdout:3/480: stat d0/db/d3f/d49/d65/c97 0 2024-04-25T16:19:58.933 INFO:tasks.workunit.client.0.smithi059.stdout:3/481: sync 2024-04-25T16:19:59.074 INFO:tasks.workunit.client.0.smithi059.stdout:6/475: link d9/d16/f1f d9/d16/d54/f94 0 2024-04-25T16:19:59.212 INFO:tasks.workunit.client.0.smithi059.stdout:5/484: getdents d1/d1e/d27/d66/d70/d3d 0 2024-04-25T16:19:59.262 INFO:tasks.workunit.client.0.smithi059.stdout:1/500: mkdir d7/d13/d77/da3 0 2024-04-25T16:19:59.309 INFO:tasks.workunit.client.0.smithi059.stdout:7/438: symlink d0/d7/d16/l91 0 2024-04-25T16:19:59.417 INFO:tasks.workunit.client.0.smithi059.stdout:8/418: mkdir d7/dd/d17/d23/d37/d5c/d87 0 2024-04-25T16:19:59.539 INFO:tasks.workunit.client.0.smithi059.stdout:5/485: dread d1/dd/f8e [0,4194304] 0 2024-04-25T16:19:59.753 INFO:tasks.workunit.client.0.smithi059.stdout:2/446: truncate de/d16/f6b 2255938 0 2024-04-25T16:19:59.962 INFO:tasks.workunit.client.0.smithi059.stdout:7/439: fdatasync d0/d7/d16/d20/d2b/d33/d4c/d4e/f66 0 2024-04-25T16:19:59.977 INFO:tasks.workunit.client.0.smithi059.stdout:7/440: stat d0/d7/d16/d5a/f80 0 2024-04-25T16:19:59.983 INFO:tasks.workunit.client.0.smithi059.stdout:8/419: truncate d7/f1f 1895451 0 2024-04-25T16:20:00.023 INFO:tasks.workunit.client.0.smithi059.stdout:0/433: truncate dc/df/d24/f6d 1009866 0 2024-04-25T16:20:00.106 INFO:tasks.workunit.client.0.smithi059.stdout:4/431: rename d0/d4/df/d44/f88 to d0/d4/df/f8b 0 2024-04-25T16:20:00.199 INFO:tasks.workunit.client.0.smithi059.stdout:4/432: sync 2024-04-25T16:20:00.230 INFO:tasks.workunit.client.0.smithi059.stdout:9/461: rename d6/l80 to d6/l89 0 2024-04-25T16:20:00.323 INFO:tasks.workunit.client.0.smithi059.stdout:7/441: symlink d0/d7/d51/l92 0 2024-04-25T16:20:00.412 INFO:tasks.workunit.client.0.smithi059.stdout:0/434: rmdir dc/d68 39 2024-04-25T16:20:00.468 INFO:tasks.workunit.client.0.smithi059.stdout:6/476: creat d9/f95 x:0 0 0 2024-04-25T16:20:00.623 INFO:tasks.workunit.client.0.smithi059.stdout:2/447: fsync de/d2a/d2e/d36/d59/f61 0 2024-04-25T16:20:00.628 INFO:tasks.workunit.client.0.smithi059.stdout:1/501: creat d7/d13/fa4 x:0 0 0 2024-04-25T16:20:00.702 INFO:tasks.workunit.client.0.smithi059.stdout:4/433: truncate d0/d4/f1b 3907678 0 2024-04-25T16:20:00.714 INFO:tasks.workunit.client.0.smithi059.stdout:3/482: getdents d0/db/d3f 0 2024-04-25T16:20:00.775 INFO:tasks.workunit.client.0.smithi059.stdout:9/462: rename d6/d35/f29 to d6/d4e/f8a 0 2024-04-25T16:20:01.245 INFO:tasks.workunit.client.0.smithi059.stdout:5/486: link d1/f15 d1/d1e/d27/d66/fa7 0 2024-04-25T16:20:01.419 INFO:tasks.workunit.client.0.smithi059.stdout:2/448: dread de/d16/f79 [0,4194304] 0 2024-04-25T16:20:01.441 INFO:tasks.workunit.client.0.smithi059.stdout:4/434: chown d0/d4/df/d1c/l7a 6723 1 2024-04-25T16:20:01.534 INFO:tasks.workunit.client.0.smithi059.stdout:3/483: symlink d0/db/d3f/d49/la1 0 2024-04-25T16:20:01.562 INFO:tasks.workunit.client.0.smithi059.stdout:8/420: write d7/d16/d3a/f50 [268396,93596] 0 2024-04-25T16:20:01.645 INFO:tasks.workunit.client.0.smithi059.stdout:8/421: dread d7/dd/ff [0,4194304] 0 2024-04-25T16:20:02.021 INFO:tasks.workunit.client.0.smithi059.stdout:1/502: truncate d7/d13/d2d/d4a/f4b 210187 0 2024-04-25T16:20:02.119 INFO:tasks.workunit.client.0.smithi059.stdout:2/449: dread de/d16/f32 [0,4194304] 0 2024-04-25T16:20:02.161 INFO:tasks.workunit.client.0.smithi059.stdout:7/442: creat d0/d7/d16/d20/d2b/d33/f93 x:0 0 0 2024-04-25T16:20:02.230 INFO:tasks.workunit.client.0.smithi059.stdout:6/477: rename d9/l15 to d9/l96 0 2024-04-25T16:20:02.309 INFO:tasks.workunit.client.0.smithi059.stdout:0/435: dwrite dc/d37/d47/f64 [0,4194304] 0 2024-04-25T16:20:02.460 INFO:tasks.workunit.client.0.smithi059.stdout:2/450: stat de/d2a/d2e/d6a/f8f 0 2024-04-25T16:20:02.542 INFO:tasks.workunit.client.0.smithi059.stdout:9/463: creat d6/d4e/d54/f8b x:0 0 0 2024-04-25T16:20:02.580 INFO:tasks.workunit.client.0.smithi059.stdout:1/503: dread d7/d13/f92 [0,4194304] 0 2024-04-25T16:20:02.584 INFO:tasks.workunit.client.0.smithi059.stdout:3/484: fdatasync d0/f37 0 2024-04-25T16:20:02.643 INFO:tasks.workunit.client.0.smithi059.stdout:1/504: stat d7/la1 0 2024-04-25T16:20:02.665 INFO:tasks.workunit.client.0.smithi059.stdout:7/443: read d0/d7/d16/f2a [2980473,76159] 0 2024-04-25T16:20:02.692 INFO:tasks.workunit.client.0.smithi059.stdout:5/487: dwrite d1/d1e/f20 [4194304,4194304] 0 2024-04-25T16:20:02.733 INFO:tasks.workunit.client.0.smithi059.stdout:1/505: sync 2024-04-25T16:20:02.806 INFO:tasks.workunit.client.0.smithi059.stdout:6/478: read - d9/d1b/f73 zero size 2024-04-25T16:20:03.099 INFO:tasks.workunit.client.0.smithi059.stdout:0/436: fsync dc/f3a 0 2024-04-25T16:20:03.124 INFO:tasks.workunit.client.0.smithi059.stdout:0/437: dread dc/df/f5d [0,4194304] 0 2024-04-25T16:20:03.130 INFO:tasks.workunit.client.0.smithi059.stdout:8/422: write d7/dd/f3c [1860343,129548] 0 2024-04-25T16:20:03.183 INFO:tasks.workunit.client.0.smithi059.stdout:8/423: dread d7/d16/d3a/f50 [0,4194304] 0 2024-04-25T16:20:03.404 INFO:tasks.workunit.client.0.smithi059.stdout:3/485: rename d0/d1e/d57/l60 to d0/d1e/d57/la2 0 2024-04-25T16:20:03.428 INFO:tasks.workunit.client.0.smithi059.stdout:9/464: dread d6/d4e/d54/d5d/f59 [0,4194304] 0 2024-04-25T16:20:03.691 INFO:tasks.workunit.client.0.smithi059.stdout:6/479: mkdir d9/d16/d24/d97 0 2024-04-25T16:20:03.810 INFO:tasks.workunit.client.0.smithi059.stdout:4/435: getdents d0/d4/df/d74 0 2024-04-25T16:20:03.870 INFO:tasks.workunit.client.0.smithi059.stdout:2/451: symlink de/d2a/d2e/d36/la3 0 2024-04-25T16:20:04.061 INFO:tasks.workunit.client.0.smithi059.stdout:1/506: mknod d7/d13/d2d/d4a/ca5 0 2024-04-25T16:20:04.109 INFO:tasks.workunit.client.0.smithi059.stdout:1/507: dread d7/d13/d16/f46 [0,4194304] 0 2024-04-25T16:20:04.174 INFO:tasks.workunit.client.0.smithi059.stdout:1/508: dread d7/d13/f92 [0,4194304] 0 2024-04-25T16:20:04.187 INFO:tasks.workunit.client.0.smithi059.stdout:1/509: chown d7/d2a/c5f 12915 1 2024-04-25T16:20:04.195 INFO:tasks.workunit.client.0.smithi059.stdout:1/510: chown d7/d2a/f67 58494 1 2024-04-25T16:20:04.346 INFO:tasks.workunit.client.0.smithi059.stdout:8/424: symlink d7/l88 0 2024-04-25T16:20:04.378 INFO:tasks.workunit.client.0.smithi059.stdout:2/452: dread - de/d16/d82/f84 zero size 2024-04-25T16:20:04.518 INFO:tasks.workunit.client.0.smithi059.stdout:3/486: readlink d0/d1e/d57/la2 0 2024-04-25T16:20:04.962 INFO:tasks.workunit.client.0.smithi059.stdout:8/425: creat d7/dd/d17/d23/d37/d5c/d87/f89 x:0 0 0 2024-04-25T16:20:04.970 INFO:tasks.workunit.client.0.smithi059.stdout:2/453: creat de/d5a/d9a/fa4 x:0 0 0 2024-04-25T16:20:04.986 INFO:tasks.workunit.client.0.smithi059.stdout:0/438: write dc/d44/d5f/f7e [1629627,32737] 0 2024-04-25T16:20:05.016 INFO:tasks.workunit.client.0.smithi059.stdout:9/465: write d6/d35/d28/f40 [356207,75464] 0 2024-04-25T16:20:05.044 INFO:tasks.workunit.client.0.smithi059.stdout:6/480: link d9/d27/f5f d9/d16/d53/f98 0 2024-04-25T16:20:05.055 INFO:tasks.workunit.client.0.smithi059.stdout:6/481: stat d9/c7d 0 2024-04-25T16:20:05.095 INFO:tasks.workunit.client.0.smithi059.stdout:3/487: creat d0/d1e/fa3 x:0 0 0 2024-04-25T16:20:05.165 INFO:tasks.workunit.client.0.smithi059.stdout:2/454: rename de/d16 to de/d16/da5 22 2024-04-25T16:20:05.274 INFO:tasks.workunit.client.0.smithi059.stdout:7/444: dwrite d0/d7/d16/d20/d2b/d33/d79/f7b [0,4194304] 0 2024-04-25T16:20:05.385 INFO:tasks.workunit.client.0.smithi059.stdout:6/482: rmdir d9/d16/d53/d55/d71/d7e 39 2024-04-25T16:20:05.394 INFO:tasks.workunit.client.0.smithi059.stdout:9/466: fdatasync d6/d35/d28/f69 0 2024-04-25T16:20:05.402 INFO:tasks.workunit.client.0.smithi059.stdout:0/439: dread - dc/d37/d47/d60/d6e/f8a zero size 2024-04-25T16:20:05.444 INFO:tasks.workunit.client.0.smithi059.stdout:8/426: fsync d7/dd/d17/d23/d38/f7b 0 2024-04-25T16:20:05.492 INFO:tasks.workunit.client.0.smithi059.stdout:5/488: dwrite d1/d1e/d27/d66/d70/d3d/d50/f8d [0,4194304] 0 2024-04-25T16:20:05.572 INFO:tasks.workunit.client.0.smithi059.stdout:3/488: mkdir d0/db/d47/d98/da4 0 2024-04-25T16:20:05.600 INFO:tasks.workunit.client.0.smithi059.stdout:2/455: rename de/d16/d3e/d87 to de/d16/d82/da6 0 2024-04-25T16:20:05.682 INFO:tasks.workunit.client.0.smithi059.stdout:4/436: dwrite d0/d4/f7f [0,4194304] 0 2024-04-25T16:20:05.765 INFO:tasks.workunit.client.0.smithi059.stdout:1/511: write d7/d13/f63 [413937,108649] 0 2024-04-25T16:20:05.768 INFO:tasks.workunit.client.0.smithi059.stdout:9/467: stat d6/f18 0 2024-04-25T16:20:06.034 INFO:tasks.workunit.client.0.smithi059.stdout:2/456: mkdir de/d2a/da7 0 2024-04-25T16:20:06.081 INFO:tasks.workunit.client.0.smithi059.stdout:5/489: dread d1/d1e/d27/d66/d70/d24/f5e [0,4194304] 0 2024-04-25T16:20:06.089 INFO:tasks.workunit.client.0.smithi059.stdout:5/490: chown d1/l1f 11743005 1 2024-04-25T16:20:06.220 INFO:tasks.workunit.client.0.smithi059.stdout:1/512: rename d7/d13/d16/d54 to d7/d21/d51/da6 0 2024-04-25T16:20:06.337 INFO:tasks.workunit.client.0.smithi059.stdout:6/483: symlink d9/d16/d53/d55/d71/l99 0 2024-04-25T16:20:06.464 INFO:tasks.workunit.client.0.smithi059.stdout:2/457: mkdir de/d16/d82/da8 0 2024-04-25T16:20:06.477 INFO:tasks.workunit.client.0.smithi059.stdout:3/489: write d0/d1e/f45 [403391,25797] 0 2024-04-25T16:20:06.569 INFO:tasks.workunit.client.0.smithi059.stdout:7/445: dwrite d0/d7/d16/d20/f59 [0,4194304] 0 2024-04-25T16:20:06.632 INFO:tasks.workunit.client.0.smithi059.stdout:9/468: truncate d6/d4e/d54/d5d/f75 1462895 0 2024-04-25T16:20:06.639 INFO:tasks.workunit.client.0.smithi059.stdout:1/513: truncate d7/d13/d16/f50 555001 0 2024-04-25T16:20:06.646 INFO:tasks.workunit.client.0.smithi059.stdout:0/440: link dc/d44/d5f/f7e dc/df/d24/f8f 0 2024-04-25T16:20:06.670 INFO:tasks.workunit.client.0.smithi059.stdout:1/514: chown d7/f26 1567218250 1 2024-04-25T16:20:07.025 INFO:tasks.workunit.client.0.smithi059.stdout:6/484: rename d9/d16/d53/d55/d6e/f70 to d9/d16/d53/d55/d6e/f9a 0 2024-04-25T16:20:07.041 INFO:tasks.workunit.client.0.smithi059.stdout:4/437: creat d0/f8c x:0 0 0 2024-04-25T16:20:07.061 INFO:tasks.workunit.client.0.smithi059.stdout:2/458: fsync de/d2a/d2e/d6a/f8f 0 2024-04-25T16:20:07.063 INFO:tasks.workunit.client.0.smithi059.stdout:8/427: getdents d7/d16 0 2024-04-25T16:20:07.087 INFO:tasks.workunit.client.0.smithi059.stdout:7/446: mkdir d0/d7/d16/d20/d2b/d33/d79/d5d/d94 0 2024-04-25T16:20:07.094 INFO:tasks.workunit.client.0.smithi059.stdout:1/515: mkdir d7/d13/d16/d5c/d74/da7 0 2024-04-25T16:20:07.214 INFO:tasks.workunit.client.0.smithi059.stdout:4/438: dread d0/d4/df/f19 [0,4194304] 0 2024-04-25T16:20:07.582 INFO:tasks.workunit.client.0.smithi059.stdout:0/441: write dc/df/d5e/f8c [932780,103806] 0 2024-04-25T16:20:07.628 INFO:tasks.workunit.client.0.smithi059.stdout:6/485: creat d9/d16/d53/d74/f9b x:0 0 0 2024-04-25T16:20:07.655 INFO:tasks.workunit.client.0.smithi059.stdout:1/516: creat d7/d13/d16/d5c/fa8 x:0 0 0 2024-04-25T16:20:07.687 INFO:tasks.workunit.client.0.smithi059.stdout:2/459: rename de/d2a/d2e/d36/d59/c60 to de/d2a/d2e/d6a/ca9 0 2024-04-25T16:20:07.857 INFO:tasks.workunit.client.0.smithi059.stdout:3/490: dwrite d0/db/d47/d7e/f99 [0,4194304] 0 2024-04-25T16:20:07.873 INFO:tasks.workunit.client.0.smithi059.stdout:5/491: dwrite d1/d1e/d27/d66/d70/d3d/d44/d79/f90 [4194304,4194304] 0 2024-04-25T16:20:08.035 INFO:tasks.workunit.client.0.smithi059.stdout:5/492: write d1/d1e/d27/d66/d70/d3d/d50/f8d [4917464,126735] 0 2024-04-25T16:20:08.078 INFO:tasks.workunit.client.0.smithi059.stdout:9/469: write d6/f1b [2083956,68078] 0 2024-04-25T16:20:08.136 INFO:tasks.workunit.client.0.smithi059.stdout:8/428: write d7/d16/d3a/f3e [2544238,4997] 0 2024-04-25T16:20:08.314 INFO:tasks.workunit.client.0.smithi059.stdout:7/447: dwrite d0/d7/d16/d20/d2b/d33/d4c/d4e/f66 [0,4194304] 0 2024-04-25T16:20:08.506 INFO:tasks.workunit.client.0.smithi059.stdout:0/442: dread dc/dd/f4c [0,4194304] 0 2024-04-25T16:20:08.530 INFO:tasks.workunit.client.0.smithi059.stdout:4/439: dwrite d0/d4/df/d1c/d45/d54/f63 [0,4194304] 0 2024-04-25T16:20:08.877 INFO:tasks.workunit.client.0.smithi059.stdout:8/429: creat d7/dd/d17/d23/d37/d5c/d87/f8a x:0 0 0 2024-04-25T16:20:09.015 INFO:tasks.workunit.client.0.smithi059.stdout:7/448: creat d0/d7/d16/d20/d2b/d33/d79/d5d/f95 x:0 0 0 2024-04-25T16:20:09.350 INFO:tasks.workunit.client.0.smithi059.stdout:0/443: mknod dc/dd/d3b/d66/c90 0 2024-04-25T16:20:09.468 INFO:tasks.workunit.client.0.smithi059.stdout:2/460: rename de/d2a/d2e/d36/d2c/f63 to de/d5a/d9a/faa 0 2024-04-25T16:20:09.533 INFO:tasks.workunit.client.0.smithi059.stdout:0/444: sync 2024-04-25T16:20:09.611 INFO:tasks.workunit.client.0.smithi059.stdout:5/493: link d1/d1e/d27/d66/d70/d3d/d44/d79/f90 d1/d1e/d8f/fa8 0 2024-04-25T16:20:09.745 INFO:tasks.workunit.client.0.smithi059.stdout:5/494: dread d1/d1e/d27/d66/d70/d3d/f57 [0,4194304] 0 2024-04-25T16:20:09.759 INFO:tasks.workunit.client.0.smithi059.stdout:7/449: mknod d0/d7/d16/d20/d2b/d33/d79/d5d/c96 0 2024-04-25T16:20:09.767 INFO:tasks.workunit.client.0.smithi059.stdout:1/517: creat d7/d13/d16/fa9 x:0 0 0 2024-04-25T16:20:09.816 INFO:tasks.workunit.client.0.smithi059.stdout:7/450: sync 2024-04-25T16:20:09.912 INFO:tasks.workunit.client.0.smithi059.stdout:6/486: link d9/d16/d24/f3c d9/d16/d24/d97/f9c 0 2024-04-25T16:20:09.933 INFO:tasks.workunit.client.0.smithi059.stdout:6/487: dread - d9/d16/d53/d74/f9b zero size 2024-04-25T16:20:10.001 INFO:tasks.workunit.client.0.smithi059.stdout:3/491: rmdir d0/db/d47/d98/da4 0 2024-04-25T16:20:10.036 INFO:tasks.workunit.client.0.smithi059.stdout:0/445: symlink dc/dd/d3b/d66/l91 0 2024-04-25T16:20:10.099 INFO:tasks.workunit.client.0.smithi059.stdout:9/470: dwrite d6/d4e/d54/d5d/f59 [0,4194304] 0 2024-04-25T16:20:10.326 INFO:tasks.workunit.client.0.smithi059.stdout:5/495: dread d1/d1e/d27/d66/d70/d24/f38 [0,4194304] 0 2024-04-25T16:20:10.346 INFO:tasks.workunit.client.0.smithi059.stdout:5/496: stat d1/d48/da3/d6d/f82 0 2024-04-25T16:20:10.401 INFO:tasks.workunit.client.0.smithi059.stdout:9/471: creat d6/d35/d28/f8c x:0 0 0 2024-04-25T16:20:10.496 INFO:tasks.workunit.client.0.smithi059.stdout:4/440: link d0/d4/df/f8b d0/d4/df/d1c/f8d 0 2024-04-25T16:20:10.542 INFO:tasks.workunit.client.0.smithi059.stdout:2/461: creat de/d2a/d2e/d36/fab x:0 0 0 2024-04-25T16:20:11.033 INFO:tasks.workunit.client.0.smithi059.stdout:8/430: dwrite d7/f15 [0,4194304] 0 2024-04-25T16:20:11.147 INFO:tasks.workunit.client.0.smithi059.stdout:2/462: truncate de/d2a/d2e/d36/d2c/f4e 298563 0 2024-04-25T16:20:11.237 INFO:tasks.workunit.client.0.smithi059.stdout:1/518: write d7/d93/f4f [3387595,16272] 0 2024-04-25T16:20:11.289 INFO:tasks.workunit.client.0.smithi059.stdout:7/451: getdents d0/d7/d16/d5a 0 2024-04-25T16:20:11.299 INFO:tasks.workunit.client.0.smithi059.stdout:3/492: write d0/db/d2d/f87 [895990,8846] 0 2024-04-25T16:20:11.321 INFO:tasks.workunit.client.0.smithi059.stdout:8/431: rmdir d7/d2f/d76 39 2024-04-25T16:20:11.322 INFO:tasks.workunit.client.0.smithi059.stdout:3/493: readlink d0/db/l4c 0 2024-04-25T16:20:11.409 INFO:tasks.workunit.client.0.smithi059.stdout:3/494: sync 2024-04-25T16:20:11.430 INFO:tasks.workunit.client.0.smithi059.stdout:4/441: creat d0/d4/df/d1c/d45/d54/d75/d82/f8e x:0 0 0 2024-04-25T16:20:11.465 INFO:tasks.workunit.client.0.smithi059.stdout:4/442: write d0/f8c [403263,31172] 0 2024-04-25T16:20:11.690 INFO:tasks.workunit.client.0.smithi059.stdout:2/463: creat de/d16/d82/fac x:0 0 0 2024-04-25T16:20:11.698 INFO:tasks.workunit.client.0.smithi059.stdout:0/446: getdents dc/dd/d3b 0 2024-04-25T16:20:11.717 INFO:tasks.workunit.client.0.smithi059.stdout:1/519: fdatasync d7/d13/d2d/d41/d8f/f25 0 2024-04-25T16:20:11.745 INFO:tasks.workunit.client.0.smithi059.stdout:9/472: write d6/d4e/d54/d5d/d48/f78 [1147170,4414] 0 2024-04-25T16:20:11.783 INFO:tasks.workunit.client.0.smithi059.stdout:7/452: mknod d0/d7/d16/d20/d2b/d33/d79/d5d/c97 0 2024-04-25T16:20:11.817 INFO:tasks.workunit.client.0.smithi059.stdout:3/495: fdatasync d0/f3e 0 2024-04-25T16:20:11.898 INFO:tasks.workunit.client.0.smithi059.stdout:4/443: mkdir d0/d4/df/d1c/d45/d54/d75/d82/d8f 0 2024-04-25T16:20:11.993 INFO:tasks.workunit.client.0.smithi059.stdout:6/488: dwrite d9/d1b/f8e [0,4194304] 0 2024-04-25T16:20:12.072 INFO:tasks.workunit.client.0.smithi059.stdout:5/497: dwrite d1/d1e/d27/d66/d70/d3d/f5d [4194304,4194304] 0 2024-04-25T16:20:12.179 INFO:tasks.workunit.client.0.smithi059.stdout:2/464: creat de/d5a/d7d/d80/fad x:0 0 0 2024-04-25T16:20:12.196 INFO:tasks.workunit.client.0.smithi059.stdout:0/447: symlink dc/d37/d47/d71/d77/l92 0 2024-04-25T16:20:12.491 INFO:tasks.workunit.client.0.smithi059.stdout:4/444: dread d0/d4/f1b [0,4194304] 0 2024-04-25T16:20:12.498 INFO:tasks.workunit.client.0.smithi059.stdout:5/498: creat d1/d1e/fa9 x:0 0 0 2024-04-25T16:20:12.555 INFO:tasks.workunit.client.0.smithi059.stdout:7/453: truncate d0/d7/d16/d20/d2b/f2e 4072136 0 2024-04-25T16:20:12.833 INFO:tasks.workunit.client.0.smithi059.stdout:3/496: write d0/db/f14 [1545430,104767] 0 2024-04-25T16:20:12.943 INFO:tasks.workunit.client.0.smithi059.stdout:6/489: dwrite d9/d27/f84 [0,4194304] 0 2024-04-25T16:20:13.010 INFO:tasks.workunit.client.0.smithi059.stdout:1/520: truncate d7/d93/f4f 3666752 0 2024-04-25T16:20:13.020 INFO:tasks.workunit.client.0.smithi059.stdout:6/490: readlink d9/d16/d54/l61 0 2024-04-25T16:20:13.222 INFO:tasks.workunit.client.0.smithi059.stdout:2/465: rmdir de/d2a/d2e/d36/d2c/d40/d57 39 2024-04-25T16:20:13.551 INFO:tasks.workunit.client.0.smithi059.stdout:4/445: truncate d0/f67 2688978 0 2024-04-25T16:20:13.736 INFO:tasks.workunit.client.0.smithi059.stdout:8/432: getdents d7/d16 0 2024-04-25T16:20:13.930 INFO:tasks.workunit.client.0.smithi059.stdout:6/491: read d9/d16/d53/f98 [3391773,23177] 0 2024-04-25T16:20:14.053 INFO:tasks.workunit.client.0.smithi059.stdout:9/473: link d6/d35/d2f/d39/f64 d6/d4e/d7a/f8d 0 2024-04-25T16:20:14.221 INFO:tasks.workunit.client.0.smithi059.stdout:0/448: write dc/d44/f63 [3943780,83515] 0 2024-04-25T16:20:14.621 INFO:tasks.workunit.client.0.smithi059.stdout:8/433: rename d7/dd/d17/d23/d38/d65 to d7/dd/d17/d23/d37/d8b 0 2024-04-25T16:20:14.718 INFO:tasks.workunit.client.0.smithi059.stdout:7/454: write d0/d7/f7c [447602,31117] 0 2024-04-25T16:20:14.746 INFO:tasks.workunit.client.0.smithi059.stdout:6/492: mknod d9/d27/d39/c9d 0 2024-04-25T16:20:14.870 INFO:tasks.workunit.client.0.smithi059.stdout:5/499: dwrite d1/d1e/d27/d66/d70/d3d/f57 [0,4194304] 0 2024-04-25T16:20:14.945 INFO:tasks.workunit.client.0.smithi059.stdout:2/466: write de/d16/f32 [69992,111199] 0 2024-04-25T16:20:14.990 INFO:tasks.workunit.client.0.smithi059.stdout:3/497: dwrite d0/d1e/f52 [0,4194304] 0 2024-04-25T16:20:15.045 INFO:tasks.workunit.client.0.smithi059.stdout:5/500: readlink d1/d1e/d27/l3b 0 2024-04-25T16:20:15.053 INFO:tasks.workunit.client.0.smithi059.stdout:8/434: mkdir d7/d16/d8c 0 2024-04-25T16:20:15.123 INFO:tasks.workunit.client.0.smithi059.stdout:7/455: symlink d0/d7/d16/d20/d71/d7e/l98 0 2024-04-25T16:20:15.188 INFO:tasks.workunit.client.0.smithi059.stdout:0/449: truncate dc/df/f16 3864105 0 2024-04-25T16:20:15.346 INFO:tasks.workunit.client.0.smithi059.stdout:6/493: mkdir d9/d16/d53/d55/d71/d7e/d9e 0 2024-04-25T16:20:15.355 INFO:tasks.workunit.client.0.smithi059.stdout:6/494: readlink d9/d16/d24/l67 0 2024-04-25T16:20:15.524 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:20:15.524 INFO:tasks.workunit.client.0.smithi059.stdout:0/450: truncate dc/df/f1d 2691610 0 2024-04-25T16:20:15.526 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:20:15.536 INFO:tasks.workunit.client.0.smithi059.stdout:0/451: chown dc/dd/c15 1488529 1 2024-04-25T16:20:15.618 INFO:tasks.workunit.client.0.smithi059.stdout:4/446: dwrite d0/d4/f1b [0,4194304] 0 2024-04-25T16:20:15.726 INFO:tasks.workunit.client.0.smithi059.stdout:8/435: mknod d7/dd/d17/d23/d37/d5c/c8d 0 2024-04-25T16:20:15.766 INFO:tasks.workunit.client.0.smithi059.stdout:1/521: write d7/d13/d2d/d4a/f4b [1201896,98263] 0 2024-04-25T16:20:15.823 INFO:tasks.workunit.client.0.smithi059.stdout:9/474: write d6/d4e/d54/d5d/f45 [4161134,47138] 0 2024-04-25T16:20:15.955 INFO:tasks.workunit.client.0.smithi059.stdout:9/475: sync 2024-04-25T16:20:15.970 INFO:tasks.workunit.client.0.smithi059.stdout:7/456: getdents d0/d7/d16/d20/d2b/d33/d62 0 2024-04-25T16:20:15.976 INFO:tasks.workunit.client.0.smithi059.stdout:1/522: dread d7/d13/d2d/f40 [0,4194304] 0 2024-04-25T16:20:16.004 INFO:tasks.workunit.client.0.smithi059.stdout:7/457: fsync d0/d7/f7c 0 2024-04-25T16:20:16.019 INFO:tasks.workunit.client.0.smithi059.stdout:9/476: chown d6/d4e/d54/d5d/c37 1 1 2024-04-25T16:20:16.181 INFO:tasks.workunit.client.0.smithi059.stdout:4/447: creat d0/d4/df/d1c/d45/d54/d75/f90 x:0 0 0 2024-04-25T16:20:16.183 INFO:tasks.workunit.client.0.smithi059.stdout:8/436: truncate d7/dd/d17/d23/d37/f44 2246361 0 2024-04-25T16:20:16.209 INFO:tasks.workunit.client.0.smithi059.stdout:2/467: getdents de/d2a/d33 0 2024-04-25T16:20:16.257 INFO:tasks.workunit.client.0.smithi059.stdout:0/452: mkdir dc/d37/d93 0 2024-04-25T16:20:16.372 INFO:tasks.workunit.client.0.smithi059.stdout:5/501: write d1/d1e/d27/d66/d70/d3d/f55 [1586339,89049] 0 2024-04-25T16:20:16.378 INFO:tasks.workunit.client.0.smithi059.stdout:3/498: dwrite d0/d1e/f90 [0,4194304] 0 2024-04-25T16:20:16.476 INFO:tasks.workunit.client.0.smithi059.stdout:6/495: write d9/d1b/d58/f76 [870340,124813] 0 2024-04-25T16:20:16.554 INFO:tasks.workunit.client.0.smithi059.stdout:8/437: unlink d7/dd/f5b 0 2024-04-25T16:20:16.647 INFO:tasks.workunit.client.0.smithi059.stdout:0/453: read dc/d37/d47/f64 [3864049,101426] 0 2024-04-25T16:20:16.774 INFO:tasks.workunit.client.0.smithi059.stdout:9/477: mknod d6/c8e 0 2024-04-25T16:20:16.941 INFO:tasks.workunit.client.0.smithi059.stdout:3/499: creat d0/db/d3f/d6c/fa5 x:0 0 0 2024-04-25T16:20:17.186 INFO:tasks.workunit.client.0.smithi059.stdout:1/523: dwrite d7/d13/d2d/d4a/f56 [0,4194304] 0 2024-04-25T16:20:17.243 INFO:tasks.workunit.client.0.smithi059.stdout:5/502: mkdir d1/d1e/d27/d66/d70/d75/daa 0 2024-04-25T16:20:17.254 INFO:tasks.workunit.client.0.smithi059.stdout:6/496: symlink d9/d16/d24/l9f 0 2024-04-25T16:20:17.370 INFO:tasks.workunit.client.0.smithi059.stdout:4/448: creat d0/d4/df/d1c/d45/d54/d75/d7e/f91 x:0 0 0 2024-04-25T16:20:17.402 INFO:tasks.workunit.client.0.smithi059.stdout:7/458: dwrite d0/d7/d16/d20/f59 [0,4194304] 0 2024-04-25T16:20:17.468 INFO:tasks.workunit.client.0.smithi059.stdout:2/468: rename de/d16/l17 to de/d2a/d2e/d36/d2c/d40/d57/lae 0 2024-04-25T16:20:17.499 INFO:tasks.workunit.client.0.smithi059.stdout:9/478: symlink d6/d4e/d54/d5d/d48/d49/l8f 0 2024-04-25T16:20:17.530 INFO:tasks.workunit.client.0.smithi059.stdout:9/479: chown d6 123 1 2024-04-25T16:20:17.633 INFO:tasks.workunit.client.0.smithi059.stdout:4/449: dwrite d0/d4/f1b [0,4194304] 0 2024-04-25T16:20:17.704 INFO:tasks.workunit.client.0.smithi059.stdout:1/524: read d7/d13/f63 [78035,66507] 0 2024-04-25T16:20:17.891 INFO:tasks.workunit.client.0.smithi059.stdout:6/497: creat d9/d27/d68/fa0 x:0 0 0 2024-04-25T16:20:17.894 INFO:tasks.workunit.client.0.smithi059.stdout:8/438: unlink d7/d2f/f3f 0 2024-04-25T16:20:18.023 INFO:tasks.workunit.client.0.smithi059.stdout:5/503: rename d1/c25 to d1/d1e/d27/d66/d70/d3d/cab 0 2024-04-25T16:20:18.396 INFO:tasks.workunit.client.0.smithi059.stdout:9/480: mknod d6/d35/d28/c90 0 2024-04-25T16:20:18.398 INFO:tasks.workunit.client.0.smithi059.stdout:7/459: creat d0/d7/d16/d20/d2b/d33/d4c/d5c/f99 x:0 0 0 2024-04-25T16:20:18.399 INFO:tasks.workunit.client.0.smithi059.stdout:2/469: creat de/d16/d7f/faf x:0 0 0 2024-04-25T16:20:18.443 INFO:tasks.workunit.client.0.smithi059.stdout:4/450: rmdir d0/d4/df/d1c/d45/d6f 39 2024-04-25T16:20:18.573 INFO:tasks.workunit.client.0.smithi059.stdout:4/451: dread d0/d4/df/f3a [0,4194304] 0 2024-04-25T16:20:18.605 INFO:tasks.workunit.client.0.smithi059.stdout:1/525: rename d7/d13/d16/d7f/d9c to d7/d2a/d85/daa 0 2024-04-25T16:20:18.672 INFO:tasks.workunit.client.0.smithi059.stdout:5/504: truncate d1/d48/da3/f96 4649277 0 2024-04-25T16:20:19.027 INFO:tasks.workunit.client.0.smithi059.stdout:4/452: rmdir d0/d4/df/d1c/d45/d54 39 2024-04-25T16:20:19.038 INFO:tasks.workunit.client.0.smithi059.stdout:4/453: readlink d0/d4/df/d1c/l25 0 2024-04-25T16:20:19.524 INFO:tasks.workunit.client.0.smithi059.stdout:0/454: dwrite dc/df/d24/f74 [0,4194304] 0 2024-04-25T16:20:19.708 INFO:tasks.workunit.client.0.smithi059.stdout:0/455: dread dc/f29 [0,4194304] 0 2024-04-25T16:20:19.827 INFO:tasks.workunit.client.0.smithi059.stdout:6/498: write d9/f10 [958166,110952] 0 2024-04-25T16:20:19.963 INFO:tasks.workunit.client.0.smithi059.stdout:2/470: truncate f1 2157279 0 2024-04-25T16:20:19.990 INFO:tasks.workunit.client.0.smithi059.stdout:3/500: dwrite d0/db/d2d/f46 [0,4194304] 0 2024-04-25T16:20:20.067 INFO:tasks.workunit.client.0.smithi059.stdout:8/439: dwrite d7/dd/d17/d23/f81 [0,4194304] 0 2024-04-25T16:20:20.074 INFO:tasks.workunit.client.0.smithi059.stdout:9/481: unlink d6/d4e/d54/f55 0 2024-04-25T16:20:20.180 INFO:tasks.workunit.client.0.smithi059.stdout:8/440: chown d7/dd/d17/d23/f81 1019373866 1 2024-04-25T16:20:20.332 INFO:tasks.workunit.client.0.smithi059.stdout:1/526: getdents d7/d2a/d85/daa 0 2024-04-25T16:20:20.446 INFO:tasks.workunit.client.0.smithi059.stdout:6/499: mknod d9/d16/d53/d6c/ca1 0 2024-04-25T16:20:20.617 INFO:tasks.workunit.client.0.smithi059.stdout:9/482: chown d6/d4e/d54/f73 3145047 1 2024-04-25T16:20:20.658 INFO:tasks.workunit.client.0.smithi059.stdout:8/441: dread - d7/dd/d17/d23/d37/d5c/d87/f89 zero size 2024-04-25T16:20:20.917 INFO:tasks.workunit.client.0.smithi059.stdout:5/505: unlink d1/d1e/c9a 0 2024-04-25T16:20:20.951 INFO:tasks.workunit.client.0.smithi059.stdout:6/500: fdatasync d9/d16/f26 0 2024-04-25T16:20:20.957 INFO:tasks.workunit.client.0.smithi059.stdout:7/460: creat d0/f9a x:0 0 0 2024-04-25T16:20:21.066 INFO:tasks.workunit.client.0.smithi059.stdout:0/456: dwrite dc/d37/d47/d60/f61 [0,4194304] 0 2024-04-25T16:20:21.158 INFO:tasks.workunit.client.0.smithi059.stdout:4/454: rename d0/d4/df/d1c/d45/c29 to d0/d4/df/d1c/d45/d6f/c92 0 2024-04-25T16:20:21.243 INFO:tasks.workunit.client.0.smithi059.stdout:2/471: creat de/da1/fb0 x:0 0 0 2024-04-25T16:20:21.244 INFO:tasks.workunit.client.0.smithi059.stdout:2/472: chown de/d5a/d7d/d80/fad 258663 1 2024-04-25T16:20:21.244 INFO:tasks.workunit.client.0.smithi059.stdout:2/473: readlink de/d67/l9f 0 2024-04-25T16:20:21.244 INFO:tasks.workunit.client.0.smithi059.stdout:2/474: readlink de/d2a/d2e/l23 0 2024-04-25T16:20:21.260 INFO:tasks.workunit.client.0.smithi059.stdout:9/483: mknod d6/d4e/c91 0 2024-04-25T16:20:21.294 INFO:tasks.workunit.client.0.smithi059.stdout:1/527: write d7/f22 [9366691,33473] 0 2024-04-25T16:20:21.497 INFO:tasks.workunit.client.0.smithi059.stdout:5/506: creat d1/d1e/d27/d66/fac x:0 0 0 2024-04-25T16:20:21.511 INFO:tasks.workunit.client.0.smithi059.stdout:6/501: fsync d9/d27/d39/f92 0 2024-04-25T16:20:21.549 INFO:tasks.workunit.client.0.smithi059.stdout:0/457: creat dc/d37/d47/d71/f94 x:0 0 0 2024-04-25T16:20:21.739 INFO:tasks.workunit.client.0.smithi059.stdout:3/501: rename d0/d1e/d31/c50 to d0/db/d3f/d49/d65/ca6 0 2024-04-25T16:20:21.785 INFO:tasks.workunit.client.0.smithi059.stdout:3/502: chown d0/db/d3f/d49/la1 4313891 1 2024-04-25T16:20:22.019 INFO:tasks.workunit.client.0.smithi059.stdout:1/528: write d7/d13/d16/f24 [84467,111927] 0 2024-04-25T16:20:22.049 INFO:tasks.workunit.client.0.smithi059.stdout:5/507: mkdir d1/d1e/d27/d66/d70/d3d/d44/d79/dad 0 2024-04-25T16:20:22.171 INFO:tasks.workunit.client.0.smithi059.stdout:0/458: dread dc/f7b [0,4194304] 0 2024-04-25T16:20:22.519 INFO:tasks.workunit.client.0.smithi059.stdout:8/442: creat d7/f8e x:0 0 0 2024-04-25T16:20:22.520 INFO:tasks.workunit.client.0.smithi059.stdout:4/455: truncate d0/d4/df/f8b 1046510 0 2024-04-25T16:20:22.525 INFO:tasks.workunit.client.0.smithi059.stdout:3/503: mknod d0/db/d47/d5b/ca7 0 2024-04-25T16:20:22.595 INFO:tasks.workunit.client.0.smithi059.stdout:4/456: readlink d0/d4/df/d44/l53 0 2024-04-25T16:20:22.652 INFO:tasks.workunit.client.0.smithi059.stdout:2/475: link de/d67/f72 de/d2a/d33/fb1 0 2024-04-25T16:20:22.724 INFO:tasks.workunit.client.0.smithi059.stdout:1/529: mknod d7/cab 0 2024-04-25T16:20:22.735 INFO:tasks.workunit.client.0.smithi059.stdout:5/508: dread d1/d48/da3/f96 [0,4194304] 0 2024-04-25T16:20:22.767 INFO:tasks.workunit.client.0.smithi059.stdout:8/443: chown d7/l10 15 1 2024-04-25T16:20:22.930 INFO:tasks.workunit.client.0.smithi059.stdout:3/504: fdatasync d0/d1e/f53 0 2024-04-25T16:20:23.601 INFO:tasks.workunit.client.0.smithi059.stdout:9/484: getdents d6/d4e/d7a 0 2024-04-25T16:20:23.631 INFO:tasks.workunit.client.0.smithi059.stdout:6/502: getdents d9/d16/d54 0 2024-04-25T16:20:23.802 INFO:tasks.workunit.client.0.smithi059.stdout:7/461: link d0/cc d0/c9b 0 2024-04-25T16:20:23.918 INFO:tasks.workunit.client.0.smithi059.stdout:5/509: fsync d1/d1e/d27/d66/d70/d3d/d50/d8a/f99 0 2024-04-25T16:20:23.947 INFO:tasks.workunit.client.0.smithi059.stdout:8/444: read - d7/dd/d17/d23/d37/f82 zero size 2024-04-25T16:20:24.044 INFO:tasks.workunit.client.0.smithi059.stdout:3/505: mkdir d0/d1e/d57/da8 0 2024-04-25T16:20:24.124 INFO:tasks.workunit.client.0.smithi059.stdout:9/485: readlink d6/d4e/d54/l70 0 2024-04-25T16:20:24.447 INFO:tasks.workunit.client.0.smithi059.stdout:6/503: truncate d9/d1b/f8e 3387020 0 2024-04-25T16:20:24.456 INFO:tasks.workunit.client.0.smithi059.stdout:4/457: creat d0/d79/f93 x:0 0 0 2024-04-25T16:20:24.459 INFO:tasks.workunit.client.0.smithi059.stdout:2/476: unlink de/f2d 0 2024-04-25T16:20:24.467 INFO:tasks.workunit.client.0.smithi059.stdout:7/462: creat d0/d7/d16/d20/d2b/d33/d79/f9c x:0 0 0 2024-04-25T16:20:24.515 INFO:tasks.workunit.client.0.smithi059.stdout:2/477: dread de/d16/f79 [0,4194304] 0 2024-04-25T16:20:24.557 INFO:tasks.workunit.client.0.smithi059.stdout:5/510: rename d1/d1e/d27/d66/d70/d3d/f80 to d1/d1e/d27/d66/d70/d75/fae 0 2024-04-25T16:20:24.681 INFO:tasks.workunit.client.0.smithi059.stdout:0/459: creat dc/f95 x:0 0 0 2024-04-25T16:20:24.806 INFO:tasks.workunit.client.0.smithi059.stdout:9/486: dread - d6/f7e zero size 2024-04-25T16:20:25.061 INFO:tasks.workunit.client.0.smithi059.stdout:6/504: read d9/d16/d24/d97/f9c [3005068,112123] 0 2024-04-25T16:20:25.163 INFO:tasks.workunit.client.0.smithi059.stdout:1/530: dwrite d7/d13/d16/d7f/f9e [0,4194304] 0 2024-04-25T16:20:25.167 INFO:tasks.workunit.client.0.smithi059.stdout:6/505: read d9/d16/d54/f94 [424366,77553] 0 2024-04-25T16:20:25.234 INFO:tasks.workunit.client.0.smithi059.stdout:7/463: truncate d0/d7/f7c 241229 0 2024-04-25T16:20:25.286 INFO:tasks.workunit.client.0.smithi059.stdout:8/445: write d7/d2f/d43/f6f [1039291,68603] 0 2024-04-25T16:20:25.313 INFO:tasks.workunit.client.0.smithi059.stdout:0/460: rmdir dc/d37/d47 39 2024-04-25T16:20:25.319 INFO:tasks.workunit.client.0.smithi059.stdout:0/461: readlink dc/d84/l89 0 2024-04-25T16:20:25.491 INFO:tasks.workunit.client.0.smithi059.stdout:3/506: dwrite d0/f7 [4194304,4194304] 0 2024-04-25T16:20:25.558 INFO:tasks.workunit.client.0.smithi059.stdout:4/458: dread - d0/d4/df/d1c/d45/d54/d75/d82/f8e zero size 2024-04-25T16:20:25.589 INFO:tasks.workunit.client.0.smithi059.stdout:4/459: read d0/d4/df/d48/d5f/f68 [92606,39840] 0 2024-04-25T16:20:25.595 INFO:tasks.workunit.client.0.smithi059.stdout:6/506: symlink d9/d16/d54/la2 0 2024-04-25T16:20:25.696 INFO:tasks.workunit.client.0.smithi059.stdout:5/511: mkdir d1/d1e/d27/d66/d70/d75/daa/daf 0 2024-04-25T16:20:25.704 INFO:tasks.workunit.client.0.smithi059.stdout:5/512: chown d1/dd/f6e 31024779 1 2024-04-25T16:20:25.717 INFO:tasks.workunit.client.0.smithi059.stdout:5/513: chown d1/d1e/d27/d66/d70/f22 11766 1 2024-04-25T16:20:25.851 INFO:tasks.workunit.client.0.smithi059.stdout:2/478: rename de/d2a/d33/fb1 to de/d2a/d2e/fb2 0 2024-04-25T16:20:25.913 INFO:tasks.workunit.client.0.smithi059.stdout:8/446: fsync d7/f1c 0 2024-04-25T16:20:25.978 INFO:tasks.workunit.client.0.smithi059.stdout:7/464: dread d0/d7/d16/d20/d2b/d33/d79/f7b [0,4194304] 0 2024-04-25T16:20:26.023 INFO:tasks.workunit.client.0.smithi059.stdout:9/487: dwrite d6/d35/d6c/f79 [0,4194304] 0 2024-04-25T16:20:26.059 INFO:tasks.workunit.client.0.smithi059.stdout:8/447: sync 2024-04-25T16:20:26.087 INFO:tasks.workunit.client.0.smithi059.stdout:3/507: mknod d0/db/d3f/d89/ca9 0 2024-04-25T16:20:26.095 INFO:tasks.workunit.client.0.smithi059.stdout:6/507: rmdir d9/d27/d39 39 2024-04-25T16:20:26.495 INFO:tasks.workunit.client.0.smithi059.stdout:0/462: creat dc/d68/f96 x:0 0 0 2024-04-25T16:20:26.545 INFO:tasks.workunit.client.0.smithi059.stdout:7/465: symlink d0/d3f/l9d 0 2024-04-25T16:20:26.710 INFO:tasks.workunit.client.0.smithi059.stdout:4/460: dwrite d0/d4/df/d1c/f85 [0,4194304] 0 2024-04-25T16:20:26.816 INFO:tasks.workunit.client.0.smithi059.stdout:8/448: truncate d7/dd/d33/f73 1090867 0 2024-04-25T16:20:26.863 INFO:tasks.workunit.client.0.smithi059.stdout:1/531: getdents d7/d13/d16/d7f 0 2024-04-25T16:20:26.893 INFO:tasks.workunit.client.0.smithi059.stdout:8/449: sync 2024-04-25T16:20:26.956 INFO:tasks.workunit.client.0.smithi059.stdout:3/508: dread d0/d1e/f53 [0,4194304] 0 2024-04-25T16:20:26.985 INFO:tasks.workunit.client.0.smithi059.stdout:8/450: read - d7/dd/d17/d23/d37/d5c/d87/f89 zero size 2024-04-25T16:20:27.011 INFO:tasks.workunit.client.0.smithi059.stdout:3/509: dread d0/d1e/f6e [0,4194304] 0 2024-04-25T16:20:27.056 INFO:tasks.workunit.client.0.smithi059.stdout:6/508: creat d9/d16/d53/d55/d71/d7e/d9e/fa3 x:0 0 0 2024-04-25T16:20:27.124 INFO:tasks.workunit.client.0.smithi059.stdout:9/488: dwrite d6/d4e/d54/f62 [0,4194304] 0 2024-04-25T16:20:27.134 INFO:tasks.workunit.client.0.smithi059.stdout:6/509: sync 2024-04-25T16:20:27.414 INFO:tasks.workunit.client.0.smithi059.stdout:3/510: creat d0/db/d3f/d49/faa x:0 0 0 2024-04-25T16:20:27.434 INFO:tasks.workunit.client.0.smithi059.stdout:8/451: read d7/d16/d3a/f50 [38932,84758] 0 2024-04-25T16:20:27.438 INFO:tasks.workunit.client.0.smithi059.stdout:6/510: stat d9/d16/d24/l45 0 2024-04-25T16:20:27.464 INFO:tasks.workunit.client.0.smithi059.stdout:8/452: stat d7/dd/c13 0 2024-04-25T16:20:27.541 INFO:tasks.workunit.client.0.smithi059.stdout:5/514: getdents d1 0 2024-04-25T16:20:27.548 INFO:tasks.workunit.client.0.smithi059.stdout:5/515: readlink d1/l1b 0 2024-04-25T16:20:27.592 INFO:tasks.workunit.client.0.smithi059.stdout:2/479: creat de/d2a/d2e/d36/d2c/d40/d57/d95/fb3 x:0 0 0 2024-04-25T16:20:27.948 INFO:tasks.workunit.client.0.smithi059.stdout:7/466: rename d0/d7/d16/d20/d2b/d33/d4c/d5c/f70 to d0/d7/f9e 0 2024-04-25T16:20:27.955 INFO:tasks.workunit.client.0.smithi059.stdout:8/453: mkdir d7/d16/d8f 0 2024-04-25T16:20:27.983 INFO:tasks.workunit.client.0.smithi059.stdout:7/467: chown d0/d7/d16/d20/d2b/d33/d4c/d4e/d4f/f52 5849742 1 2024-04-25T16:20:28.052 INFO:tasks.workunit.client.0.smithi059.stdout:8/454: sync 2024-04-25T16:20:28.302 INFO:tasks.workunit.client.0.smithi059.stdout:5/516: creat d1/d48/d85/fb0 x:0 0 0 2024-04-25T16:20:28.383 INFO:tasks.workunit.client.0.smithi059.stdout:2/480: unlink de/d2a/d2e/d36/c46 0 2024-04-25T16:20:28.415 INFO:tasks.workunit.client.0.smithi059.stdout:5/517: chown d1/d48/da3/d6d/f82 4883139 1 2024-04-25T16:20:28.456 INFO:tasks.workunit.client.0.smithi059.stdout:0/463: dwrite dc/d37/d47/f75 [0,4194304] 0 2024-04-25T16:20:28.460 INFO:tasks.workunit.client.0.smithi059.stdout:4/461: dwrite d0/d4/df/d48/d5f/f6a [0,4194304] 0 2024-04-25T16:20:28.586 INFO:tasks.workunit.client.0.smithi059.stdout:5/518: stat d1/dd/ff 0 2024-04-25T16:20:28.587 INFO:tasks.workunit.client.0.smithi059.stdout:9/489: write d6/d4e/d54/d5d/d48/d49/f5c [3265797,63498] 0 2024-04-25T16:20:28.770 INFO:tasks.workunit.client.0.smithi059.stdout:1/532: rename d7/d13/d2d/d4a/f91 to d7/d13/d16/d72/fac 0 2024-04-25T16:20:28.927 INFO:tasks.workunit.client.0.smithi059.stdout:2/481: stat de/d16/d7f/l85 0 2024-04-25T16:20:28.991 INFO:tasks.workunit.client.0.smithi059.stdout:0/464: fsync dc/d44/f50 0 2024-04-25T16:20:29.139 INFO:tasks.workunit.client.0.smithi059.stdout:9/490: mknod d6/d4e/d54/d5d/d48/d49/c92 0 2024-04-25T16:20:29.207 INFO:tasks.workunit.client.0.smithi059.stdout:3/511: creat d0/db/d2d/fab x:0 0 0 2024-04-25T16:20:29.271 INFO:tasks.workunit.client.0.smithi059.stdout:9/491: dread d6/d35/d28/f50 [0,4194304] 0 2024-04-25T16:20:29.305 INFO:tasks.workunit.client.0.smithi059.stdout:4/462: rename d0/l6 to d0/d79/l94 0 2024-04-25T16:20:29.354 INFO:tasks.workunit.client.0.smithi059.stdout:1/533: rmdir d7/d93/d8e 39 2024-04-25T16:20:29.386 INFO:tasks.workunit.client.0.smithi059.stdout:9/492: dwrite d6/d4e/d54/f62 [0,4194304] 0 2024-04-25T16:20:29.451 INFO:tasks.workunit.client.0.smithi059.stdout:8/455: creat d7/d16/d8c/f90 x:0 0 0 2024-04-25T16:20:29.476 INFO:tasks.workunit.client.0.smithi059.stdout:9/493: chown d6/d4e/c91 5 1 2024-04-25T16:20:29.490 INFO:tasks.workunit.client.0.smithi059.stdout:9/494: fdatasync d6/d35/d2f/d39/f64 0 2024-04-25T16:20:29.676 INFO:tasks.workunit.client.0.smithi059.stdout:3/512: fsync d0/ff 0 2024-04-25T16:20:29.856 INFO:tasks.workunit.client.0.smithi059.stdout:6/511: getdents d9/d16/d53/d74 0 2024-04-25T16:20:30.058 INFO:tasks.workunit.client.0.smithi059.stdout:7/468: write d0/d7/d16/d20/d2b/d33/d79/d5d/f95 [665327,49534] 0 2024-04-25T16:20:30.125 INFO:tasks.workunit.client.0.smithi059.stdout:3/513: dread d0/db/d47/d7e/f99 [0,4194304] 0 2024-04-25T16:20:30.135 INFO:tasks.workunit.client.0.smithi059.stdout:3/514: stat d0/db/d47/c84 0 2024-04-25T16:20:30.181 INFO:tasks.workunit.client.0.smithi059.stdout:3/515: dread d0/d1e/f53 [0,4194304] 0 2024-04-25T16:20:30.193 INFO:tasks.workunit.client.0.smithi059.stdout:3/516: chown d0/db/d47/f8b 12899 1 2024-04-25T16:20:30.266 INFO:tasks.workunit.client.0.smithi059.stdout:1/534: getdents d7/d13/d16/d7f 0 2024-04-25T16:20:30.277 INFO:tasks.workunit.client.0.smithi059.stdout:1/535: readlink d7/d13/d2d/d41/d8f/l90 0 2024-04-25T16:20:30.411 INFO:tasks.workunit.client.0.smithi059.stdout:6/512: mknod d9/d16/ca4 0 2024-04-25T16:20:30.416 INFO:tasks.workunit.client.0.smithi059.stdout:9/495: symlink d6/d4e/d54/d5d/d48/l93 0 2024-04-25T16:20:30.502 INFO:tasks.workunit.client.0.smithi059.stdout:6/513: sync 2024-04-25T16:20:30.514 INFO:tasks.workunit.client.0.smithi059.stdout:6/514: stat d9/d16/d53/d55/d71/d7e/c85 0 2024-04-25T16:20:30.524 INFO:tasks.workunit.client.0.smithi059.stdout:6/515: stat d9/d16/d53/d55/l89 0 2024-04-25T16:20:30.624 INFO:tasks.workunit.client.0.smithi059.stdout:3/517: creat d0/db/d3f/d6c/fac x:0 0 0 2024-04-25T16:20:30.633 INFO:tasks.workunit.client.0.smithi059.stdout:9/496: truncate d6/d4e/d54/f73 177426 0 2024-04-25T16:20:30.892 INFO:tasks.workunit.client.0.smithi059.stdout:6/516: mkdir d9/d27/d39/da5 0 2024-04-25T16:20:31.006 INFO:tasks.workunit.client.0.smithi059.stdout:5/519: write d1/d1e/d27/d66/d70/d75/f7d [354030,105574] 0 2024-04-25T16:20:31.014 INFO:tasks.workunit.client.0.smithi059.stdout:3/518: dread d0/db/d47/f2e [0,4194304] 0 2024-04-25T16:20:31.107 INFO:tasks.workunit.client.0.smithi059.stdout:9/497: mknod d6/d35/d2f/c94 0 2024-04-25T16:20:31.109 INFO:tasks.workunit.client.0.smithi059.stdout:0/465: dwrite f9 [0,4194304] 0 2024-04-25T16:20:31.187 INFO:tasks.workunit.client.0.smithi059.stdout:8/456: write d7/d2f/f53 [7572525,117105] 0 2024-04-25T16:20:31.200 INFO:tasks.workunit.client.0.smithi059.stdout:7/469: getdents d0/d7/d16/d20/d2b/d33/d4c/d4e 0 2024-04-25T16:20:31.297 INFO:tasks.workunit.client.0.smithi059.stdout:4/463: dwrite d0/d4/df/d44/f4d [0,4194304] 0 2024-04-25T16:20:31.373 INFO:tasks.workunit.client.0.smithi059.stdout:3/519: symlink d0/d1e/d57/lad 0 2024-04-25T16:20:31.422 INFO:tasks.workunit.client.0.smithi059.stdout:4/464: stat d0/d4/df/f19 0 2024-04-25T16:20:31.530 INFO:tasks.workunit.client.0.smithi059.stdout:2/482: dwrite de/d2a/d2e/d36/d2c/f4e [0,4194304] 0 2024-04-25T16:20:31.632 INFO:tasks.workunit.client.0.smithi059.stdout:5/520: rename d1/dd/ff to d1/d48/d85/fb1 0 2024-04-25T16:20:31.748 INFO:tasks.workunit.client.0.smithi059.stdout:6/517: dwrite d9/d16/d24/f3f [0,4194304] 0 2024-04-25T16:20:31.757 INFO:tasks.workunit.client.0.smithi059.stdout:1/536: dwrite d7/d93/f4f [0,4194304] 0 2024-04-25T16:20:31.904 INFO:tasks.workunit.client.0.smithi059.stdout:0/466: mknod dc/d37/d47/d71/c97 0 2024-04-25T16:20:31.941 INFO:tasks.workunit.client.0.smithi059.stdout:2/483: symlink de/d5a/d9a/lb4 0 2024-04-25T16:20:32.012 INFO:tasks.workunit.client.0.smithi059.stdout:8/457: write d7/dd/d17/f4e [179818,67925] 0 2024-04-25T16:20:32.107 INFO:tasks.workunit.client.0.smithi059.stdout:3/520: dread d0/db/d2d/f9a [0,4194304] 0 2024-04-25T16:20:32.223 INFO:tasks.workunit.client.0.smithi059.stdout:9/498: dwrite d6/d4e/d54/d5d/d48/d49/f58 [0,4194304] 0 2024-04-25T16:20:32.300 INFO:tasks.workunit.client.0.smithi059.stdout:9/499: stat d6/d4e/c7f 0 2024-04-25T16:20:32.355 INFO:tasks.workunit.client.0.smithi059.stdout:6/518: mkdir d9/d16/d53/d6c/da6 0 2024-04-25T16:20:32.423 INFO:tasks.workunit.client.0.smithi059.stdout:9/500: dwrite d6/d4e/d54/f62 [0,4194304] 0 2024-04-25T16:20:32.497 INFO:tasks.workunit.client.0.smithi059.stdout:1/537: unlink d7/d13/d2d/l47 0 2024-04-25T16:20:32.568 INFO:tasks.workunit.client.0.smithi059.stdout:2/484: creat de/da1/fb5 x:0 0 0 2024-04-25T16:20:32.624 INFO:tasks.workunit.client.0.smithi059.stdout:4/465: dwrite d0/d4/df/d44/f83 [0,4194304] 0 2024-04-25T16:20:32.727 INFO:tasks.workunit.client.0.smithi059.stdout:4/466: sync 2024-04-25T16:20:32.746 INFO:tasks.workunit.client.0.smithi059.stdout:3/521: mkdir d0/db/d3f/d49/d65/dae 0 2024-04-25T16:20:33.044 INFO:tasks.workunit.client.0.smithi059.stdout:5/521: dwrite d1/d1e/d27/d66/d70/d3d/d50/d8a/fa1 [0,4194304] 0 2024-04-25T16:20:33.075 INFO:tasks.workunit.client.0.smithi059.stdout:7/470: dwrite d0/d7/d16/d20/d2b/d33/f39 [0,4194304] 0 2024-04-25T16:20:33.176 INFO:tasks.workunit.client.0.smithi059.stdout:0/467: dwrite dc/d37/d47/f64 [0,4194304] 0 2024-04-25T16:20:33.185 INFO:tasks.workunit.client.0.smithi059.stdout:4/467: mknod d0/d79/c95 0 2024-04-25T16:20:33.194 INFO:tasks.workunit.client.0.smithi059.stdout:3/522: fdatasync d0/d1e/f56 0 2024-04-25T16:20:33.252 INFO:tasks.workunit.client.0.smithi059.stdout:6/519: symlink d9/d27/d39/d7b/la7 0 2024-04-25T16:20:33.266 INFO:tasks.workunit.client.0.smithi059.stdout:2/485: readlink de/d2a/d2e/l23 0 2024-04-25T16:20:33.302 INFO:tasks.workunit.client.0.smithi059.stdout:2/486: chown de/d5a 1405 1 2024-04-25T16:20:33.680 INFO:tasks.workunit.client.0.smithi059.stdout:9/501: dwrite d6/d35/d28/f8c [0,4194304] 0 2024-04-25T16:20:33.743 INFO:tasks.workunit.client.0.smithi059.stdout:8/458: rmdir d7/d2f/d43/d69 0 2024-04-25T16:20:33.764 INFO:tasks.workunit.client.0.smithi059.stdout:1/538: symlink d7/d13/d2d/d4a/lad 0 2024-04-25T16:20:33.772 INFO:tasks.workunit.client.0.smithi059.stdout:9/502: chown d6/d35/d28/f50 15 1 2024-04-25T16:20:33.829 INFO:tasks.workunit.client.0.smithi059.stdout:5/522: fdatasync d1/d48/da3/d6d/f73 0 2024-04-25T16:20:33.926 INFO:tasks.workunit.client.0.smithi059.stdout:3/523: symlink d0/db/d47/laf 0 2024-04-25T16:20:33.935 INFO:tasks.workunit.client.0.smithi059.stdout:3/524: chown d0/db/d47/d98 123257 1 2024-04-25T16:20:33.959 INFO:tasks.workunit.client.0.smithi059.stdout:3/525: dread d0/db/d3f/f5e [0,4194304] 0 2024-04-25T16:20:34.034 INFO:tasks.workunit.client.0.smithi059.stdout:3/526: sync 2024-04-25T16:20:34.194 INFO:tasks.workunit.client.0.smithi059.stdout:6/520: mknod d9/d16/d53/d55/ca8 0 2024-04-25T16:20:34.376 INFO:tasks.workunit.client.0.smithi059.stdout:1/539: rmdir d7/d13/d16/d72 39 2024-04-25T16:20:34.382 INFO:tasks.workunit.client.0.smithi059.stdout:1/540: readlink d7/d2a/l4c 0 2024-04-25T16:20:34.411 INFO:tasks.workunit.client.0.smithi059.stdout:9/503: dread - d6/d4e/d54/d5d/d48/d49/f72 zero size 2024-04-25T16:20:34.463 INFO:tasks.workunit.client.0.smithi059.stdout:9/504: dread d6/d35/d28/f50 [0,4194304] 0 2024-04-25T16:20:34.511 INFO:tasks.workunit.client.0.smithi059.stdout:0/468: getdents dc/d37/d93 0 2024-04-25T16:20:34.884 INFO:tasks.workunit.client.0.smithi059.stdout:6/521: symlink d9/d16/d53/d55/d71/d7e/la9 0 2024-04-25T16:20:35.063 INFO:tasks.workunit.client.0.smithi059.stdout:5/523: mknod d1/d1e/d27/d66/d70/d3d/d50/cb2 0 2024-04-25T16:20:35.303 INFO:tasks.workunit.client.0.smithi059.stdout:4/468: dwrite d0/d4/df/d1c/f37 [0,4194304] 0 2024-04-25T16:20:35.414 INFO:tasks.workunit.client.0.smithi059.stdout:2/487: getdents de/d5a 0 2024-04-25T16:20:35.535 INFO:tasks.workunit.client.0.smithi059.stdout:5/524: fdatasync d1/d48/da3/f81 0 2024-04-25T16:20:35.548 INFO:tasks.workunit.client.0.smithi059.stdout:5/525: chown d1/d48/da3/f96 979 1 2024-04-25T16:20:35.657 INFO:tasks.workunit.client.0.smithi059.stdout:6/522: mknod d9/d16/d53/d55/d71/caa 0 2024-04-25T16:20:35.666 INFO:tasks.workunit.client.0.smithi059.stdout:6/523: chown d9/d1b/f80 463694 1 2024-04-25T16:20:35.805 INFO:tasks.workunit.client.0.smithi059.stdout:9/505: getdents d6/d35/d26/d6b 0 2024-04-25T16:20:35.887 INFO:tasks.workunit.client.0.smithi059.stdout:2/488: mknod de/d2a/d2e/d36/d2c/d40/d57/d95/cb6 0 2024-04-25T16:20:35.993 INFO:tasks.workunit.client.0.smithi059.stdout:5/526: creat d1/d1e/d27/fb3 x:0 0 0 2024-04-25T16:20:36.088 INFO:tasks.workunit.client.0.smithi059.stdout:8/459: link d7/dd/d17/d23/d37/f44 d7/f91 0 2024-04-25T16:20:36.120 INFO:tasks.workunit.client.0.smithi059.stdout:1/541: getdents d7/d13/d2d/d4a 0 2024-04-25T16:20:36.172 INFO:tasks.workunit.client.0.smithi059.stdout:7/471: rmdir d0/d7/d16/d20/d2b/d33/d62 0 2024-04-25T16:20:36.275 INFO:tasks.workunit.client.0.smithi059.stdout:3/527: write d0/db/d2d/f3c [4448883,86290] 0 2024-04-25T16:20:36.360 INFO:tasks.workunit.client.0.smithi059.stdout:9/506: dwrite d6/d4e/d54/d5d/d48/d49/f5c [0,4194304] 0 2024-04-25T16:20:36.424 INFO:tasks.workunit.client.0.smithi059.stdout:5/527: dread - d1/d1e/d27/d66/fac zero size 2024-04-25T16:20:36.451 INFO:tasks.workunit.client.0.smithi059.stdout:0/469: rmdir dc/d6a 0 2024-04-25T16:20:36.517 INFO:tasks.workunit.client.0.smithi059.stdout:8/460: symlink d7/dd/d17/d23/d37/d8b/d7d/l92 0 2024-04-25T16:20:36.723 INFO:tasks.workunit.client.0.smithi059.stdout:4/469: write d0/f8c [1210003,84846] 0 2024-04-25T16:20:36.881 INFO:tasks.workunit.client.0.smithi059.stdout:5/528: dread d1/dd/f13 [0,4194304] 0 2024-04-25T16:20:36.887 INFO:tasks.workunit.client.0.smithi059.stdout:5/529: readlink d1/l1f 0 2024-04-25T16:20:36.932 INFO:tasks.workunit.client.0.smithi059.stdout:2/489: creat de/d2a/d2e/fb7 x:0 0 0 2024-04-25T16:20:37.011 INFO:tasks.workunit.client.0.smithi059.stdout:7/472: mkdir d0/d7/d16/d20/d2b/d33/d9f 0 2024-04-25T16:20:37.040 INFO:tasks.workunit.client.0.smithi059.stdout:6/524: write d9/f21 [4230670,10015] 0 2024-04-25T16:20:37.054 INFO:tasks.workunit.client.0.smithi059.stdout:7/473: rename d0/d7/d16/d20/d2b/d33/d87 to d0/d7/d16/d20/d2b/d33/d87/da0 22 2024-04-25T16:20:37.159 INFO:tasks.workunit.client.0.smithi059.stdout:1/542: truncate d7/d13/d16/f50 1081031 0 2024-04-25T16:20:37.347 INFO:tasks.workunit.client.0.smithi059.stdout:5/530: unlink d1/d1e/d27/d66/d70/d24/f5e 0 2024-04-25T16:20:37.355 INFO:tasks.workunit.client.0.smithi059.stdout:5/531: readlink d1/d1e/d27/l3b 0 2024-04-25T16:20:37.466 INFO:tasks.workunit.client.0.smithi059.stdout:9/507: write d6/d4e/d54/d5d/d48/d49/f7c [985492,108244] 0 2024-04-25T16:20:37.531 INFO:tasks.workunit.client.0.smithi059.stdout:3/528: dwrite d0/db/d3f/f5e [0,4194304] 0 2024-04-25T16:20:37.709 INFO:tasks.workunit.client.0.smithi059.stdout:4/470: dwrite d0/d4/f7f [0,4194304] 0 2024-04-25T16:20:37.839 INFO:tasks.workunit.client.0.smithi059.stdout:2/490: symlink de/d2a/d2e/d36/d2c/lb8 0 2024-04-25T16:20:37.916 INFO:tasks.workunit.client.0.smithi059.stdout:0/470: link dc/d84/l89 dc/dd/l98 0 2024-04-25T16:20:37.928 INFO:tasks.workunit.client.0.smithi059.stdout:8/461: creat d7/f93 x:0 0 0 2024-04-25T16:20:37.947 INFO:tasks.workunit.client.0.smithi059.stdout:3/529: symlink d0/db/d3f/d89/lb0 0 2024-04-25T16:20:38.029 INFO:tasks.workunit.client.0.smithi059.stdout:7/474: dread d0/d7/d16/f44 [0,4194304] 0 2024-04-25T16:20:38.036 INFO:tasks.workunit.client.0.smithi059.stdout:8/462: chown d7/dd/d17/d23/d37 1168391 1 2024-04-25T16:20:38.136 INFO:tasks.workunit.client.0.smithi059.stdout:7/475: sync 2024-04-25T16:20:38.137 INFO:tasks.workunit.client.0.smithi059.stdout:6/525: creat d9/d16/d53/d6c/da6/fab x:0 0 0 2024-04-25T16:20:38.154 INFO:tasks.workunit.client.0.smithi059.stdout:1/543: unlink d7/d13/d2d/d41/c6f 0 2024-04-25T16:20:38.156 INFO:tasks.workunit.client.0.smithi059.stdout:9/508: mkdir d6/d4e/d54/d5d/d95 0 2024-04-25T16:20:38.177 INFO:tasks.workunit.client.0.smithi059.stdout:2/491: read de/d2a/d2e/f58 [2909018,7037] 0 2024-04-25T16:20:38.210 INFO:tasks.workunit.client.0.smithi059.stdout:9/509: sync 2024-04-25T16:20:38.277 INFO:tasks.workunit.client.0.smithi059.stdout:9/510: sync 2024-04-25T16:20:38.811 INFO:tasks.workunit.client.0.smithi059.stdout:0/471: mknod dc/d37/d47/d60/c99 0 2024-04-25T16:20:39.049 INFO:tasks.workunit.client.0.smithi059.stdout:6/526: fsync d9/d1b/f48 0 2024-04-25T16:20:39.061 INFO:tasks.workunit.client.0.smithi059.stdout:4/471: write d0/d4/df/d1c/d45/f62 [976275,63656] 0 2024-04-25T16:20:39.096 INFO:tasks.workunit.client.0.smithi059.stdout:7/476: stat d0/d7/d16/d20/d2b/d33/f8c 0 2024-04-25T16:20:39.134 INFO:tasks.workunit.client.0.smithi059.stdout:5/532: dwrite d1/d1e/d27/d66/d70/d24/f38 [0,4194304] 0 2024-04-25T16:20:39.203 INFO:tasks.workunit.client.0.smithi059.stdout:4/472: chown d0/d4/df/d74/f78 16 1 2024-04-25T16:20:39.210 INFO:tasks.workunit.client.0.smithi059.stdout:2/492: creat de/d2a/d2e/d36/d2c/d40/d57/d95/fb9 x:0 0 0 2024-04-25T16:20:39.244 INFO:tasks.workunit.client.0.smithi059.stdout:9/511: creat d6/d35/d26/f96 x:0 0 0 2024-04-25T16:20:39.397 INFO:tasks.workunit.client.0.smithi059.stdout:0/472: rename dc/df/d24/f8f to dc/d84/f9a 0 2024-04-25T16:20:39.879 INFO:tasks.workunit.client.0.smithi059.stdout:8/463: truncate d7/f1f 2610985 0 2024-04-25T16:20:39.884 INFO:tasks.workunit.client.0.smithi059.stdout:4/473: mknod d0/d4/df/d48/c96 0 2024-04-25T16:20:39.898 INFO:tasks.workunit.client.0.smithi059.stdout:2/493: truncate de/d2a/d2e/d36/d2c/d40/d57/f71 425476 0 2024-04-25T16:20:39.920 INFO:tasks.workunit.client.0.smithi059.stdout:9/512: read d6/f47 [70585,65154] 0 2024-04-25T16:20:40.204 INFO:tasks.workunit.client.0.smithi059.stdout:6/527: rename d9/d16/d53/d55/d71/d7e/d9e/fa3 to d9/d16/d53/d74/fac 0 2024-04-25T16:20:40.222 INFO:tasks.workunit.client.0.smithi059.stdout:3/530: write d0/db/d47/f2e [1321319,90265] 0 2024-04-25T16:20:40.397 INFO:tasks.workunit.client.0.smithi059.stdout:9/513: truncate d6/d35/d28/f74 881464 0 2024-04-25T16:20:40.495 INFO:tasks.workunit.client.0.smithi059.stdout:7/477: rename d0/d7/d16/d20/d2b/d33/d79/c3a to d0/d7/d16/d20/d2b/d33/d4c/d4e/ca1 0 2024-04-25T16:20:40.552 INFO:tasks.workunit.client.0.smithi059.stdout:1/544: dwrite d7/d13/fa4 [0,4194304] 0 2024-04-25T16:20:40.645 INFO:tasks.workunit.client.0.smithi059.stdout:4/474: unlink d0/d4/df/d48/d5f/c76 0 2024-04-25T16:20:40.646 INFO:tasks.workunit.client.0.smithi059.stdout:2/494: creat de/d16/d9d/fba x:0 0 0 2024-04-25T16:20:40.813 INFO:tasks.workunit.client.0.smithi059.stdout:3/531: truncate d0/d1e/f81 678773 0 2024-04-25T16:20:40.902 INFO:tasks.workunit.client.0.smithi059.stdout:5/533: getdents d1/d1e/d27/d66/d70 0 2024-04-25T16:20:41.036 INFO:tasks.workunit.client.0.smithi059.stdout:0/473: rename dc/d68 to dc/dd/d3b/d66/d9b 0 2024-04-25T16:20:41.211 INFO:tasks.workunit.client.0.smithi059.stdout:4/475: dread - d0/d4/df/d1c/d45/d54/f77 zero size 2024-04-25T16:20:41.226 INFO:tasks.workunit.client.0.smithi059.stdout:4/476: stat d0/d4/df/d1c/d45/d54/f63 0 2024-04-25T16:20:41.235 INFO:tasks.workunit.client.0.smithi059.stdout:4/477: chown d0/d4/df/c6e 41277 1 2024-04-25T16:20:41.520 INFO:tasks.workunit.client.0.smithi059.stdout:0/474: mkdir dc/d37/d47/d71/d9c 0 2024-04-25T16:20:41.652 INFO:tasks.workunit.client.0.smithi059.stdout:4/478: creat d0/d4/df/d44/f97 x:0 0 0 2024-04-25T16:20:41.731 INFO:tasks.workunit.client.0.smithi059.stdout:6/528: link d9/d16/d54/f94 d9/d16/d54/fad 0 2024-04-25T16:20:41.837 INFO:tasks.workunit.client.0.smithi059.stdout:1/545: rmdir d7/d13/d2d/d41/d8f/d9f 0 2024-04-25T16:20:41.934 INFO:tasks.workunit.client.0.smithi059.stdout:6/529: rmdir d9/d16/d24/d97 39 2024-04-25T16:20:41.947 INFO:tasks.workunit.client.0.smithi059.stdout:4/479: dread d0/d4/df/d1c/d45/f60 [0,4194304] 0 2024-04-25T16:20:42.058 INFO:tasks.workunit.client.0.smithi059.stdout:8/464: dwrite d7/dd/d17/d23/d37/d5c/f7c [0,4194304] 0 2024-04-25T16:20:42.141 INFO:tasks.workunit.client.0.smithi059.stdout:8/465: fdatasync d7/dd/d17/d23/d37/d5c/f7c 0 2024-04-25T16:20:42.235 INFO:tasks.workunit.client.0.smithi059.stdout:8/466: sync 2024-04-25T16:20:42.335 INFO:tasks.workunit.client.0.smithi059.stdout:9/514: mkdir d6/d4e/d97 0 2024-04-25T16:20:42.361 INFO:tasks.workunit.client.0.smithi059.stdout:2/495: write de/d2a/d33/f74 [5378746,95524] 0 2024-04-25T16:20:42.672 INFO:tasks.workunit.client.0.smithi059.stdout:3/532: dwrite d0/d1e/f32 [4194304,4194304] 0 2024-04-25T16:20:42.696 INFO:tasks.workunit.client.0.smithi059.stdout:7/478: dwrite d0/d7/f10 [0,4194304] 0 2024-04-25T16:20:42.702 INFO:tasks.workunit.client.0.smithi059.stdout:5/534: dwrite d1/d1e/d27/d66/d70/d3d/f57 [0,4194304] 0 2024-04-25T16:20:42.806 INFO:tasks.workunit.client.0.smithi059.stdout:1/546: rename d7/d93/c4e to d7/d93/cae 0 2024-04-25T16:20:42.809 INFO:tasks.workunit.client.0.smithi059.stdout:0/475: write dc/df/f1d [759486,112706] 0 2024-04-25T16:20:42.871 INFO:tasks.workunit.client.0.smithi059.stdout:0/476: read - dc/d37/d47/d60/d6e/f8a zero size 2024-04-25T16:20:42.896 INFO:tasks.workunit.client.0.smithi059.stdout:4/480: symlink d0/d4/df/d1c/d45/d54/d75/d82/d8f/l98 0 2024-04-25T16:20:42.976 INFO:tasks.workunit.client.0.smithi059.stdout:2/496: rename de/d2a/f9e to de/d5a/d7d/fbb 0 2024-04-25T16:20:43.095 INFO:tasks.workunit.client.0.smithi059.stdout:6/530: dwrite d9/f35 [0,4194304] 0 2024-04-25T16:20:43.165 INFO:tasks.workunit.client.0.smithi059.stdout:6/531: write d9/f35 [4614162,9453] 0 2024-04-25T16:20:43.183 INFO:tasks.workunit.client.0.smithi059.stdout:9/515: symlink d6/l98 0 2024-04-25T16:20:43.187 INFO:tasks.workunit.client.0.smithi059.stdout:3/533: fsync d0/f28 0 2024-04-25T16:20:43.208 INFO:tasks.workunit.client.0.smithi059.stdout:1/547: creat d7/d2a/d85/d8d/faf x:0 0 0 2024-04-25T16:20:43.251 INFO:tasks.workunit.client.0.smithi059.stdout:7/479: truncate d0/d7/d16/d20/f67 716218 0 2024-04-25T16:20:43.363 INFO:tasks.workunit.client.0.smithi059.stdout:7/480: stat d0/d7/d16/d20/d2b/d33/d79/l90 0 2024-04-25T16:20:43.366 INFO:tasks.workunit.client.0.smithi059.stdout:5/535: dread d1/dd/f1d [0,4194304] 0 2024-04-25T16:20:43.382 INFO:tasks.workunit.client.0.smithi059.stdout:7/481: chown d0/d3f/c8d 0 1 2024-04-25T16:20:43.422 INFO:tasks.workunit.client.0.smithi059.stdout:7/482: dread d0/d7/f29 [0,4194304] 0 2024-04-25T16:20:43.969 INFO:tasks.workunit.client.0.smithi059.stdout:1/548: mknod d7/d21/d51/cb0 0 2024-04-25T16:20:44.057 INFO:tasks.workunit.client.0.smithi059.stdout:9/516: dread - d6/d4e/d54/d5d/d48/f86 zero size 2024-04-25T16:20:44.092 INFO:tasks.workunit.client.0.smithi059.stdout:5/536: creat d1/d1e/d27/fb4 x:0 0 0 2024-04-25T16:20:44.239 INFO:tasks.workunit.client.0.smithi059.stdout:8/467: getdents d7/dd/d17/d23/d37/d5c 0 2024-04-25T16:20:44.271 INFO:tasks.workunit.client.0.smithi059.stdout:8/468: truncate d7/dd/d17/d23/d38/f7b 4194668 0 2024-04-25T16:20:44.305 INFO:tasks.workunit.client.0.smithi059.stdout:2/497: mknod de/cbc 0 2024-04-25T16:20:44.410 INFO:tasks.workunit.client.0.smithi059.stdout:3/534: symlink d0/d1e/lb1 0 2024-04-25T16:20:44.604 INFO:tasks.workunit.client.0.smithi059.stdout:9/517: fdatasync d6/d35/d28/f8c 0 2024-04-25T16:20:44.789 INFO:tasks.workunit.client.0.smithi059.stdout:5/537: fsync d1/f3 0 2024-04-25T16:20:44.864 INFO:tasks.workunit.client.0.smithi059.stdout:8/469: fsync d7/d2f/f53 0 2024-04-25T16:20:44.935 INFO:tasks.workunit.client.0.smithi059.stdout:2/498: symlink de/d2a/d2e/d36/d59/lbd 0 2024-04-25T16:20:45.042 INFO:tasks.workunit.client.0.smithi059.stdout:3/535: stat d0/db/d2d/c5c 0 2024-04-25T16:20:45.053 INFO:tasks.workunit.client.0.smithi059.stdout:3/536: fsync d0/d1e/f32 0 2024-04-25T16:20:45.062 INFO:tasks.workunit.client.0.smithi059.stdout:3/537: readlink d0/db/l29 0 2024-04-25T16:20:45.077 INFO:tasks.workunit.client.0.smithi059.stdout:3/538: chown d0/db/d47/f48 239 1 2024-04-25T16:20:45.104 INFO:tasks.workunit.client.0.smithi059.stdout:0/477: write dc/dd/d3b/d66/f6f [2639284,151] 0 2024-04-25T16:20:45.126 INFO:tasks.workunit.client.0.smithi059.stdout:3/539: chown d0/db/d3f/d49/f9d 135 1 2024-04-25T16:20:45.135 INFO:tasks.workunit.client.0.smithi059.stdout:0/478: dread dc/f7b [0,4194304] 0 2024-04-25T16:20:45.147 INFO:tasks.workunit.client.0.smithi059.stdout:3/540: stat d0/db/d2d/fab 0 2024-04-25T16:20:45.258 INFO:tasks.workunit.client.0.smithi059.stdout:5/538: symlink d1/d1e/d27/d66/d70/d3d/d50/d8a/lb5 0 2024-04-25T16:20:45.272 INFO:tasks.workunit.client.0.smithi059.stdout:5/539: readlink d1/d1e/d27/d66/d70/d3d/l94 0 2024-04-25T16:20:45.324 INFO:tasks.workunit.client.0.smithi059.stdout:4/481: getdents d0/d4/df/d1c/d45 0 2024-04-25T16:20:45.454 INFO:tasks.workunit.client.0.smithi059.stdout:2/499: unlink de/d16/d3e/la2 0 2024-04-25T16:20:45.507 INFO:tasks.workunit.client.0.smithi059.stdout:6/532: write d9/d1b/f80 [737623,1296] 0 2024-04-25T16:20:45.587 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:20:45.590 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:20:45.916 INFO:tasks.workunit.client.0.smithi059.stdout:8/470: fdatasync d7/dd/d17/d23/d38/f5d 0 2024-04-25T16:20:45.918 INFO:tasks.workunit.client.0.smithi059.stdout:7/483: dwrite d0/d7/d16/d20/d2b/d33/d79/f9c [0,4194304] 0 2024-04-25T16:20:45.998 INFO:tasks.workunit.client.0.smithi059.stdout:2/500: fsync de/d2a/d2e/d36/d2c/f8c 0 2024-04-25T16:20:46.024 INFO:tasks.workunit.client.0.smithi059.stdout:7/484: chown d0/d7/c11 5230 1 2024-04-25T16:20:46.029 INFO:tasks.workunit.client.0.smithi059.stdout:2/501: chown de/d2a/d2e/d36/d2c 243488 1 2024-04-25T16:20:46.305 INFO:tasks.workunit.client.0.smithi059.stdout:9/518: dwrite d6/d35/d28/f8c [0,4194304] 0 2024-04-25T16:20:46.363 INFO:tasks.workunit.client.0.smithi059.stdout:8/471: unlink d7/dd/d17/d23/l5f 0 2024-04-25T16:20:46.385 INFO:tasks.workunit.client.0.smithi059.stdout:8/472: chown d7/dd/d33/f41 1 1 2024-04-25T16:20:46.391 INFO:tasks.workunit.client.0.smithi059.stdout:0/479: link dc/f2a dc/dd/f9d 0 2024-04-25T16:20:46.400 INFO:tasks.workunit.client.0.smithi059.stdout:8/473: chown d7/d16/d45/d7f 632 1 2024-04-25T16:20:46.440 INFO:tasks.workunit.client.0.smithi059.stdout:2/502: chown de/d2a/d2e/l5c 765 1 2024-04-25T16:20:46.670 INFO:tasks.workunit.client.0.smithi059.stdout:0/480: mkdir dc/d37/d47/d71/d9e 0 2024-04-25T16:20:46.760 INFO:tasks.workunit.client.0.smithi059.stdout:8/474: rename d7/d16/d45 to d7/dd/d17/d23/d37/d5c/d87/d94 0 2024-04-25T16:20:46.813 INFO:tasks.workunit.client.0.smithi059.stdout:2/503: dread - de/d16/f7b zero size 2024-04-25T16:20:46.955 INFO:tasks.workunit.client.0.smithi059.stdout:1/549: write d7/d13/d2d/f96 [5449193,12361] 0 2024-04-25T16:20:46.959 INFO:tasks.workunit.client.0.smithi059.stdout:0/481: symlink dc/d44/d5f/l9f 0 2024-04-25T16:20:47.003 INFO:tasks.workunit.client.0.smithi059.stdout:1/550: readlink d7/d13/d2d/d41/d8f/l90 0 2024-04-25T16:20:47.138 INFO:tasks.workunit.client.0.smithi059.stdout:9/519: creat d6/d35/d2f/f99 x:0 0 0 2024-04-25T16:20:47.194 INFO:tasks.workunit.client.0.smithi059.stdout:2/504: mkdir de/d2a/d2e/dbe 0 2024-04-25T16:20:47.424 INFO:tasks.workunit.client.0.smithi059.stdout:9/520: dread d6/d4e/d7a/f8d [0,4194304] 0 2024-04-25T16:20:47.472 INFO:tasks.workunit.client.0.smithi059.stdout:4/482: rmdir d0/d4/df/d44 39 2024-04-25T16:20:47.476 INFO:tasks.workunit.client.0.smithi059.stdout:0/482: rename dc/dd/d5c/l7f to dc/d37/d47/d81/la0 0 2024-04-25T16:20:47.503 INFO:tasks.workunit.client.0.smithi059.stdout:3/541: write d0/db/d3f/d6c/fac [975754,130814] 0 2024-04-25T16:20:47.564 INFO:tasks.workunit.client.0.smithi059.stdout:1/551: fdatasync d7/d93/d8e/f9a 0 2024-04-25T16:20:47.771 INFO:tasks.workunit.client.0.smithi059.stdout:0/483: dread dc/d37/d47/d60/f61 [0,4194304] 0 2024-04-25T16:20:47.786 INFO:tasks.workunit.client.0.smithi059.stdout:0/484: readlink dc/dd/d3b/d66/d9b/l8e 0 2024-04-25T16:20:47.808 INFO:tasks.workunit.client.0.smithi059.stdout:5/540: write d1/f15 [4325122,28655] 0 2024-04-25T16:20:47.836 INFO:tasks.workunit.client.0.smithi059.stdout:9/521: getdents d6/d35/d6c 0 2024-04-25T16:20:47.880 INFO:tasks.workunit.client.0.smithi059.stdout:4/483: dread - d0/d4/df/d44/f59 zero size 2024-04-25T16:20:47.997 INFO:tasks.workunit.client.0.smithi059.stdout:6/533: dwrite d9/d16/d54/fad [0,4194304] 0 2024-04-25T16:20:48.062 INFO:tasks.workunit.client.0.smithi059.stdout:1/552: mkdir d7/db1 0 2024-04-25T16:20:48.085 INFO:tasks.workunit.client.0.smithi059.stdout:9/522: dread - d6/f68 zero size 2024-04-25T16:20:48.100 INFO:tasks.workunit.client.0.smithi059.stdout:6/534: chown d9/d16/f22 80 1 2024-04-25T16:20:48.378 INFO:tasks.workunit.client.0.smithi059.stdout:7/485: write d0/d7/d16/d20/d2b/d33/d4c/d4e/d4f/f6e [674609,50644] 0 2024-04-25T16:20:48.494 INFO:tasks.workunit.client.0.smithi059.stdout:8/475: dwrite d7/dd/d17/f4e [0,4194304] 0 2024-04-25T16:20:48.740 INFO:tasks.workunit.client.0.smithi059.stdout:3/542: write d0/d1e/f52 [4629757,93944] 0 2024-04-25T16:20:48.778 INFO:tasks.workunit.client.0.smithi059.stdout:2/505: dwrite de/d2a/d2e/f98 [0,4194304] 0 2024-04-25T16:20:48.863 INFO:tasks.workunit.client.0.smithi059.stdout:6/535: mknod d9/d16/d24/d5d/d77/cae 0 2024-04-25T16:20:48.876 INFO:tasks.workunit.client.0.smithi059.stdout:4/484: write d0/f8c [923952,32276] 0 2024-04-25T16:20:48.881 INFO:tasks.workunit.client.0.smithi059.stdout:6/536: readlink d9/d16/l1d 0 2024-04-25T16:20:48.908 INFO:tasks.workunit.client.0.smithi059.stdout:6/537: truncate d9/d16/f1f 8398013 0 2024-04-25T16:20:48.911 INFO:tasks.workunit.client.0.smithi059.stdout:2/506: sync 2024-04-25T16:20:49.279 INFO:tasks.workunit.client.0.smithi059.stdout:7/486: unlink d0/d7/d16/d20/d2b/d33/d79/d5d/d85/c8f 0 2024-04-25T16:20:49.298 INFO:tasks.workunit.client.0.smithi059.stdout:7/487: dread d0/d7/f8a [0,4194304] 0 2024-04-25T16:20:49.341 INFO:tasks.workunit.client.0.smithi059.stdout:8/476: symlink d7/d16/d3a/l95 0 2024-04-25T16:20:49.400 INFO:tasks.workunit.client.0.smithi059.stdout:5/541: link d1/d1e/d27/d66/d70/d3d/d50/c74 d1/d1e/d27/d66/d70/d3d/d50/cb6 0 2024-04-25T16:20:49.536 INFO:tasks.workunit.client.0.smithi059.stdout:9/523: unlink d6/d35/d28/c56 0 2024-04-25T16:20:49.597 INFO:tasks.workunit.client.0.smithi059.stdout:3/543: symlink d0/db/d3f/d49/d65/lb2 0 2024-04-25T16:20:49.606 INFO:tasks.workunit.client.0.smithi059.stdout:3/544: stat d0/db/d3f/d49 0 2024-04-25T16:20:49.811 INFO:tasks.workunit.client.0.smithi059.stdout:4/485: unlink d0/d4/df/c61 0 2024-04-25T16:20:49.826 INFO:tasks.workunit.client.0.smithi059.stdout:0/485: link dc/f36 dc/d37/d47/d71/d9c/fa1 0 2024-04-25T16:20:50.123 INFO:tasks.workunit.client.0.smithi059.stdout:5/542: rmdir d1/d1e/d27/d66/d70/d75 39 2024-04-25T16:20:50.133 INFO:tasks.workunit.client.0.smithi059.stdout:1/553: creat d7/d93/fb2 x:0 0 0 2024-04-25T16:20:50.242 INFO:tasks.workunit.client.0.smithi059.stdout:9/524: fdatasync d6/d4e/d54/d5d/d48/d49/f58 0 2024-04-25T16:20:50.249 INFO:tasks.workunit.client.0.smithi059.stdout:5/543: read - d1/d1e/d27/d66/d70/d3d/d44/d79/f7e zero size 2024-04-25T16:20:50.271 INFO:tasks.workunit.client.0.smithi059.stdout:8/477: dread d7/d2f/f47 [0,4194304] 0 2024-04-25T16:20:50.323 INFO:tasks.workunit.client.0.smithi059.stdout:3/545: dread d0/d1e/f45 [0,4194304] 0 2024-04-25T16:20:50.487 INFO:tasks.workunit.client.0.smithi059.stdout:0/486: creat dc/dd/d3b/d66/fa2 x:0 0 0 2024-04-25T16:20:50.950 INFO:tasks.workunit.client.0.smithi059.stdout:5/544: symlink d1/d1e/lb7 0 2024-04-25T16:20:51.154 INFO:tasks.workunit.client.0.smithi059.stdout:2/507: write de/d2a/d33/f7e [3037892,3001] 0 2024-04-25T16:20:51.169 INFO:tasks.workunit.client.0.smithi059.stdout:7/488: write d0/d7/d16/f53 [452132,73364] 0 2024-04-25T16:20:51.211 INFO:tasks.workunit.client.0.smithi059.stdout:6/538: link d9/d27/f34 d9/d27/d39/faf 0 2024-04-25T16:20:51.215 INFO:tasks.workunit.client.0.smithi059.stdout:1/554: write d7/d13/d2d/d4a/f56 [3899045,36360] 0 2024-04-25T16:20:51.219 INFO:tasks.workunit.client.0.smithi059.stdout:9/525: creat d6/d35/d2f/d39/f9a x:0 0 0 2024-04-25T16:20:51.289 INFO:tasks.workunit.client.0.smithi059.stdout:7/489: chown d0/d7/d16/f53 124351700 1 2024-04-25T16:20:51.296 INFO:tasks.workunit.client.0.smithi059.stdout:6/539: chown d9/d27/d39/f66 2799467 1 2024-04-25T16:20:51.346 INFO:tasks.workunit.client.0.smithi059.stdout:5/545: dread - d1/d1e/d27/d66/f69 zero size 2024-04-25T16:20:51.615 INFO:tasks.workunit.client.0.smithi059.stdout:1/555: dread d7/d13/d16/f50 [0,4194304] 0 2024-04-25T16:20:51.645 INFO:tasks.workunit.client.0.smithi059.stdout:9/526: creat d6/d35/d28/f9b x:0 0 0 2024-04-25T16:20:51.679 INFO:tasks.workunit.client.0.smithi059.stdout:6/540: mkdir d9/d1b/d58/d49/db0 0 2024-04-25T16:20:51.759 INFO:tasks.workunit.client.0.smithi059.stdout:7/490: rename d0/d7/d16/d20/d2b/d33/f39 to d0/d7/d16/d20/d2b/d33/d79/d5d/d94/fa2 0 2024-04-25T16:20:51.776 INFO:tasks.workunit.client.0.smithi059.stdout:8/478: dwrite d7/dd/d17/d23/d37/d5c/d87/f8a [0,4194304] 0 2024-04-25T16:20:51.867 INFO:tasks.workunit.client.0.smithi059.stdout:5/546: mkdir d1/d1e/d27/d66/d70/d3d/d50/db8 0 2024-04-25T16:20:51.874 INFO:tasks.workunit.client.0.smithi059.stdout:3/546: write d0/db/d2d/f58 [105357,8499] 0 2024-04-25T16:20:51.900 INFO:tasks.workunit.client.0.smithi059.stdout:5/547: chown d1/c16 63 1 2024-04-25T16:20:52.024 INFO:tasks.workunit.client.0.smithi059.stdout:4/486: getdents d0/d4/df/d44 0 2024-04-25T16:20:52.034 INFO:tasks.workunit.client.0.smithi059.stdout:0/487: creat dc/d37/fa3 x:0 0 0 2024-04-25T16:20:52.048 INFO:tasks.workunit.client.0.smithi059.stdout:2/508: fsync de/d2a/d2e/d36/d2c/d40/d57/f71 0 2024-04-25T16:20:52.349 INFO:tasks.workunit.client.0.smithi059.stdout:6/541: truncate d9/d1b/f7a 47556 0 2024-04-25T16:20:52.359 INFO:tasks.workunit.client.0.smithi059.stdout:8/479: rename d7/dd/ff to d7/d2f/d43/f96 0 2024-04-25T16:20:52.370 INFO:tasks.workunit.client.0.smithi059.stdout:3/547: mkdir d0/db/d3f/d89/db3 0 2024-04-25T16:20:52.413 INFO:tasks.workunit.client.0.smithi059.stdout:8/480: dread d7/d16/d3a/f50 [0,4194304] 0 2024-04-25T16:20:52.431 INFO:tasks.workunit.client.0.smithi059.stdout:3/548: dread d0/f37 [0,4194304] 0 2024-04-25T16:20:52.453 INFO:tasks.workunit.client.0.smithi059.stdout:2/509: creat de/d2a/d2e/d36/d2c/fbf x:0 0 0 2024-04-25T16:20:52.461 INFO:tasks.workunit.client.0.smithi059.stdout:4/487: symlink d0/d4/df/d1c/d45/d54/d75/d7e/l99 0 2024-04-25T16:20:52.475 INFO:tasks.workunit.client.0.smithi059.stdout:2/510: chown la 5 1 2024-04-25T16:20:52.780 INFO:tasks.workunit.client.0.smithi059.stdout:6/542: symlink d9/d1b/d58/d49/lb1 0 2024-04-25T16:20:52.808 INFO:tasks.workunit.client.0.smithi059.stdout:6/543: readlink d9/d16/d53/d55/d6e/l8b 0 2024-04-25T16:20:52.831 INFO:tasks.workunit.client.0.smithi059.stdout:0/488: getdents dc/d37/d93 0 2024-04-25T16:20:52.901 INFO:tasks.workunit.client.0.smithi059.stdout:5/548: mkdir d1/d1e/d27/d66/d70/db9 0 2024-04-25T16:20:52.905 INFO:tasks.workunit.client.0.smithi059.stdout:6/544: chown d9/d16/d24/c43 56 1 2024-04-25T16:20:52.949 INFO:tasks.workunit.client.0.smithi059.stdout:1/556: dwrite d7/d13/d16/f24 [0,4194304] 0 2024-04-25T16:20:53.027 INFO:tasks.workunit.client.0.smithi059.stdout:7/491: write d0/d7/d16/d20/d2b/d33/f93 [216179,35675] 0 2024-04-25T16:20:53.048 INFO:tasks.workunit.client.0.smithi059.stdout:3/549: truncate d0/db/d3f/f5e 4214335 0 2024-04-25T16:20:53.198 INFO:tasks.workunit.client.0.smithi059.stdout:8/481: creat d7/d2f/d76/f97 x:0 0 0 2024-04-25T16:20:53.249 INFO:tasks.workunit.client.0.smithi059.stdout:1/557: dread d7/f69 [0,4194304] 0 2024-04-25T16:20:53.420 INFO:tasks.workunit.client.0.smithi059.stdout:6/545: truncate d9/f4b 1601025 0 2024-04-25T16:20:53.472 INFO:tasks.workunit.client.0.smithi059.stdout:3/550: mkdir d0/db/d3f/d6c/db4 0 2024-04-25T16:20:53.770 INFO:tasks.workunit.client.0.smithi059.stdout:9/527: getdents d6/d4e 0 2024-04-25T16:20:53.843 INFO:tasks.workunit.client.0.smithi059.stdout:5/549: truncate d1/d1e/d27/d66/d70/d3d/d44/f67 981448 0 2024-04-25T16:20:54.127 INFO:tasks.workunit.client.0.smithi059.stdout:2/511: write de/d16/f1a [269242,50620] 0 2024-04-25T16:20:54.220 INFO:tasks.workunit.client.0.smithi059.stdout:6/546: truncate d9/d1b/d58/f76 2035375 0 2024-04-25T16:20:54.287 INFO:tasks.workunit.client.0.smithi059.stdout:4/488: write d0/d4/df/d1c/d45/d54/f72 [651040,81550] 0 2024-04-25T16:20:54.393 INFO:tasks.workunit.client.0.smithi059.stdout:8/482: dread d7/dd/f3c [0,4194304] 0 2024-04-25T16:20:54.409 INFO:tasks.workunit.client.0.smithi059.stdout:0/489: link dc/dd/c15 dc/df/d5e/ca4 0 2024-04-25T16:20:54.540 INFO:tasks.workunit.client.0.smithi059.stdout:7/492: dwrite d0/d7/f73 [4194304,4194304] 0 2024-04-25T16:20:55.053 INFO:tasks.workunit.client.0.smithi059.stdout:5/550: read d1/d1e/d27/d66/d70/d75/f7d [247270,111096] 0 2024-04-25T16:20:55.067 INFO:tasks.workunit.client.0.smithi059.stdout:5/551: stat d1/d1e/l32 0 2024-04-25T16:20:55.293 INFO:tasks.workunit.client.0.smithi059.stdout:1/558: creat d7/d93/fb3 x:0 0 0 2024-04-25T16:20:55.293 INFO:tasks.workunit.client.0.smithi059.stdout:2/512: getdents de/d16/d82/da8 0 2024-04-25T16:20:55.313 INFO:tasks.workunit.client.0.smithi059.stdout:1/559: stat d7/d2a/d85/d8d/c98 0 2024-04-25T16:20:55.591 INFO:tasks.workunit.client.0.smithi059.stdout:0/490: symlink dc/d37/d93/la5 0 2024-04-25T16:20:55.609 INFO:tasks.workunit.client.0.smithi059.stdout:2/513: truncate f7 1525471 0 2024-04-25T16:20:55.741 INFO:tasks.workunit.client.0.smithi059.stdout:1/560: read - d7/d93/fb2 zero size 2024-04-25T16:20:55.904 INFO:tasks.workunit.client.0.smithi059.stdout:7/493: link d0/d7/d16/d20/d2b/d33/d79/d5d/f95 d0/d3f/fa3 0 2024-04-25T16:20:55.989 INFO:tasks.workunit.client.0.smithi059.stdout:3/551: dwrite d0/db/f30 [4194304,4194304] 0 2024-04-25T16:20:56.000 INFO:tasks.workunit.client.0.smithi059.stdout:9/528: dwrite d6/d4e/d54/f8b [0,4194304] 0 2024-04-25T16:20:56.008 INFO:tasks.workunit.client.0.smithi059.stdout:1/561: creat d7/d13/d16/d5c/d74/fb4 x:0 0 0 2024-04-25T16:20:56.153 INFO:tasks.workunit.client.0.smithi059.stdout:4/489: getdents d0/d4/df/d1c 0 2024-04-25T16:20:56.632 INFO:tasks.workunit.client.0.smithi059.stdout:8/483: write d7/d16/d3a/f50 [548607,125764] 0 2024-04-25T16:20:56.675 INFO:tasks.workunit.client.0.smithi059.stdout:8/484: chown d7/f15 0 1 2024-04-25T16:20:56.705 INFO:tasks.workunit.client.0.smithi059.stdout:5/552: write d1/d1e/d27/d66/d70/d3d/f9e [230827,11963] 0 2024-04-25T16:20:56.744 INFO:tasks.workunit.client.0.smithi059.stdout:6/547: dwrite d9/f56 [0,4194304] 0 2024-04-25T16:20:56.835 INFO:tasks.workunit.client.0.smithi059.stdout:9/529: mknod d6/d35/d6c/c9c 0 2024-04-25T16:20:56.836 INFO:tasks.workunit.client.0.smithi059.stdout:7/494: dread - d0/d7/d16/d20/d2b/d33/d79/d5d/f7f zero size 2024-04-25T16:20:56.839 INFO:tasks.workunit.client.0.smithi059.stdout:2/514: write de/d2a/d2e/d36/fab [1001923,74808] 0 2024-04-25T16:20:56.887 INFO:tasks.workunit.client.0.smithi059.stdout:1/562: creat d7/d13/d2d/d4a/fb5 x:0 0 0 2024-04-25T16:20:56.894 INFO:tasks.workunit.client.0.smithi059.stdout:3/552: mknod d0/db/d47/d98/cb5 0 2024-04-25T16:20:56.936 INFO:tasks.workunit.client.0.smithi059.stdout:1/563: chown d7/d93/d8e/f9a 8 1 2024-04-25T16:20:57.204 INFO:tasks.workunit.client.0.smithi059.stdout:2/515: symlink de/d16/d3e/lc0 0 2024-04-25T16:20:57.363 INFO:tasks.workunit.client.0.smithi059.stdout:9/530: fdatasync d6/d4e/d54/d5d/d48/d49/f5e 0 2024-04-25T16:20:57.434 INFO:tasks.workunit.client.0.smithi059.stdout:7/495: unlink d0/d7/d16/d20/d2b/d33/d79/d5d/f78 0 2024-04-25T16:20:57.523 INFO:tasks.workunit.client.0.smithi059.stdout:0/491: link dc/d37/d47/c8b dc/d44/d5f/ca6 0 2024-04-25T16:20:57.691 INFO:tasks.workunit.client.0.smithi059.stdout:8/485: truncate d7/d2f/f4a 4891965 0 2024-04-25T16:20:57.785 INFO:tasks.workunit.client.0.smithi059.stdout:2/516: rename de/d2a/d2e/d36/d2c/d40/d57/d95 to de/d2a/d2e/dbe/dc1 0 2024-04-25T16:20:58.339 INFO:tasks.workunit.client.0.smithi059.stdout:5/553: write d1/d1e/d27/d66/d70/d24/f4b [1007301,101386] 0 2024-04-25T16:20:58.379 INFO:tasks.workunit.client.0.smithi059.stdout:6/548: creat d9/fb2 x:0 0 0 2024-04-25T16:20:58.432 INFO:tasks.workunit.client.0.smithi059.stdout:8/486: readlink d7/dd/d17/d23/d37/l6b 0 2024-04-25T16:20:58.453 INFO:tasks.workunit.client.0.smithi059.stdout:1/564: dwrite d7/d13/d16/f33 [4194304,4194304] 0 2024-04-25T16:20:58.563 INFO:tasks.workunit.client.0.smithi059.stdout:7/496: rename d0/l1c to d0/d7/d51/la4 0 2024-04-25T16:20:58.846 INFO:tasks.workunit.client.0.smithi059.stdout:2/517: truncate de/d2a/d2e/d36/d2c/d40/f52 811481 0 2024-04-25T16:20:58.975 INFO:tasks.workunit.client.0.smithi059.stdout:4/490: link d0/l2c d0/d4/df/d48/d5f/l9a 0 2024-04-25T16:20:59.168 INFO:tasks.workunit.client.0.smithi059.stdout:3/553: creat d0/db/fb6 x:0 0 0 2024-04-25T16:20:59.180 INFO:tasks.workunit.client.0.smithi059.stdout:0/492: write dc/d37/d47/d60/f61 [1372067,73058] 0 2024-04-25T16:20:59.291 INFO:tasks.workunit.client.0.smithi059.stdout:9/531: dwrite d6/d35/d2f/d39/f9a [0,4194304] 0 2024-04-25T16:20:59.627 INFO:tasks.workunit.client.0.smithi059.stdout:5/554: creat d1/dd/fba x:0 0 0 2024-04-25T16:20:59.681 INFO:tasks.workunit.client.0.smithi059.stdout:8/487: creat d7/dd/d33/d57/f98 x:0 0 0 2024-04-25T16:20:59.832 INFO:tasks.workunit.client.0.smithi059.stdout:6/549: rename d9/f35 to d9/d16/d53/d6c/fb3 0 2024-04-25T16:20:59.900 INFO:tasks.workunit.client.0.smithi059.stdout:7/497: symlink d0/d7/d16/d20/d2b/d33/d79/d5d/d94/la5 0 2024-04-25T16:20:59.970 INFO:tasks.workunit.client.0.smithi059.stdout:2/518: fdatasync de/d16/d7f/faf 0 2024-04-25T16:21:00.025 INFO:tasks.workunit.client.0.smithi059.stdout:4/491: dread d0/d4/df/d1c/f8d [0,4194304] 0 2024-04-25T16:21:00.112 INFO:tasks.workunit.client.0.smithi059.stdout:3/554: mknod d0/d1e/d31/cb7 0 2024-04-25T16:21:00.128 INFO:tasks.workunit.client.0.smithi059.stdout:3/555: dread d0/d1e/f45 [0,4194304] 0 2024-04-25T16:21:00.331 INFO:tasks.workunit.client.0.smithi059.stdout:9/532: fdatasync d6/d4e/d54/d5d/d48/d49/f72 0 2024-04-25T16:21:00.381 INFO:tasks.workunit.client.0.smithi059.stdout:5/555: creat d1/d48/fbb x:0 0 0 2024-04-25T16:21:00.422 INFO:tasks.workunit.client.0.smithi059.stdout:8/488: fsync d7/dd/d17/d23/d37/d5c/f7c 0 2024-04-25T16:21:00.626 INFO:tasks.workunit.client.0.smithi059.stdout:7/498: creat d0/d7/d16/d20/d2b/d33/d79/d5d/fa6 x:0 0 0 2024-04-25T16:21:00.649 INFO:tasks.workunit.client.0.smithi059.stdout:6/550: dread d9/d27/f84 [0,4194304] 0 2024-04-25T16:21:00.854 INFO:tasks.workunit.client.0.smithi059.stdout:2/519: creat de/d67/fc2 x:0 0 0 2024-04-25T16:21:01.114 INFO:tasks.workunit.client.0.smithi059.stdout:1/565: write d7/d13/f92 [2640471,78313] 0 2024-04-25T16:21:01.150 INFO:tasks.workunit.client.0.smithi059.stdout:5/556: dread d1/d1e/d27/d66/d70/d3d/d44/f88 [0,4194304] 0 2024-04-25T16:21:01.252 INFO:tasks.workunit.client.0.smithi059.stdout:7/499: rmdir d0/d7/d16/d20/d2b/d33/d79/d5d/d94 39 2024-04-25T16:21:01.255 INFO:tasks.workunit.client.0.smithi059.stdout:8/489: dread - d7/dd/d33/f6c zero size 2024-04-25T16:21:01.289 INFO:tasks.workunit.client.0.smithi059.stdout:3/556: mknod d0/db/d3f/d6c/d9f/cb8 0 2024-04-25T16:21:01.343 INFO:tasks.workunit.client.0.smithi059.stdout:2/520: dread - de/d16/d82/fac zero size 2024-04-25T16:21:01.359 INFO:tasks.workunit.client.0.smithi059.stdout:9/533: mknod d6/d35/d2f/d39/d85/c9d 0 2024-04-25T16:21:01.396 INFO:tasks.workunit.client.0.smithi059.stdout:6/551: dread d9/f10 [0,4194304] 0 2024-04-25T16:21:01.412 INFO:tasks.workunit.client.0.smithi059.stdout:0/493: write dc/f95 [816121,71738] 0 2024-04-25T16:21:01.488 INFO:tasks.workunit.client.0.smithi059.stdout:1/566: mkdir d7/d2a/d85/daa/db6 0 2024-04-25T16:21:01.515 INFO:tasks.workunit.client.0.smithi059.stdout:8/490: chown d7/d2f/d43/f96 39 1 2024-04-25T16:21:01.678 INFO:tasks.workunit.client.0.smithi059.stdout:3/557: dread d0/db/d2d/f46 [0,4194304] 0 2024-04-25T16:21:01.761 INFO:tasks.workunit.client.0.smithi059.stdout:9/534: creat d6/d4e/d54/d5d/d48/d6e/f9e x:0 0 0 2024-04-25T16:21:01.976 INFO:tasks.workunit.client.0.smithi059.stdout:8/491: symlink d7/dd/d33/l99 0 2024-04-25T16:21:02.011 INFO:tasks.workunit.client.0.smithi059.stdout:2/521: getdents de/d2a/da7 0 2024-04-25T16:21:02.017 INFO:tasks.workunit.client.0.smithi059.stdout:2/522: stat de/d16/f7b 0 2024-04-25T16:21:02.118 INFO:tasks.workunit.client.0.smithi059.stdout:6/552: symlink d9/d1b/d58/d49/db0/lb4 0 2024-04-25T16:21:02.188 INFO:tasks.workunit.client.0.smithi059.stdout:4/492: write d0/d4/df/d1c/f85 [1501320,64471] 0 2024-04-25T16:21:02.189 INFO:tasks.workunit.client.0.smithi059.stdout:6/553: readlink d9/d16/d24/l45 0 2024-04-25T16:21:02.189 INFO:tasks.workunit.client.0.smithi059.stdout:6/554: chown d9/d16/d53/d74 52 1 2024-04-25T16:21:02.192 INFO:tasks.workunit.client.0.smithi059.stdout:5/557: rmdir d1/d1e/d27/d66/d70/d75/daa/daf 0 2024-04-25T16:21:02.337 INFO:tasks.workunit.client.0.smithi059.stdout:7/500: rename d0/d7/d16/d20/d2b/d33/d79/d5d/f7f to d0/d7/fa7 0 2024-04-25T16:21:02.608 INFO:tasks.workunit.client.0.smithi059.stdout:3/558: rename d0/db/d47/d5b/f5d to d0/db/d47/d98/fb9 0 2024-04-25T16:21:02.651 INFO:tasks.workunit.client.0.smithi059.stdout:7/501: truncate d0/d7/d16/d20/d2b/d33/f43 3481127 0 2024-04-25T16:21:02.904 INFO:tasks.workunit.client.0.smithi059.stdout:8/492: rename d7/d16/d3a/f3e to d7/d16/d3a/f9a 0 2024-04-25T16:21:03.058 INFO:tasks.workunit.client.0.smithi059.stdout:0/494: write dc/dd/f23 [3277265,112086] 0 2024-04-25T16:21:03.073 INFO:tasks.workunit.client.0.smithi059.stdout:1/567: write d7/d13/f87 [115956,42095] 0 2024-04-25T16:21:03.214 INFO:tasks.workunit.client.0.smithi059.stdout:3/559: dread d0/db/f5a [4194304,4194304] 0 2024-04-25T16:21:03.351 INFO:tasks.workunit.client.0.smithi059.stdout:3/560: sync 2024-04-25T16:21:03.435 INFO:tasks.workunit.client.0.smithi059.stdout:2/523: write fb [984721,23682] 0 2024-04-25T16:21:03.486 INFO:tasks.workunit.client.0.smithi059.stdout:7/502: write d0/f9a [559101,64847] 0 2024-04-25T16:21:03.490 INFO:tasks.workunit.client.0.smithi059.stdout:5/558: write d1/d1e/d27/d66/d70/d75/f95 [979496,25720] 0 2024-04-25T16:21:03.588 INFO:tasks.workunit.client.0.smithi059.stdout:9/535: dwrite d6/d35/f4b [0,4194304] 0 2024-04-25T16:21:03.652 INFO:tasks.workunit.client.0.smithi059.stdout:6/555: rename d9/l96 to d9/d16/d24/d5d/d77/lb5 0 2024-04-25T16:21:03.674 INFO:tasks.workunit.client.0.smithi059.stdout:4/493: getdents d0/d4/df/d1c/d45/d54/d75/d82/d8f 0 2024-04-25T16:21:04.160 INFO:tasks.workunit.client.0.smithi059.stdout:7/503: chown d0/d3f/fa3 52 1 2024-04-25T16:21:04.163 INFO:tasks.workunit.client.0.smithi059.stdout:5/559: creat d1/d1e/d27/d66/d70/d3d/fbc x:0 0 0 2024-04-25T16:21:04.218 INFO:tasks.workunit.client.0.smithi059.stdout:3/561: dwrite d0/d1e/f45 [0,4194304] 0 2024-04-25T16:21:04.442 INFO:tasks.workunit.client.0.smithi059.stdout:9/536: creat d6/d4e/f9f x:0 0 0 2024-04-25T16:21:04.458 INFO:tasks.workunit.client.0.smithi059.stdout:9/537: stat d6/d4e/d54/d5d/d48/d49/f72 0 2024-04-25T16:21:04.468 INFO:tasks.workunit.client.0.smithi059.stdout:8/493: rename d7/d16/c29 to d7/dd/d33/d57/c9b 0 2024-04-25T16:21:04.886 INFO:tasks.workunit.client.0.smithi059.stdout:5/560: creat d1/d1e/d27/fbd x:0 0 0 2024-04-25T16:21:05.000 INFO:tasks.workunit.client.0.smithi059.stdout:9/538: read - d6/d35/d28/f9b zero size 2024-04-25T16:21:05.125 INFO:tasks.workunit.client.0.smithi059.stdout:1/568: rename d7/d13 to d7/d2a/d85/db7 0 2024-04-25T16:21:05.201 INFO:tasks.workunit.client.0.smithi059.stdout:8/494: creat d7/dd/f9c x:0 0 0 2024-04-25T16:21:05.414 INFO:tasks.workunit.client.0.smithi059.stdout:0/495: getdents dc/dd/d3b 0 2024-04-25T16:21:05.421 INFO:tasks.workunit.client.0.smithi059.stdout:0/496: chown dc/d44/d5f 2 1 2024-04-25T16:21:05.449 INFO:tasks.workunit.client.0.smithi059.stdout:3/562: mkdir d0/d1e/d57/da8/dba 0 2024-04-25T16:21:05.506 INFO:tasks.workunit.client.0.smithi059.stdout:5/561: mkdir d1/d48/d85/dbe 0 2024-04-25T16:21:05.702 INFO:tasks.workunit.client.0.smithi059.stdout:8/495: creat d7/d2f/d76/f9d x:0 0 0 2024-04-25T16:21:05.766 INFO:tasks.workunit.client.0.smithi059.stdout:0/497: mknod dc/d44/ca7 0 2024-04-25T16:21:05.876 INFO:tasks.workunit.client.0.smithi059.stdout:2/524: dwrite de/d67/f72 [8388608,4194304] 0 2024-04-25T16:21:06.140 INFO:tasks.workunit.client.0.smithi059.stdout:8/496: creat d7/d16/f9e x:0 0 0 2024-04-25T16:21:06.177 INFO:tasks.workunit.client.0.smithi059.stdout:2/525: read de/d16/f1a [563582,127657] 0 2024-04-25T16:21:06.217 INFO:tasks.workunit.client.0.smithi059.stdout:3/563: symlink d0/db/d3f/d49/d65/dae/lbb 0 2024-04-25T16:21:06.294 INFO:tasks.workunit.client.0.smithi059.stdout:6/556: dwrite d9/d1b/d58/f76 [0,4194304] 0 2024-04-25T16:21:06.361 INFO:tasks.workunit.client.0.smithi059.stdout:0/498: symlink dc/la8 0 2024-04-25T16:21:06.380 INFO:tasks.workunit.client.0.smithi059.stdout:8/497: fdatasync d7/d2f/d43/f6f 0 2024-04-25T16:21:06.483 INFO:tasks.workunit.client.0.smithi059.stdout:7/504: write d0/d3f/f4d [853591,1084] 0 2024-04-25T16:21:06.486 INFO:tasks.workunit.client.0.smithi059.stdout:1/569: getdents d7/d2a/d85 0 2024-04-25T16:21:06.562 INFO:tasks.workunit.client.0.smithi059.stdout:4/494: dwrite d0/d4/df/d48/f81 [4194304,4194304] 0 2024-04-25T16:21:06.627 INFO:tasks.workunit.client.0.smithi059.stdout:2/526: rename de/d2a/d2e/d36/fab to de/d5a/d7d/fc3 0 2024-04-25T16:21:06.635 INFO:tasks.workunit.client.0.smithi059.stdout:9/539: write d6/d4e/d54/d5d/d48/f86 [63578,20716] 0 2024-04-25T16:21:06.671 INFO:tasks.workunit.client.0.smithi059.stdout:6/557: rmdir d9/d1b 39 2024-04-25T16:21:06.790 INFO:tasks.workunit.client.0.smithi059.stdout:0/499: dread dc/df/f1d [0,4194304] 0 2024-04-25T16:21:07.088 INFO:tasks.workunit.client.0.smithi059.stdout:5/562: dwrite d1/dd/f12 [0,4194304] 0 2024-04-25T16:21:07.210 INFO:tasks.workunit.client.0.smithi059.stdout:2/527: symlink de/d5a/d9a/lc4 0 2024-04-25T16:21:07.392 INFO:tasks.workunit.client.0.smithi059.stdout:9/540: creat d6/d4e/d54/d5d/d48/d6e/fa0 x:0 0 0 2024-04-25T16:21:07.400 INFO:tasks.workunit.client.0.smithi059.stdout:6/558: truncate d9/d16/d24/f3f 106693 0 2024-04-25T16:21:07.408 INFO:tasks.workunit.client.0.smithi059.stdout:3/564: write d0/db/d2d/f87 [11141239,96129] 0 2024-04-25T16:21:07.436 INFO:tasks.workunit.client.0.smithi059.stdout:0/500: stat dc/d84/f9a 0 2024-04-25T16:21:07.617 INFO:tasks.workunit.client.0.smithi059.stdout:5/563: fsync d1/dd/f6e 0 2024-04-25T16:21:07.617 INFO:tasks.workunit.client.0.smithi059.stdout:2/528: unlink de/da1/fb5 0 2024-04-25T16:21:07.668 INFO:tasks.workunit.client.0.smithi059.stdout:7/505: truncate d0/d7/d16/d20/d2b/d33/f43 573648 0 2024-04-25T16:21:07.786 INFO:tasks.workunit.client.0.smithi059.stdout:6/559: creat d9/d16/fb6 x:0 0 0 2024-04-25T16:21:07.876 INFO:tasks.workunit.client.0.smithi059.stdout:6/560: sync 2024-04-25T16:21:07.881 INFO:tasks.workunit.client.0.smithi059.stdout:8/498: dwrite d7/dd/d17/d23/d38/f5d [0,4194304] 0 2024-04-25T16:21:07.957 INFO:tasks.workunit.client.0.smithi059.stdout:6/561: readlink d9/d16/d53/d55/d71/l99 0 2024-04-25T16:21:08.012 INFO:tasks.workunit.client.0.smithi059.stdout:3/565: rename d0/f28 to d0/db/d7f/fbc 0 2024-04-25T16:21:08.062 INFO:tasks.workunit.client.0.smithi059.stdout:9/541: truncate d6/d35/d28/f50 4482568 0 2024-04-25T16:21:08.075 INFO:tasks.workunit.client.0.smithi059.stdout:1/570: write d7/d2a/f3d [1317447,45895] 0 2024-04-25T16:21:08.125 INFO:tasks.workunit.client.0.smithi059.stdout:2/529: rmdir de/d16/d9d 39 2024-04-25T16:21:08.177 INFO:tasks.workunit.client.0.smithi059.stdout:4/495: dwrite d0/d4/df/d1c/d45/d54/f77 [0,4194304] 0 2024-04-25T16:21:08.449 INFO:tasks.workunit.client.0.smithi059.stdout:6/562: symlink d9/d16/d53/d6c/lb7 0 2024-04-25T16:21:08.462 INFO:tasks.workunit.client.0.smithi059.stdout:8/499: chown d7/dd/c27 394 1 2024-04-25T16:21:08.498 INFO:tasks.workunit.client.0.smithi059.stdout:6/563: chown d9/d16/c57 340 1 2024-04-25T16:21:08.498 INFO:tasks.workunit.client.0.smithi059.stdout:0/501: symlink dc/d37/la9 0 2024-04-25T16:21:08.618 INFO:tasks.workunit.client.0.smithi059.stdout:3/566: creat d0/db/d3f/d49/fbd x:0 0 0 2024-04-25T16:21:08.637 INFO:tasks.workunit.client.0.smithi059.stdout:3/567: write d0/d1e/f45 [3299997,55379] 0 2024-04-25T16:21:08.676 INFO:tasks.workunit.client.0.smithi059.stdout:1/571: mkdir d7/d2a/db8 0 2024-04-25T16:21:09.221 INFO:tasks.workunit.client.0.smithi059.stdout:4/496: fsync d0/d4/df/d48/f4e 0 2024-04-25T16:21:09.242 INFO:tasks.workunit.client.0.smithi059.stdout:8/500: stat d7/dd/d17/d23/d37/d5c/c84 0 2024-04-25T16:21:09.246 INFO:tasks.workunit.client.0.smithi059.stdout:2/530: chown de/d2a/d33/c6f 6473294 1 2024-04-25T16:21:09.391 INFO:tasks.workunit.client.0.smithi059.stdout:2/531: dread de/d2a/d2e/d36/d2c/f8c [0,4194304] 0 2024-04-25T16:21:09.659 INFO:tasks.workunit.client.0.smithi059.stdout:5/564: link d1/d1e/d8f/fa8 d1/d1e/d27/d66/d70/d75/daa/fbf 0 2024-04-25T16:21:09.676 INFO:tasks.workunit.client.0.smithi059.stdout:5/565: stat d1/d1e/d27/d66/d70/d3d/d50/d8a/lb5 0 2024-04-25T16:21:09.783 INFO:tasks.workunit.client.0.smithi059.stdout:7/506: write d0/d7/d16/d20/d2b/d33/f43 [54036,83483] 0 2024-04-25T16:21:09.833 INFO:tasks.workunit.client.0.smithi059.stdout:7/507: dread d0/d7/d16/d20/d2b/d33/f43 [0,4194304] 0 2024-04-25T16:21:09.991 INFO:tasks.workunit.client.0.smithi059.stdout:0/502: symlink dc/d44/d5f/d72/laa 0 2024-04-25T16:21:10.000 INFO:tasks.workunit.client.0.smithi059.stdout:0/503: chown dc/d37/la9 0 1 2024-04-25T16:21:10.035 INFO:tasks.workunit.client.0.smithi059.stdout:2/532: creat de/d5a/fc5 x:0 0 0 2024-04-25T16:21:10.053 INFO:tasks.workunit.client.0.smithi059.stdout:2/533: read de/d2a/d33/f89 [211440,107732] 0 2024-04-25T16:21:10.240 INFO:tasks.workunit.client.0.smithi059.stdout:9/542: write d6/d4e/d54/d5d/f38 [554592,92754] 0 2024-04-25T16:21:10.372 INFO:tasks.workunit.client.0.smithi059.stdout:5/566: mknod d1/d48/da3/d6d/cc0 0 2024-04-25T16:21:10.617 INFO:tasks.workunit.client.0.smithi059.stdout:6/564: dwrite d9/d16/f42 [4194304,4194304] 0 2024-04-25T16:21:10.758 INFO:tasks.workunit.client.0.smithi059.stdout:5/567: dread - d1/d1e/d27/d66/d70/d24/f62 zero size 2024-04-25T16:21:10.870 INFO:tasks.workunit.client.0.smithi059.stdout:2/534: dread de/d2a/d33/f7e [0,4194304] 0 2024-04-25T16:21:10.938 INFO:tasks.workunit.client.0.smithi059.stdout:1/572: dwrite d7/d2a/d85/db7/d2d/d41/d8f/f59 [0,4194304] 0 2024-04-25T16:21:11.000 INFO:tasks.workunit.client.0.smithi059.stdout:6/565: fdatasync d9/d16/d53/f82 0 2024-04-25T16:21:11.161 INFO:tasks.workunit.client.0.smithi059.stdout:4/497: getdents d0/d4 0 2024-04-25T16:21:11.171 INFO:tasks.workunit.client.0.smithi059.stdout:5/568: creat d1/d1e/d27/d66/d70/d3d/d44/d79/d92/fc1 x:0 0 0 2024-04-25T16:21:11.378 INFO:tasks.workunit.client.0.smithi059.stdout:2/535: unlink de/d2a/d33/f89 0 2024-04-25T16:21:11.388 INFO:tasks.workunit.client.0.smithi059.stdout:8/501: write d7/dd/d17/d23/f63 [118061,107763] 0 2024-04-25T16:21:11.503 INFO:tasks.workunit.client.0.smithi059.stdout:3/568: dwrite d0/db/d7f/fbc [0,4194304] 0 2024-04-25T16:21:11.508 INFO:tasks.workunit.client.0.smithi059.stdout:2/536: dread de/d2a/d2e/d36/d2c/d40/f47 [0,4194304] 0 2024-04-25T16:21:11.650 INFO:tasks.workunit.client.0.smithi059.stdout:6/566: truncate d9/d27/d39/f86 1012863 0 2024-04-25T16:21:11.662 INFO:tasks.workunit.client.0.smithi059.stdout:0/504: write dc/dd/d3b/d66/f87 [966709,17842] 0 2024-04-25T16:21:11.752 INFO:tasks.workunit.client.0.smithi059.stdout:1/573: write d7/d2a/d85/db7/d2d/d41/f7b [304647,91972] 0 2024-04-25T16:21:11.806 INFO:tasks.workunit.client.0.smithi059.stdout:4/498: truncate d0/d4/df/f3a 617152 0 2024-04-25T16:21:11.814 INFO:tasks.workunit.client.0.smithi059.stdout:7/508: dwrite d0/d7/d16/d20/d2b/f4a [0,4194304] 0 2024-04-25T16:21:11.819 INFO:tasks.workunit.client.0.smithi059.stdout:8/502: dread - d7/f93 zero size 2024-04-25T16:21:11.880 INFO:tasks.workunit.client.0.smithi059.stdout:5/569: stat d1/d48/c76 0 2024-04-25T16:21:12.072 INFO:tasks.workunit.client.0.smithi059.stdout:3/569: fdatasync d0/db/d47/d7e/f99 0 2024-04-25T16:21:12.240 INFO:tasks.workunit.client.0.smithi059.stdout:9/543: getdents d6/d35/d2f 0 2024-04-25T16:21:12.373 INFO:tasks.workunit.client.0.smithi059.stdout:2/537: dread de/d2a/d2e/fb2 [8388608,4194304] 0 2024-04-25T16:21:12.561 INFO:tasks.workunit.client.0.smithi059.stdout:6/567: write d9/d16/d53/d55/f93 [795603,2172] 0 2024-04-25T16:21:12.604 INFO:tasks.workunit.client.0.smithi059.stdout:4/499: truncate d0/f67 2307486 0 2024-04-25T16:21:12.615 INFO:tasks.workunit.client.0.smithi059.stdout:4/500: chown d0/d4/f56 432871 1 2024-04-25T16:21:12.652 INFO:tasks.workunit.client.0.smithi059.stdout:6/568: sync 2024-04-25T16:21:12.653 INFO:tasks.workunit.client.0.smithi059.stdout:2/538: creat de/d16/d7f/fc6 x:0 0 0 2024-04-25T16:21:12.675 INFO:tasks.workunit.client.0.smithi059.stdout:1/574: write d7/d93/d8e/fa2 [535284,76932] 0 2024-04-25T16:21:12.741 INFO:tasks.workunit.client.0.smithi059.stdout:7/509: write d0/d3f/f6a [3741293,117065] 0 2024-04-25T16:21:12.742 INFO:tasks.workunit.client.0.smithi059.stdout:5/570: creat d1/d1e/d8f/fc2 x:0 0 0 2024-04-25T16:21:12.783 INFO:tasks.workunit.client.0.smithi059.stdout:0/505: creat dc/d37/fab x:0 0 0 2024-04-25T16:21:12.834 INFO:tasks.workunit.client.0.smithi059.stdout:3/570: write d0/db/d2d/f46 [2419191,85995] 0 2024-04-25T16:21:12.909 INFO:tasks.workunit.client.0.smithi059.stdout:8/503: dwrite d7/d16/d3a/f50 [0,4194304] 0 2024-04-25T16:21:13.499 INFO:tasks.workunit.client.0.smithi059.stdout:2/539: truncate de/d16/d7f/faf 926707 0 2024-04-25T16:21:13.533 INFO:tasks.workunit.client.0.smithi059.stdout:6/569: mknod d9/d16/d24/cb8 0 2024-04-25T16:21:13.578 INFO:tasks.workunit.client.0.smithi059.stdout:7/510: dread d0/d7/f40 [0,4194304] 0 2024-04-25T16:21:13.641 INFO:tasks.workunit.client.0.smithi059.stdout:9/544: getdents d6 0 2024-04-25T16:21:13.655 INFO:tasks.workunit.client.0.smithi059.stdout:3/571: getdents d0/d1e/d95 0 2024-04-25T16:21:13.713 INFO:tasks.workunit.client.0.smithi059.stdout:8/504: mknod d7/d2f/d76/d85/c9f 0 2024-04-25T16:21:13.788 INFO:tasks.workunit.client.0.smithi059.stdout:4/501: dwrite d0/d4/df/d44/f4d [0,4194304] 0 2024-04-25T16:21:14.085 INFO:tasks.workunit.client.0.smithi059.stdout:1/575: dwrite d7/d2a/d85/db7/f8b [4194304,4194304] 0 2024-04-25T16:21:14.263 INFO:tasks.workunit.client.0.smithi059.stdout:0/506: dwrite dc/d37/d47/d71/f7a [0,4194304] 0 2024-04-25T16:21:14.335 INFO:tasks.workunit.client.0.smithi059.stdout:0/507: chown dc/d37/d47/d60/f61 99 1 2024-04-25T16:21:14.734 INFO:tasks.workunit.client.0.smithi059.stdout:5/571: getdents d1/d1e/d27/d66/d70/d3d 0 2024-04-25T16:21:14.830 INFO:tasks.workunit.client.0.smithi059.stdout:1/576: dread - d7/d2a/d85/db7/d2d/d41/d8f/fa0 zero size 2024-04-25T16:21:14.918 INFO:tasks.workunit.client.0.smithi059.stdout:0/508: creat dc/dd/d5c/fac x:0 0 0 2024-04-25T16:21:15.273 INFO:tasks.workunit.client.0.smithi059.stdout:6/570: creat d9/d16/d53/fb9 x:0 0 0 2024-04-25T16:21:15.338 INFO:tasks.workunit.client.0.smithi059.stdout:5/572: mkdir d1/d1e/d27/d66/d70/d75/dc3 0 2024-04-25T16:21:15.380 INFO:tasks.workunit.client.0.smithi059.stdout:5/573: chown d1/dd/fa5 71566129 1 2024-04-25T16:21:15.403 INFO:tasks.workunit.client.0.smithi059.stdout:1/577: unlink d7/f69 0 2024-04-25T16:21:15.431 INFO:tasks.workunit.client.0.smithi059.stdout:5/574: chown d1/d48/da3/f81 95 1 2024-04-25T16:21:15.433 INFO:tasks.workunit.client.0.smithi059.stdout:7/511: dwrite d0/d7/d16/d20/f59 [0,4194304] 0 2024-04-25T16:21:15.504 INFO:tasks.workunit.client.0.smithi059.stdout:0/509: creat dc/d37/d47/fad x:0 0 0 2024-04-25T16:21:15.613 INFO:tasks.workunit.client.0.smithi059.stdout:4/502: link d0/d4/f7f d0/d4/df/d1c/d45/f9b 0 2024-04-25T16:21:15.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:21:15.654 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:21:15.690 INFO:tasks.workunit.client.0.smithi059.stdout:0/510: dread dc/d84/f9a [0,4194304] 0 2024-04-25T16:21:15.693 INFO:tasks.workunit.client.0.smithi059.stdout:2/540: getdents de/d2a/d2e 0 2024-04-25T16:21:15.713 INFO:tasks.workunit.client.0.smithi059.stdout:8/505: write d7/f93 [127188,54485] 0 2024-04-25T16:21:15.738 INFO:tasks.workunit.client.0.smithi059.stdout:0/511: stat dc/d37/fab 0 2024-04-25T16:21:15.757 INFO:tasks.workunit.client.0.smithi059.stdout:1/578: symlink d7/d2a/d85/db7/d16/d5c/d74/lb9 0 2024-04-25T16:21:15.806 INFO:tasks.workunit.client.0.smithi059.stdout:3/572: link d0/db/d47/c83 d0/cbe 0 2024-04-25T16:21:15.831 INFO:tasks.workunit.client.0.smithi059.stdout:5/575: rmdir d1/d1e/d27/d66/d70/d3d/d44 39 2024-04-25T16:21:15.855 INFO:tasks.workunit.client.0.smithi059.stdout:5/576: dread d1/d48/da3/f52 [0,4194304] 0 2024-04-25T16:21:15.876 INFO:tasks.workunit.client.0.smithi059.stdout:5/577: read d1/d1e/d27/f4e [38479,111096] 0 2024-04-25T16:21:15.969 INFO:tasks.workunit.client.0.smithi059.stdout:5/578: sync 2024-04-25T16:21:15.989 INFO:tasks.workunit.client.0.smithi059.stdout:4/503: creat d0/d4/df/d1c/d45/f9c x:0 0 0 2024-04-25T16:21:16.150 INFO:tasks.workunit.client.0.smithi059.stdout:8/506: rmdir d7/d2f/d76 39 2024-04-25T16:21:16.156 INFO:tasks.workunit.client.0.smithi059.stdout:0/512: creat dc/dd/fae x:0 0 0 2024-04-25T16:21:16.186 INFO:tasks.workunit.client.0.smithi059.stdout:2/541: truncate de/d16/d82/fac 592149 0 2024-04-25T16:21:16.191 INFO:tasks.workunit.client.0.smithi059.stdout:1/579: mknod d7/d2a/d85/cba 0 2024-04-25T16:21:16.202 INFO:tasks.workunit.client.0.smithi059.stdout:9/545: write d6/fb [91230,23203] 0 2024-04-25T16:21:16.704 INFO:tasks.workunit.client.0.smithi059.stdout:4/504: rmdir d0 39 2024-04-25T16:21:16.716 INFO:tasks.workunit.client.0.smithi059.stdout:6/571: write d9/d27/f34 [4236126,51132] 0 2024-04-25T16:21:16.743 INFO:tasks.workunit.client.0.smithi059.stdout:8/507: creat d7/dd/d33/d57/fa0 x:0 0 0 2024-04-25T16:21:16.747 INFO:tasks.workunit.client.0.smithi059.stdout:7/512: creat d0/d7/d16/d20/d2b/d33/d4c/d4e/fa8 x:0 0 0 2024-04-25T16:21:16.755 INFO:tasks.workunit.client.0.smithi059.stdout:9/546: mknod d6/ca1 0 2024-04-25T16:21:17.085 INFO:tasks.workunit.client.0.smithi059.stdout:0/513: getdents dc/dd/d3b/d86 0 2024-04-25T16:21:17.091 INFO:tasks.workunit.client.0.smithi059.stdout:0/514: readlink dc/df/l1c 0 2024-04-25T16:21:17.105 INFO:tasks.workunit.client.0.smithi059.stdout:0/515: dread - dc/d37/d47/d60/d6e/f8a zero size 2024-04-25T16:21:17.198 INFO:tasks.workunit.client.0.smithi059.stdout:6/572: creat d9/d16/d24/d97/fba x:0 0 0 2024-04-25T16:21:17.224 INFO:tasks.workunit.client.0.smithi059.stdout:8/508: symlink d7/d16/d3a/la1 0 2024-04-25T16:21:17.258 INFO:tasks.workunit.client.0.smithi059.stdout:9/547: mknod d6/d35/d28/ca2 0 2024-04-25T16:21:17.260 INFO:tasks.workunit.client.0.smithi059.stdout:3/573: dwrite d0/db/d3f/d49/faa [0,4194304] 0 2024-04-25T16:21:17.353 INFO:tasks.workunit.client.0.smithi059.stdout:9/548: readlink d6/d35/d2f/l5f 0 2024-04-25T16:21:17.391 INFO:tasks.workunit.client.0.smithi059.stdout:8/509: dread d7/d16/d3a/f50 [0,4194304] 0 2024-04-25T16:21:17.558 INFO:tasks.workunit.client.0.smithi059.stdout:5/579: rename d1/dd/l1a to d1/d1e/d27/d66/d70/lc4 0 2024-04-25T16:21:17.713 INFO:tasks.workunit.client.0.smithi059.stdout:2/542: dwrite de/d2a/d2e/f98 [0,4194304] 0 2024-04-25T16:21:17.854 INFO:tasks.workunit.client.0.smithi059.stdout:4/505: write d0/d4/df/d48/d5f/f6a [4824980,115658] 0 2024-04-25T16:21:17.856 INFO:tasks.workunit.client.0.smithi059.stdout:6/573: write f6 [2499465,128151] 0 2024-04-25T16:21:18.218 INFO:tasks.workunit.client.0.smithi059.stdout:7/513: truncate d0/d7/d16/d20/d2b/f2e 2596375 0 2024-04-25T16:21:18.408 INFO:tasks.workunit.client.0.smithi059.stdout:2/543: mknod de/d2a/d2e/dbe/cc7 0 2024-04-25T16:21:18.425 INFO:tasks.workunit.client.0.smithi059.stdout:4/506: fsync d0/d4/f4b 0 2024-04-25T16:21:18.649 INFO:tasks.workunit.client.0.smithi059.stdout:5/580: symlink d1/d1e/d27/d66/d70/d3d/d44/lc5 0 2024-04-25T16:21:18.663 INFO:tasks.workunit.client.0.smithi059.stdout:3/574: write d0/d1e/f52 [824735,65049] 0 2024-04-25T16:21:18.664 INFO:tasks.workunit.client.0.smithi059.stdout:9/549: write d6/f47 [2198887,26974] 0 2024-04-25T16:21:18.664 INFO:tasks.workunit.client.0.smithi059.stdout:7/514: dread - d0/d7/d16/d20/d2b/d33/d79/d5d/fa6 zero size 2024-04-25T16:21:18.749 INFO:tasks.workunit.client.0.smithi059.stdout:5/581: chown d1/d1e/d27/d66/d70/d3d/d50/d8a/fa1 95 1 2024-04-25T16:21:18.757 INFO:tasks.workunit.client.0.smithi059.stdout:7/515: read d0/d7/d16/d20/d2b/d33/d79/d5d/f74 [369804,98667] 0 2024-04-25T16:21:18.819 INFO:tasks.workunit.client.0.smithi059.stdout:0/516: write dc/d37/d47/d71/d9c/fa1 [2073557,103663] 0 2024-04-25T16:21:18.823 INFO:tasks.workunit.client.0.smithi059.stdout:2/544: symlink de/d16/d82/lc8 0 2024-04-25T16:21:18.831 INFO:tasks.workunit.client.0.smithi059.stdout:4/507: creat d0/d79/f9d x:0 0 0 2024-04-25T16:21:18.878 INFO:tasks.workunit.client.0.smithi059.stdout:4/508: write d0/d4/df/d44/f4d [462762,98859] 0 2024-04-25T16:21:18.894 INFO:tasks.workunit.client.0.smithi059.stdout:4/509: stat d0/d4/df/d1c/d45 0 2024-04-25T16:21:19.257 INFO:tasks.workunit.client.0.smithi059.stdout:8/510: dwrite d7/dd/d17/d23/d37/f44 [0,4194304] 0 2024-04-25T16:21:19.266 INFO:tasks.workunit.client.0.smithi059.stdout:1/580: rename d7/d2a/d85/daa to d7/d2a/d85/db7/dbb 0 2024-04-25T16:21:19.605 INFO:tasks.workunit.client.0.smithi059.stdout:6/574: dwrite d9/d16/d53/d74/fac [0,4194304] 0 2024-04-25T16:21:19.703 INFO:tasks.workunit.client.0.smithi059.stdout:6/575: sync 2024-04-25T16:21:19.789 INFO:tasks.workunit.client.0.smithi059.stdout:3/575: mknod d0/d1e/d31/cbf 0 2024-04-25T16:21:19.889 INFO:tasks.workunit.client.0.smithi059.stdout:9/550: creat d6/d35/d26/fa3 x:0 0 0 2024-04-25T16:21:19.929 INFO:tasks.workunit.client.0.smithi059.stdout:7/516: mkdir d0/d7/d51/da9 0 2024-04-25T16:21:19.994 INFO:tasks.workunit.client.0.smithi059.stdout:5/582: creat d1/d1e/d27/d66/d70/d24/fc6 x:0 0 0 2024-04-25T16:21:20.077 INFO:tasks.workunit.client.0.smithi059.stdout:0/517: fdatasync dc/dd/f20 0 2024-04-25T16:21:20.098 INFO:tasks.workunit.client.0.smithi059.stdout:0/518: write dc/d37/d47/fad [70165,58373] 0 2024-04-25T16:21:20.118 INFO:tasks.workunit.client.0.smithi059.stdout:0/519: read dc/d37/d47/fad [85619,126214] 0 2024-04-25T16:21:20.206 INFO:tasks.workunit.client.0.smithi059.stdout:1/581: rmdir d7/d2a/d85/d8d 39 2024-04-25T16:21:20.496 INFO:tasks.workunit.client.0.smithi059.stdout:6/576: rmdir d9/d16/d53/d55/d71/d7e 39 2024-04-25T16:21:20.571 INFO:tasks.workunit.client.0.smithi059.stdout:3/576: creat d0/db/d47/d98/fc0 x:0 0 0 2024-04-25T16:21:20.619 INFO:tasks.workunit.client.0.smithi059.stdout:9/551: readlink d6/d4e/d54/l6a 0 2024-04-25T16:21:20.650 INFO:tasks.workunit.client.0.smithi059.stdout:7/517: symlink d0/d7/d16/d20/d2b/d33/d4c/laa 0 2024-04-25T16:21:20.829 INFO:tasks.workunit.client.0.smithi059.stdout:0/520: symlink dc/d84/laf 0 2024-04-25T16:21:20.918 INFO:tasks.workunit.client.0.smithi059.stdout:8/511: mknod d7/d2f/ca2 0 2024-04-25T16:21:21.005 INFO:tasks.workunit.client.0.smithi059.stdout:6/577: creat d9/d16/d53/d6c/fbb x:0 0 0 2024-04-25T16:21:21.166 INFO:tasks.workunit.client.0.smithi059.stdout:7/518: mkdir d0/d7/d16/d20/dab 0 2024-04-25T16:21:21.266 INFO:tasks.workunit.client.0.smithi059.stdout:2/545: creat de/fc9 x:0 0 0 2024-04-25T16:21:21.475 INFO:tasks.workunit.client.0.smithi059.stdout:0/521: read dc/df/f16 [167689,29181] 0 2024-04-25T16:21:21.559 INFO:tasks.workunit.client.0.smithi059.stdout:8/512: rmdir d7/dd/d17/d23/d37/d5c/d87 39 2024-04-25T16:21:21.565 INFO:tasks.workunit.client.0.smithi059.stdout:1/582: mkdir d7/d2a/d85/db7/d6a/dbc 0 2024-04-25T16:21:21.604 INFO:tasks.workunit.client.0.smithi059.stdout:6/578: dread d9/d16/d24/f3f [0,4194304] 0 2024-04-25T16:21:21.698 INFO:tasks.workunit.client.0.smithi059.stdout:5/583: creat d1/d1e/d27/d66/d70/fc7 x:0 0 0 2024-04-25T16:21:21.923 INFO:tasks.workunit.client.0.smithi059.stdout:6/579: rename d9/d16/d53/d6c/lb7 to d9/d16/lbc 0 2024-04-25T16:21:21.938 INFO:tasks.workunit.client.0.smithi059.stdout:8/513: dread d7/d2f/f4a [0,4194304] 0 2024-04-25T16:21:22.045 INFO:tasks.workunit.client.0.smithi059.stdout:5/584: creat d1/d48/da3/fc8 x:0 0 0 2024-04-25T16:21:22.144 INFO:tasks.workunit.client.0.smithi059.stdout:4/510: write d0/d4/f7f [2699926,99582] 0 2024-04-25T16:21:22.234 INFO:tasks.workunit.client.0.smithi059.stdout:4/511: sync 2024-04-25T16:21:22.289 INFO:tasks.workunit.client.0.smithi059.stdout:9/552: write d6/d35/d2f/f99 [11537,62819] 0 2024-04-25T16:21:22.359 INFO:tasks.workunit.client.0.smithi059.stdout:3/577: dwrite d0/db/d47/f2e [0,4194304] 0 2024-04-25T16:21:22.426 INFO:tasks.workunit.client.0.smithi059.stdout:7/519: rename d0/d7/f2c to d0/d7/fac 0 2024-04-25T16:21:22.450 INFO:tasks.workunit.client.0.smithi059.stdout:3/578: readlink d0/d1e/d57/la2 0 2024-04-25T16:21:22.519 INFO:tasks.workunit.client.0.smithi059.stdout:8/514: fdatasync d7/dd/d17/d23/f71 0 2024-04-25T16:21:22.530 INFO:tasks.workunit.client.0.smithi059.stdout:8/515: chown d7/dd/c13 6 1 2024-04-25T16:21:22.638 INFO:tasks.workunit.client.0.smithi059.stdout:1/583: rename d7/c27 to d7/cbd 0 2024-04-25T16:21:22.655 INFO:tasks.workunit.client.0.smithi059.stdout:1/584: chown d7/d2a/d85/db7/d2d/d41/d8f/f5e 13 1 2024-04-25T16:21:22.663 INFO:tasks.workunit.client.0.smithi059.stdout:1/585: stat d7/d21/l86 0 2024-04-25T16:21:22.710 INFO:tasks.workunit.client.0.smithi059.stdout:4/512: mkdir d0/d4/df/d1c/d45/d54/d75/d7e/d9e 0 2024-04-25T16:21:22.804 INFO:tasks.workunit.client.0.smithi059.stdout:0/522: write dc/d44/f73 [3268414,40141] 0 2024-04-25T16:21:22.838 INFO:tasks.workunit.client.0.smithi059.stdout:3/579: truncate d0/d1e/f45 3527111 0 2024-04-25T16:21:23.026 INFO:tasks.workunit.client.0.smithi059.stdout:2/546: getdents de/d2a/d2e/d36/d2c/d40 0 2024-04-25T16:21:23.275 INFO:tasks.workunit.client.0.smithi059.stdout:4/513: dread - d0/d4/df/d1c/d45/d54/d75/f90 zero size 2024-04-25T16:21:23.393 INFO:tasks.workunit.client.0.smithi059.stdout:0/523: symlink dc/d44/d5f/d72/lb0 0 2024-04-25T16:21:23.416 INFO:tasks.workunit.client.0.smithi059.stdout:0/524: write dc/d37/d47/d71/d9c/fa1 [207482,91827] 0 2024-04-25T16:21:23.451 INFO:tasks.workunit.client.0.smithi059.stdout:3/580: unlink d0/db/f7c 0 2024-04-25T16:21:23.511 INFO:tasks.workunit.client.0.smithi059.stdout:5/585: write d1/d1e/d27/d66/d70/d3d/d44/f88 [1430514,92741] 0 2024-04-25T16:21:23.562 INFO:tasks.workunit.client.0.smithi059.stdout:6/580: dwrite d9/f59 [0,4194304] 0 2024-04-25T16:21:23.639 INFO:tasks.workunit.client.0.smithi059.stdout:9/553: link d6/d4e/f9f d6/d4e/d54/d5d/d48/d6e/fa4 0 2024-04-25T16:21:23.668 INFO:tasks.workunit.client.0.smithi059.stdout:2/547: dread de/f76 [0,4194304] 0 2024-04-25T16:21:23.679 INFO:tasks.workunit.client.0.smithi059.stdout:9/554: chown d6/l14 1094 1 2024-04-25T16:21:23.680 INFO:tasks.workunit.client.0.smithi059.stdout:6/581: chown d9/d16/c2d 7531 1 2024-04-25T16:21:23.729 INFO:tasks.workunit.client.0.smithi059.stdout:4/514: creat d0/d4/f9f x:0 0 0 2024-04-25T16:21:23.805 INFO:tasks.workunit.client.0.smithi059.stdout:8/516: write d7/dd/d33/f6c [170523,68227] 0 2024-04-25T16:21:23.842 INFO:tasks.workunit.client.0.smithi059.stdout:0/525: stat dc/df/d24/l4d 0 2024-04-25T16:21:24.219 INFO:tasks.workunit.client.0.smithi059.stdout:5/586: mknod d1/d48/d85/cc9 0 2024-04-25T16:21:24.341 INFO:tasks.workunit.client.0.smithi059.stdout:9/555: creat d6/d35/d2f/fa5 x:0 0 0 2024-04-25T16:21:24.457 INFO:tasks.workunit.client.0.smithi059.stdout:2/548: truncate de/d2a/d2e/d36/d2c/d40/f47 986364 0 2024-04-25T16:21:24.607 INFO:tasks.workunit.client.0.smithi059.stdout:2/549: dread de/d2a/d2e/d36/d59/f61 [0,4194304] 0 2024-04-25T16:21:24.796 INFO:tasks.workunit.client.0.smithi059.stdout:7/520: link d0/d7/c19 d0/d7/cad 0 2024-04-25T16:21:24.820 INFO:tasks.workunit.client.0.smithi059.stdout:8/517: mkdir d7/d16/da3 0 2024-04-25T16:21:24.872 INFO:tasks.workunit.client.0.smithi059.stdout:0/526: creat dc/dd/d3b/fb1 x:0 0 0 2024-04-25T16:21:24.885 INFO:tasks.workunit.client.0.smithi059.stdout:7/521: sync 2024-04-25T16:21:24.900 INFO:tasks.workunit.client.0.smithi059.stdout:3/581: write d0/db/d3f/d49/f9d [1398267,26245] 0 2024-04-25T16:21:24.990 INFO:tasks.workunit.client.0.smithi059.stdout:5/587: mkdir d1/d1e/dca 0 2024-04-25T16:21:25.004 INFO:tasks.workunit.client.0.smithi059.stdout:5/588: chown d1/d1e/d27/d66/d70/d3d/d50 37 1 2024-04-25T16:21:25.051 INFO:tasks.workunit.client.0.smithi059.stdout:5/589: sync 2024-04-25T16:21:25.465 INFO:tasks.workunit.client.0.smithi059.stdout:0/527: creat dc/dd/d3b/d66/fb2 x:0 0 0 2024-04-25T16:21:25.466 INFO:tasks.workunit.client.0.smithi059.stdout:8/518: creat d7/dd/d17/d23/d38/fa4 x:0 0 0 2024-04-25T16:21:25.534 INFO:tasks.workunit.client.0.smithi059.stdout:3/582: readlink d0/l6a 0 2024-04-25T16:21:25.612 INFO:tasks.workunit.client.0.smithi059.stdout:1/586: dwrite d7/d2a/d85/db7/d2d/d4a/f56 [0,4194304] 0 2024-04-25T16:21:25.670 INFO:tasks.workunit.client.0.smithi059.stdout:9/556: mknod d6/d4e/d54/ca6 0 2024-04-25T16:21:25.693 INFO:tasks.workunit.client.0.smithi059.stdout:5/590: creat d1/d1e/d8f/fcb x:0 0 0 2024-04-25T16:21:25.826 INFO:tasks.workunit.client.0.smithi059.stdout:8/519: fdatasync d7/dd/d17/d23/f63 0 2024-04-25T16:21:25.855 INFO:tasks.workunit.client.0.smithi059.stdout:7/522: rmdir d0/d7/d16/d20/d2b/d33/d79/d5d/d94 39 2024-04-25T16:21:25.868 INFO:tasks.workunit.client.0.smithi059.stdout:6/582: dwrite d9/d16/d53/d55/f93 [0,4194304] 0 2024-04-25T16:21:26.036 INFO:tasks.workunit.client.0.smithi059.stdout:3/583: mknod d0/db/d47/d5b/cc1 0 2024-04-25T16:21:26.040 INFO:tasks.workunit.client.0.smithi059.stdout:1/587: mkdir d7/d2a/d85/db7/d16/d7f/dbe 0 2024-04-25T16:21:26.164 INFO:tasks.workunit.client.0.smithi059.stdout:4/515: dwrite d0/d4/df/d48/f6c [4194304,4194304] 0 2024-04-25T16:21:26.228 INFO:tasks.workunit.client.0.smithi059.stdout:9/557: rename d6/d35/d26/f96 to d6/d35/d26/fa7 0 2024-04-25T16:21:26.318 INFO:tasks.workunit.client.0.smithi059.stdout:5/591: dread d1/d1e/d27/d66/d70/d3d/d44/f67 [0,4194304] 0 2024-04-25T16:21:26.364 INFO:tasks.workunit.client.0.smithi059.stdout:2/550: write de/d2a/d2e/d36/d2c/f8c [3941183,104614] 0 2024-04-25T16:21:26.621 INFO:tasks.workunit.client.0.smithi059.stdout:8/520: truncate d7/d2f/d43/f6f 1366856 0 2024-04-25T16:21:26.625 INFO:tasks.workunit.client.0.smithi059.stdout:6/583: mknod d9/d16/d53/d55/d6e/cbd 0 2024-04-25T16:21:26.647 INFO:tasks.workunit.client.0.smithi059.stdout:6/584: chown d9/d27/d68/f6d 1 1 2024-04-25T16:21:26.652 INFO:tasks.workunit.client.0.smithi059.stdout:8/521: chown d7/dd/d17/d23/d37/f82 15 1 2024-04-25T16:21:26.689 INFO:tasks.workunit.client.0.smithi059.stdout:7/523: truncate d0/d7/d16/d20/d2b/d33/d4c/f81 112544 0 2024-04-25T16:21:27.129 INFO:tasks.workunit.client.0.smithi059.stdout:4/516: fsync d0/d4/f2e 0 2024-04-25T16:21:27.129 INFO:tasks.workunit.client.0.smithi059.stdout:2/551: fsync de/d2a/d2e/d36/d2c/d40/f49 0 2024-04-25T16:21:27.139 INFO:tasks.workunit.client.0.smithi059.stdout:6/585: truncate d9/d27/f5f 876965 0 2024-04-25T16:21:27.141 INFO:tasks.workunit.client.0.smithi059.stdout:8/522: unlink d7/dd/d17/d23/d37/d5c/d78/c80 0 2024-04-25T16:21:27.244 INFO:tasks.workunit.client.0.smithi059.stdout:2/552: sync 2024-04-25T16:21:27.394 INFO:tasks.workunit.client.0.smithi059.stdout:3/584: rename d0/db/f20 to d0/d1e/d57/fc2 0 2024-04-25T16:21:27.455 INFO:tasks.workunit.client.0.smithi059.stdout:7/524: mkdir d0/d7/dae 0 2024-04-25T16:21:27.567 INFO:tasks.workunit.client.0.smithi059.stdout:6/586: truncate d9/d27/f84 4986655 0 2024-04-25T16:21:27.665 INFO:tasks.workunit.client.0.smithi059.stdout:0/528: dwrite dc/d37/d47/d71/f8d [0,4194304] 0 2024-04-25T16:21:27.731 INFO:tasks.workunit.client.0.smithi059.stdout:9/558: rename d6/d4e/d54/d5d/d48/l93 to d6/d35/d26/d6b/la8 0 2024-04-25T16:21:27.765 INFO:tasks.workunit.client.0.smithi059.stdout:3/585: creat d0/db/d3f/d49/d65/fc3 x:0 0 0 2024-04-25T16:21:27.799 INFO:tasks.workunit.client.0.smithi059.stdout:8/523: rmdir d7/dd/d17/d23/d37/d5c/d87/d94 39 2024-04-25T16:21:27.920 INFO:tasks.workunit.client.0.smithi059.stdout:6/587: mknod d9/d27/d39/d7b/cbe 0 2024-04-25T16:21:27.966 INFO:tasks.workunit.client.0.smithi059.stdout:5/592: getdents d1/d1e 0 2024-04-25T16:21:28.124 INFO:tasks.workunit.client.0.smithi059.stdout:2/553: rename de/d2a/d2e/dbe to de/d2a/d33/d65/dca 0 2024-04-25T16:21:28.257 INFO:tasks.workunit.client.0.smithi059.stdout:0/529: creat dc/dd/d3b/d66/d9b/fb3 x:0 0 0 2024-04-25T16:21:28.315 INFO:tasks.workunit.client.0.smithi059.stdout:3/586: creat d0/db/d3f/fc4 x:0 0 0 2024-04-25T16:21:28.321 INFO:tasks.workunit.client.0.smithi059.stdout:8/524: truncate d7/d2f/f47 1947323 0 2024-04-25T16:21:28.371 INFO:tasks.workunit.client.0.smithi059.stdout:1/588: dwrite d7/f22 [4194304,4194304] 0 2024-04-25T16:21:28.708 INFO:tasks.workunit.client.0.smithi059.stdout:7/525: rename d0/d7/d16/f44 to d0/d3f/faf 0 2024-04-25T16:21:28.708 INFO:tasks.workunit.client.0.smithi059.stdout:4/517: link d0/d4/df/d44/f97 d0/d4/df/d1c/fa0 0 2024-04-25T16:21:29.226 INFO:tasks.workunit.client.0.smithi059.stdout:5/593: mkdir d1/d1e/d27/d66/d70/db9/dcc 0 2024-04-25T16:21:29.345 INFO:tasks.workunit.client.0.smithi059.stdout:4/518: read d0/d4/df/f42 [439993,79114] 0 2024-04-25T16:21:29.486 INFO:tasks.workunit.client.0.smithi059.stdout:7/526: dread d0/d7/d16/d20/f59 [0,4194304] 0 2024-04-25T16:21:29.497 INFO:tasks.workunit.client.0.smithi059.stdout:7/527: chown d0/d7/f23 25 1 2024-04-25T16:21:29.961 INFO:tasks.workunit.client.0.smithi059.stdout:5/594: read - d1/d1e/d27/d66/d70/d3d/d44/d79/d92/fc1 zero size 2024-04-25T16:21:30.330 INFO:tasks.workunit.client.0.smithi059.stdout:3/587: dread d0/db/d3f/d49/f9d [0,4194304] 0 2024-04-25T16:21:30.362 INFO:tasks.workunit.client.0.smithi059.stdout:5/595: rmdir d1 39 2024-04-25T16:21:30.368 INFO:tasks.workunit.client.0.smithi059.stdout:4/519: symlink d0/d4/df/d1c/d45/d54/d75/d7e/d9e/la1 0 2024-04-25T16:21:30.421 INFO:tasks.workunit.client.0.smithi059.stdout:9/559: dwrite d6/d35/d26/fa7 [0,4194304] 0 2024-04-25T16:21:30.510 INFO:tasks.workunit.client.0.smithi059.stdout:8/525: write d7/dd/d17/d23/d38/f7b [3467582,92558] 0 2024-04-25T16:21:30.692 INFO:tasks.workunit.client.0.smithi059.stdout:0/530: dwrite dc/dd/d3b/f80 [0,4194304] 0 2024-04-25T16:21:30.812 INFO:tasks.workunit.client.0.smithi059.stdout:1/589: dwrite d7/d2a/d85/db7/d2d/d41/d8f/f2e [0,4194304] 0 2024-04-25T16:21:30.812 INFO:tasks.workunit.client.0.smithi059.stdout:3/588: fsync d0/db/d3f/d49/f7b 0 2024-04-25T16:21:30.936 INFO:tasks.workunit.client.0.smithi059.stdout:1/590: chown d7/d2a/l64 17090892 1 2024-04-25T16:21:31.125 INFO:tasks.workunit.client.0.smithi059.stdout:6/588: write d9/d27/d39/f86 [848140,106229] 0 2024-04-25T16:21:31.138 INFO:tasks.workunit.client.0.smithi059.stdout:6/589: chown d9/f4d 23 1 2024-04-25T16:21:31.248 INFO:tasks.workunit.client.0.smithi059.stdout:8/526: mkdir d7/dd/d17/d23/d37/d8b/d7d/d7e/da5 0 2024-04-25T16:21:31.307 INFO:tasks.workunit.client.0.smithi059.stdout:0/531: mknod dc/d37/cb4 0 2024-04-25T16:21:31.460 INFO:tasks.workunit.client.0.smithi059.stdout:3/589: creat d0/db/d3f/d49/fc5 x:0 0 0 2024-04-25T16:21:31.607 INFO:tasks.workunit.client.0.smithi059.stdout:4/520: link d0/d4/df/d1c/d45/f27 d0/d4/df/d1c/d45/d54/d75/fa2 0 2024-04-25T16:21:31.646 INFO:tasks.workunit.client.0.smithi059.stdout:6/590: dread d9/d27/f34 [0,4194304] 0 2024-04-25T16:21:31.744 INFO:tasks.workunit.client.0.smithi059.stdout:6/591: sync 2024-04-25T16:21:31.934 INFO:tasks.workunit.client.0.smithi059.stdout:7/528: dwrite d0/d7/f1f [0,4194304] 0 2024-04-25T16:21:31.995 INFO:tasks.workunit.client.0.smithi059.stdout:9/560: link d6/f7e d6/d4e/d54/fa9 0 2024-04-25T16:21:32.048 INFO:tasks.workunit.client.0.smithi059.stdout:9/561: chown d6/d35/d26/fa3 0 1 2024-04-25T16:21:32.089 INFO:tasks.workunit.client.0.smithi059.stdout:4/521: mkdir d0/d4/df/d48/da3 0 2024-04-25T16:21:32.094 INFO:tasks.workunit.client.0.smithi059.stdout:2/554: dwrite de/d2a/d2e/f30 [0,4194304] 0 2024-04-25T16:21:32.548 INFO:tasks.workunit.client.0.smithi059.stdout:2/555: unlink de/d2a/d2e/l5e 0 2024-04-25T16:21:32.601 INFO:tasks.workunit.client.0.smithi059.stdout:4/522: mkdir d0/d4/df/d48/da3/da4 0 2024-04-25T16:21:32.615 INFO:tasks.workunit.client.0.smithi059.stdout:4/523: chown d0/d4/df/d48/d5f/f68 11930132 1 2024-04-25T16:21:32.666 INFO:tasks.workunit.client.0.smithi059.stdout:5/596: rename d1/d1e/d27/d66/d70/d3d to d1/dcd 0 2024-04-25T16:21:32.763 INFO:tasks.workunit.client.0.smithi059.stdout:9/562: creat d6/d4e/d54/faa x:0 0 0 2024-04-25T16:21:32.796 INFO:tasks.workunit.client.0.smithi059.stdout:4/524: read d0/d4/df/d1c/d45/d54/f77 [1604181,23223] 0 2024-04-25T16:21:32.890 INFO:tasks.workunit.client.0.smithi059.stdout:8/527: rename d7/dd/d17/d23/d37/d5c/d87/f8a to d7/d16/d36/fa6 0 2024-04-25T16:21:32.966 INFO:tasks.workunit.client.0.smithi059.stdout:5/597: creat d1/dcd/d50/fce x:0 0 0 2024-04-25T16:21:32.967 INFO:tasks.workunit.client.0.smithi059.stdout:2/556: fsync de/d2a/d2e/f3f 0 2024-04-25T16:21:32.988 INFO:tasks.workunit.client.0.smithi059.stdout:5/598: chown d1/dd/f12 359 1 2024-04-25T16:21:33.241 INFO:tasks.workunit.client.0.smithi059.stdout:8/528: fdatasync d7/d16/d3a/f50 0 2024-04-25T16:21:33.355 INFO:tasks.workunit.client.0.smithi059.stdout:4/525: symlink d0/d4/df/d1c/d45/d54/la5 0 2024-04-25T16:21:33.368 INFO:tasks.workunit.client.0.smithi059.stdout:1/591: dwrite d7/d2a/d85/db7/d16/d5c/fa8 [0,4194304] 0 2024-04-25T16:21:33.452 INFO:tasks.workunit.client.0.smithi059.stdout:3/590: rename d0/db/d3f/d49/d65/ca6 to d0/d1e/d31/cc6 0 2024-04-25T16:21:33.737 INFO:tasks.workunit.client.0.smithi059.stdout:6/592: rename d9/d16/d24/f32 to d9/d16/d53/d6c/da6/fbf 0 2024-04-25T16:21:33.821 INFO:tasks.workunit.client.0.smithi059.stdout:5/599: link d1/d1e/d27/fb3 d1/d1e/d27/d66/d70/db9/fcf 0 2024-04-25T16:21:34.055 INFO:tasks.workunit.client.0.smithi059.stdout:9/563: rename d6/d35/d2f/d39/f64 to d6/d4e/d54/d5d/d95/fab 0 2024-04-25T16:21:34.075 INFO:tasks.workunit.client.0.smithi059.stdout:6/593: read d9/d16/f1f [6975935,6454] 0 2024-04-25T16:21:34.293 INFO:tasks.workunit.client.0.smithi059.stdout:2/557: getdents de/d16/d82 0 2024-04-25T16:21:34.298 INFO:tasks.workunit.client.0.smithi059.stdout:0/532: write dc/df/d24/f6d [1472327,55612] 0 2024-04-25T16:21:34.329 INFO:tasks.workunit.client.0.smithi059.stdout:3/591: fdatasync d0/db/d3f/d6c/fac 0 2024-04-25T16:21:34.728 INFO:tasks.workunit.client.0.smithi059.stdout:7/529: dwrite d0/f88 [4194304,4194304] 0 2024-04-25T16:21:34.824 INFO:tasks.workunit.client.0.smithi059.stdout:9/564: fsync d6/d4e/d54/f8b 0 2024-04-25T16:21:35.085 INFO:tasks.workunit.client.0.smithi059.stdout:3/592: fdatasync d0/d1e/f53 0 2024-04-25T16:21:35.124 INFO:tasks.workunit.client.0.smithi059.stdout:1/592: link d7/d21/d51/cb0 d7/d2a/d85/db7/cbf 0 2024-04-25T16:21:35.372 INFO:tasks.workunit.client.0.smithi059.stdout:2/558: fsync de/d2a/f4c 0 2024-04-25T16:21:35.400 INFO:tasks.workunit.client.0.smithi059.stdout:4/526: write d0/d4/df/d48/d5f/f6a [3219055,36718] 0 2024-04-25T16:21:35.633 INFO:tasks.workunit.client.0.smithi059.stdout:1/593: dread - d7/d93/fb3 zero size 2024-04-25T16:21:35.850 INFO:tasks.workunit.client.0.smithi059.stdout:7/530: creat d0/d7/d16/d20/d2b/d33/d9f/fb0 x:0 0 0 2024-04-25T16:21:35.890 INFO:tasks.workunit.client.0.smithi059.stdout:7/531: dread d0/d7/d16/d20/d2b/d33/d4c/d4e/d4f/f52 [0,4194304] 0 2024-04-25T16:21:36.014 INFO:tasks.workunit.client.0.smithi059.stdout:0/533: rename f6 to dc/df/d24/fb5 0 2024-04-25T16:21:36.094 INFO:tasks.workunit.client.0.smithi059.stdout:5/600: write d1/d1e/d27/f30 [3103425,42891] 0 2024-04-25T16:21:36.144 INFO:tasks.workunit.client.0.smithi059.stdout:7/532: rmdir d0/d7/d16/d20/d2b/d33/d4c/d4e/d4f 39 2024-04-25T16:21:36.149 INFO:tasks.workunit.client.0.smithi059.stdout:8/529: write d7/d2f/d43/f96 [962515,51471] 0 2024-04-25T16:21:36.437 INFO:tasks.workunit.client.0.smithi059.stdout:2/559: rename de/d2a/d33/f53 to de/d2a/d2e/d36/d2c/d40/fcb 0 2024-04-25T16:21:36.509 INFO:tasks.workunit.client.0.smithi059.stdout:1/594: creat d7/d2a/db8/fc0 x:0 0 0 2024-04-25T16:21:36.566 INFO:tasks.workunit.client.0.smithi059.stdout:9/565: getdents d6/d4e 0 2024-04-25T16:21:36.719 INFO:tasks.workunit.client.0.smithi059.stdout:8/530: dread d7/dd/d33/f73 [0,4194304] 0 2024-04-25T16:21:36.738 INFO:tasks.workunit.client.0.smithi059.stdout:8/531: chown d7/dd/d33/c6d 3 1 2024-04-25T16:21:36.750 INFO:tasks.workunit.client.0.smithi059.stdout:8/532: dread - d7/dd/d17/d23/f71 zero size 2024-04-25T16:21:36.946 INFO:tasks.workunit.client.0.smithi059.stdout:2/560: truncate de/d16/d7f/fc6 387370 0 2024-04-25T16:21:36.968 INFO:tasks.workunit.client.0.smithi059.stdout:3/593: write d0/db/f30 [5948503,77872] 0 2024-04-25T16:21:37.079 INFO:tasks.workunit.client.0.smithi059.stdout:5/601: creat d1/d1e/d27/d66/d70/d75/dc3/fd0 x:0 0 0 2024-04-25T16:21:37.098 INFO:tasks.workunit.client.0.smithi059.stdout:5/602: dread - d1/d1e/d27/d66/d70/d75/dc3/fd0 zero size 2024-04-25T16:21:37.181 INFO:tasks.workunit.client.0.smithi059.stdout:9/566: fsync d6/d4e/d54/d5d/d48/d6e/f9e 0 2024-04-25T16:21:37.294 INFO:tasks.workunit.client.0.smithi059.stdout:7/533: symlink d0/d7/d16/d20/d2b/d33/d79/d5d/lb1 0 2024-04-25T16:21:37.317 INFO:tasks.workunit.client.0.smithi059.stdout:7/534: stat d0/d7/d16/d20/d2b/d33/f41 0 2024-04-25T16:21:37.501 INFO:tasks.workunit.client.0.smithi059.stdout:3/594: mkdir d0/d1e/d31/dc7 0 2024-04-25T16:21:37.581 INFO:tasks.workunit.client.0.smithi059.stdout:1/595: fsync d7/d2a/d85/db7/d2d/d4a/f4b 0 2024-04-25T16:21:37.637 INFO:tasks.workunit.client.0.smithi059.stdout:5/603: mkdir d1/dcd/d44/dd1 0 2024-04-25T16:21:37.672 INFO:tasks.workunit.client.0.smithi059.stdout:0/534: getdents dc/df/d5e 0 2024-04-25T16:21:37.771 INFO:tasks.workunit.client.0.smithi059.stdout:4/527: dwrite d0/d4/df/d44/f59 [0,4194304] 0 2024-04-25T16:21:37.838 INFO:tasks.workunit.client.0.smithi059.stdout:8/533: fsync d7/d16/d3a/f9a 0 2024-04-25T16:21:37.841 INFO:tasks.workunit.client.0.smithi059.stdout:9/567: fsync d6/d4e/d54/f62 0 2024-04-25T16:21:37.914 INFO:tasks.workunit.client.0.smithi059.stdout:9/568: dread d6/d35/d2f/d39/f4f [0,4194304] 0 2024-04-25T16:21:37.941 INFO:tasks.workunit.client.0.smithi059.stdout:3/595: creat d0/db/d47/d5b/fc8 x:0 0 0 2024-04-25T16:21:37.949 INFO:tasks.workunit.client.0.smithi059.stdout:7/535: read d0/d7/d16/d20/d2b/d33/d79/f9c [335538,65501] 0 2024-04-25T16:21:37.986 INFO:tasks.workunit.client.0.smithi059.stdout:3/596: chown d0/d1e/d57/lad 3200234 1 2024-04-25T16:21:37.995 INFO:tasks.workunit.client.0.smithi059.stdout:3/597: stat d0/db/d47/d98/fc0 0 2024-04-25T16:21:38.360 INFO:tasks.workunit.client.0.smithi059.stdout:9/569: stat d6/d35/l21 0 2024-04-25T16:21:38.365 INFO:tasks.workunit.client.0.smithi059.stdout:2/561: creat de/d16/fcc x:0 0 0 2024-04-25T16:21:38.416 INFO:tasks.workunit.client.0.smithi059.stdout:6/594: mkdir d9/d16/dc0 0 2024-04-25T16:21:38.431 INFO:tasks.workunit.client.0.smithi059.stdout:4/528: dread d0/d4/df/d1c/d45/d54/f72 [0,4194304] 0 2024-04-25T16:21:38.613 INFO:tasks.workunit.client.0.smithi059.stdout:7/536: dread d0/d7/fac [0,4194304] 0 2024-04-25T16:21:38.843 INFO:tasks.workunit.client.0.smithi059.stdout:1/596: link d7/d21/f49 d7/d2a/d85/db7/d6a/dbc/fc1 0 2024-04-25T16:21:38.954 INFO:tasks.workunit.client.0.smithi059.stdout:4/529: rename d0/d4/df/d48/l5a to d0/d4/df/d48/da3/la6 0 2024-04-25T16:21:38.964 INFO:tasks.workunit.client.0.smithi059.stdout:4/530: chown d0/d4/df/f12 3206626 1 2024-04-25T16:21:39.148 INFO:tasks.workunit.client.0.smithi059.stdout:6/595: symlink d9/d16/d53/lc1 0 2024-04-25T16:21:39.152 INFO:tasks.workunit.client.0.smithi059.stdout:1/597: mkdir d7/d2a/d85/db7/dbb/dc2 0 2024-04-25T16:21:39.191 INFO:tasks.workunit.client.0.smithi059.stdout:5/604: write d1/d1e/d27/d66/d70/d75/f95 [1056578,13259] 0 2024-04-25T16:21:39.290 INFO:tasks.workunit.client.0.smithi059.stdout:0/535: dwrite dc/d37/d47/d71/d9c/fa1 [0,4194304] 0 2024-04-25T16:21:39.366 INFO:tasks.workunit.client.0.smithi059.stdout:0/536: fsync dc/d37/d47/d71/d9c/fa1 0 2024-04-25T16:21:39.386 INFO:tasks.workunit.client.0.smithi059.stdout:0/537: rename dc/d37/d47/d71/d77 to dc/d37/d47/d71/d77/db6 22 2024-04-25T16:21:39.392 INFO:tasks.workunit.client.0.smithi059.stdout:0/538: readlink dc/dd/l46 0 2024-04-25T16:21:39.504 INFO:tasks.workunit.client.0.smithi059.stdout:8/534: dwrite d7/d16/f9e [0,4194304] 0 2024-04-25T16:21:39.612 INFO:tasks.workunit.client.0.smithi059.stdout:2/562: write fd [2054159,119770] 0 2024-04-25T16:21:39.778 INFO:tasks.workunit.client.0.smithi059.stdout:9/570: dwrite d6/d4e/d54/d5d/d48/f5a [0,4194304] 0 2024-04-25T16:21:39.903 INFO:tasks.workunit.client.0.smithi059.stdout:3/598: dwrite d0/db/d3f/d49/d65/f85 [0,4194304] 0 2024-04-25T16:21:39.972 INFO:tasks.workunit.client.0.smithi059.stdout:4/531: creat d0/d4/df/d1c/d45/d54/d75/d82/d8f/fa7 x:0 0 0 2024-04-25T16:21:40.023 INFO:tasks.workunit.client.0.smithi059.stdout:6/596: chown d9/d1b/d58/d49/db0 1570 1 2024-04-25T16:21:40.047 INFO:tasks.workunit.client.0.smithi059.stdout:1/598: fsync d7/d2a/d85/db7/d2d/d41/f7b 0 2024-04-25T16:21:40.112 INFO:tasks.workunit.client.0.smithi059.stdout:5/605: truncate d1/d48/da3/f52 355797 0 2024-04-25T16:21:40.590 INFO:tasks.workunit.client.0.smithi059.stdout:7/537: creat d0/d7/d16/d20/d2b/fb2 x:0 0 0 2024-04-25T16:21:40.600 INFO:tasks.workunit.client.0.smithi059.stdout:7/538: chown d0/d3f/fa3 0 1 2024-04-25T16:21:40.742 INFO:tasks.workunit.client.0.smithi059.stdout:4/532: fdatasync d0/d4/df/d44/f4d 0 2024-04-25T16:21:40.763 INFO:tasks.workunit.client.0.smithi059.stdout:4/533: dread - d0/d4/df/d1c/d45/d54/d75/f90 zero size 2024-04-25T16:21:40.884 INFO:tasks.workunit.client.0.smithi059.stdout:4/534: sync 2024-04-25T16:21:41.006 INFO:tasks.workunit.client.0.smithi059.stdout:0/539: mknod dc/cb7 0 2024-04-25T16:21:41.076 INFO:tasks.workunit.client.0.smithi059.stdout:2/563: link fd de/d2a/d2e/d36/d2c/fcd 0 2024-04-25T16:21:41.081 INFO:tasks.workunit.client.0.smithi059.stdout:5/606: dread d1/d48/d85/fb1 [0,4194304] 0 2024-04-25T16:21:41.098 INFO:tasks.workunit.client.0.smithi059.stdout:5/607: readlink d1/dcd/l45 0 2024-04-25T16:21:41.364 INFO:tasks.workunit.client.0.smithi059.stdout:1/599: symlink d7/d2a/d85/d8d/lc3 0 2024-04-25T16:21:41.528 INFO:tasks.workunit.client.0.smithi059.stdout:4/535: dread d0/d4/df/d48/f81 [0,4194304] 0 2024-04-25T16:21:41.528 INFO:tasks.workunit.client.0.smithi059.stdout:5/608: dread - d1/d1e/d27/d66/d70/d24/fa6 zero size 2024-04-25T16:21:41.597 INFO:tasks.workunit.client.0.smithi059.stdout:0/540: dread dc/d44/f73 [4194304,4194304] 0 2024-04-25T16:21:41.694 INFO:tasks.workunit.client.0.smithi059.stdout:0/541: dwrite dc/d37/d47/d71/d9c/fa1 [0,4194304] 0 2024-04-25T16:21:41.762 INFO:tasks.workunit.client.0.smithi059.stdout:1/600: creat d7/d21/fc4 x:0 0 0 2024-04-25T16:21:41.771 INFO:tasks.workunit.client.0.smithi059.stdout:8/535: rename d7/dd/f3c to d7/d16/fa7 0 2024-04-25T16:21:41.785 INFO:tasks.workunit.client.0.smithi059.stdout:9/571: write d6/f4a [4117172,62321] 0 2024-04-25T16:21:41.928 INFO:tasks.workunit.client.0.smithi059.stdout:8/536: dwrite d7/d2f/f47 [0,4194304] 0 2024-04-25T16:21:42.011 INFO:tasks.workunit.client.0.smithi059.stdout:7/539: rename d0/d7/d16/d20/d2b to d0/d7/d51/da9/db3 0 2024-04-25T16:21:42.110 INFO:tasks.workunit.client.0.smithi059.stdout:6/597: dwrite d9/d16/f52 [0,4194304] 0 2024-04-25T16:21:42.174 INFO:tasks.workunit.client.0.smithi059.stdout:9/572: fsync d6/d35/d28/f5b 0 2024-04-25T16:21:42.175 INFO:tasks.workunit.client.0.smithi059.stdout:3/599: rmdir d0/db/d3f/d89 39 2024-04-25T16:21:42.576 INFO:tasks.workunit.client.0.smithi059.stdout:5/609: rmdir d1/dcd/d44/d79/dad 0 2024-04-25T16:21:42.618 INFO:tasks.workunit.client.0.smithi059.stdout:9/573: read d6/d35/d2f/f3c [4185443,3883] 0 2024-04-25T16:21:42.699 INFO:tasks.workunit.client.0.smithi059.stdout:6/598: creat d9/d16/d53/d6c/da6/fc2 x:0 0 0 2024-04-25T16:21:42.702 INFO:tasks.workunit.client.0.smithi059.stdout:2/564: write de/d16/d3e/f8d [734476,109342] 0 2024-04-25T16:21:42.728 INFO:tasks.workunit.client.0.smithi059.stdout:6/599: readlink d9/d16/d54/l61 0 2024-04-25T16:21:42.744 INFO:tasks.workunit.client.0.smithi059.stdout:6/600: stat d9/d16/dc0 0 2024-04-25T16:21:42.868 INFO:tasks.workunit.client.0.smithi059.stdout:0/542: creat dc/d37/fb8 x:0 0 0 2024-04-25T16:21:42.873 INFO:tasks.workunit.client.0.smithi059.stdout:1/601: rmdir d7/db1 0 2024-04-25T16:21:42.888 INFO:tasks.workunit.client.0.smithi059.stdout:6/601: dread d9/d16/f42 [0,4194304] 0 2024-04-25T16:21:42.920 INFO:tasks.workunit.client.0.smithi059.stdout:6/602: stat d9/d16/d24/l45 0 2024-04-25T16:21:42.969 INFO:tasks.workunit.client.0.smithi059.stdout:5/610: fsync d1/dcd/d44/f67 0 2024-04-25T16:21:42.974 INFO:tasks.workunit.client.0.smithi059.stdout:4/536: write d0/fc [2582187,123607] 0 2024-04-25T16:21:43.026 INFO:tasks.workunit.client.0.smithi059.stdout:9/574: unlink d6/d4e/d54/d5d/d48/d6e/fa0 0 2024-04-25T16:21:43.184 INFO:tasks.workunit.client.0.smithi059.stdout:2/565: symlink de/d2a/d2e/d36/d2c/lce 0 2024-04-25T16:21:43.186 INFO:tasks.workunit.client.0.smithi059.stdout:4/537: dread d0/d4/df/d44/f49 [0,4194304] 0 2024-04-25T16:21:43.335 INFO:tasks.workunit.client.0.smithi059.stdout:5/611: truncate d1/f11 654575 0 2024-04-25T16:21:43.351 INFO:tasks.workunit.client.0.smithi059.stdout:8/537: dwrite d7/f15 [0,4194304] 0 2024-04-25T16:21:43.485 INFO:tasks.workunit.client.0.smithi059.stdout:7/540: write d0/d3f/f6a [5171084,29384] 0 2024-04-25T16:21:43.518 INFO:tasks.workunit.client.0.smithi059.stdout:9/575: symlink d6/d35/d6c/lac 0 2024-04-25T16:21:43.904 INFO:tasks.workunit.client.0.smithi059.stdout:5/612: mknod d1/dcd/d50/d8a/cd2 0 2024-04-25T16:21:43.914 INFO:tasks.workunit.client.0.smithi059.stdout:3/600: dwrite d0/db/d2d/f58 [0,4194304] 0 2024-04-25T16:21:44.064 INFO:tasks.workunit.client.0.smithi059.stdout:2/566: dread de/d2a/d2e/d36/d2c/f8c [0,4194304] 0 2024-04-25T16:21:44.077 INFO:tasks.workunit.client.0.smithi059.stdout:6/603: dread d9/d16/d53/d55/d71/d7e/f8a [0,4194304] 0 2024-04-25T16:21:44.079 INFO:tasks.workunit.client.0.smithi059.stdout:9/576: unlink d6/d35/d26/fa3 0 2024-04-25T16:21:44.090 INFO:tasks.workunit.client.0.smithi059.stdout:1/602: write d7/d2a/d85/db7/d6a/f79 [869754,54234] 0 2024-04-25T16:21:44.117 INFO:tasks.workunit.client.0.smithi059.stdout:0/543: link dc/dd/d3b/d66/d9b/f82 dc/dd/d5c/fb9 0 2024-04-25T16:21:44.173 INFO:tasks.workunit.client.0.smithi059.stdout:8/538: dread d7/d16/d3a/f50 [0,4194304] 0 2024-04-25T16:21:44.595 INFO:tasks.workunit.client.0.smithi059.stdout:3/601: mkdir d0/d1e/d57/dc9 0 2024-04-25T16:21:44.758 INFO:tasks.workunit.client.0.smithi059.stdout:4/538: write d0/d4/df/f8b [970713,106014] 0 2024-04-25T16:21:44.766 INFO:tasks.workunit.client.0.smithi059.stdout:2/567: stat de/d16/d7f/faf 0 2024-04-25T16:21:44.885 INFO:tasks.workunit.client.0.smithi059.stdout:6/604: mkdir d9/d16/d24/d97/dc3 0 2024-04-25T16:21:45.008 INFO:tasks.workunit.client.0.smithi059.stdout:7/541: dwrite d0/d7/f10 [4194304,4194304] 0 2024-04-25T16:21:45.125 INFO:tasks.workunit.client.0.smithi059.stdout:4/539: mknod d0/d4/df/d48/da3/ca8 0 2024-04-25T16:21:45.134 INFO:tasks.workunit.client.0.smithi059.stdout:4/540: readlink d0/d4/df/l8a 0 2024-04-25T16:21:45.303 INFO:tasks.workunit.client.0.smithi059.stdout:2/568: mkdir de/d2a/d33/d65/dcf 0 2024-04-25T16:21:45.376 INFO:tasks.workunit.client.0.smithi059.stdout:1/603: creat d7/d2a/d85/db7/d77/da3/fc5 x:0 0 0 2024-04-25T16:21:45.544 INFO:tasks.workunit.client.0.smithi059.stdout:6/605: mkdir d9/d16/d53/d55/d71/d7e/dc4 0 2024-04-25T16:21:45.725 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:21:45.728 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:21:46.100 INFO:tasks.workunit.client.0.smithi059.stdout:3/602: truncate d0/d1e/f8f 1551024 0 2024-04-25T16:21:46.105 INFO:tasks.workunit.client.0.smithi059.stdout:4/541: truncate d0/d4/df/d1c/d45/d54/d75/d82/f8e 640408 0 2024-04-25T16:21:46.119 INFO:tasks.workunit.client.0.smithi059.stdout:0/544: write dc/d37/d47/f7c [900006,59527] 0 2024-04-25T16:21:46.133 INFO:tasks.workunit.client.0.smithi059.stdout:8/539: creat d7/d2f/fa8 x:0 0 0 2024-04-25T16:21:46.157 INFO:tasks.workunit.client.0.smithi059.stdout:5/613: getdents d1/dd 0 2024-04-25T16:21:46.278 INFO:tasks.workunit.client.0.smithi059.stdout:6/606: read d9/d1b/f80 [352288,2933] 0 2024-04-25T16:21:46.340 INFO:tasks.workunit.client.0.smithi059.stdout:9/577: dwrite d6/d4e/d54/d5d/d95/fab [0,4194304] 0 2024-04-25T16:21:46.410 INFO:tasks.workunit.client.0.smithi059.stdout:6/607: sync 2024-04-25T16:21:46.474 INFO:tasks.workunit.client.0.smithi059.stdout:1/604: creat d7/d2a/d85/db7/d16/d5c/d74/da7/fc6 x:0 0 0 2024-04-25T16:21:46.608 INFO:tasks.workunit.client.0.smithi059.stdout:0/545: fsync dc/d37/fa3 0 2024-04-25T16:21:46.610 INFO:tasks.workunit.client.0.smithi059.stdout:8/540: rmdir d7/d16/d3a 39 2024-04-25T16:21:46.619 INFO:tasks.workunit.client.0.smithi059.stdout:3/603: creat d0/db/d47/d98/fca x:0 0 0 2024-04-25T16:21:46.778 INFO:tasks.workunit.client.0.smithi059.stdout:7/542: creat d0/d7/d51/da9/db3/fb4 x:0 0 0 2024-04-25T16:21:46.885 INFO:tasks.workunit.client.0.smithi059.stdout:9/578: rename d6/d35/d26/c67 to d6/d4e/d7a/cad 0 2024-04-25T16:21:46.905 INFO:tasks.workunit.client.0.smithi059.stdout:9/579: stat d6/d35/d2f/d39/d85 0 2024-04-25T16:21:46.991 INFO:tasks.workunit.client.0.smithi059.stdout:1/605: symlink d7/d21/d51/da6/lc7 0 2024-04-25T16:21:47.093 INFO:tasks.workunit.client.0.smithi059.stdout:4/542: getdents d0/d4/df/d48/da3/da4 0 2024-04-25T16:21:47.255 INFO:tasks.workunit.client.0.smithi059.stdout:7/543: fsync d0/d7/f40 0 2024-04-25T16:21:47.255 INFO:tasks.workunit.client.0.smithi059.stdout:0/546: rename dc/d44/f63 to dc/df/d5e/fba 0 2024-04-25T16:21:47.317 INFO:tasks.workunit.client.0.smithi059.stdout:6/608: fdatasync d9/d16/d53/f98 0 2024-04-25T16:21:47.442 INFO:tasks.workunit.client.0.smithi059.stdout:3/604: readlink d0/db/d3f/d49/d65/lb2 0 2024-04-25T16:21:47.451 INFO:tasks.workunit.client.0.smithi059.stdout:3/605: chown d0/d1e/d57/l72 724308569 1 2024-04-25T16:21:47.546 INFO:tasks.workunit.client.0.smithi059.stdout:8/541: symlink d7/d16/d3a/la9 0 2024-04-25T16:21:47.650 INFO:tasks.workunit.client.0.smithi059.stdout:2/569: dwrite de/f96 [0,4194304] 0 2024-04-25T16:21:47.724 INFO:tasks.workunit.client.0.smithi059.stdout:4/543: mkdir d0/d4/df/d48/da9 0 2024-04-25T16:21:47.733 INFO:tasks.workunit.client.0.smithi059.stdout:9/580: mkdir d6/dae 0 2024-04-25T16:21:47.790 INFO:tasks.workunit.client.0.smithi059.stdout:0/547: chown dc/d37/l43 164 1 2024-04-25T16:21:47.826 INFO:tasks.workunit.client.0.smithi059.stdout:0/548: dread dc/f7b [0,4194304] 0 2024-04-25T16:21:48.157 INFO:tasks.workunit.client.0.smithi059.stdout:9/581: fsync d6/f47 0 2024-04-25T16:21:48.198 INFO:tasks.workunit.client.0.smithi059.stdout:5/614: dwrite d1/d48/da3/d6d/f82 [0,4194304] 0 2024-04-25T16:21:48.270 INFO:tasks.workunit.client.0.smithi059.stdout:7/544: creat d0/d7/dae/fb5 x:0 0 0 2024-04-25T16:21:48.279 INFO:tasks.workunit.client.0.smithi059.stdout:0/549: truncate f9 2179472 0 2024-04-25T16:21:48.309 INFO:tasks.workunit.client.0.smithi059.stdout:0/550: read dc/d44/f73 [2497071,21240] 0 2024-04-25T16:21:48.337 INFO:tasks.workunit.client.0.smithi059.stdout:6/609: creat d9/d27/d39/da5/fc5 x:0 0 0 2024-04-25T16:21:48.376 INFO:tasks.workunit.client.0.smithi059.stdout:3/606: creat d0/d1e/d95/fcb x:0 0 0 2024-04-25T16:21:48.394 INFO:tasks.workunit.client.0.smithi059.stdout:0/551: sync 2024-04-25T16:21:48.622 INFO:tasks.workunit.client.0.smithi059.stdout:1/606: dwrite d7/d2a/d85/d8d/f95 [4194304,4194304] 0 2024-04-25T16:21:48.688 INFO:tasks.workunit.client.0.smithi059.stdout:1/607: readlink d7/d2a/d62/l75 0 2024-04-25T16:21:48.910 INFO:tasks.workunit.client.0.smithi059.stdout:9/582: mkdir d6/d35/d28/daf 0 2024-04-25T16:21:48.926 INFO:tasks.workunit.client.0.smithi059.stdout:6/610: mkdir d9/d16/d53/d6c/da6/dc6 0 2024-04-25T16:21:48.954 INFO:tasks.workunit.client.0.smithi059.stdout:0/552: mkdir dc/dd/d3b/d66/dbb 0 2024-04-25T16:21:48.956 INFO:tasks.workunit.client.0.smithi059.stdout:3/607: dread - d0/db/d3f/d49/fbd zero size 2024-04-25T16:21:49.010 INFO:tasks.workunit.client.0.smithi059.stdout:2/570: rename de/d2a/f4c to de/d16/fd0 0 2024-04-25T16:21:49.071 INFO:tasks.workunit.client.0.smithi059.stdout:0/553: dread dc/df/f1d [0,4194304] 0 2024-04-25T16:21:49.220 INFO:tasks.workunit.client.0.smithi059.stdout:6/611: symlink d9/d16/d54/lc7 0 2024-04-25T16:21:49.228 INFO:tasks.workunit.client.0.smithi059.stdout:9/583: chown d6/d35/c2c 8622 1 2024-04-25T16:21:49.241 INFO:tasks.workunit.client.0.smithi059.stdout:0/554: dread dc/f3a [0,4194304] 0 2024-04-25T16:21:49.265 INFO:tasks.workunit.client.0.smithi059.stdout:3/608: truncate d0/d1e/fa3 956101 0 2024-04-25T16:21:49.326 INFO:tasks.workunit.client.0.smithi059.stdout:6/612: stat d9/d16/d24/c28 0 2024-04-25T16:21:49.444 INFO:tasks.workunit.client.0.smithi059.stdout:8/542: dwrite d7/dd/d33/d57/fa0 [0,4194304] 0 2024-04-25T16:21:49.523 INFO:tasks.workunit.client.0.smithi059.stdout:4/544: dwrite d0/d4/f7f [0,4194304] 0 2024-04-25T16:21:49.653 INFO:tasks.workunit.client.0.smithi059.stdout:6/613: rmdir d9 39 2024-04-25T16:21:49.723 INFO:tasks.workunit.client.0.smithi059.stdout:0/555: mknod dc/d37/d47/d71/d77/cbc 0 2024-04-25T16:21:49.767 INFO:tasks.workunit.client.0.smithi059.stdout:3/609: mknod d0/db/d3f/d49/d65/ccc 0 2024-04-25T16:21:49.814 INFO:tasks.workunit.client.0.smithi059.stdout:2/571: fsync de/d2a/d2e/fb7 0 2024-04-25T16:21:50.181 INFO:tasks.workunit.client.0.smithi059.stdout:3/610: truncate d0/db/d2d/f46 767323 0 2024-04-25T16:21:50.182 INFO:tasks.workunit.client.0.smithi059.stdout:0/556: fdatasync dc/dd/d3b/d66/d9b/fb3 0 2024-04-25T16:21:50.365 INFO:tasks.workunit.client.0.smithi059.stdout:8/543: mkdir d7/dd/d17/d23/d37/d5c/d87/d94/d66/daa 0 2024-04-25T16:21:50.368 INFO:tasks.workunit.client.0.smithi059.stdout:1/608: link d7/d2a/d85/db7/d2d/d4a/fb5 d7/d2a/d85/db7/dbb/db6/fc8 0 2024-04-25T16:21:50.573 INFO:tasks.workunit.client.0.smithi059.stdout:5/615: dwrite d1/dd/f1d [0,4194304] 0 2024-04-25T16:21:50.582 INFO:tasks.workunit.client.0.smithi059.stdout:7/545: write d0/d7/d16/f42 [45641,119881] 0 2024-04-25T16:21:50.658 INFO:tasks.workunit.client.0.smithi059.stdout:2/572: creat de/d2a/d33/d65/dcf/fd1 x:0 0 0 2024-04-25T16:21:50.677 INFO:tasks.workunit.client.0.smithi059.stdout:5/616: readlink d1/d1e/l2f 0 2024-04-25T16:21:50.752 INFO:tasks.workunit.client.0.smithi059.stdout:1/609: unlink d7/d2a/d85/db7/d2d/d4a/f56 0 2024-04-25T16:21:51.341 INFO:tasks.workunit.client.0.smithi059.stdout:7/546: truncate d0/d7/d51/da9/db3/f2e 2726674 0 2024-04-25T16:21:51.556 INFO:tasks.workunit.client.0.smithi059.stdout:8/544: getdents d7/dd/d33 0 2024-04-25T16:21:51.667 INFO:tasks.workunit.client.0.smithi059.stdout:1/610: creat d7/d2a/d85/fc9 x:0 0 0 2024-04-25T16:21:51.846 INFO:tasks.workunit.client.0.smithi059.stdout:4/545: write d0/d4/df/d48/f4e [3021379,79291] 0 2024-04-25T16:21:51.871 INFO:tasks.workunit.client.0.smithi059.stdout:4/546: readlink d0/d4/df/d1c/d45/d54/d75/d82/d8f/l98 0 2024-04-25T16:21:51.915 INFO:tasks.workunit.client.0.smithi059.stdout:9/584: rename d6/d35/c24 to d6/d35/d2f/d39/cb0 0 2024-04-25T16:21:51.957 INFO:tasks.workunit.client.0.smithi059.stdout:8/545: symlink d7/d2f/d43/lab 0 2024-04-25T16:21:52.058 INFO:tasks.workunit.client.0.smithi059.stdout:6/614: dwrite d9/d16/d24/d97/f9c [0,4194304] 0 2024-04-25T16:21:52.429 INFO:tasks.workunit.client.0.smithi059.stdout:6/615: truncate d9/d16/d24/f3f 833234 0 2024-04-25T16:21:52.571 INFO:tasks.workunit.client.0.smithi059.stdout:9/585: mknod d6/d4e/d54/d5d/cb1 0 2024-04-25T16:21:52.625 INFO:tasks.workunit.client.0.smithi059.stdout:6/616: read - d9/d16/fb6 zero size 2024-04-25T16:21:52.649 INFO:tasks.workunit.client.0.smithi059.stdout:6/617: chown d9/d16 274857210 1 2024-04-25T16:21:52.661 INFO:tasks.workunit.client.0.smithi059.stdout:5/617: dwrite d1/d1e/d27/d66/f8b [0,4194304] 0 2024-04-25T16:21:52.985 INFO:tasks.workunit.client.0.smithi059.stdout:2/573: write de/d5a/d9a/fa4 [287029,6369] 0 2024-04-25T16:21:53.025 INFO:tasks.workunit.client.0.smithi059.stdout:7/547: mknod d0/cb6 0 2024-04-25T16:21:53.034 INFO:tasks.workunit.client.0.smithi059.stdout:0/557: rename dc/d37/d93 to dc/dd/dbd 0 2024-04-25T16:21:53.039 INFO:tasks.workunit.client.0.smithi059.stdout:1/611: write d7/d21/f7c [368603,54582] 0 2024-04-25T16:21:53.041 INFO:tasks.workunit.client.0.smithi059.stdout:8/546: write d7/f1c [501481,86797] 0 2024-04-25T16:21:53.092 INFO:tasks.workunit.client.0.smithi059.stdout:7/548: readlink d0/d7/d51/l92 0 2024-04-25T16:21:53.157 INFO:tasks.workunit.client.0.smithi059.stdout:5/618: creat d1/dcd/d50/d8a/fd3 x:0 0 0 2024-04-25T16:21:53.184 INFO:tasks.workunit.client.0.smithi059.stdout:7/549: sync 2024-04-25T16:21:53.219 INFO:tasks.workunit.client.0.smithi059.stdout:9/586: symlink d6/dae/lb2 0 2024-04-25T16:21:53.352 INFO:tasks.workunit.client.0.smithi059.stdout:3/611: creat d0/fcd x:0 0 0 2024-04-25T16:21:53.641 INFO:tasks.workunit.client.0.smithi059.stdout:9/587: truncate d6/d4e/d54/d5d/d48/d49/f5c 1253772 0 2024-04-25T16:21:53.737 INFO:tasks.workunit.client.0.smithi059.stdout:2/574: unlink de/d16/d3e/c68 0 2024-04-25T16:21:53.777 INFO:tasks.workunit.client.0.smithi059.stdout:6/618: write d9/d1b/f36 [1642600,60158] 0 2024-04-25T16:21:53.781 INFO:tasks.workunit.client.0.smithi059.stdout:3/612: dread - d0/db/d2d/d7a/f92 zero size 2024-04-25T16:21:53.804 INFO:tasks.workunit.client.0.smithi059.stdout:6/619: dread - d9/d16/fb6 zero size 2024-04-25T16:21:53.815 INFO:tasks.workunit.client.0.smithi059.stdout:3/613: chown d0/db/d3f/d49/c8e 16 1 2024-04-25T16:21:53.893 INFO:tasks.workunit.client.0.smithi059.stdout:1/612: truncate d7/d2a/d85/db7/d2d/d4a/fb5 774351 0 2024-04-25T16:21:53.905 INFO:tasks.workunit.client.0.smithi059.stdout:1/613: stat d7/d2a/d85/db7/d77/da3 0 2024-04-25T16:21:54.113 INFO:tasks.workunit.client.0.smithi059.stdout:9/588: truncate d6/f4a 2330627 0 2024-04-25T16:21:54.121 INFO:tasks.workunit.client.0.smithi059.stdout:2/575: symlink de/da1/ld2 0 2024-04-25T16:21:54.127 INFO:tasks.workunit.client.0.smithi059.stdout:7/550: write d0/f27 [3448665,65928] 0 2024-04-25T16:21:54.137 INFO:tasks.workunit.client.0.smithi059.stdout:4/547: rename d0/d4/df/d1c/d45/d54/f63 to d0/d4/df/faa 0 2024-04-25T16:21:54.261 INFO:tasks.workunit.client.0.smithi059.stdout:6/620: creat d9/d27/d39/d7b/fc8 x:0 0 0 2024-04-25T16:21:54.297 INFO:tasks.workunit.client.0.smithi059.stdout:8/547: dwrite d7/f93 [0,4194304] 0 2024-04-25T16:21:54.489 INFO:tasks.workunit.client.0.smithi059.stdout:4/548: creat d0/d4/fab x:0 0 0 2024-04-25T16:21:54.684 INFO:tasks.workunit.client.0.smithi059.stdout:9/589: dread f1 [0,4194304] 0 2024-04-25T16:21:54.686 INFO:tasks.workunit.client.0.smithi059.stdout:1/614: dread d7/fc [0,4194304] 0 2024-04-25T16:21:54.927 INFO:tasks.workunit.client.0.smithi059.stdout:3/614: write d0/db/d7f/fbc [4404130,113506] 0 2024-04-25T16:21:55.035 INFO:tasks.workunit.client.0.smithi059.stdout:0/558: getdents dc/dd/d5c 0 2024-04-25T16:21:55.059 INFO:tasks.workunit.client.0.smithi059.stdout:2/576: write de/d16/f31 [2041191,30032] 0 2024-04-25T16:21:55.213 INFO:tasks.workunit.client.0.smithi059.stdout:6/621: truncate d9/d16/d53/f98 277329 0 2024-04-25T16:21:55.271 INFO:tasks.workunit.client.0.smithi059.stdout:5/619: getdents d1/d1e/d27/d66/d70/d75 0 2024-04-25T16:21:55.345 INFO:tasks.workunit.client.0.smithi059.stdout:8/548: dread d7/dd/d17/d23/f2a [0,4194304] 0 2024-04-25T16:21:55.663 INFO:tasks.workunit.client.0.smithi059.stdout:3/615: fsync d0/db/d2d/f3c 0 2024-04-25T16:21:55.677 INFO:tasks.workunit.client.0.smithi059.stdout:3/616: chown d0/db/d3f/d49/fbd 431186464 1 2024-04-25T16:21:55.934 INFO:tasks.workunit.client.0.smithi059.stdout:6/622: creat d9/d16/d54/fc9 x:0 0 0 2024-04-25T16:21:56.062 INFO:tasks.workunit.client.0.smithi059.stdout:5/620: unlink d1/d1e/d27/d66/d70/d75/dc3/fd0 0 2024-04-25T16:21:56.149 INFO:tasks.workunit.client.0.smithi059.stdout:8/549: creat d7/dd/d17/d23/d37/d8b/d7d/fac x:0 0 0 2024-04-25T16:21:56.186 INFO:tasks.workunit.client.0.smithi059.stdout:4/549: truncate d0/d4/df/faa 31038 0 2024-04-25T16:21:56.194 INFO:tasks.workunit.client.0.smithi059.stdout:4/550: chown d0/d4/f7f 58 1 2024-04-25T16:21:56.385 INFO:tasks.workunit.client.0.smithi059.stdout:7/551: rename d0/d7/d51/da9/db3/d33/d9f to d0/d7/d51/da9/db3/d33/d79/d5d/db7 0 2024-04-25T16:21:56.514 INFO:tasks.workunit.client.0.smithi059.stdout:6/623: creat d9/d16/d53/d55/fca x:0 0 0 2024-04-25T16:21:56.566 INFO:tasks.workunit.client.0.smithi059.stdout:5/621: fdatasync d1/d1e/d27/d66/d70/f39 0 2024-04-25T16:21:56.825 INFO:tasks.workunit.client.0.smithi059.stdout:3/617: mkdir d0/db/d3f/dce 0 2024-04-25T16:21:56.891 INFO:tasks.workunit.client.0.smithi059.stdout:7/552: truncate d0/d7/f28 1827588 0 2024-04-25T16:21:56.897 INFO:tasks.workunit.client.0.smithi059.stdout:7/553: readlink d0/d7/l25 0 2024-04-25T16:21:57.029 INFO:tasks.workunit.client.0.smithi059.stdout:5/622: truncate d1/fa 856641 0 2024-04-25T16:21:57.069 INFO:tasks.workunit.client.0.smithi059.stdout:1/615: write d7/d2a/d85/db7/d16/d5c/f70 [1178017,97136] 0 2024-04-25T16:21:57.126 INFO:tasks.workunit.client.0.smithi059.stdout:5/623: sync 2024-04-25T16:21:57.129 INFO:tasks.workunit.client.0.smithi059.stdout:9/590: dwrite d6/d35/d28/f3e [0,4194304] 0 2024-04-25T16:21:57.208 INFO:tasks.workunit.client.0.smithi059.stdout:3/618: mknod d0/db/d7f/ccf 0 2024-04-25T16:21:57.238 INFO:tasks.workunit.client.0.smithi059.stdout:0/559: write dc/dd/d3b/fb1 [367903,43230] 0 2024-04-25T16:21:57.312 INFO:tasks.workunit.client.0.smithi059.stdout:4/551: link d0/d4/df/d48/d5f/f68 d0/d4/df/d1c/d45/d54/d75/d7e/fac 0 2024-04-25T16:21:57.410 INFO:tasks.workunit.client.0.smithi059.stdout:1/616: dread d7/d2a/d85/db7/d2d/d41/f73 [0,4194304] 0 2024-04-25T16:21:57.841 INFO:tasks.workunit.client.0.smithi059.stdout:0/560: dread - dc/d37/fab zero size 2024-04-25T16:21:57.995 INFO:tasks.workunit.client.0.smithi059.stdout:4/552: rename d0/d4/df/d1c/d45/d54/d75/d7e/d9e/la1 to d0/d4/df/d1c/d45/d6f/lad 0 2024-04-25T16:21:57.995 INFO:tasks.workunit.client.0.smithi059.stdout:1/617: creat d7/d2a/d85/db7/d2d/fca x:0 0 0 2024-04-25T16:21:58.062 INFO:tasks.workunit.client.0.smithi059.stdout:3/619: mknod d0/db/d3f/cd0 0 2024-04-25T16:21:58.068 INFO:tasks.workunit.client.0.smithi059.stdout:8/550: write d7/dd/d17/d23/f2a [3293506,14375] 0 2024-04-25T16:21:58.239 INFO:tasks.workunit.client.0.smithi059.stdout:8/551: dread d7/d16/d3a/f9a [0,4194304] 0 2024-04-25T16:21:58.250 INFO:tasks.workunit.client.0.smithi059.stdout:1/618: unlink d7/d2a/d85/cba 0 2024-04-25T16:21:58.325 INFO:tasks.workunit.client.0.smithi059.stdout:4/553: chown d0/d4/df/d44/f97 64872398 1 2024-04-25T16:21:58.502 INFO:tasks.workunit.client.0.smithi059.stdout:2/577: unlink de/d2a/d2e/d36/d2c/d40/d57/c7c 0 2024-04-25T16:21:58.600 INFO:tasks.workunit.client.0.smithi059.stdout:1/619: rmdir d7/d2a/d85/db7/d6a 39 2024-04-25T16:21:58.601 INFO:tasks.workunit.client.0.smithi059.stdout:6/624: dwrite d9/d1b/d58/f76 [0,4194304] 0 2024-04-25T16:21:58.728 INFO:tasks.workunit.client.0.smithi059.stdout:6/625: chown d9/d1b/f2c 15 1 2024-04-25T16:21:58.858 INFO:tasks.workunit.client.0.smithi059.stdout:8/552: dread d7/d16/fa7 [0,4194304] 0 2024-04-25T16:21:58.871 INFO:tasks.workunit.client.0.smithi059.stdout:6/626: chown d9/d16/d53/d6c/da6/fc2 0 1 2024-04-25T16:21:58.926 INFO:tasks.workunit.client.0.smithi059.stdout:5/624: write d1/dcd/d44/f67 [1719898,109011] 0 2024-04-25T16:21:58.973 INFO:tasks.workunit.client.0.smithi059.stdout:3/620: creat d0/db/d2d/d7a/d86/fd1 x:0 0 0 2024-04-25T16:21:59.004 INFO:tasks.workunit.client.0.smithi059.stdout:2/578: symlink de/d2a/d2e/d36/d2c/ld3 0 2024-04-25T16:21:59.022 INFO:tasks.workunit.client.0.smithi059.stdout:5/625: read - d1/d1e/d27/d66/d70/f22 zero size 2024-04-25T16:21:59.036 INFO:tasks.workunit.client.0.smithi059.stdout:7/554: dwrite d0/d7/d51/da9/db3/d33/d4c/d4e/f66 [0,4194304] 0 2024-04-25T16:21:59.130 INFO:tasks.workunit.client.0.smithi059.stdout:6/627: fsync d9/d1b/f80 0 2024-04-25T16:21:59.145 INFO:tasks.workunit.client.0.smithi059.stdout:5/626: chown d1/d48/da3/fc8 1583739489 1 2024-04-25T16:21:59.158 INFO:tasks.workunit.client.0.smithi059.stdout:4/554: fsync d0/d4/df/d48/d5f/f68 0 2024-04-25T16:21:59.313 INFO:tasks.workunit.client.0.smithi059.stdout:2/579: dread de/d16/f8e [0,4194304] 0 2024-04-25T16:21:59.348 INFO:tasks.workunit.client.0.smithi059.stdout:2/580: chown de/d5a/d9a 228026754 1 2024-04-25T16:21:59.383 INFO:tasks.workunit.client.0.smithi059.stdout:7/555: rmdir d0 39 2024-04-25T16:21:59.400 INFO:tasks.workunit.client.0.smithi059.stdout:1/620: creat d7/d2a/d85/db7/d16/d72/fcb x:0 0 0 2024-04-25T16:21:59.407 INFO:tasks.workunit.client.0.smithi059.stdout:9/591: write d6/d4e/d54/d5d/d95/fab [1220107,16540] 0 2024-04-25T16:21:59.554 INFO:tasks.workunit.client.0.smithi059.stdout:8/553: creat d7/dd/d17/d23/d37/d5c/d87/d94/d7f/fad x:0 0 0 2024-04-25T16:21:59.559 INFO:tasks.workunit.client.0.smithi059.stdout:0/561: dwrite dc/d37/d47/f75 [0,4194304] 0 2024-04-25T16:21:59.634 INFO:tasks.workunit.client.0.smithi059.stdout:0/562: chown dc/dd/f23 401 1 2024-04-25T16:21:59.817 INFO:tasks.workunit.client.0.smithi059.stdout:5/627: mknod d1/d1e/cd4 0 2024-04-25T16:21:59.830 INFO:tasks.workunit.client.0.smithi059.stdout:5/628: stat d1/d1e/d27/d66/d70/db9/dcc 0 2024-04-25T16:21:59.887 INFO:tasks.workunit.client.0.smithi059.stdout:6/628: symlink d9/d16/d24/d5d/d77/lcb 0 2024-04-25T16:22:00.419 INFO:tasks.workunit.client.0.smithi059.stdout:9/592: creat d6/d35/d6c/fb3 x:0 0 0 2024-04-25T16:22:00.427 INFO:tasks.workunit.client.0.smithi059.stdout:9/593: chown d6/d35/d2f 1366 1 2024-04-25T16:22:00.430 INFO:tasks.workunit.client.0.smithi059.stdout:9/594: stat f2 0 2024-04-25T16:22:00.518 INFO:tasks.workunit.client.0.smithi059.stdout:0/563: chown dc/df/c17 149664 1 2024-04-25T16:22:00.578 INFO:tasks.workunit.client.0.smithi059.stdout:1/621: dread d7/d2a/d85/db7/fa4 [0,4194304] 0 2024-04-25T16:22:00.584 INFO:tasks.workunit.client.0.smithi059.stdout:8/554: rename d7/dd/d17/d23/d37/d5c/c84 to d7/dd/d17/d23/d37/d5c/d87/d94/d7f/cae 0 2024-04-25T16:22:00.670 INFO:tasks.workunit.client.0.smithi059.stdout:5/629: symlink d1/d1e/d27/d66/d70/d24/ld5 0 2024-04-25T16:22:01.282 INFO:tasks.workunit.client.0.smithi059.stdout:7/556: truncate d0/d7/d16/d20/f35 3437529 0 2024-04-25T16:22:01.548 INFO:tasks.workunit.client.0.smithi059.stdout:3/621: link d0/d1e/f81 d0/db/d47/d5b/fd2 0 2024-04-25T16:22:01.557 INFO:tasks.workunit.client.0.smithi059.stdout:3/622: chown d0/db/c36 28773 1 2024-04-25T16:22:01.699 INFO:tasks.workunit.client.0.smithi059.stdout:7/557: mknod d0/d7/d51/da9/db3/d33/d4c/d5c/cb8 0 2024-04-25T16:22:01.794 INFO:tasks.workunit.client.0.smithi059.stdout:4/555: dwrite d0/d4/df/f8b [0,4194304] 0 2024-04-25T16:22:01.809 INFO:tasks.workunit.client.0.smithi059.stdout:7/558: sync 2024-04-25T16:22:01.883 INFO:tasks.workunit.client.0.smithi059.stdout:4/556: chown d0/d4/df/d48/f4e 421692661 1 2024-04-25T16:22:02.066 INFO:tasks.workunit.client.0.smithi059.stdout:7/559: mkdir d0/d7/d51/da9/db3/d33/d79/d5d/d85/db9 0 2024-04-25T16:22:02.157 INFO:tasks.workunit.client.0.smithi059.stdout:1/622: link d7/d2a/d85/db7/d16/c3f d7/d2a/d85/db7/d16/ccc 0 2024-04-25T16:22:02.158 INFO:tasks.workunit.client.0.smithi059.stdout:4/557: stat d0/d4/df/d1c/d45/d6f/lad 0 2024-04-25T16:22:02.533 INFO:tasks.workunit.client.0.smithi059.stdout:2/581: write f7 [1989806,10912] 0 2024-04-25T16:22:02.553 INFO:tasks.workunit.client.0.smithi059.stdout:5/630: write d1/dd/f13 [5178421,114618] 0 2024-04-25T16:22:02.667 INFO:tasks.workunit.client.0.smithi059.stdout:5/631: dread - d1/dd/fba zero size 2024-04-25T16:22:02.843 INFO:tasks.workunit.client.0.smithi059.stdout:0/564: dwrite dc/dd/f4c [0,4194304] 0 2024-04-25T16:22:02.868 INFO:tasks.workunit.client.0.smithi059.stdout:9/595: dwrite d6/d4e/d54/d5d/f75 [0,4194304] 0 2024-04-25T16:22:02.962 INFO:tasks.workunit.client.0.smithi059.stdout:6/629: dwrite d9/d16/d53/f98 [0,4194304] 0 2024-04-25T16:22:02.963 INFO:tasks.workunit.client.0.smithi059.stdout:7/560: creat d0/d7/d51/da9/db3/d33/d87/fba x:0 0 0 2024-04-25T16:22:02.969 INFO:tasks.workunit.client.0.smithi059.stdout:2/582: rmdir de 39 2024-04-25T16:22:03.036 INFO:tasks.workunit.client.0.smithi059.stdout:1/623: rmdir d7/d21 39 2024-04-25T16:22:03.067 INFO:tasks.workunit.client.0.smithi059.stdout:5/632: mknod d1/dd/cd6 0 2024-04-25T16:22:03.084 INFO:tasks.workunit.client.0.smithi059.stdout:6/630: sync 2024-04-25T16:22:03.168 INFO:tasks.workunit.client.0.smithi059.stdout:6/631: sync 2024-04-25T16:22:03.199 INFO:tasks.workunit.client.0.smithi059.stdout:9/596: dread d6/d35/d28/f5b [0,4194304] 0 2024-04-25T16:22:03.245 INFO:tasks.workunit.client.0.smithi059.stdout:8/555: rename d7/d16/d8c/f90 to d7/dd/faf 0 2024-04-25T16:22:03.572 INFO:tasks.workunit.client.0.smithi059.stdout:1/624: creat d7/d2a/d85/d8d/fcd x:0 0 0 2024-04-25T16:22:03.632 INFO:tasks.workunit.client.0.smithi059.stdout:3/623: rename d0/db/d3f/d49/l9e to d0/db/d2d/d7a/ld3 0 2024-04-25T16:22:03.667 INFO:tasks.workunit.client.0.smithi059.stdout:8/556: symlink d7/dd/d17/d23/d37/d5c/d87/d94/lb0 0 2024-04-25T16:22:03.700 INFO:tasks.workunit.client.0.smithi059.stdout:6/632: dread d9/d27/d39/f86 [0,4194304] 0 2024-04-25T16:22:03.773 INFO:tasks.workunit.client.0.smithi059.stdout:9/597: dread d6/d35/f4b [0,4194304] 0 2024-04-25T16:22:03.792 INFO:tasks.workunit.client.0.smithi059.stdout:9/598: read - d6/d4e/d54/d5d/d48/d49/f72 zero size 2024-04-25T16:22:03.801 INFO:tasks.workunit.client.0.smithi059.stdout:9/599: dread - d6/f68 zero size 2024-04-25T16:22:03.962 INFO:tasks.workunit.client.0.smithi059.stdout:5/633: dwrite d1/d1e/d27/d66/f8b [0,4194304] 0 2024-04-25T16:22:04.172 INFO:tasks.workunit.client.0.smithi059.stdout:8/557: chown d7/d2f/d43/f6f 58676932 1 2024-04-25T16:22:04.266 INFO:tasks.workunit.client.0.smithi059.stdout:9/600: dread d6/d4e/d54/d5d/d48/d49/f7c [0,4194304] 0 2024-04-25T16:22:04.318 INFO:tasks.workunit.client.0.smithi059.stdout:6/633: write d9/d16/d53/f82 [525022,22233] 0 2024-04-25T16:22:04.334 INFO:tasks.workunit.client.0.smithi059.stdout:7/561: write d0/d7/f9e [5228224,102144] 0 2024-04-25T16:22:04.341 INFO:tasks.workunit.client.0.smithi059.stdout:0/565: write dc/dd/d5c/fb9 [1191740,44562] 0 2024-04-25T16:22:04.389 INFO:tasks.workunit.client.0.smithi059.stdout:3/624: dread d0/f7 [4194304,4194304] 0 2024-04-25T16:22:04.521 INFO:tasks.workunit.client.0.smithi059.stdout:2/583: dwrite de/d16/d82/fac [0,4194304] 0 2024-04-25T16:22:04.595 INFO:tasks.workunit.client.0.smithi059.stdout:4/558: rename d0/d4/df/d48/l5b to d0/d4/df/d44/lae 0 2024-04-25T16:22:04.641 INFO:tasks.workunit.client.0.smithi059.stdout:2/584: chown de/d2a/d2e/d36/f25 61 1 2024-04-25T16:22:04.655 INFO:tasks.workunit.client.0.smithi059.stdout:2/585: stat de/d16/d82/lc8 0 2024-04-25T16:22:04.824 INFO:tasks.workunit.client.0.smithi059.stdout:5/634: write d1/d1e/d27/d66/d70/d75/fae [390757,13220] 0 2024-04-25T16:22:04.828 INFO:tasks.workunit.client.0.smithi059.stdout:0/566: mkdir dc/dd/d5c/dbe 0 2024-04-25T16:22:04.858 INFO:tasks.workunit.client.0.smithi059.stdout:9/601: dread - d6/d4e/d54/d5d/d48/d6e/fa4 zero size 2024-04-25T16:22:05.289 INFO:tasks.workunit.client.0.smithi059.stdout:1/625: creat d7/fce x:0 0 0 2024-04-25T16:22:05.432 INFO:tasks.workunit.client.0.smithi059.stdout:6/634: rename d9/d1b/d58/f76 to d9/d16/d54/fcc 0 2024-04-25T16:22:05.572 INFO:tasks.workunit.client.0.smithi059.stdout:4/559: creat d0/d4/df/d1c/d45/d54/d75/d82/faf x:0 0 0 2024-04-25T16:22:05.588 INFO:tasks.workunit.client.0.smithi059.stdout:4/560: readlink d0/l1a 0 2024-04-25T16:22:05.670 INFO:tasks.workunit.client.0.smithi059.stdout:3/625: write d0/db/d2d/f58 [3929614,28027] 0 2024-04-25T16:22:05.707 INFO:tasks.workunit.client.0.smithi059.stdout:9/602: dread d6/d35/d2f/d39/f52 [0,4194304] 0 2024-04-25T16:22:05.723 INFO:tasks.workunit.client.0.smithi059.stdout:0/567: truncate dc/dd/d3b/d66/d9b/f70 1032106 0 2024-04-25T16:22:05.827 INFO:tasks.workunit.client.0.smithi059.stdout:1/626: fsync d7/d2a/d85/db7/f87 0 2024-04-25T16:22:06.373 INFO:tasks.workunit.client.0.smithi059.stdout:3/626: symlink d0/db/d47/ld4 0 2024-04-25T16:22:06.386 INFO:tasks.workunit.client.0.smithi059.stdout:3/627: chown d0/db/d2d/d7a 15635 1 2024-04-25T16:22:06.450 INFO:tasks.workunit.client.0.smithi059.stdout:9/603: truncate d6/d4e/d54/d5d/d48/d6e/f9e 168638 0 2024-04-25T16:22:06.610 INFO:tasks.workunit.client.0.smithi059.stdout:3/628: dread - d0/db/d2d/d7a/d86/fd1 zero size 2024-04-25T16:22:06.691 INFO:tasks.workunit.client.0.smithi059.stdout:8/558: dwrite d7/d2f/d76/f9d [0,4194304] 0 2024-04-25T16:22:06.698 INFO:tasks.workunit.client.0.smithi059.stdout:9/604: fsync d6/d4e/d54/d5d/d95/fab 0 2024-04-25T16:22:06.777 INFO:tasks.workunit.client.0.smithi059.stdout:7/562: write d0/d7/d51/da9/db3/d33/d4c/d4e/f77 [193957,53681] 0 2024-04-25T16:22:06.895 INFO:tasks.workunit.client.0.smithi059.stdout:0/568: getdents dc/d37 0 2024-04-25T16:22:06.915 INFO:tasks.workunit.client.0.smithi059.stdout:5/635: dwrite d1/d1e/d27/d66/fa7 [0,4194304] 0 2024-04-25T16:22:07.107 INFO:tasks.workunit.client.0.smithi059.stdout:7/563: dread d0/d7/f10 [0,4194304] 0 2024-04-25T16:22:07.113 INFO:tasks.workunit.client.0.smithi059.stdout:7/564: stat d0/c6d 0 2024-04-25T16:22:07.263 INFO:tasks.workunit.client.0.smithi059.stdout:2/586: rename de/l18 to de/d67/ld4 0 2024-04-25T16:22:07.264 INFO:tasks.workunit.client.0.smithi059.stdout:9/605: creat d6/d4e/fb4 x:0 0 0 2024-04-25T16:22:07.292 INFO:tasks.workunit.client.0.smithi059.stdout:9/606: stat d6/d35/d6c/c9c 0 2024-04-25T16:22:07.326 INFO:tasks.workunit.client.0.smithi059.stdout:8/559: getdents d7/dd/d17/d23/d37/d5c/d87/d94/d66/daa 0 2024-04-25T16:22:07.401 INFO:tasks.workunit.client.0.smithi059.stdout:4/561: unlink d0/d4/df/l51 0 2024-04-25T16:22:07.604 INFO:tasks.workunit.client.0.smithi059.stdout:6/635: rename d9/d16/d54/f5c to d9/d16/d53/d55/fcd 0 2024-04-25T16:22:07.650 INFO:tasks.workunit.client.0.smithi059.stdout:4/562: dread d0/d4/df/d1c/f3d [0,4194304] 0 2024-04-25T16:22:07.668 INFO:tasks.workunit.client.0.smithi059.stdout:6/636: chown d9/f72 240 1 2024-04-25T16:22:07.721 INFO:tasks.workunit.client.0.smithi059.stdout:2/587: creat de/d2a/d2e/d36/d2c/d40/d57/fd5 x:0 0 0 2024-04-25T16:22:07.722 INFO:tasks.workunit.client.0.smithi059.stdout:9/607: truncate d6/d4e/d54/f8b 1152166 0 2024-04-25T16:22:07.778 INFO:tasks.workunit.client.0.smithi059.stdout:1/627: dwrite d7/d2a/d85/db7/d16/f33 [0,4194304] 0 2024-04-25T16:22:07.846 INFO:tasks.workunit.client.0.smithi059.stdout:1/628: stat d7/d2a/d85/db7/f87 0 2024-04-25T16:22:07.857 INFO:tasks.workunit.client.0.smithi059.stdout:1/629: dread - d7/d93/fb2 zero size 2024-04-25T16:22:08.034 INFO:tasks.workunit.client.0.smithi059.stdout:8/560: fsync d7/dd/d17/d23/d37/f44 0 2024-04-25T16:22:08.039 INFO:tasks.workunit.client.0.smithi059.stdout:3/629: write d0/db/d2d/f87 [1001501,14904] 0 2024-04-25T16:22:08.097 INFO:tasks.workunit.client.0.smithi059.stdout:7/565: write d0/f9a [850455,123057] 0 2024-04-25T16:22:08.128 INFO:tasks.workunit.client.0.smithi059.stdout:6/637: creat d9/d16/d53/d55/d6e/fce x:0 0 0 2024-04-25T16:22:08.439 INFO:tasks.workunit.client.0.smithi059.stdout:9/608: write f1 [2178887,108431] 0 2024-04-25T16:22:08.459 INFO:tasks.workunit.client.0.smithi059.stdout:5/636: dwrite d1/d48/da3/d6d/f82 [0,4194304] 0 2024-04-25T16:22:08.573 INFO:tasks.workunit.client.0.smithi059.stdout:0/569: dwrite dc/d37/fa3 [0,4194304] 0 2024-04-25T16:22:08.637 INFO:tasks.workunit.client.0.smithi059.stdout:4/563: dread d0/d4/df/d48/f6c [0,4194304] 0 2024-04-25T16:22:08.743 INFO:tasks.workunit.client.0.smithi059.stdout:0/570: sync 2024-04-25T16:22:08.760 INFO:tasks.workunit.client.0.smithi059.stdout:3/630: truncate d0/db/d2d/d7a/f92 921822 0 2024-04-25T16:22:08.804 INFO:tasks.workunit.client.0.smithi059.stdout:2/588: write de/d2a/d33/d65/dcf/fd1 [363793,3419] 0 2024-04-25T16:22:08.826 INFO:tasks.workunit.client.0.smithi059.stdout:3/631: sync 2024-04-25T16:22:08.938 INFO:tasks.workunit.client.0.smithi059.stdout:1/630: dread d7/d2a/d85/db7/f92 [0,4194304] 0 2024-04-25T16:22:08.967 INFO:tasks.workunit.client.0.smithi059.stdout:8/561: dwrite d7/dd/d17/f4e [0,4194304] 0 2024-04-25T16:22:09.030 INFO:tasks.workunit.client.0.smithi059.stdout:9/609: symlink d6/d35/d6c/lb5 0 2024-04-25T16:22:09.069 INFO:tasks.workunit.client.0.smithi059.stdout:6/638: truncate d9/f21 984885 0 2024-04-25T16:22:09.074 INFO:tasks.workunit.client.0.smithi059.stdout:8/562: chown d7/d16/fa7 125847886 1 2024-04-25T16:22:09.091 INFO:tasks.workunit.client.0.smithi059.stdout:2/589: rmdir de/d5a 39 2024-04-25T16:22:09.218 INFO:tasks.workunit.client.0.smithi059.stdout:1/631: dwrite d7/d2a/d85/db7/d16/f33 [0,4194304] 0 2024-04-25T16:22:09.286 INFO:tasks.workunit.client.0.smithi059.stdout:5/637: creat d1/dcd/d44/dd1/fd7 x:0 0 0 2024-04-25T16:22:09.295 INFO:tasks.workunit.client.0.smithi059.stdout:7/566: link d0/d7/fa d0/d7/d51/da9/fbb 0 2024-04-25T16:22:09.315 INFO:tasks.workunit.client.0.smithi059.stdout:2/590: chown de/d2a/d2e/d36/d2c/d40/d57/c69 2 1 2024-04-25T16:22:09.326 INFO:tasks.workunit.client.0.smithi059.stdout:8/563: rename d7/dd/d17/d23/d37 to d7/dd/d17/d23/d37/d5c/d87/d94/db1 22 2024-04-25T16:22:09.532 INFO:tasks.workunit.client.0.smithi059.stdout:4/564: mknod d0/d4/df/d48/da3/da4/cb0 0 2024-04-25T16:22:09.541 INFO:tasks.workunit.client.0.smithi059.stdout:3/632: mkdir d0/db/d3f/d89/dd5 0 2024-04-25T16:22:09.558 INFO:tasks.workunit.client.0.smithi059.stdout:6/639: dread - d9/d16/d53/d6c/da6/fc2 zero size 2024-04-25T16:22:09.641 INFO:tasks.workunit.client.0.smithi059.stdout:4/565: chown d0/d4/df/d48/c4c 12184384 1 2024-04-25T16:22:09.674 INFO:tasks.workunit.client.0.smithi059.stdout:0/571: dwrite dc/dd/d5c/fac [0,4194304] 0 2024-04-25T16:22:09.967 INFO:tasks.workunit.client.0.smithi059.stdout:5/638: mkdir d1/dcd/d50/d8a/dd8 0 2024-04-25T16:22:09.990 INFO:tasks.workunit.client.0.smithi059.stdout:8/564: chown d7/dd/faf 307 1 2024-04-25T16:22:10.018 INFO:tasks.workunit.client.0.smithi059.stdout:8/565: write d7/d2f/d76/f9d [4465579,112598] 0 2024-04-25T16:22:10.256 INFO:tasks.workunit.client.0.smithi059.stdout:9/610: creat d6/d4e/d54/d5d/d48/fb6 x:0 0 0 2024-04-25T16:22:10.264 INFO:tasks.workunit.client.0.smithi059.stdout:7/567: write d0/d7/f10 [5868001,45646] 0 2024-04-25T16:22:10.304 INFO:tasks.workunit.client.0.smithi059.stdout:9/611: dread d6/d35/d2f/d39/f52 [0,4194304] 0 2024-04-25T16:22:10.335 INFO:tasks.workunit.client.0.smithi059.stdout:9/612: dread d6/d4e/d7a/f8d [0,4194304] 0 2024-04-25T16:22:10.346 INFO:tasks.workunit.client.0.smithi059.stdout:2/591: write de/d67/fc2 [872047,43902] 0 2024-04-25T16:22:10.533 INFO:tasks.workunit.client.0.smithi059.stdout:6/640: truncate d9/f4d 363162 0 2024-04-25T16:22:10.556 INFO:tasks.workunit.client.0.smithi059.stdout:0/572: mknod dc/d37/d47/d60/cbf 0 2024-04-25T16:22:10.558 INFO:tasks.workunit.client.0.smithi059.stdout:6/641: chown d9/d27/d39/d7b/la7 3775 1 2024-04-25T16:22:10.618 INFO:tasks.workunit.client.0.smithi059.stdout:1/632: creat d7/d21/d51/da6/fcf x:0 0 0 2024-04-25T16:22:10.766 INFO:tasks.workunit.client.0.smithi059.stdout:5/639: symlink d1/dcd/d44/dd1/ld9 0 2024-04-25T16:22:10.964 INFO:tasks.workunit.client.0.smithi059.stdout:7/568: symlink d0/d7/d51/da9/lbc 0 2024-04-25T16:22:11.219 INFO:tasks.workunit.client.0.smithi059.stdout:2/592: unlink de/d16/d3e/la0 0 2024-04-25T16:22:11.520 INFO:tasks.workunit.client.0.smithi059.stdout:7/569: truncate d0/d7/d51/da9/db3/d33/d4c/d4e/f66 1841267 0 2024-04-25T16:22:11.554 INFO:tasks.workunit.client.0.smithi059.stdout:3/633: write d0/d1e/f6e [1082059,22185] 0 2024-04-25T16:22:11.557 INFO:tasks.workunit.client.0.smithi059.stdout:2/593: readlink de/d67/ld4 0 2024-04-25T16:22:11.558 INFO:tasks.workunit.client.0.smithi059.stdout:1/633: dread d7/d21/f49 [0,4194304] 0 2024-04-25T16:22:11.589 INFO:tasks.workunit.client.0.smithi059.stdout:7/570: chown d0/d7/f73 125767192 1 2024-04-25T16:22:11.807 INFO:tasks.workunit.client.0.smithi059.stdout:4/566: dwrite d0/d4/df/f66 [0,4194304] 0 2024-04-25T16:22:12.046 INFO:tasks.workunit.client.0.smithi059.stdout:3/634: mkdir d0/db/d2d/d7a/dd6 0 2024-04-25T16:22:12.098 INFO:tasks.workunit.client.0.smithi059.stdout:9/613: write d6/d35/d28/f3e [80027,22776] 0 2024-04-25T16:22:12.208 INFO:tasks.workunit.client.0.smithi059.stdout:9/614: dwrite d6/d4e/d7a/f8d [0,4194304] 0 2024-04-25T16:22:12.271 INFO:tasks.workunit.client.0.smithi059.stdout:8/566: rename d7/dd/d17/d23/d37/d5c/d87/d94/d66/c70 to d7/dd/d17/d23/d37/d5c/cb2 0 2024-04-25T16:22:12.275 INFO:tasks.workunit.client.0.smithi059.stdout:4/567: truncate d0/d4/df/d1c/d45/f9b 4806444 0 2024-04-25T16:22:12.299 INFO:tasks.workunit.client.0.smithi059.stdout:8/567: readlink d7/d2f/d43/l75 0 2024-04-25T16:22:12.352 INFO:tasks.workunit.client.0.smithi059.stdout:1/634: rmdir d7/d2a/d85/db7/d6a/dbc 39 2024-04-25T16:22:12.428 INFO:tasks.workunit.client.0.smithi059.stdout:3/635: dread d0/db/d3f/d49/f9d [0,4194304] 0 2024-04-25T16:22:12.475 INFO:tasks.workunit.client.0.smithi059.stdout:0/573: write dc/dd/f20 [502928,68232] 0 2024-04-25T16:22:12.577 INFO:tasks.workunit.client.0.smithi059.stdout:4/568: symlink d0/d4/df/d1c/d45/d54/d75/d7e/lb1 0 2024-04-25T16:22:12.588 INFO:tasks.workunit.client.0.smithi059.stdout:5/640: write d1/d1e/d27/d66/d70/d24/fa6 [340373,30812] 0 2024-04-25T16:22:12.663 INFO:tasks.workunit.client.0.smithi059.stdout:8/568: rmdir d7/dd/d17/d23/d37/d5c/d87/d94/d66 39 2024-04-25T16:22:12.672 INFO:tasks.workunit.client.0.smithi059.stdout:7/571: fsync d0/d7/d51/da9/db3/d33/d4c/d4e/f66 0 2024-04-25T16:22:12.696 INFO:tasks.workunit.client.0.smithi059.stdout:6/642: dwrite d9/d16/d54/fc9 [0,4194304] 0 2024-04-25T16:22:12.764 INFO:tasks.workunit.client.0.smithi059.stdout:7/572: stat d0/d3f/f6a 0 2024-04-25T16:22:12.770 INFO:tasks.workunit.client.0.smithi059.stdout:2/594: mkdir de/d5a/dd6 0 2024-04-25T16:22:12.928 INFO:tasks.workunit.client.0.smithi059.stdout:0/574: readlink dc/df/l3f 0 2024-04-25T16:22:13.192 INFO:tasks.workunit.client.0.smithi059.stdout:4/569: mknod d0/d4/df/d48/cb2 0 2024-04-25T16:22:13.337 INFO:tasks.workunit.client.0.smithi059.stdout:2/595: dread - de/d2a/d2e/f6e zero size 2024-04-25T16:22:13.389 INFO:tasks.workunit.client.0.smithi059.stdout:9/615: dwrite d6/d35/d2f/f3c [4194304,4194304] 0 2024-04-25T16:22:13.461 INFO:tasks.workunit.client.0.smithi059.stdout:6/643: creat d9/d16/d24/d97/fcf x:0 0 0 2024-04-25T16:22:13.491 INFO:tasks.workunit.client.0.smithi059.stdout:1/635: write d7/d2a/d85/db7/d2d/d41/f73 [1266770,30565] 0 2024-04-25T16:22:13.541 INFO:tasks.workunit.client.0.smithi059.stdout:0/575: creat dc/d37/d47/d81/fc0 x:0 0 0 2024-04-25T16:22:13.558 INFO:tasks.workunit.client.0.smithi059.stdout:0/576: chown dc/d37/d47/d71/d77/cbc 0 1 2024-04-25T16:22:13.611 INFO:tasks.workunit.client.0.smithi059.stdout:4/570: truncate d0/d4/df/d1c/d45/d54/f72 1000200 0 2024-04-25T16:22:13.623 INFO:tasks.workunit.client.0.smithi059.stdout:4/571: chown d0/d4/df/d1c/c24 9 1 2024-04-25T16:22:13.809 INFO:tasks.workunit.client.0.smithi059.stdout:2/596: mknod de/d16/d82/da6/cd7 0 2024-04-25T16:22:13.818 INFO:tasks.workunit.client.0.smithi059.stdout:7/573: getdents d0/d7/d51/da9/db3/d33/d79/d5d/d85/db9 0 2024-04-25T16:22:13.824 INFO:tasks.workunit.client.0.smithi059.stdout:5/641: dwrite d1/d48/fbb [0,4194304] 0 2024-04-25T16:22:13.936 INFO:tasks.workunit.client.0.smithi059.stdout:5/642: chown d1/d48/da3/d6d 31210 1 2024-04-25T16:22:13.983 INFO:tasks.workunit.client.0.smithi059.stdout:7/574: chown d0/d7/d51/da9/db3/d33/f43 299 1 2024-04-25T16:22:14.004 INFO:tasks.workunit.client.0.smithi059.stdout:1/636: chown d7/d2a/d85/db7/dbb/db6/fc8 14185 1 2024-04-25T16:22:14.035 INFO:tasks.workunit.client.0.smithi059.stdout:3/636: dwrite d0/d1e/f45 [0,4194304] 0 2024-04-25T16:22:14.103 INFO:tasks.workunit.client.0.smithi059.stdout:1/637: chown d7/d2a/l64 7 1 2024-04-25T16:22:14.104 INFO:tasks.workunit.client.0.smithi059.stdout:7/575: chown d0/d7/d16/d20/l7a 6354 1 2024-04-25T16:22:14.122 INFO:tasks.workunit.client.0.smithi059.stdout:7/576: chown d0/l18 265273895 1 2024-04-25T16:22:14.234 INFO:tasks.workunit.client.0.smithi059.stdout:0/577: unlink dc/df/d24/l4d 0 2024-04-25T16:22:14.241 INFO:tasks.workunit.client.0.smithi059.stdout:4/572: creat d0/d4/df/d44/fb3 x:0 0 0 2024-04-25T16:22:14.256 INFO:tasks.workunit.client.0.smithi059.stdout:0/578: readlink dc/d37/l79 0 2024-04-25T16:22:14.285 INFO:tasks.workunit.client.0.smithi059.stdout:4/573: rename d0/d4/df/d1c/d45 to d0/d4/df/d1c/d45/d54/d75/d7e/db4 22 2024-04-25T16:22:14.668 INFO:tasks.workunit.client.0.smithi059.stdout:1/638: unlink d7/d2a/d85/db7/d2d/d41/d8f/f59 0 2024-04-25T16:22:14.672 INFO:tasks.workunit.client.0.smithi059.stdout:7/577: unlink d0/d7/d51/c6c 0 2024-04-25T16:22:14.688 INFO:tasks.workunit.client.0.smithi059.stdout:8/569: getdents d7/d2f/d76 0 2024-04-25T16:22:14.692 INFO:tasks.workunit.client.0.smithi059.stdout:0/579: fdatasync dc/dd/d3b/d66/f6f 0 2024-04-25T16:22:14.856 INFO:tasks.workunit.client.0.smithi059.stdout:3/637: mknod d0/db/cd7 0 2024-04-25T16:22:14.885 INFO:tasks.workunit.client.0.smithi059.stdout:3/638: read d0/d1e/f53 [4090469,36902] 0 2024-04-25T16:22:15.292 INFO:tasks.workunit.client.0.smithi059.stdout:1/639: truncate d7/f12 3345245 0 2024-04-25T16:22:15.707 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:36:28.311 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:22:15.713 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:36:28.317 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:22:15.728 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:36:28.291 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:22:15.728 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:36:28.291 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:22:15.731 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:36:28.294 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:22:15.731 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:36:28.294 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:22:15.784 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:22:15.787 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:22:15.806 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:36:28.410 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:22:15.823 INFO:tasks.workunit.client.0.smithi059.stdout:8/570: rename d7/d16/l2d to d7/dd/lb3 0 2024-04-25T16:22:15.825 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:36:28.388 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:22:15.839 INFO:tasks.workunit.client.0.smithi059.stdout:9/616: truncate d6/d35/d28/f3e 2597843 0 2024-04-25T16:22:15.844 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:36:28.407 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:22:15.908 INFO:tasks.workunit.client.0.smithi059.stdout:1/640: dread - d7/d2a/d85/db7/d16/fa9 zero size 2024-04-25T16:22:15.970 INFO:tasks.workunit.client.0.smithi059.stdout:6/644: dwrite d9/f4d [0,4194304] 0 2024-04-25T16:22:16.058 INFO:tasks.workunit.client.0.smithi059.stdout:3/639: mknod d0/d1e/d31/dc7/cd8 0 2024-04-25T16:22:16.084 INFO:tasks.workunit.client.0.smithi059.stdout:6/645: chown d9/d16/d53/d6c/fbb 0 1 2024-04-25T16:22:16.144 INFO:tasks.workunit.client.0.smithi059.stdout:5/643: write d1/d1e/d27/d66/d70/db9/fcf [875505,126352] 0 2024-04-25T16:22:16.552 INFO:tasks.workunit.client.0.smithi059.stdout:4/574: getdents d0/d79 0 2024-04-25T16:22:16.637 INFO:tasks.workunit.client.0.smithi059.stdout:2/597: link de/d2a/f35 de/d2a/d2e/d6a/fd8 0 2024-04-25T16:22:16.800 INFO:tasks.workunit.client.0.smithi059.stdout:1/641: mkdir d7/d2a/d85/db7/d16/d5c/d74/dd0 0 2024-04-25T16:22:16.843 INFO:tasks.workunit.client.0.smithi059.stdout:3/640: symlink d0/d1e/d95/ld9 0 2024-04-25T16:22:16.930 INFO:tasks.workunit.client.0.smithi059.stdout:6/646: fdatasync d9/d16/d53/d6c/da6/fc2 0 2024-04-25T16:22:17.004 INFO:tasks.workunit.client.0.smithi059.stdout:0/580: link dc/dd/d3b/d66/d9b/f70 dc/dd/d3b/d66/d9b/fc1 0 2024-04-25T16:22:17.090 INFO:tasks.workunit.client.0.smithi059.stdout:9/617: getdents d6/d35/d28/daf 0 2024-04-25T16:22:17.096 INFO:tasks.workunit.client.0.smithi059.stdout:9/618: readlink d6/d35/l21 0 2024-04-25T16:22:17.103 INFO:tasks.workunit.client.0.smithi059.stdout:9/619: read - d6/f68 zero size 2024-04-25T16:22:17.195 INFO:tasks.workunit.client.0.smithi059.stdout:7/578: write d0/d7/d51/da9/db3/d33/f43 [425549,62213] 0 2024-04-25T16:22:17.209 INFO:tasks.workunit.client.0.smithi059.stdout:7/579: chown d0/d3f/f4d 144 1 2024-04-25T16:22:17.225 INFO:tasks.workunit.client.0.smithi059.stdout:7/580: stat d0/d7/d51/da9/db3/d33/d4c/d5c/cb8 0 2024-04-25T16:22:17.281 INFO:tasks.workunit.client.0.smithi059.stdout:3/641: dread - d0/db/d47/d5b/f8c zero size 2024-04-25T16:22:17.411 INFO:tasks.workunit.client.0.smithi059.stdout:6/647: read d9/d16/d53/d74/fac [187821,33742] 0 2024-04-25T16:22:17.628 INFO:tasks.workunit.client.0.smithi059.stdout:7/581: read d0/d7/f73 [7106567,74443] 0 2024-04-25T16:22:17.676 INFO:tasks.workunit.client.0.smithi059.stdout:2/598: mknod de/d2a/d33/d88/cd9 0 2024-04-25T16:22:17.825 INFO:tasks.workunit.client.0.smithi059.stdout:6/648: mknod d9/d16/d24/d5d/d77/cd0 0 2024-04-25T16:22:18.146 INFO:tasks.workunit.client.0.smithi059.stdout:7/582: truncate d0/d7/fac 605425 0 2024-04-25T16:22:18.170 INFO:tasks.workunit.client.0.smithi059.stdout:7/583: read d0/d7/d51/da9/db3/d33/d79/d5d/f74 [222154,2280] 0 2024-04-25T16:22:18.268 INFO:tasks.workunit.client.0.smithi059.stdout:8/571: rename d7/dd/d17/d23/d37/d8b/d7d to d7/dd/d17/db4 0 2024-04-25T16:22:18.374 INFO:tasks.workunit.client.0.smithi059.stdout:3/642: fdatasync d0/db/d2d/d7a/f92 0 2024-04-25T16:22:18.375 INFO:tasks.workunit.client.0.smithi059.stdout:6/649: truncate d9/d1b/f80 1377056 0 2024-04-25T16:22:18.971 INFO:tasks.workunit.client.0.smithi059.stdout:9/620: write d6/d4e/d54/d5d/d48/d49/f5e [910786,72998] 0 2024-04-25T16:22:18.973 INFO:tasks.workunit.client.0.smithi059.stdout:0/581: write dc/d37/fab [627639,23162] 0 2024-04-25T16:22:19.094 INFO:tasks.workunit.client.0.smithi059.stdout:1/642: write d7/d2a/d85/db7/d16/d72/fac [237646,56672] 0 2024-04-25T16:22:19.174 INFO:tasks.workunit.client.0.smithi059.stdout:5/644: dwrite d1/dcd/fbc [0,4194304] 0 2024-04-25T16:22:19.177 INFO:tasks.workunit.client.0.smithi059.stdout:4/575: dwrite d0/d4/df/d48/f4e [4194304,4194304] 0 2024-04-25T16:22:19.241 INFO:tasks.workunit.client.0.smithi059.stdout:6/650: symlink d9/d16/d53/d55/d71/d7e/dc4/ld1 0 2024-04-25T16:22:19.571 INFO:tasks.workunit.client.0.smithi059.stdout:8/572: link d7/dd/d17/d23/d37/d5c/l79 d7/d16/d8f/lb5 0 2024-04-25T16:22:19.629 INFO:tasks.workunit.client.0.smithi059.stdout:2/599: write de/d16/f43 [2099221,79662] 0 2024-04-25T16:22:19.642 INFO:tasks.workunit.client.0.smithi059.stdout:2/600: chown de/d5a/dd6 101 1 2024-04-25T16:22:19.664 INFO:tasks.workunit.client.0.smithi059.stdout:6/651: mkdir d9/d16/d24/d5d/d77/dd2 0 2024-04-25T16:22:19.786 INFO:tasks.workunit.client.0.smithi059.stdout:1/643: truncate d7/d2a/d85/db7/d2d/d41/f5d 419294 0 2024-04-25T16:22:19.822 INFO:tasks.workunit.client.0.smithi059.stdout:7/584: write d0/d7/d16/d20/f59 [755006,3778] 0 2024-04-25T16:22:20.099 INFO:tasks.workunit.client.0.smithi059.stdout:8/573: fdatasync d7/dd/d17/d23/d37/f82 0 2024-04-25T16:22:20.100 INFO:tasks.workunit.client.0.smithi059.stdout:2/601: mknod de/d2a/d33/d65/cda 0 2024-04-25T16:22:20.255 INFO:tasks.workunit.client.0.smithi059.stdout:3/643: dwrite d0/d1e/f53 [0,4194304] 0 2024-04-25T16:22:20.320 INFO:tasks.workunit.client.0.smithi059.stdout:3/644: chown d0/db/d47/f8b 75 1 2024-04-25T16:22:20.349 INFO:tasks.workunit.client.0.smithi059.stdout:1/644: mknod d7/d2a/d85/db7/d16/d5c/d74/cd1 0 2024-04-25T16:22:20.352 INFO:tasks.workunit.client.0.smithi059.stdout:6/652: read d9/d16/d53/f98 [2148681,48002] 0 2024-04-25T16:22:20.364 INFO:tasks.workunit.client.0.smithi059.stdout:2/602: fdatasync de/d16/f7b 0 2024-04-25T16:22:20.416 INFO:tasks.workunit.client.0.smithi059.stdout:8/574: creat d7/d2f/d76/d85/fb6 x:0 0 0 2024-04-25T16:22:20.577 INFO:tasks.workunit.client.0.smithi059.stdout:7/585: creat d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/fbd x:0 0 0 2024-04-25T16:22:20.648 INFO:tasks.workunit.client.0.smithi059.stdout:1/645: rmdir d7/d2a/d85/d8d 39 2024-04-25T16:22:20.698 INFO:tasks.workunit.client.0.smithi059.stdout:2/603: unlink de/d2a/d2e/d6a/f8f 0 2024-04-25T16:22:21.058 INFO:tasks.workunit.client.0.smithi059.stdout:9/621: write d6/d4e/d54/d5d/d48/f78 [2428056,28997] 0 2024-04-25T16:22:21.123 INFO:tasks.workunit.client.0.smithi059.stdout:9/622: chown f2 1774061 1 2024-04-25T16:22:21.169 INFO:tasks.workunit.client.0.smithi059.stdout:0/582: dwrite dc/dd/f58 [0,4194304] 0 2024-04-25T16:22:21.282 INFO:tasks.workunit.client.0.smithi059.stdout:1/646: symlink d7/d2a/d85/db7/d6a/ld2 0 2024-04-25T16:22:21.459 INFO:tasks.workunit.client.0.smithi059.stdout:2/604: rmdir de/d5a/d7d/d80 39 2024-04-25T16:22:21.465 INFO:tasks.workunit.client.0.smithi059.stdout:4/576: dwrite d0/d4/df/f3a [0,4194304] 0 2024-04-25T16:22:21.744 INFO:tasks.workunit.client.0.smithi059.stdout:8/575: getdents d7/dd/d17/d23/d37 0 2024-04-25T16:22:21.807 INFO:tasks.workunit.client.0.smithi059.stdout:4/577: chown d0/d4/f7f 49617012 1 2024-04-25T16:22:21.865 INFO:tasks.workunit.client.0.smithi059.stdout:1/647: dread d7/f29 [0,4194304] 0 2024-04-25T16:22:21.893 INFO:tasks.workunit.client.0.smithi059.stdout:8/576: stat d7/dd/d17/d23/d37/d5c/d87/f89 0 2024-04-25T16:22:22.023 INFO:tasks.workunit.client.0.smithi059.stdout:2/605: dread de/d2a/d33/f74 [0,4194304] 0 2024-04-25T16:22:22.074 INFO:tasks.workunit.client.0.smithi059.stdout:5/645: dwrite d1/d1e/d27/d66/d70/d75/daa/fbf [4194304,4194304] 0 2024-04-25T16:22:22.144 INFO:tasks.workunit.client.0.smithi059.stdout:5/646: dread - d1/d1e/fa9 zero size 2024-04-25T16:22:22.501 INFO:tasks.workunit.client.0.smithi059.stdout:6/653: write f6 [5203689,54611] 0 2024-04-25T16:22:22.504 INFO:tasks.workunit.client.0.smithi059.stdout:3/645: write d0/db/d3f/d6c/fa5 [657317,67259] 0 2024-04-25T16:22:22.505 INFO:tasks.workunit.client.0.smithi059.stdout:1/648: creat d7/d2a/db8/fd3 x:0 0 0 2024-04-25T16:22:22.539 INFO:tasks.workunit.client.0.smithi059.stdout:8/577: chown d7/d16/d8f/lb5 5 1 2024-04-25T16:22:22.553 INFO:tasks.workunit.client.0.smithi059.stdout:6/654: chown d9/d16/d53/fb9 1811186 1 2024-04-25T16:22:22.565 INFO:tasks.workunit.client.0.smithi059.stdout:1/649: readlink d7/d2a/d85/db7/d16/d5c/d74/lb9 0 2024-04-25T16:22:22.694 INFO:tasks.workunit.client.0.smithi059.stdout:3/646: sync 2024-04-25T16:22:22.788 INFO:tasks.workunit.client.0.smithi059.stdout:0/583: truncate dc/d37/fab 180753 0 2024-04-25T16:22:22.822 INFO:tasks.workunit.client.0.smithi059.stdout:9/623: rename l4 to d6/d4e/lb7 0 2024-04-25T16:22:22.823 INFO:tasks.workunit.client.0.smithi059.stdout:4/578: write d0/d4/f2e [7830653,13991] 0 2024-04-25T16:22:23.070 INFO:tasks.workunit.client.0.smithi059.stdout:7/586: symlink d0/lbe 0 2024-04-25T16:22:23.231 INFO:tasks.workunit.client.0.smithi059.stdout:2/606: fsync de/d16/f32 0 2024-04-25T16:22:23.232 INFO:tasks.workunit.client.0.smithi059.stdout:8/578: rmdir d7/dd/d17/d23/d38 39 2024-04-25T16:22:23.237 INFO:tasks.workunit.client.0.smithi059.stdout:1/650: mknod d7/d21/d51/cd4 0 2024-04-25T16:22:23.245 INFO:tasks.workunit.client.0.smithi059.stdout:3/647: creat d0/d1e/d31/dc7/fda x:0 0 0 2024-04-25T16:22:23.368 INFO:tasks.workunit.client.0.smithi059.stdout:0/584: mkdir dc/d44/d5f/dc2 0 2024-04-25T16:22:23.377 INFO:tasks.workunit.client.0.smithi059.stdout:6/655: rename d9/d27/d39/f66 to d9/d16/d53/d6c/da6/fd3 0 2024-04-25T16:22:23.419 INFO:tasks.workunit.client.0.smithi059.stdout:4/579: read d0/f67 [1281421,76816] 0 2024-04-25T16:22:23.433 INFO:tasks.workunit.client.0.smithi059.stdout:0/585: chown dc/df/l3f 14636 1 2024-04-25T16:22:23.473 INFO:tasks.workunit.client.0.smithi059.stdout:9/624: dread d6/d4e/d54/d5d/f75 [0,4194304] 0 2024-04-25T16:22:23.693 INFO:tasks.workunit.client.0.smithi059.stdout:5/647: write d1/d1e/d27/d66/d70/d24/f4b [1765645,102312] 0 2024-04-25T16:22:23.695 INFO:tasks.workunit.client.0.smithi059.stdout:2/607: rmdir de/d2a/d2e/d36/d2c 39 2024-04-25T16:22:23.700 INFO:tasks.workunit.client.0.smithi059.stdout:7/587: rename d0/d7/d51/da9/db3/d33/d4c/d5c/cb8 to d0/d7/d16/d20/d71/d7e/cbf 0 2024-04-25T16:22:23.721 INFO:tasks.workunit.client.0.smithi059.stdout:6/656: fsync d9/d16/d53/f98 0 2024-04-25T16:22:23.807 INFO:tasks.workunit.client.0.smithi059.stdout:4/580: rmdir d0/d79 39 2024-04-25T16:22:23.816 INFO:tasks.workunit.client.0.smithi059.stdout:9/625: symlink d6/d35/d2f/d39/d85/lb8 0 2024-04-25T16:22:23.817 INFO:tasks.workunit.client.0.smithi059.stdout:0/586: fsync dc/dd/f3c 0 2024-04-25T16:22:24.104 INFO:tasks.workunit.client.0.smithi059.stdout:1/651: rename d7/d2a/d85/db7/d16/d72/f7d to d7/d2a/d85/db7/d16/d7f/dbe/fd5 0 2024-04-25T16:22:24.261 INFO:tasks.workunit.client.0.smithi059.stdout:6/657: creat d9/d1b/d58/d49/fd4 x:0 0 0 2024-04-25T16:22:24.417 INFO:tasks.workunit.client.0.smithi059.stdout:7/588: mknod d0/d7/d51/da9/db3/d33/d87/cc0 0 2024-04-25T16:22:24.534 INFO:tasks.workunit.client.0.smithi059.stdout:0/587: fdatasync dc/d37/d47/d71/f7a 0 2024-04-25T16:22:24.682 INFO:tasks.workunit.client.0.smithi059.stdout:3/648: write d0/d1e/d57/fc2 [112995,31855] 0 2024-04-25T16:22:24.724 INFO:tasks.workunit.client.0.smithi059.stdout:1/652: symlink d7/d2a/d85/db7/d77/ld6 0 2024-04-25T16:22:24.878 INFO:tasks.workunit.client.0.smithi059.stdout:5/648: dwrite d1/d48/da3/d6d/f82 [0,4194304] 0 2024-04-25T16:22:25.092 INFO:tasks.workunit.client.0.smithi059.stdout:4/581: dwrite d0/f8c [0,4194304] 0 2024-04-25T16:22:25.355 INFO:tasks.workunit.client.0.smithi059.stdout:9/626: write d6/d4e/d54/d5d/d48/f5a [85929,84342] 0 2024-04-25T16:22:25.391 INFO:tasks.workunit.client.0.smithi059.stdout:9/627: dread d6/d4e/d54/d5d/d48/d49/f7c [0,4194304] 0 2024-04-25T16:22:25.423 INFO:tasks.workunit.client.0.smithi059.stdout:0/588: unlink dc/dd/d3b/d66/d9b/f96 0 2024-04-25T16:22:25.526 INFO:tasks.workunit.client.0.smithi059.stdout:2/608: rmdir de/d5a/dd6 0 2024-04-25T16:22:25.538 INFO:tasks.workunit.client.0.smithi059.stdout:3/649: read d0/d1e/f6e [1094333,120617] 0 2024-04-25T16:22:25.613 INFO:tasks.workunit.client.0.smithi059.stdout:1/653: unlink d7/d93/c83 0 2024-04-25T16:22:25.679 INFO:tasks.workunit.client.0.smithi059.stdout:6/658: dwrite d9/d1b/f6b [0,4194304] 0 2024-04-25T16:22:25.832 INFO:tasks.workunit.client.0.smithi059.stdout:7/589: dwrite d0/d7/f73 [0,4194304] 0 2024-04-25T16:22:25.904 INFO:tasks.workunit.client.0.smithi059.stdout:7/590: chown d0/d7/d51/da9/db3/d33/d79/f9c 25745 1 2024-04-25T16:22:26.214 INFO:tasks.workunit.client.0.smithi059.stdout:4/582: chown d0/d4/df/d1c/d45/f27 173258242 1 2024-04-25T16:22:26.557 INFO:tasks.workunit.client.0.smithi059.stdout:1/654: rmdir d7/d2a/d85/db7/dbb/db6 39 2024-04-25T16:22:26.861 INFO:tasks.workunit.client.0.smithi059.stdout:6/659: fsync d9/d16/d53/d55/f93 0 2024-04-25T16:22:26.916 INFO:tasks.workunit.client.0.smithi059.stdout:8/579: link d7/l72 d7/dd/d17/d23/d37/d5c/d87/d94/lb7 0 2024-04-25T16:22:27.044 INFO:tasks.workunit.client.0.smithi059.stdout:9/628: fsync d6/d4e/d54/fa9 0 2024-04-25T16:22:27.089 INFO:tasks.workunit.client.0.smithi059.stdout:0/589: mknod dc/dd/d3b/d86/cc3 0 2024-04-25T16:22:27.170 INFO:tasks.workunit.client.0.smithi059.stdout:2/609: mkdir de/d5a/d7d/d80/ddb 0 2024-04-25T16:22:27.654 INFO:tasks.workunit.client.0.smithi059.stdout:3/650: link d0/db/c4a d0/db/d3f/d89/dd5/cdb 0 2024-04-25T16:22:27.663 INFO:tasks.workunit.client.0.smithi059.stdout:5/649: write d1/d1e/f37 [7230852,50861] 0 2024-04-25T16:22:28.096 INFO:tasks.workunit.client.0.smithi059.stdout:7/591: creat d0/d7/d51/da9/db3/d33/fc1 x:0 0 0 2024-04-25T16:22:28.123 INFO:tasks.workunit.client.0.smithi059.stdout:9/629: creat d6/fb9 x:0 0 0 2024-04-25T16:22:28.155 INFO:tasks.workunit.client.0.smithi059.stdout:1/655: write d7/d2a/d85/db7/d16/d5c/d74/da7/fc6 [99500,111488] 0 2024-04-25T16:22:28.178 INFO:tasks.workunit.client.0.smithi059.stdout:6/660: write d9/d27/f34 [4359097,33888] 0 2024-04-25T16:22:28.180 INFO:tasks.workunit.client.0.smithi059.stdout:8/580: write d7/dd/d17/d23/f2a [2013692,90349] 0 2024-04-25T16:22:28.320 INFO:tasks.workunit.client.0.smithi059.stdout:4/583: dwrite d0/d4/df/d1c/d45/f60 [0,4194304] 0 2024-04-25T16:22:28.388 INFO:tasks.workunit.client.0.smithi059.stdout:2/610: rename de/d16/f19 to de/d2a/da7/fdc 0 2024-04-25T16:22:28.408 INFO:tasks.workunit.client.0.smithi059.stdout:3/651: symlink d0/db/d47/d7e/ldc 0 2024-04-25T16:22:28.412 INFO:tasks.workunit.client.0.smithi059.stdout:2/611: chown de/f76 664758 1 2024-04-25T16:22:28.551 INFO:tasks.workunit.client.0.smithi059.stdout:0/590: dwrite dc/dd/d3b/d66/d9b/fc1 [0,4194304] 0 2024-04-25T16:22:28.617 INFO:tasks.workunit.client.0.smithi059.stdout:0/591: read dc/dd/f9d [1189601,16164] 0 2024-04-25T16:22:28.650 INFO:tasks.workunit.client.0.smithi059.stdout:9/630: chown d6/d4e/lb7 4210 1 2024-04-25T16:22:28.792 INFO:tasks.workunit.client.0.smithi059.stdout:8/581: dread - d7/d2f/d76/d85/fb6 zero size 2024-04-25T16:22:28.830 INFO:tasks.workunit.client.0.smithi059.stdout:8/582: chown d7/d2f/d76 822 1 2024-04-25T16:22:28.868 INFO:tasks.workunit.client.0.smithi059.stdout:2/612: dread de/d16/d3e/f8d [0,4194304] 0 2024-04-25T16:22:28.883 INFO:tasks.workunit.client.0.smithi059.stdout:2/613: chown de/d16/d3e 6 1 2024-04-25T16:22:28.970 INFO:tasks.workunit.client.0.smithi059.stdout:0/592: fsync dc/dd/f20 0 2024-04-25T16:22:29.049 INFO:tasks.workunit.client.0.smithi059.stdout:1/656: mknod d7/d2a/d85/cd7 0 2024-04-25T16:22:29.276 INFO:tasks.workunit.client.0.smithi059.stdout:7/592: write d0/d7/d16/d20/f59 [1038070,96138] 0 2024-04-25T16:22:29.375 INFO:tasks.workunit.client.0.smithi059.stdout:8/583: creat d7/dd/d17/db4/fb8 x:0 0 0 2024-04-25T16:22:29.452 INFO:tasks.workunit.client.0.smithi059.stdout:4/584: dwrite d0/d4/df/d44/f59 [0,4194304] 0 2024-04-25T16:22:29.537 INFO:tasks.workunit.client.0.smithi059.stdout:6/661: link d9/f59 d9/d27/d39/da5/fd5 0 2024-04-25T16:22:29.623 INFO:tasks.workunit.client.0.smithi059.stdout:0/593: truncate dc/d37/d47/d71/f7a 4972844 0 2024-04-25T16:22:29.650 INFO:tasks.workunit.client.0.smithi059.stdout:3/652: dwrite d0/db/d3f/d49/f9d [0,4194304] 0 2024-04-25T16:22:29.741 INFO:tasks.workunit.client.0.smithi059.stdout:1/657: fdatasync d7/d2a/d85/db7/d2d/d4a/f4b 0 2024-04-25T16:22:29.744 INFO:tasks.workunit.client.0.smithi059.stdout:8/584: rmdir d7/dd 39 2024-04-25T16:22:29.805 INFO:tasks.workunit.client.0.smithi059.stdout:5/650: getdents d1/d1e/d27/d66 0 2024-04-25T16:22:29.885 INFO:tasks.workunit.client.0.smithi059.stdout:9/631: rmdir d6/d4e/d97 0 2024-04-25T16:22:29.907 INFO:tasks.workunit.client.0.smithi059.stdout:9/632: dread d6/d35/d2f/d39/f52 [0,4194304] 0 2024-04-25T16:22:29.965 INFO:tasks.workunit.client.0.smithi059.stdout:4/585: unlink d0/d4/f4b 0 2024-04-25T16:22:30.007 INFO:tasks.workunit.client.0.smithi059.stdout:2/614: write de/d2a/d2e/d36/d59/f61 [1422147,99649] 0 2024-04-25T16:22:30.063 INFO:tasks.workunit.client.0.smithi059.stdout:6/662: creat d9/d16/d24/d97/fd6 x:0 0 0 2024-04-25T16:22:30.087 INFO:tasks.workunit.client.0.smithi059.stdout:6/663: write d9/d16/d24/d97/fd6 [368472,30814] 0 2024-04-25T16:22:30.433 INFO:tasks.workunit.client.0.smithi059.stdout:7/593: chown d0/d7/d51/da9/db3/d33/d79/d5d/d94/fa2 7291544 1 2024-04-25T16:22:30.442 INFO:tasks.workunit.client.0.smithi059.stdout:7/594: chown d0/d7/d16/d20/d71 132 1 2024-04-25T16:22:30.629 INFO:tasks.workunit.client.0.smithi059.stdout:1/658: mknod d7/d2a/db8/cd8 0 2024-04-25T16:22:31.008 INFO:tasks.workunit.client.0.smithi059.stdout:4/586: rename d0/d4/df/d44/f49 to d0/d4/df/d1c/d45/d54/d75/d82/d8f/fb5 0 2024-04-25T16:22:31.039 INFO:tasks.workunit.client.0.smithi059.stdout:9/633: dread d6/d4e/d54/d5d/f38 [0,4194304] 0 2024-04-25T16:22:31.064 INFO:tasks.workunit.client.0.smithi059.stdout:2/615: creat de/d16/d7f/fdd x:0 0 0 2024-04-25T16:22:31.156 INFO:tasks.workunit.client.0.smithi059.stdout:6/664: truncate d9/d16/d54/f94 7254839 0 2024-04-25T16:22:31.168 INFO:tasks.workunit.client.0.smithi059.stdout:9/634: sync 2024-04-25T16:22:31.243 INFO:tasks.workunit.client.0.smithi059.stdout:3/653: mknod d0/cdd 0 2024-04-25T16:22:31.680 INFO:tasks.workunit.client.0.smithi059.stdout:1/659: rename d7/d2a/l64 to d7/d2a/d85/db7/dbb/dc2/ld9 0 2024-04-25T16:22:31.706 INFO:tasks.workunit.client.0.smithi059.stdout:2/616: chown de/d2a/c64 492081324 1 2024-04-25T16:22:31.790 INFO:tasks.workunit.client.0.smithi059.stdout:6/665: mkdir d9/d1b/d58/d49/db0/dd7 0 2024-04-25T16:22:31.801 INFO:tasks.workunit.client.0.smithi059.stdout:9/635: stat d6/d35/d2f/c94 0 2024-04-25T16:22:31.929 INFO:tasks.workunit.client.0.smithi059.stdout:5/651: dwrite d1/d1e/d27/d66/d70/f61 [0,4194304] 0 2024-04-25T16:22:32.014 INFO:tasks.workunit.client.0.smithi059.stdout:0/594: write dc/f4e [5186218,35939] 0 2024-04-25T16:22:32.139 INFO:tasks.workunit.client.0.smithi059.stdout:2/617: chown de/d2a/d2e/f98 76 1 2024-04-25T16:22:32.367 INFO:tasks.workunit.client.0.smithi059.stdout:7/595: creat d0/d7/d51/da9/db3/d33/d79/d5d/fc2 x:0 0 0 2024-04-25T16:22:32.505 INFO:tasks.workunit.client.0.smithi059.stdout:4/587: write d0/d4/df/d1c/d45/f2d [2247200,38662] 0 2024-04-25T16:22:32.506 INFO:tasks.workunit.client.0.smithi059.stdout:0/595: readlink dc/d37/d47/l56 0 2024-04-25T16:22:32.550 INFO:tasks.workunit.client.0.smithi059.stdout:1/660: symlink d7/d2a/d85/db7/d2d/d4a/lda 0 2024-04-25T16:22:32.672 INFO:tasks.workunit.client.0.smithi059.stdout:3/654: write d0/db/d3f/d49/d65/f85 [371871,877] 0 2024-04-25T16:22:32.908 INFO:tasks.workunit.client.0.smithi059.stdout:8/585: getdents d7/dd/d17/d23/d37/d5c/d78 0 2024-04-25T16:22:32.916 INFO:tasks.workunit.client.0.smithi059.stdout:4/588: mknod d0/d4/df/d1c/cb6 0 2024-04-25T16:22:32.921 INFO:tasks.workunit.client.0.smithi059.stdout:0/596: truncate dc/dd/f20 634907 0 2024-04-25T16:22:33.104 INFO:tasks.workunit.client.0.smithi059.stdout:3/655: creat d0/d1e/d57/fde x:0 0 0 2024-04-25T16:22:33.323 INFO:tasks.workunit.client.0.smithi059.stdout:4/589: chown d0/d4/df/d1c/d45/d54/d75/fa2 90675713 1 2024-04-25T16:22:33.346 INFO:tasks.workunit.client.0.smithi059.stdout:5/652: dwrite d1/d1e/d27/f59 [0,4194304] 0 2024-04-25T16:22:33.352 INFO:tasks.workunit.client.0.smithi059.stdout:6/666: dwrite d9/d16/d53/d55/f93 [0,4194304] 0 2024-04-25T16:22:33.360 INFO:tasks.workunit.client.0.smithi059.stdout:0/597: symlink dc/df/d5e/lc4 0 2024-04-25T16:22:33.378 INFO:tasks.workunit.client.0.smithi059.stdout:9/636: dwrite f2 [4194304,4194304] 0 2024-04-25T16:22:33.464 INFO:tasks.workunit.client.0.smithi059.stdout:8/586: symlink d7/dd/d33/d57/lb9 0 2024-04-25T16:22:33.468 INFO:tasks.workunit.client.0.smithi059.stdout:1/661: creat d7/d2a/d85/db7/dbb/fdb x:0 0 0 2024-04-25T16:22:33.549 INFO:tasks.workunit.client.0.smithi059.stdout:4/590: stat d0/d4/df/d1c/l7a 0 2024-04-25T16:22:33.589 INFO:tasks.workunit.client.0.smithi059.stdout:3/656: symlink d0/db/d47/d5b/ldf 0 2024-04-25T16:22:33.649 INFO:tasks.workunit.client.0.smithi059.stdout:2/618: dwrite de/d16/fd0 [0,4194304] 0 2024-04-25T16:22:33.650 INFO:tasks.workunit.client.0.smithi059.stdout:5/653: chown d1/dcd/d44/lc5 1120630756 1 2024-04-25T16:22:33.796 INFO:tasks.workunit.client.0.smithi059.stdout:5/654: chown d1/d1e/cd4 1036813 1 2024-04-25T16:22:33.826 INFO:tasks.workunit.client.0.smithi059.stdout:7/596: link d0/c37 d0/d7/d16/d5a/cc3 0 2024-04-25T16:22:33.947 INFO:tasks.workunit.client.0.smithi059.stdout:8/587: dread d7/d16/d3a/f9a [0,4194304] 0 2024-04-25T16:22:33.997 INFO:tasks.workunit.client.0.smithi059.stdout:1/662: creat d7/d2a/d85/db7/d16/d7f/dbe/fdc x:0 0 0 2024-04-25T16:22:34.002 INFO:tasks.workunit.client.0.smithi059.stdout:9/637: truncate d6/d4e/d7a/f8d 4273516 0 2024-04-25T16:22:34.014 INFO:tasks.workunit.client.0.smithi059.stdout:7/597: stat d0/d7/d16/d20/d71/d7e/l82 0 2024-04-25T16:22:34.035 INFO:tasks.workunit.client.0.smithi059.stdout:6/667: write d9/d27/d68/fa0 [778813,1674] 0 2024-04-25T16:22:34.124 INFO:tasks.workunit.client.0.smithi059.stdout:0/598: dread dc/dd/d3b/d66/d9b/f82 [0,4194304] 0 2024-04-25T16:22:34.167 INFO:tasks.workunit.client.0.smithi059.stdout:1/663: dread d7/d2a/d85/db7/d2d/d4a/fb5 [0,4194304] 0 2024-04-25T16:22:34.298 INFO:tasks.workunit.client.0.smithi059.stdout:5/655: unlink d1/dd/l14 0 2024-04-25T16:22:34.302 INFO:tasks.workunit.client.0.smithi059.stdout:3/657: symlink d0/d1e/d57/dc9/le0 0 2024-04-25T16:22:34.446 INFO:tasks.workunit.client.0.smithi059.stdout:5/656: dread d1/f3 [0,4194304] 0 2024-04-25T16:22:34.542 INFO:tasks.workunit.client.0.smithi059.stdout:8/588: fsync d7/dd/d33/d57/f98 0 2024-04-25T16:22:34.594 INFO:tasks.workunit.client.0.smithi059.stdout:0/599: read dc/dd/f20 [69725,31226] 0 2024-04-25T16:22:34.746 INFO:tasks.workunit.client.0.smithi059.stdout:4/591: creat d0/d4/df/d1c/d45/d54/fb7 x:0 0 0 2024-04-25T16:22:34.807 INFO:tasks.workunit.client.0.smithi059.stdout:2/619: fdatasync de/d2a/d2e/d36/d2c/d40/f49 0 2024-04-25T16:22:35.060 INFO:tasks.workunit.client.0.smithi059.stdout:5/657: mkdir d1/dcd/d44/d79/dda 0 2024-04-25T16:22:35.527 INFO:tasks.workunit.client.0.smithi059.stdout:4/592: creat d0/d4/df/d48/d5f/fb8 x:0 0 0 2024-04-25T16:22:35.664 INFO:tasks.workunit.client.0.smithi059.stdout:2/620: mknod de/d2a/d33/d65/dca/dc1/cde 0 2024-04-25T16:22:35.678 INFO:tasks.workunit.client.0.smithi059.stdout:9/638: dwrite d6/d4e/d54/d5d/d48/f5a [4194304,4194304] 0 2024-04-25T16:22:35.877 INFO:tasks.workunit.client.0.smithi059.stdout:7/598: dwrite d0/d7/d51/da9/db3/d33/f41 [0,4194304] 0 2024-04-25T16:22:35.983 INFO:tasks.workunit.client.0.smithi059.stdout:5/658: fdatasync d1/d1e/d27/fb4 0 2024-04-25T16:22:36.035 INFO:tasks.workunit.client.0.smithi059.stdout:8/589: mknod d7/dd/d17/d23/d37/d5c/d87/d94/cba 0 2024-04-25T16:22:36.201 INFO:tasks.workunit.client.0.smithi059.stdout:9/639: fsync d6/f18 0 2024-04-25T16:22:36.208 INFO:tasks.workunit.client.0.smithi059.stdout:3/658: dwrite d0/db/f19 [0,4194304] 0 2024-04-25T16:22:36.226 INFO:tasks.workunit.client.0.smithi059.stdout:1/664: dwrite d7/d2a/d85/db7/d16/d5c/d74/fb4 [0,4194304] 0 2024-04-25T16:22:36.358 INFO:tasks.workunit.client.0.smithi059.stdout:5/659: chown d1/dcd/d50/cb2 61612990 1 2024-04-25T16:22:36.397 INFO:tasks.workunit.client.0.smithi059.stdout:7/599: dread - d0/d7/d51/da9/db3/d33/d79/d5d/f75 zero size 2024-04-25T16:22:36.399 INFO:tasks.workunit.client.0.smithi059.stdout:6/668: dwrite d9/d1b/f80 [0,4194304] 0 2024-04-25T16:22:36.500 INFO:tasks.workunit.client.0.smithi059.stdout:2/621: truncate de/d67/f72 13256746 0 2024-04-25T16:22:36.520 INFO:tasks.workunit.client.0.smithi059.stdout:0/600: dwrite dc/f2d [0,4194304] 0 2024-04-25T16:22:36.589 INFO:tasks.workunit.client.0.smithi059.stdout:6/669: chown d9/f4d 3141 1 2024-04-25T16:22:36.872 INFO:tasks.workunit.client.0.smithi059.stdout:5/660: creat d1/dcd/d44/d79/fdb x:0 0 0 2024-04-25T16:22:36.992 INFO:tasks.workunit.client.0.smithi059.stdout:0/601: fdatasync dc/d84/f9a 0 2024-04-25T16:22:37.012 INFO:tasks.workunit.client.0.smithi059.stdout:0/602: dread - dc/dd/d3b/d66/d9b/fb3 zero size 2024-04-25T16:22:37.254 INFO:tasks.workunit.client.0.smithi059.stdout:3/659: truncate d0/db/d47/d5b/fc8 180402 0 2024-04-25T16:22:37.266 INFO:tasks.workunit.client.0.smithi059.stdout:7/600: fsync d0/d7/d51/da9/db3/d33/d79/d5d/f95 0 2024-04-25T16:22:37.268 INFO:tasks.workunit.client.0.smithi059.stdout:6/670: dread - d9/d16/d53/d55/fca zero size 2024-04-25T16:22:37.296 INFO:tasks.workunit.client.0.smithi059.stdout:4/593: link d0/d4/df/d48/cb2 d0/d4/df/d1c/d45/d54/d75/d7e/d9e/cb9 0 2024-04-25T16:22:37.297 INFO:tasks.workunit.client.0.smithi059.stdout:3/660: stat d0/db/d3f/d49/f7b 0 2024-04-25T16:22:37.303 INFO:tasks.workunit.client.0.smithi059.stdout:5/661: symlink d1/d1e/ldc 0 2024-04-25T16:22:37.339 INFO:tasks.workunit.client.0.smithi059.stdout:5/662: chown d1/d48/fbb 1795105 1 2024-04-25T16:22:37.557 INFO:tasks.workunit.client.0.smithi059.stdout:0/603: unlink dc/d37/d47/d71/d9c/fa1 0 2024-04-25T16:22:37.718 INFO:tasks.workunit.client.0.smithi059.stdout:7/601: creat d0/d7/d51/da9/db3/d33/d79/fc4 x:0 0 0 2024-04-25T16:22:37.837 INFO:tasks.workunit.client.0.smithi059.stdout:5/663: creat d1/d1e/d27/d66/d70/d75/fdd x:0 0 0 2024-04-25T16:22:37.913 INFO:tasks.workunit.client.0.smithi059.stdout:0/604: chown dc/df/l40 58 1 2024-04-25T16:22:38.486 INFO:tasks.workunit.client.0.smithi059.stdout:8/590: write d7/f1c [1276456,60417] 0 2024-04-25T16:22:38.630 INFO:tasks.workunit.client.0.smithi059.stdout:1/665: write d7/fc [308960,51872] 0 2024-04-25T16:22:38.744 INFO:tasks.workunit.client.0.smithi059.stdout:6/671: write d9/d1b/f73 [336867,70685] 0 2024-04-25T16:22:38.754 INFO:tasks.workunit.client.0.smithi059.stdout:4/594: write d0/d4/df/d1c/f37 [4192501,49087] 0 2024-04-25T16:22:38.767 INFO:tasks.workunit.client.0.smithi059.stdout:3/661: rename d0/db/d3f/d6c/db4 to d0/db/d2d/de1 0 2024-04-25T16:22:38.805 INFO:tasks.workunit.client.0.smithi059.stdout:3/662: stat d0/d1e/f1f 0 2024-04-25T16:22:38.827 INFO:tasks.workunit.client.0.smithi059.stdout:3/663: readlink d0/db/l79 0 2024-04-25T16:22:38.893 INFO:tasks.workunit.client.0.smithi059.stdout:9/640: unlink d6/l6f 0 2024-04-25T16:22:39.078 INFO:tasks.workunit.client.0.smithi059.stdout:0/605: dwrite dc/d37/d47/d60/d6e/f8a [0,4194304] 0 2024-04-25T16:22:39.137 INFO:tasks.workunit.client.0.smithi059.stdout:2/622: dwrite de/d67/f72 [0,4194304] 0 2024-04-25T16:22:39.212 INFO:tasks.workunit.client.0.smithi059.stdout:7/602: link d0/d7/d51/da9/db3/d33/d79/d5d/f95 d0/d7/d16/d20/fc5 0 2024-04-25T16:22:39.224 INFO:tasks.workunit.client.0.smithi059.stdout:6/672: mkdir d9/d16/d53/d55/d71/d7e/d9e/dd8 0 2024-04-25T16:22:39.236 INFO:tasks.workunit.client.0.smithi059.stdout:4/595: symlink d0/d4/df/d1c/d45/d54/d75/d82/lba 0 2024-04-25T16:22:39.314 INFO:tasks.workunit.client.0.smithi059.stdout:6/673: chown d9/f79 39819999 1 2024-04-25T16:22:39.334 INFO:tasks.workunit.client.0.smithi059.stdout:9/641: rmdir d6/d35 39 2024-04-25T16:22:39.407 INFO:tasks.workunit.client.0.smithi059.stdout:0/606: dread dc/f2d [0,4194304] 0 2024-04-25T16:22:39.478 INFO:tasks.workunit.client.0.smithi059.stdout:5/664: getdents d1/dcd/d50 0 2024-04-25T16:22:39.500 INFO:tasks.workunit.client.0.smithi059.stdout:3/664: dread d0/db/d2d/f9a [0,4194304] 0 2024-04-25T16:22:39.551 INFO:tasks.workunit.client.0.smithi059.stdout:0/607: sync 2024-04-25T16:22:39.671 INFO:tasks.workunit.client.0.smithi059.stdout:2/623: stat de/d2a/d2e/d6a/fd8 0 2024-04-25T16:22:39.685 INFO:tasks.workunit.client.0.smithi059.stdout:2/624: readlink de/d16/d82/lc8 0 2024-04-25T16:22:39.841 INFO:tasks.workunit.client.0.smithi059.stdout:9/642: mkdir d6/d4e/dba 0 2024-04-25T16:22:39.844 INFO:tasks.workunit.client.0.smithi059.stdout:4/596: creat d0/d4/df/d48/da3/fbb x:0 0 0 2024-04-25T16:22:39.854 INFO:tasks.workunit.client.0.smithi059.stdout:1/666: link d7/d21/fc4 d7/d21/d51/da6/fdd 0 2024-04-25T16:22:39.868 INFO:tasks.workunit.client.0.smithi059.stdout:6/674: chown d9/d16/d53/d6c/da6/fbf 496070 1 2024-04-25T16:22:39.958 INFO:tasks.workunit.client.0.smithi059.stdout:5/665: dread d1/d1e/d27/f59 [4194304,4194304] 0 2024-04-25T16:22:40.086 INFO:tasks.workunit.client.0.smithi059.stdout:2/625: rmdir de/da1 39 2024-04-25T16:22:40.242 INFO:tasks.workunit.client.0.smithi059.stdout:0/608: dread dc/d37/fa3 [0,4194304] 0 2024-04-25T16:22:40.655 INFO:tasks.workunit.client.0.smithi059.stdout:3/665: write d0/f6 [1878694,38877] 0 2024-04-25T16:22:40.687 INFO:tasks.workunit.client.0.smithi059.stdout:9/643: write d6/d4e/d54/f84 [497289,74894] 0 2024-04-25T16:22:40.705 INFO:tasks.workunit.client.0.smithi059.stdout:9/644: dread - d6/d4e/d54/fa9 zero size 2024-04-25T16:22:40.875 INFO:tasks.workunit.client.0.smithi059.stdout:8/591: rename d7/dd/d17/d23/d38/l60 to d7/lbb 0 2024-04-25T16:22:40.984 INFO:tasks.workunit.client.0.smithi059.stdout:2/626: truncate de/d16/f8e 3280169 0 2024-04-25T16:22:41.074 INFO:tasks.workunit.client.0.smithi059.stdout:4/597: unlink d0/d4/df/d1c/d45/d54/l55 0 2024-04-25T16:22:41.372 INFO:tasks.workunit.client.0.smithi059.stdout:2/627: mknod de/d2a/da7/cdf 0 2024-04-25T16:22:41.391 INFO:tasks.workunit.client.0.smithi059.stdout:6/675: write d9/d16/d24/d97/f9c [625089,80669] 0 2024-04-25T16:22:41.424 INFO:tasks.workunit.client.0.smithi059.stdout:1/667: creat d7/d2a/d85/db7/d6a/fde x:0 0 0 2024-04-25T16:22:41.704 INFO:tasks.workunit.client.0.smithi059.stdout:4/598: creat d0/d4/df/d1c/d45/d54/d75/fbc x:0 0 0 2024-04-25T16:22:41.751 INFO:tasks.workunit.client.0.smithi059.stdout:3/666: symlink d0/db/d3f/d89/db3/le2 0 2024-04-25T16:22:41.832 INFO:tasks.workunit.client.0.smithi059.stdout:9/645: read d6/d35/d2f/f4d [787409,122439] 0 2024-04-25T16:22:41.866 INFO:tasks.workunit.client.0.smithi059.stdout:2/628: truncate de/f1d 2960769 0 2024-04-25T16:22:41.984 INFO:tasks.workunit.client.0.smithi059.stdout:6/676: symlink d9/d1b/d58/d49/ld9 0 2024-04-25T16:22:42.003 INFO:tasks.workunit.client.0.smithi059.stdout:1/668: truncate d7/d93/fb3 339420 0 2024-04-25T16:22:42.153 INFO:tasks.workunit.client.0.smithi059.stdout:7/603: rename d0/d7/d16/d20/d71/d7e to d0/d7/d51/da9/db3/d33/dc6 0 2024-04-25T16:22:42.172 INFO:tasks.workunit.client.0.smithi059.stdout:1/669: dread d7/d2a/d85/db7/f92 [0,4194304] 0 2024-04-25T16:22:42.215 INFO:tasks.workunit.client.0.smithi059.stdout:9/646: write d6/d4e/d54/d5d/d48/f5a [5106017,1903] 0 2024-04-25T16:22:42.300 INFO:tasks.workunit.client.0.smithi059.stdout:2/629: symlink de/d2a/d33/d88/le0 0 2024-04-25T16:22:42.347 INFO:tasks.workunit.client.0.smithi059.stdout:0/609: write dc/dd/f3c [34246,38413] 0 2024-04-25T16:22:42.370 INFO:tasks.workunit.client.0.smithi059.stdout:3/667: truncate d0/db/d2d/f46 732380 0 2024-04-25T16:22:42.508 INFO:tasks.workunit.client.0.smithi059.stdout:8/592: dwrite d7/d2f/d76/d85/fb6 [0,4194304] 0 2024-04-25T16:22:42.673 INFO:tasks.workunit.client.0.smithi059.stdout:5/666: rename d1/d48/da3/d6d to d1/d48/d85/dbe/dde 0 2024-04-25T16:22:42.808 INFO:tasks.workunit.client.0.smithi059.stdout:6/677: fsync d9/d1b/f8e 0 2024-04-25T16:22:42.824 INFO:tasks.workunit.client.0.smithi059.stdout:6/678: dread - d9/d16/d53/d74/f9b zero size 2024-04-25T16:22:42.918 INFO:tasks.workunit.client.0.smithi059.stdout:3/668: mknod d0/d1e/d57/da8/ce3 0 2024-04-25T16:22:43.136 INFO:tasks.workunit.client.0.smithi059.stdout:4/599: rename d0/f8c to d0/d4/df/d48/da9/fbd 0 2024-04-25T16:22:43.217 INFO:tasks.workunit.client.0.smithi059.stdout:5/667: unlink d1/dcd/d50/d8a/cd2 0 2024-04-25T16:22:43.440 INFO:tasks.workunit.client.0.smithi059.stdout:6/679: dwrite d9/d1b/f80 [4194304,4194304] 0 2024-04-25T16:22:43.518 INFO:tasks.workunit.client.0.smithi059.stdout:3/669: fdatasync d0/db/f19 0 2024-04-25T16:22:43.537 INFO:tasks.workunit.client.0.smithi059.stdout:3/670: chown d0/db/d3f/d6c/f93 625673288 1 2024-04-25T16:22:43.668 INFO:tasks.workunit.client.0.smithi059.stdout:4/600: rmdir d0/d4/df/d48/da9 39 2024-04-25T16:22:43.878 INFO:tasks.workunit.client.0.smithi059.stdout:5/668: fsync d1/d1e/d27/d66/d70/d24/f62 0 2024-04-25T16:22:43.894 INFO:tasks.workunit.client.0.smithi059.stdout:1/670: write d7/d2a/f67 [1342581,128043] 0 2024-04-25T16:22:43.958 INFO:tasks.workunit.client.0.smithi059.stdout:0/610: write dc/dd/f20 [1316888,72329] 0 2024-04-25T16:22:43.982 INFO:tasks.workunit.client.0.smithi059.stdout:4/601: creat d0/d4/df/d44/fbe x:0 0 0 2024-04-25T16:22:44.012 INFO:tasks.workunit.client.0.smithi059.stdout:6/680: dread d9/f4b [0,4194304] 0 2024-04-25T16:22:44.023 INFO:tasks.workunit.client.0.smithi059.stdout:6/681: stat d9/f79 0 2024-04-25T16:22:44.056 INFO:tasks.workunit.client.0.smithi059.stdout:9/647: getdents d6 0 2024-04-25T16:22:44.123 INFO:tasks.workunit.client.0.smithi059.stdout:3/671: mkdir d0/db/d2d/de4 0 2024-04-25T16:22:44.316 INFO:tasks.workunit.client.0.smithi059.stdout:7/604: rename d0/d7/d51/da9/db3/d33/d4c/d4e/f66 to d0/d7/d51/da9/db3/d33/fc7 0 2024-04-25T16:22:44.443 INFO:tasks.workunit.client.0.smithi059.stdout:4/602: creat d0/d4/df/d48/d5f/fbf x:0 0 0 2024-04-25T16:22:44.639 INFO:tasks.workunit.client.0.smithi059.stdout:8/593: dwrite d7/f1f [0,4194304] 0 2024-04-25T16:22:44.778 INFO:tasks.workunit.client.0.smithi059.stdout:3/672: creat d0/d1e/d31/dc7/fe5 x:0 0 0 2024-04-25T16:22:44.921 INFO:tasks.workunit.client.0.smithi059.stdout:7/605: symlink d0/d7/d51/da9/db3/d33/d87/lc8 0 2024-04-25T16:22:44.927 INFO:tasks.workunit.client.0.smithi059.stdout:5/669: write d1/d48/d85/fb1 [588624,14373] 0 2024-04-25T16:22:45.006 INFO:tasks.workunit.client.0.smithi059.stdout:0/611: unlink dc/c14 0 2024-04-25T16:22:45.010 INFO:tasks.workunit.client.0.smithi059.stdout:4/603: rmdir d0/d4/df/d1c/d45/d54/d75/d82 39 2024-04-25T16:22:45.254 INFO:tasks.workunit.client.0.smithi059.stdout:9/648: truncate d6/d35/d28/f74 1883696 0 2024-04-25T16:22:45.268 INFO:tasks.workunit.client.0.smithi059.stdout:1/671: creat d7/d2a/d85/db7/d16/fdf x:0 0 0 2024-04-25T16:22:45.633 INFO:tasks.workunit.client.0.smithi059.stdout:4/604: stat d0/d4/df/faa 0 2024-04-25T16:22:45.851 INFO:tasks.workunit.client.0.smithi059.stdout:6/682: dwrite d9/d16/f17 [0,4194304] 0 2024-04-25T16:22:45.861 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:22:45.864 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:22:45.948 INFO:tasks.workunit.client.0.smithi059.stdout:8/594: creat d7/d16/da3/fbc x:0 0 0 2024-04-25T16:22:45.950 INFO:tasks.workunit.client.0.smithi059.stdout:3/673: mkdir d0/db/d2d/de4/de6 0 2024-04-25T16:22:46.006 INFO:tasks.workunit.client.0.smithi059.stdout:2/630: rename de/d16/d82/da8 to de/d2a/d2e/de1 0 2024-04-25T16:22:46.310 INFO:tasks.workunit.client.0.smithi059.stdout:9/649: rmdir d6/d35/d28 39 2024-04-25T16:22:46.328 INFO:tasks.workunit.client.0.smithi059.stdout:4/605: chown d0/d4/df/c3c 74799531 1 2024-04-25T16:22:46.466 INFO:tasks.workunit.client.0.smithi059.stdout:7/606: dwrite d0/d7/d51/da9/db3/d33/d4c/d4e/f77 [0,4194304] 0 2024-04-25T16:22:46.545 INFO:tasks.workunit.client.0.smithi059.stdout:7/607: chown d0/d7/d51/da9/db3/d33/d79/d5d/lb1 1439441517 1 2024-04-25T16:22:46.701 INFO:tasks.workunit.client.0.smithi059.stdout:3/674: symlink d0/db/d3f/d6c/le7 0 2024-04-25T16:22:46.721 INFO:tasks.workunit.client.0.smithi059.stdout:2/631: dread - de/d2a/d2e/d36/d2c/d40/d57/f8a zero size 2024-04-25T16:22:47.133 INFO:tasks.workunit.client.0.smithi059.stdout:4/606: truncate d0/d4/df/d48/f4e 8597383 0 2024-04-25T16:22:47.142 INFO:tasks.workunit.client.0.smithi059.stdout:7/608: fdatasync d0/d7/d51/da9/db3/d33/d4c/d5c/f99 0 2024-04-25T16:22:47.158 INFO:tasks.workunit.client.0.smithi059.stdout:4/607: stat d0/d4/df/d1c/f6b 0 2024-04-25T16:22:47.171 INFO:tasks.workunit.client.0.smithi059.stdout:7/609: chown d0/d7/d51/da9/db3/d33/d87 10001666 1 2024-04-25T16:22:47.239 INFO:tasks.workunit.client.0.smithi059.stdout:2/632: stat de/d2a/d2e/fb2 0 2024-04-25T16:22:47.255 INFO:tasks.workunit.client.0.smithi059.stdout:3/675: dread d0/d1e/f53 [0,4194304] 0 2024-04-25T16:22:47.324 INFO:tasks.workunit.client.0.smithi059.stdout:6/683: link d9/c13 d9/d16/d53/d55/cda 0 2024-04-25T16:22:47.628 INFO:tasks.workunit.client.0.smithi059.stdout:5/670: rename d1/dcd/d50/d8a/fa1 to d1/d1e/d27/d66/d70/fdf 0 2024-04-25T16:22:47.701 INFO:tasks.workunit.client.0.smithi059.stdout:4/608: mknod d0/d4/df/d48/da3/cc0 0 2024-04-25T16:22:47.882 INFO:tasks.workunit.client.0.smithi059.stdout:1/672: getdents d7 0 2024-04-25T16:22:47.967 INFO:tasks.workunit.client.0.smithi059.stdout:8/595: write d7/d2f/f4a [4181955,81415] 0 2024-04-25T16:22:48.067 INFO:tasks.workunit.client.0.smithi059.stdout:8/596: chown d7/d16/d3a/f50 0 1 2024-04-25T16:22:48.068 INFO:tasks.workunit.client.0.smithi059.stdout:2/633: dread de/d16/f43 [0,4194304] 0 2024-04-25T16:22:48.180 INFO:tasks.workunit.client.0.smithi059.stdout:3/676: symlink d0/db/d2d/de4/de6/le8 0 2024-04-25T16:22:48.182 INFO:tasks.workunit.client.0.smithi059.stdout:1/673: rmdir d7/d2a/d85/db7/d2d/d41 39 2024-04-25T16:22:48.376 INFO:tasks.workunit.client.0.smithi059.stdout:2/634: mknod de/d5a/d7d/d80/ce2 0 2024-04-25T16:22:48.513 INFO:tasks.workunit.client.0.smithi059.stdout:2/635: dread de/d2a/d2e/d36/d2c/f8c [0,4194304] 0 2024-04-25T16:22:48.629 INFO:tasks.workunit.client.0.smithi059.stdout:3/677: read d0/db/d3f/d49/d65/f85 [1454169,123424] 0 2024-04-25T16:22:48.719 INFO:tasks.workunit.client.0.smithi059.stdout:9/650: dwrite d6/d35/d2f/d39/f4f [0,4194304] 0 2024-04-25T16:22:48.852 INFO:tasks.workunit.client.0.smithi059.stdout:1/674: fsync d7/d2a/d85/db7/d2d/d41/d8f/fa0 0 2024-04-25T16:22:48.892 INFO:tasks.workunit.client.0.smithi059.stdout:3/678: dread - d0/d1e/d57/fde zero size 2024-04-25T16:22:48.915 INFO:tasks.workunit.client.0.smithi059.stdout:4/609: link d0/d4/df/d1c/d45/d54/d75/f80 d0/d4/df/d1c/d45/d54/d75/d82/d8f/fc1 0 2024-04-25T16:22:49.020 INFO:tasks.workunit.client.0.smithi059.stdout:8/597: mkdir d7/dd/d17/d23/d37/d5c/d87/d94/d66/daa/dbd 0 2024-04-25T16:22:49.025 INFO:tasks.workunit.client.0.smithi059.stdout:2/636: fdatasync de/d5a/f77 0 2024-04-25T16:22:49.178 INFO:tasks.workunit.client.0.smithi059.stdout:0/612: creat dc/fc5 x:0 0 0 2024-04-25T16:22:49.268 INFO:tasks.workunit.client.0.smithi059.stdout:3/679: mkdir d0/db/d3f/d6c/d9f/de9 0 2024-04-25T16:22:49.390 INFO:tasks.workunit.client.0.smithi059.stdout:5/671: getdents d1/d1e/d27/d66/d70 0 2024-04-25T16:22:49.418 INFO:tasks.workunit.client.0.smithi059.stdout:3/680: sync 2024-04-25T16:22:49.614 INFO:tasks.workunit.client.0.smithi059.stdout:7/610: write d0/d7/d51/da9/db3/d33/d79/fc4 [913770,51488] 0 2024-04-25T16:22:49.806 INFO:tasks.workunit.client.0.smithi059.stdout:6/684: dwrite d9/f72 [0,4194304] 0 2024-04-25T16:22:49.901 INFO:tasks.workunit.client.0.smithi059.stdout:2/637: mkdir de/d5a/d7d/d80/ddb/de3 0 2024-04-25T16:22:49.980 INFO:tasks.workunit.client.0.smithi059.stdout:7/611: mknod d0/d7/d51/da9/db3/d33/d79/cc9 0 2024-04-25T16:22:50.205 INFO:tasks.workunit.client.0.smithi059.stdout:0/613: unlink dc/df/d24/c3e 0 2024-04-25T16:22:50.213 INFO:tasks.workunit.client.0.smithi059.stdout:0/614: chown dc/dd/d3b 74070414 1 2024-04-25T16:22:50.894 INFO:tasks.workunit.client.0.smithi059.stdout:6/685: truncate d9/d16/f26 8642137 0 2024-04-25T16:22:50.910 INFO:tasks.workunit.client.0.smithi059.stdout:4/610: dwrite d0/d4/df/d1c/d45/f9b [0,4194304] 0 2024-04-25T16:22:51.012 INFO:tasks.workunit.client.0.smithi059.stdout:9/651: dwrite d6/d35/d28/f69 [0,4194304] 0 2024-04-25T16:22:51.050 INFO:tasks.workunit.client.0.smithi059.stdout:8/598: dwrite d7/dd/d33/f73 [0,4194304] 0 2024-04-25T16:22:51.073 INFO:tasks.workunit.client.0.smithi059.stdout:5/672: dwrite d1/dcd/f57 [0,4194304] 0 2024-04-25T16:22:51.189 INFO:tasks.workunit.client.0.smithi059.stdout:1/675: link d7/d2a/d85/db7/d2d/d41/d8f/l90 d7/d2a/d85/db7/d6a/le0 0 2024-04-25T16:22:51.226 INFO:tasks.workunit.client.0.smithi059.stdout:5/673: readlink d1/d1e/d8f/l98 0 2024-04-25T16:22:51.498 INFO:tasks.workunit.client.0.smithi059.stdout:0/615: mkdir dc/df/d5e/dc6 0 2024-04-25T16:22:51.674 INFO:tasks.workunit.client.0.smithi059.stdout:7/612: fdatasync d0/d7/fa7 0 2024-04-25T16:22:51.880 INFO:tasks.workunit.client.0.smithi059.stdout:4/611: mknod d0/d4/df/d1c/d45/d54/d75/d82/cc2 0 2024-04-25T16:22:51.960 INFO:tasks.workunit.client.0.smithi059.stdout:8/599: rename d7/d2f/f53 to d7/d16/da3/fbe 0 2024-04-25T16:22:52.018 INFO:tasks.workunit.client.0.smithi059.stdout:5/674: symlink d1/d1e/le0 0 2024-04-25T16:22:52.244 INFO:tasks.workunit.client.0.smithi059.stdout:3/681: getdents d0/db/d2d 0 2024-04-25T16:22:52.267 INFO:tasks.workunit.client.0.smithi059.stdout:2/638: creat de/d2a/d2e/d36/d2c/d40/fe4 x:0 0 0 2024-04-25T16:22:52.390 INFO:tasks.workunit.client.0.smithi059.stdout:7/613: truncate d0/d3f/f4d 965537 0 2024-04-25T16:22:52.616 INFO:tasks.workunit.client.0.smithi059.stdout:5/675: mknod d1/d1e/d27/d66/d70/d75/daa/ce1 0 2024-04-25T16:22:52.727 INFO:tasks.workunit.client.0.smithi059.stdout:2/639: read de/d2a/d2e/f58 [4912436,91028] 0 2024-04-25T16:22:52.743 INFO:tasks.workunit.client.0.smithi059.stdout:2/640: readlink de/d2a/d2e/d36/d2c/l70 0 2024-04-25T16:22:52.874 INFO:tasks.workunit.client.0.smithi059.stdout:3/682: rename d0/db/d3f/d6c/d9f to d0/db/d3f/d6c/dea 0 2024-04-25T16:22:52.882 INFO:tasks.workunit.client.0.smithi059.stdout:9/652: creat d6/d4e/d54/d5d/fbb x:0 0 0 2024-04-25T16:22:52.909 INFO:tasks.workunit.client.0.smithi059.stdout:7/614: mknod d0/d7/d16/d20/d71/cca 0 2024-04-25T16:22:52.931 INFO:tasks.workunit.client.0.smithi059.stdout:7/615: read d0/d7/d51/da9/db3/d33/f8c [208403,108696] 0 2024-04-25T16:22:52.943 INFO:tasks.workunit.client.0.smithi059.stdout:7/616: chown d0/d7/d16/d20/d71 2 1 2024-04-25T16:22:52.975 INFO:tasks.workunit.client.0.smithi059.stdout:3/683: sync 2024-04-25T16:22:52.977 INFO:tasks.workunit.client.0.smithi059.stdout:3/684: stat d0 0 2024-04-25T16:22:52.990 INFO:tasks.workunit.client.0.smithi059.stdout:4/612: rename d0/d4/df/d48/c6d to d0/d4/df/d1c/d45/d6f/cc3 0 2024-04-25T16:22:53.057 INFO:tasks.workunit.client.0.smithi059.stdout:5/676: fdatasync d1/d1e/d27/d66/f69 0 2024-04-25T16:22:53.257 INFO:tasks.workunit.client.0.smithi059.stdout:4/613: mkdir d0/d4/df/d1c/d45/d6f/dc4 0 2024-04-25T16:22:53.271 INFO:tasks.workunit.client.0.smithi059.stdout:6/686: write d9/d16/d53/d6c/da6/fc2 [694138,55747] 0 2024-04-25T16:22:53.355 INFO:tasks.workunit.client.0.smithi059.stdout:3/685: dread d0/db/f30 [4194304,4194304] 0 2024-04-25T16:22:53.478 INFO:tasks.workunit.client.0.smithi059.stdout:7/617: mkdir d0/d7/d51/da9/db3/d33/d79/d5d/dcb 0 2024-04-25T16:22:53.511 INFO:tasks.workunit.client.0.smithi059.stdout:1/676: dwrite d7/d93/d8e/fa2 [0,4194304] 0 2024-04-25T16:22:53.595 INFO:tasks.workunit.client.0.smithi059.stdout:7/618: readlink d0/d7/d51/da9/db3/d33/d79/l63 0 2024-04-25T16:22:53.614 INFO:tasks.workunit.client.0.smithi059.stdout:1/677: dread d7/d2a/d85/db7/d2d/d4a/fb5 [0,4194304] 0 2024-04-25T16:22:53.667 INFO:tasks.workunit.client.0.smithi059.stdout:7/619: sync 2024-04-25T16:22:53.766 INFO:tasks.workunit.client.0.smithi059.stdout:4/614: dread d0/d4/df/d1c/d45/d54/f72 [0,4194304] 0 2024-04-25T16:22:53.770 INFO:tasks.workunit.client.0.smithi059.stdout:9/653: link d6/d35/d28/f8c d6/fbc 0 2024-04-25T16:22:53.782 INFO:tasks.workunit.client.0.smithi059.stdout:3/686: dread d0/d1e/fa3 [0,4194304] 0 2024-04-25T16:22:53.821 INFO:tasks.workunit.client.0.smithi059.stdout:0/616: dwrite dc/d37/d47/d71/d77/f85 [0,4194304] 0 2024-04-25T16:22:54.120 INFO:tasks.workunit.client.0.smithi059.stdout:8/600: write d7/dd/d17/d23/f2a [1619736,67174] 0 2024-04-25T16:22:54.165 INFO:tasks.workunit.client.0.smithi059.stdout:5/677: write d1/d1e/d27/d66/f69 [191894,25447] 0 2024-04-25T16:22:54.167 INFO:tasks.workunit.client.0.smithi059.stdout:6/687: write d9/d16/d24/f2b [237501,18200] 0 2024-04-25T16:22:54.275 INFO:tasks.workunit.client.0.smithi059.stdout:1/678: mknod d7/d2a/d85/db7/dbb/db6/ce1 0 2024-04-25T16:22:54.335 INFO:tasks.workunit.client.0.smithi059.stdout:2/641: dwrite de/d2a/d2e/fb2 [12582912,4194304] 0 2024-04-25T16:22:54.414 INFO:tasks.workunit.client.0.smithi059.stdout:4/615: truncate d0/d4/df/d1c/fa0 491043 0 2024-04-25T16:22:54.421 INFO:tasks.workunit.client.0.smithi059.stdout:8/601: truncate d7/f1c 506686 0 2024-04-25T16:22:54.740 INFO:tasks.workunit.client.0.smithi059.stdout:7/620: dwrite d0/d7/d51/da9/db3/d33/f41 [4194304,4194304] 0 2024-04-25T16:22:54.808 INFO:tasks.workunit.client.0.smithi059.stdout:6/688: rename d9/d16/d53/lc1 to d9/d1b/d58/d49/db0/ldb 0 2024-04-25T16:22:54.953 INFO:tasks.workunit.client.0.smithi059.stdout:2/642: fsync de/d16/d3e/f8d 0 2024-04-25T16:22:55.037 INFO:tasks.workunit.client.0.smithi059.stdout:4/616: fdatasync d0/d4/df/d1c/d45/d54/d75/fbc 0 2024-04-25T16:22:55.097 INFO:tasks.workunit.client.0.smithi059.stdout:5/678: dwrite d1/d1e/d27/fb4 [0,4194304] 0 2024-04-25T16:22:55.099 INFO:tasks.workunit.client.0.smithi059.stdout:9/654: read d6/d35/f66 [1934763,124247] 0 2024-04-25T16:22:55.414 INFO:tasks.workunit.client.0.smithi059.stdout:0/617: creat dc/fc7 x:0 0 0 2024-04-25T16:22:55.432 INFO:tasks.workunit.client.0.smithi059.stdout:3/687: getdents d0/db/d3f/d89/db3 0 2024-04-25T16:22:55.439 INFO:tasks.workunit.client.0.smithi059.stdout:5/679: rmdir d1/d1e/d27/d66/d70 39 2024-04-25T16:22:55.450 INFO:tasks.workunit.client.0.smithi059.stdout:2/643: dread - de/d5a/d9a/faa zero size 2024-04-25T16:22:55.456 INFO:tasks.workunit.client.0.smithi059.stdout:4/617: symlink d0/d4/df/d1c/d45/d54/d75/d7e/lc5 0 2024-04-25T16:22:55.459 INFO:tasks.workunit.client.0.smithi059.stdout:9/655: dread - d6/d35/d6c/fb3 zero size 2024-04-25T16:22:55.589 INFO:tasks.workunit.client.0.smithi059.stdout:4/618: chown d0/d4/df/d44/c47 1515 1 2024-04-25T16:22:55.617 INFO:tasks.workunit.client.0.smithi059.stdout:1/679: dwrite d7/fce [0,4194304] 0 2024-04-25T16:22:55.668 INFO:tasks.workunit.client.0.smithi059.stdout:4/619: sync 2024-04-25T16:22:55.773 INFO:tasks.workunit.client.0.smithi059.stdout:6/689: creat d9/d16/dc0/fdc x:0 0 0 2024-04-25T16:22:56.074 INFO:tasks.workunit.client.0.smithi059.stdout:7/621: write d0/d7/d51/da9/db3/d33/d79/d5d/db7/fb0 [174300,5122] 0 2024-04-25T16:22:56.150 INFO:tasks.workunit.client.0.smithi059.stdout:4/620: symlink d0/d4/df/d44/lc6 0 2024-04-25T16:22:56.165 INFO:tasks.workunit.client.0.smithi059.stdout:5/680: dread d1/d1e/d27/fb3 [0,4194304] 0 2024-04-25T16:22:56.267 INFO:tasks.workunit.client.0.smithi059.stdout:5/681: chown d1/d1e/d27/d66/l86 1224108644 1 2024-04-25T16:22:56.330 INFO:tasks.workunit.client.0.smithi059.stdout:1/680: dread d7/d2a/d85/db7/d2d/d41/f73 [0,4194304] 0 2024-04-25T16:22:56.354 INFO:tasks.workunit.client.0.smithi059.stdout:8/602: write d7/dd/f83 [203628,69804] 0 2024-04-25T16:22:56.755 INFO:tasks.workunit.client.0.smithi059.stdout:4/621: read d0/d4/df/f12 [6975796,59617] 0 2024-04-25T16:22:57.008 INFO:tasks.workunit.client.0.smithi059.stdout:1/681: dread d7/d2a/d85/db7/d2d/d4a/f4b [0,4194304] 0 2024-04-25T16:22:57.157 INFO:tasks.workunit.client.0.smithi059.stdout:0/618: dwrite dc/d37/d47/f75 [0,4194304] 0 2024-04-25T16:22:57.255 INFO:tasks.workunit.client.0.smithi059.stdout:5/682: read d1/d1e/d27/d66/d70/d75/daa/fbf [6428809,78448] 0 2024-04-25T16:22:57.258 INFO:tasks.workunit.client.0.smithi059.stdout:8/603: mknod d7/d16/d8f/cbf 0 2024-04-25T16:22:57.339 INFO:tasks.workunit.client.0.smithi059.stdout:1/682: dread - d7/d21/d51/da6/f84 zero size 2024-04-25T16:22:57.529 INFO:tasks.workunit.client.0.smithi059.stdout:2/644: dwrite de/d2a/d2e/fb7 [0,4194304] 0 2024-04-25T16:22:57.626 INFO:tasks.workunit.client.0.smithi059.stdout:9/656: dwrite d6/d35/d28/f40 [0,4194304] 0 2024-04-25T16:22:57.690 INFO:tasks.workunit.client.0.smithi059.stdout:4/622: dread d0/d4/df/d48/d5f/f6a [0,4194304] 0 2024-04-25T16:22:57.705 INFO:tasks.workunit.client.0.smithi059.stdout:3/688: rename d0/db/d2d/d7a/f92 to d0/db/feb 0 2024-04-25T16:22:57.733 INFO:tasks.workunit.client.0.smithi059.stdout:7/622: write d0/d7/d51/da9/db3/d33/d79/f9c [4878433,95129] 0 2024-04-25T16:22:57.733 INFO:tasks.workunit.client.0.smithi059.stdout:0/619: creat dc/d37/d47/d71/d9c/fc8 x:0 0 0 2024-04-25T16:22:57.743 INFO:tasks.workunit.client.0.smithi059.stdout:6/690: write d9/d16/f26 [2212142,91930] 0 2024-04-25T16:22:58.111 INFO:tasks.workunit.client.0.smithi059.stdout:7/623: unlink d0/l26 0 2024-04-25T16:22:58.123 INFO:tasks.workunit.client.0.smithi059.stdout:9/657: stat d6/d4e/d54/d5d/cb1 0 2024-04-25T16:22:58.213 INFO:tasks.workunit.client.0.smithi059.stdout:5/683: mknod d1/dcd/d50/db8/ce2 0 2024-04-25T16:22:58.232 INFO:tasks.workunit.client.0.smithi059.stdout:8/604: write d7/d2f/d76/f9d [2669699,63053] 0 2024-04-25T16:22:58.232 INFO:tasks.workunit.client.0.smithi059.stdout:1/683: dread - d7/d2a/d85/d8d/faf zero size 2024-04-25T16:22:58.441 INFO:tasks.workunit.client.0.smithi059.stdout:6/691: symlink d9/ldd 0 2024-04-25T16:22:58.449 INFO:tasks.workunit.client.0.smithi059.stdout:3/689: mkdir d0/db/d3f/dce/dec 0 2024-04-25T16:22:58.459 INFO:tasks.workunit.client.0.smithi059.stdout:0/620: mknod dc/dd/d5c/dbe/cc9 0 2024-04-25T16:22:58.533 INFO:tasks.workunit.client.0.smithi059.stdout:6/692: sync 2024-04-25T16:22:58.563 INFO:tasks.workunit.client.0.smithi059.stdout:7/624: dread d0/d7/d16/d20/fc5 [0,4194304] 0 2024-04-25T16:22:58.627 INFO:tasks.workunit.client.0.smithi059.stdout:6/693: chown d9/d16/c2d 212 1 2024-04-25T16:22:58.630 INFO:tasks.workunit.client.0.smithi059.stdout:2/645: dwrite de/fc9 [0,4194304] 0 2024-04-25T16:22:58.712 INFO:tasks.workunit.client.0.smithi059.stdout:4/623: write d0/d4/df/f12 [9420580,69713] 0 2024-04-25T16:22:58.826 INFO:tasks.workunit.client.0.smithi059.stdout:3/690: mkdir d0/db/d47/d7e/ded 0 2024-04-25T16:22:58.833 INFO:tasks.workunit.client.0.smithi059.stdout:0/621: mkdir dc/d37/d47/d71/d9c/dca 0 2024-04-25T16:22:59.386 INFO:tasks.workunit.client.0.smithi059.stdout:9/658: dwrite d6/d4e/d54/d5d/d48/fb6 [0,4194304] 0 2024-04-25T16:22:59.397 INFO:tasks.workunit.client.0.smithi059.stdout:4/624: creat d0/d4/df/d1c/d45/d54/d75/d82/fc7 x:0 0 0 2024-04-25T16:22:59.408 INFO:tasks.workunit.client.0.smithi059.stdout:7/625: dwrite d0/f88 [0,4194304] 0 2024-04-25T16:22:59.415 INFO:tasks.workunit.client.0.smithi059.stdout:8/605: dwrite d7/dd/d17/d23/d38/f7b [0,4194304] 0 2024-04-25T16:22:59.450 INFO:tasks.workunit.client.0.smithi059.stdout:9/659: sync 2024-04-25T16:22:59.502 INFO:tasks.workunit.client.0.smithi059.stdout:3/691: truncate d0/f37 650348 0 2024-04-25T16:22:59.519 INFO:tasks.workunit.client.0.smithi059.stdout:5/684: link d1/dcd/d50/d8a/f99 d1/dcd/d44/fe3 0 2024-04-25T16:22:59.535 INFO:tasks.workunit.client.0.smithi059.stdout:1/684: rename d7/d2a/d85/db7/d16/d5c/d74/cd1 to d7/d2a/d85/db7/d2d/ce2 0 2024-04-25T16:22:59.648 INFO:tasks.workunit.client.0.smithi059.stdout:1/685: dread d7/d2a/d85/db7/f63 [0,4194304] 0 2024-04-25T16:22:59.730 INFO:tasks.workunit.client.0.smithi059.stdout:7/626: dwrite d0/d7/d51/da9/db3/d33/d79/f9c [4194304,4194304] 0 2024-04-25T16:22:59.820 INFO:tasks.workunit.client.0.smithi059.stdout:2/646: truncate de/d2a/d2e/f30 4913787 0 2024-04-25T16:22:59.825 INFO:tasks.workunit.client.0.smithi059.stdout:6/694: write d9/d16/f17 [373770,8697] 0 2024-04-25T16:22:59.891 INFO:tasks.workunit.client.0.smithi059.stdout:8/606: dread d7/f1c [0,4194304] 0 2024-04-25T16:22:59.940 INFO:tasks.workunit.client.0.smithi059.stdout:5/685: fdatasync d1/dcd/d50/fce 0 2024-04-25T16:23:00.234 INFO:tasks.workunit.client.0.smithi059.stdout:6/695: rmdir d9/d27/d68 39 2024-04-25T16:23:00.407 INFO:tasks.workunit.client.0.smithi059.stdout:6/696: dread d9/d1b/f2c [0,4194304] 0 2024-04-25T16:23:00.540 INFO:tasks.workunit.client.0.smithi059.stdout:0/622: write dc/df/d5e/fba [4461439,119485] 0 2024-04-25T16:23:00.607 INFO:tasks.workunit.client.0.smithi059.stdout:8/607: write d7/dd/d17/d23/f81 [2551465,54354] 0 2024-04-25T16:23:00.684 INFO:tasks.workunit.client.0.smithi059.stdout:9/660: write d6/d4e/d54/d5d/d48/d49/f5c [1740730,75442] 0 2024-04-25T16:23:00.741 INFO:tasks.workunit.client.0.smithi059.stdout:3/692: dwrite d0/db/d3f/d49/fc5 [0,4194304] 0 2024-04-25T16:23:00.861 INFO:tasks.workunit.client.0.smithi059.stdout:1/686: dwrite d7/d2a/f67 [0,4194304] 0 2024-04-25T16:23:01.034 INFO:tasks.workunit.client.0.smithi059.stdout:9/661: dwrite d6/d4e/d54/d5d/d95/fab [0,4194304] 0 2024-04-25T16:23:01.039 INFO:tasks.workunit.client.0.smithi059.stdout:2/647: mkdir de/d2a/d2e/d36/d2c/d40/de5 0 2024-04-25T16:23:01.105 INFO:tasks.workunit.client.0.smithi059.stdout:7/627: fsync d0/d7/d51/da9/db3/d33/d4c/d5c/f89 0 2024-04-25T16:23:01.148 INFO:tasks.workunit.client.0.smithi059.stdout:2/648: readlink de/d2a/d2e/d36/d2c/l55 0 2024-04-25T16:23:01.157 INFO:tasks.workunit.client.0.smithi059.stdout:9/662: chown d6/d4e/d54/d5d/d48/d6e/fa4 2 1 2024-04-25T16:23:01.284 INFO:tasks.workunit.client.0.smithi059.stdout:8/608: truncate d7/d16/d3a/f46 315170 0 2024-04-25T16:23:01.300 INFO:tasks.workunit.client.0.smithi059.stdout:3/693: rename d0/db/d3f/d49/f9d to d0/db/d47/d7e/ded/fee 0 2024-04-25T16:23:01.301 INFO:tasks.workunit.client.0.smithi059.stdout:1/687: creat d7/d2a/d62/fe3 x:0 0 0 2024-04-25T16:23:01.315 INFO:tasks.workunit.client.0.smithi059.stdout:4/625: getdents d0/d4/df/d48/d5f 0 2024-04-25T16:23:01.382 INFO:tasks.workunit.client.0.smithi059.stdout:5/686: write d1/d48/da3/f81 [915414,23245] 0 2024-04-25T16:23:01.428 INFO:tasks.workunit.client.0.smithi059.stdout:5/687: read d1/dd/f34 [40992,59069] 0 2024-04-25T16:23:01.438 INFO:tasks.workunit.client.0.smithi059.stdout:5/688: chown d1/l7 12501 1 2024-04-25T16:23:01.517 INFO:tasks.workunit.client.0.smithi059.stdout:2/649: creat de/d5a/d7d/d80/fe6 x:0 0 0 2024-04-25T16:23:01.901 INFO:tasks.workunit.client.0.smithi059.stdout:7/628: rename d0/d7/d51/da9/db3/d33/dc6/l82 to d0/d7/d51/da9/db3/d33/d79/d5d/db7/lcc 0 2024-04-25T16:23:01.906 INFO:tasks.workunit.client.0.smithi059.stdout:8/609: mkdir d7/d16/d8f/dc0 0 2024-04-25T16:23:01.924 INFO:tasks.workunit.client.0.smithi059.stdout:4/626: readlink d0/d4/df/d44/lae 0 2024-04-25T16:23:01.961 INFO:tasks.workunit.client.0.smithi059.stdout:4/627: read d0/d4/df/d44/f83 [3546130,73585] 0 2024-04-25T16:23:02.270 INFO:tasks.workunit.client.0.smithi059.stdout:5/689: fdatasync d1/dcd/fbc 0 2024-04-25T16:23:02.349 INFO:tasks.workunit.client.0.smithi059.stdout:3/694: mknod d0/db/d3f/dce/dec/cef 0 2024-04-25T16:23:02.434 INFO:tasks.workunit.client.0.smithi059.stdout:1/688: rename d7/d2a/d85/db7/f8b to d7/d2a/d85/db7/d16/d5c/d74/fe4 0 2024-04-25T16:23:02.703 INFO:tasks.workunit.client.0.smithi059.stdout:6/697: dwrite d9/d1b/f36 [0,4194304] 0 2024-04-25T16:23:02.864 INFO:tasks.workunit.client.0.smithi059.stdout:2/650: rename de/d2a/d2e/d36/c42 to de/d2a/d33/d65/dcf/ce7 0 2024-04-25T16:23:02.931 INFO:tasks.workunit.client.0.smithi059.stdout:1/689: fdatasync d7/d2a/d85/db7/d16/d72/fcb 0 2024-04-25T16:23:02.963 INFO:tasks.workunit.client.0.smithi059.stdout:1/690: dread d7/d2a/d85/db7/f87 [0,4194304] 0 2024-04-25T16:23:02.972 INFO:tasks.workunit.client.0.smithi059.stdout:1/691: chown d7/f26 15786626 1 2024-04-25T16:23:02.980 INFO:tasks.workunit.client.0.smithi059.stdout:1/692: chown d7/d2a/c48 102 1 2024-04-25T16:23:03.161 INFO:tasks.workunit.client.0.smithi059.stdout:0/623: link dc/df/d24/c4a dc/d37/d47/d71/ccb 0 2024-04-25T16:23:03.163 INFO:tasks.workunit.client.0.smithi059.stdout:9/663: getdents d6/d35/d26 0 2024-04-25T16:23:03.297 INFO:tasks.workunit.client.0.smithi059.stdout:2/651: mknod de/d16/d7f/ce8 0 2024-04-25T16:23:03.531 INFO:tasks.workunit.client.0.smithi059.stdout:9/664: stat d6/d4e/d54/d5d/d48/d6e/f9e 0 2024-04-25T16:23:03.705 INFO:tasks.workunit.client.0.smithi059.stdout:7/629: getdents d0/d7/d16 0 2024-04-25T16:23:03.952 INFO:tasks.workunit.client.0.smithi059.stdout:3/695: getdents d0/db/d47/d7e 0 2024-04-25T16:23:04.148 INFO:tasks.workunit.client.0.smithi059.stdout:9/665: truncate d6/fb 90104 0 2024-04-25T16:23:04.202 INFO:tasks.workunit.client.0.smithi059.stdout:6/698: link d9/d1b/l5a d9/d1b/d58/lde 0 2024-04-25T16:23:04.214 INFO:tasks.workunit.client.0.smithi059.stdout:6/699: stat d9/d16/d53/d55/d6e/fce 0 2024-04-25T16:23:04.487 INFO:tasks.workunit.client.0.smithi059.stdout:8/610: dwrite d7/dd/d33/f73 [0,4194304] 0 2024-04-25T16:23:04.575 INFO:tasks.workunit.client.0.smithi059.stdout:4/628: write d0/d4/df/d48/d5f/fb8 [467038,108730] 0 2024-04-25T16:23:04.597 INFO:tasks.workunit.client.0.smithi059.stdout:5/690: rmdir d1/d48 39 2024-04-25T16:23:04.600 INFO:tasks.workunit.client.0.smithi059.stdout:9/666: dread d6/d4e/d54/d5d/f59 [0,4194304] 0 2024-04-25T16:23:04.872 INFO:tasks.workunit.client.0.smithi059.stdout:0/624: write dc/dd/d5c/fb9 [2039882,29097] 0 2024-04-25T16:23:04.923 INFO:tasks.workunit.client.0.smithi059.stdout:0/625: readlink l8 0 2024-04-25T16:23:05.063 INFO:tasks.workunit.client.0.smithi059.stdout:2/652: dwrite de/d2a/d2e/d36/f51 [0,4194304] 0 2024-04-25T16:23:05.074 INFO:tasks.workunit.client.0.smithi059.stdout:1/693: dwrite d7/d2a/d85/db7/f87 [0,4194304] 0 2024-04-25T16:23:05.201 INFO:tasks.workunit.client.0.smithi059.stdout:1/694: stat d7/d93/fb2 0 2024-04-25T16:23:05.277 INFO:tasks.workunit.client.0.smithi059.stdout:5/691: mknod d1/d1e/d27/d66/d70/d75/daa/ce4 0 2024-04-25T16:23:05.280 INFO:tasks.workunit.client.0.smithi059.stdout:8/611: truncate d7/dd/d17/d23/f64 596910 0 2024-04-25T16:23:05.285 INFO:tasks.workunit.client.0.smithi059.stdout:4/629: rename d0/d4/l22 to d0/d4/df/d1c/d45/d6f/lc8 0 2024-04-25T16:23:05.301 INFO:tasks.workunit.client.0.smithi059.stdout:5/692: chown d1/d1e/dca 7 1 2024-04-25T16:23:05.316 INFO:tasks.workunit.client.0.smithi059.stdout:4/630: readlink d0/d4/df/d44/lc6 0 2024-04-25T16:23:05.585 INFO:tasks.workunit.client.0.smithi059.stdout:7/630: dwrite d0/d7/d51/da9/db3/d33/d4c/d5c/f89 [0,4194304] 0 2024-04-25T16:23:05.586 INFO:tasks.workunit.client.0.smithi059.stdout:3/696: dwrite d0/d1e/f8f [0,4194304] 0 2024-04-25T16:23:05.655 INFO:tasks.workunit.client.0.smithi059.stdout:9/667: symlink d6/d4e/d54/d5d/d48/lbd 0 2024-04-25T16:23:05.733 INFO:tasks.workunit.client.0.smithi059.stdout:5/693: unlink d1/dcd/d44/dd1/ld9 0 2024-04-25T16:23:05.743 INFO:tasks.workunit.client.0.smithi059.stdout:4/631: rename d0/d4/df/d1c/f37 to d0/d4/df/d48/d5f/fc9 0 2024-04-25T16:23:05.831 INFO:tasks.workunit.client.0.smithi059.stdout:8/612: dread d7/dd/d17/d23/d37/d5c/f7c [0,4194304] 0 2024-04-25T16:23:05.840 INFO:tasks.workunit.client.0.smithi059.stdout:8/613: readlink d7/dd/d33/l99 0 2024-04-25T16:23:05.842 INFO:tasks.workunit.client.0.smithi059.stdout:5/694: sync 2024-04-25T16:23:05.856 INFO:tasks.workunit.client.0.smithi059.stdout:6/700: write d9/d16/d53/d55/fca [531925,31913] 0 2024-04-25T16:23:05.991 INFO:tasks.workunit.client.0.smithi059.stdout:6/701: dread d9/d27/f5f [0,4194304] 0 2024-04-25T16:23:06.000 INFO:tasks.workunit.client.0.smithi059.stdout:6/702: stat d9/d16/d24/d5d 0 2024-04-25T16:23:06.182 INFO:tasks.workunit.client.0.smithi059.stdout:3/697: mkdir d0/d1e/d31/df0 0 2024-04-25T16:23:06.192 INFO:tasks.workunit.client.0.smithi059.stdout:3/698: read - d0/d1e/d57/fde zero size 2024-04-25T16:23:06.245 INFO:tasks.workunit.client.0.smithi059.stdout:7/631: mknod d0/d7/d51/ccd 0 2024-04-25T16:23:06.462 INFO:tasks.workunit.client.0.smithi059.stdout:8/614: fdatasync d7/dd/d17/d23/d37/f82 0 2024-04-25T16:23:06.557 INFO:tasks.workunit.client.0.smithi059.stdout:6/703: fdatasync d9/d16/d53/d6c/da6/fab 0 2024-04-25T16:23:06.699 INFO:tasks.workunit.client.0.smithi059.stdout:3/699: creat d0/db/d47/d98/ff1 x:0 0 0 2024-04-25T16:23:06.800 INFO:tasks.workunit.client.0.smithi059.stdout:0/626: dwrite dc/d37/d47/f7c [0,4194304] 0 2024-04-25T16:23:06.878 INFO:tasks.workunit.client.0.smithi059.stdout:4/632: truncate d0/d4/df/d1c/d45/d54/d75/f80 491801 0 2024-04-25T16:23:06.882 INFO:tasks.workunit.client.0.smithi059.stdout:2/653: write de/d16/f31 [1478634,4947] 0 2024-04-25T16:23:06.895 INFO:tasks.workunit.client.0.smithi059.stdout:1/695: write d7/d93/f4f [1999376,25485] 0 2024-04-25T16:23:06.965 INFO:tasks.workunit.client.0.smithi059.stdout:5/695: mknod d1/d48/da3/ce5 0 2024-04-25T16:23:07.314 INFO:tasks.workunit.client.0.smithi059.stdout:8/615: creat d7/dd/d17/db4/d7e/fc1 x:0 0 0 2024-04-25T16:23:07.327 INFO:tasks.workunit.client.0.smithi059.stdout:8/616: readlink d7/dd/d17/d23/d37/l6b 0 2024-04-25T16:23:07.784 INFO:tasks.workunit.client.0.smithi059.stdout:0/627: dread dc/d44/d5f/f7e [0,4194304] 0 2024-04-25T16:23:07.794 INFO:tasks.workunit.client.0.smithi059.stdout:0/628: chown dc/df/f5d 496644 1 2024-04-25T16:23:07.821 INFO:tasks.workunit.client.0.smithi059.stdout:1/696: rename d7/d2a/d85/db7/d2d/d41 to d7/de5 0 2024-04-25T16:23:07.823 INFO:tasks.workunit.client.0.smithi059.stdout:5/696: rmdir d1/d1e/d27 39 2024-04-25T16:23:07.886 INFO:tasks.workunit.client.0.smithi059.stdout:8/617: readlink d7/dd/d17/d23/d37/d5c/d87/d94/lb7 0 2024-04-25T16:23:07.940 INFO:tasks.workunit.client.0.smithi059.stdout:6/704: truncate d9/d16/d53/d6c/da6/fd3 81267 0 2024-04-25T16:23:08.086 INFO:tasks.workunit.client.0.smithi059.stdout:0/629: mknod dc/dd/dbd/ccc 0 2024-04-25T16:23:08.177 INFO:tasks.workunit.client.0.smithi059.stdout:9/668: write d6/f1b [1283917,102462] 0 2024-04-25T16:23:08.198 INFO:tasks.workunit.client.0.smithi059.stdout:9/669: chown d6/d4e/d54/d5d/d48/d49/f5e 227369 1 2024-04-25T16:23:08.211 INFO:tasks.workunit.client.0.smithi059.stdout:9/670: readlink d6/d4e/d54/d5d/d48/d49/l8f 0 2024-04-25T16:23:08.236 INFO:tasks.workunit.client.0.smithi059.stdout:2/654: rename de/d2a/d33/d65/dca/dc1 to de/d5a/d9a/de9 0 2024-04-25T16:23:08.243 INFO:tasks.workunit.client.0.smithi059.stdout:2/655: chown de/d16/d3e 5025 1 2024-04-25T16:23:08.507 INFO:tasks.workunit.client.0.smithi059.stdout:7/632: write d0/d7/f73 [2283816,19409] 0 2024-04-25T16:23:08.625 INFO:tasks.workunit.client.0.smithi059.stdout:9/671: creat d6/d4e/dba/fbe x:0 0 0 2024-04-25T16:23:08.717 INFO:tasks.workunit.client.0.smithi059.stdout:9/672: sync 2024-04-25T16:23:08.773 INFO:tasks.workunit.client.0.smithi059.stdout:7/633: creat d0/d7/d51/da9/db3/d33/d79/d5d/d85/fce x:0 0 0 2024-04-25T16:23:08.817 INFO:tasks.workunit.client.0.smithi059.stdout:5/697: mknod d1/dcd/ce6 0 2024-04-25T16:23:08.871 INFO:tasks.workunit.client.0.smithi059.stdout:9/673: dread d6/d4e/d54/d5d/f75 [0,4194304] 0 2024-04-25T16:23:08.972 INFO:tasks.workunit.client.0.smithi059.stdout:7/634: read d0/f30 [205371,28008] 0 2024-04-25T16:23:09.020 INFO:tasks.workunit.client.0.smithi059.stdout:6/705: getdents d9/d16 0 2024-04-25T16:23:09.055 INFO:tasks.workunit.client.0.smithi059.stdout:5/698: symlink d1/d48/d85/le7 0 2024-04-25T16:23:09.168 INFO:tasks.workunit.client.0.smithi059.stdout:7/635: truncate d0/d3f/f50 5234804 0 2024-04-25T16:23:09.173 INFO:tasks.workunit.client.0.smithi059.stdout:6/706: fdatasync d9/d16/d24/f5e 0 2024-04-25T16:23:09.269 INFO:tasks.workunit.client.0.smithi059.stdout:6/707: fsync d9/d1b/f2c 0 2024-04-25T16:23:09.362 INFO:tasks.workunit.client.0.smithi059.stdout:5/699: fsync d1/d1e/d27/f30 0 2024-04-25T16:23:09.384 INFO:tasks.workunit.client.0.smithi059.stdout:7/636: dread d0/d7/d51/da9/db3/d33/d79/d5d/db7/fb0 [0,4194304] 0 2024-04-25T16:23:09.473 INFO:tasks.workunit.client.0.smithi059.stdout:6/708: rename d9/d16/d54/lc7 to d9/d16/d53/d55/d71/d7e/d9e/dd8/ldf 0 2024-04-25T16:23:09.700 INFO:tasks.workunit.client.0.smithi059.stdout:6/709: unlink d9/d16/d24/f5e 0 2024-04-25T16:23:09.707 INFO:tasks.workunit.client.0.smithi059.stdout:4/633: write d0/d4/df/d1c/d45/f2d [3887510,92652] 0 2024-04-25T16:23:09.753 INFO:tasks.workunit.client.0.smithi059.stdout:3/700: dwrite d0/d1e/d31/dc7/fe5 [0,4194304] 0 2024-04-25T16:23:10.013 INFO:tasks.workunit.client.0.smithi059.stdout:6/710: chown d9/f21 1 1 2024-04-25T16:23:10.054 INFO:tasks.workunit.client.0.smithi059.stdout:5/700: rmdir d1/d1e/d27/d66/d70/d75/dc3 0 2024-04-25T16:23:10.339 INFO:tasks.workunit.client.0.smithi059.stdout:0/630: rmdir dc/d37 39 2024-04-25T16:23:10.398 INFO:tasks.workunit.client.0.smithi059.stdout:5/701: truncate d1/d1e/d27/d66/d70/d75/fdd 778452 0 2024-04-25T16:23:10.407 INFO:tasks.workunit.client.0.smithi059.stdout:8/618: write d7/dd/faf [705797,78035] 0 2024-04-25T16:23:10.414 INFO:tasks.workunit.client.0.smithi059.stdout:0/631: dread fa [0,4194304] 0 2024-04-25T16:23:10.557 INFO:tasks.workunit.client.0.smithi059.stdout:6/711: dread d9/f59 [0,4194304] 0 2024-04-25T16:23:10.822 INFO:tasks.workunit.client.0.smithi059.stdout:1/697: mkdir d7/d2a/d85/db7/dbb/de6 0 2024-04-25T16:23:11.008 INFO:tasks.workunit.client.0.smithi059.stdout:2/656: write de/d2a/d2e/d36/d2c/d40/f75 [47695,107727] 0 2024-04-25T16:23:11.014 INFO:tasks.workunit.client.0.smithi059.stdout:8/619: readlink d7/l1d 0 2024-04-25T16:23:11.154 INFO:tasks.workunit.client.0.smithi059.stdout:9/674: dwrite d6/d4e/d54/fa9 [0,4194304] 0 2024-04-25T16:23:11.312 INFO:tasks.workunit.client.0.smithi059.stdout:7/637: dwrite d0/d7/d51/da9/db3/d33/d79/fc4 [0,4194304] 0 2024-04-25T16:23:11.407 INFO:tasks.workunit.client.0.smithi059.stdout:3/701: write d0/db/d2d/f9a [3085880,27868] 0 2024-04-25T16:23:11.409 INFO:tasks.workunit.client.0.smithi059.stdout:4/634: write d0/d4/df/d1c/d45/d54/d75/f90 [171701,85626] 0 2024-04-25T16:23:11.448 INFO:tasks.workunit.client.0.smithi059.stdout:6/712: rmdir d9/d16/d24/d5d/d77 39 2024-04-25T16:23:11.492 INFO:tasks.workunit.client.0.smithi059.stdout:1/698: readlink d7/d21/l5b 0 2024-04-25T16:23:11.618 INFO:tasks.workunit.client.0.smithi059.stdout:2/657: unlink de/d67/ld4 0 2024-04-25T16:23:12.263 INFO:tasks.workunit.client.0.smithi059.stdout:7/638: fsync d0/d7/d51/da9/db3/d33/d79/d5d/fa6 0 2024-04-25T16:23:12.271 INFO:tasks.workunit.client.0.smithi059.stdout:5/702: creat d1/d1e/d27/d66/d70/db9/dcc/fe8 x:0 0 0 2024-04-25T16:23:12.283 INFO:tasks.workunit.client.0.smithi059.stdout:3/702: truncate d0/ff 1101506 0 2024-04-25T16:23:12.292 INFO:tasks.workunit.client.0.smithi059.stdout:6/713: rename d9/d16/d24/cb8 to d9/d16/d53/d6c/da6/dc6/ce0 0 2024-04-25T16:23:12.329 INFO:tasks.workunit.client.0.smithi059.stdout:6/714: chown d9/d27/c47 464 1 2024-04-25T16:23:12.346 INFO:tasks.workunit.client.0.smithi059.stdout:3/703: write d0/db/d47/d98/fb9 [3643591,113012] 0 2024-04-25T16:23:12.369 INFO:tasks.workunit.client.0.smithi059.stdout:1/699: symlink d7/d2a/d85/db7/d16/d5c/le7 0 2024-04-25T16:23:12.620 INFO:tasks.workunit.client.0.smithi059.stdout:8/620: symlink d7/dd/d17/d23/d37/d5c/d87/d94/d66/daa/dbd/lc2 0 2024-04-25T16:23:12.815 INFO:tasks.workunit.client.0.smithi059.stdout:5/703: fdatasync d1/d1e/f2d 0 2024-04-25T16:23:12.917 INFO:tasks.workunit.client.0.smithi059.stdout:5/704: sync 2024-04-25T16:23:12.934 INFO:tasks.workunit.client.0.smithi059.stdout:6/715: stat d9/d1b/d58/lde 0 2024-04-25T16:23:13.003 INFO:tasks.workunit.client.0.smithi059.stdout:3/704: rename d0/db/d7f to d0/db/d2d/de1/df2 0 2024-04-25T16:23:13.014 INFO:tasks.workunit.client.0.smithi059.stdout:3/705: chown d0/db/d47/d98 697 1 2024-04-25T16:23:13.096 INFO:tasks.workunit.client.0.smithi059.stdout:7/639: truncate d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/f52 612018 0 2024-04-25T16:23:13.362 INFO:tasks.workunit.client.0.smithi059.stdout:8/621: read - d7/dd/d17/db4/fb8 zero size 2024-04-25T16:23:13.409 INFO:tasks.workunit.client.0.smithi059.stdout:0/632: dwrite dc/df/d24/f6d [0,4194304] 0 2024-04-25T16:23:13.478 INFO:tasks.workunit.client.0.smithi059.stdout:9/675: dwrite d6/d35/d28/f5b [4194304,4194304] 0 2024-04-25T16:23:13.547 INFO:tasks.workunit.client.0.smithi059.stdout:6/716: rmdir d9/d16/d53/d55 39 2024-04-25T16:23:13.607 INFO:tasks.workunit.client.0.smithi059.stdout:3/706: fdatasync d0/db/d2d/d7a/d86/fd1 0 2024-04-25T16:23:13.645 INFO:tasks.workunit.client.0.smithi059.stdout:4/635: write d0/d4/df/faa [291307,896] 0 2024-04-25T16:23:13.815 INFO:tasks.workunit.client.0.smithi059.stdout:5/705: creat d1/dcd/d50/d8a/dd8/fe9 x:0 0 0 2024-04-25T16:23:13.849 INFO:tasks.workunit.client.0.smithi059.stdout:0/633: chown dc/c33 857 1 2024-04-25T16:23:14.023 INFO:tasks.workunit.client.0.smithi059.stdout:5/706: dread d1/d1e/d27/f30 [0,4194304] 0 2024-04-25T16:23:14.033 INFO:tasks.workunit.client.0.smithi059.stdout:9/676: mknod d6/d4e/d54/d5d/d48/d49/cbf 0 2024-04-25T16:23:14.057 INFO:tasks.workunit.client.0.smithi059.stdout:5/707: chown d1/d1e/f2d 39 1 2024-04-25T16:23:14.225 INFO:tasks.workunit.client.0.smithi059.stdout:3/707: creat d0/db/d2d/d7a/d86/ff3 x:0 0 0 2024-04-25T16:23:14.236 INFO:tasks.workunit.client.0.smithi059.stdout:7/640: fsync d0/d7/f28 0 2024-04-25T16:23:14.379 INFO:tasks.workunit.client.0.smithi059.stdout:2/658: dwrite de/d5a/d7d/d80/fe6 [0,4194304] 0 2024-04-25T16:23:14.448 INFO:tasks.workunit.client.0.smithi059.stdout:1/700: rename d7/cbd to d7/d2a/d85/db7/d16/d72/ce8 0 2024-04-25T16:23:14.499 INFO:tasks.workunit.client.0.smithi059.stdout:5/708: mkdir d1/d1e/d8f/dea 0 2024-04-25T16:23:14.519 INFO:tasks.workunit.client.0.smithi059.stdout:9/677: dread d6/d4e/d54/f84 [0,4194304] 0 2024-04-25T16:23:14.794 INFO:tasks.workunit.client.0.smithi059.stdout:3/708: truncate d0/db/d2d/f3c 1003144 0 2024-04-25T16:23:14.794 INFO:tasks.workunit.client.0.smithi059.stdout:8/622: creat d7/dd/d17/d23/d37/d5c/fc3 x:0 0 0 2024-04-25T16:23:14.926 INFO:tasks.workunit.client.0.smithi059.stdout:4/636: rename d0/d79/f9d to d0/d4/fca 0 2024-04-25T16:23:14.968 INFO:tasks.workunit.client.0.smithi059.stdout:7/641: dread d0/d7/d16/f2a [0,4194304] 0 2024-04-25T16:23:15.120 INFO:tasks.workunit.client.0.smithi059.stdout:0/634: truncate dc/d37/d47/d71/d9c/fc8 831965 0 2024-04-25T16:23:15.132 INFO:tasks.workunit.client.0.smithi059.stdout:5/709: mkdir d1/d1e/d27/d66/d70/d75/deb 0 2024-04-25T16:23:15.155 INFO:tasks.workunit.client.0.smithi059.stdout:5/710: chown d1/d1e/d27/fb3 10854942 1 2024-04-25T16:23:15.345 INFO:tasks.workunit.client.0.smithi059.stdout:2/659: dread - de/da1/fb0 zero size 2024-04-25T16:23:15.418 INFO:tasks.workunit.client.0.smithi059.stdout:3/709: mknod d0/db/d3f/dce/cf4 0 2024-04-25T16:23:15.442 INFO:tasks.workunit.client.0.smithi059.stdout:3/710: stat d0/db/d3f/d6c/dea 0 2024-04-25T16:23:15.482 INFO:tasks.workunit.client.0.smithi059.stdout:7/642: read d0/d7/d51/da9/fbb [4806670,15653] 0 2024-04-25T16:23:15.570 INFO:tasks.workunit.client.0.smithi059.stdout:5/711: read d1/d1e/d27/d66/d70/f39 [7459726,100750] 0 2024-04-25T16:23:15.680 INFO:tasks.workunit.client.0.smithi059.stdout:2/660: mkdir de/d5a/d9a/de9/dea 0 2024-04-25T16:23:15.685 INFO:tasks.workunit.client.0.smithi059.stdout:4/637: truncate d0/d4/df/d1c/d45/d54/d75/d82/d8f/fc1 335292 0 2024-04-25T16:23:15.816 INFO:tasks.workunit.client.0.smithi059.stdout:3/711: creat d0/db/d2d/d7a/d86/ff5 x:0 0 0 2024-04-25T16:23:15.823 INFO:tasks.workunit.client.0.smithi059.stdout:6/717: write d9/d1b/d58/d49/fd4 [939654,97848] 0 2024-04-25T16:23:15.849 INFO:tasks.workunit.client.0.smithi059.stdout:3/712: stat d0/db/d2d/f87 0 2024-04-25T16:23:15.961 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:23:15.963 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:23:16.277 INFO:tasks.workunit.client.0.smithi059.stdout:4/638: readlink d0/d4/df/d1c/d45/d6f/lc8 0 2024-04-25T16:23:16.287 INFO:tasks.workunit.client.0.smithi059.stdout:4/639: stat d0/d4/df/d48/da3 0 2024-04-25T16:23:16.385 INFO:tasks.workunit.client.0.smithi059.stdout:6/718: rmdir d9/d27/d39 39 2024-04-25T16:23:16.955 INFO:tasks.workunit.client.0.smithi059.stdout:6/719: fsync d9/d1b/f2c 0 2024-04-25T16:23:16.970 INFO:tasks.workunit.client.0.smithi059.stdout:7/643: getdents d0 0 2024-04-25T16:23:17.078 INFO:tasks.workunit.client.0.smithi059.stdout:9/678: dwrite d6/d4e/d54/d5d/d48/d49/f7c [0,4194304] 0 2024-04-25T16:23:17.225 INFO:tasks.workunit.client.0.smithi059.stdout:8/623: write d7/d2f/d76/f9d [1267128,47400] 0 2024-04-25T16:23:17.227 INFO:tasks.workunit.client.0.smithi059.stdout:0/635: write dc/d37/d47/f7c [438082,120575] 0 2024-04-25T16:23:17.476 INFO:tasks.workunit.client.0.smithi059.stdout:2/661: getdents de/d16/d3e 0 2024-04-25T16:23:17.576 INFO:tasks.workunit.client.0.smithi059.stdout:1/701: mkdir d7/d2a/d85/db7/dbb/de9 0 2024-04-25T16:23:17.595 INFO:tasks.workunit.client.0.smithi059.stdout:5/712: dwrite d1/f5b [0,4194304] 0 2024-04-25T16:23:17.694 INFO:tasks.workunit.client.0.smithi059.stdout:3/713: write d0/db/f5a [855425,96179] 0 2024-04-25T16:23:17.745 INFO:tasks.workunit.client.0.smithi059.stdout:9/679: mkdir d6/d35/d28/dc0 0 2024-04-25T16:23:17.765 INFO:tasks.workunit.client.0.smithi059.stdout:9/680: readlink d6/d4e/lb7 0 2024-04-25T16:23:17.773 INFO:tasks.workunit.client.0.smithi059.stdout:9/681: chown d6/d4e/fb4 1208 1 2024-04-25T16:23:18.066 INFO:tasks.workunit.client.0.smithi059.stdout:2/662: fdatasync de/d2a/d2e/d6a/fd8 0 2024-04-25T16:23:18.125 INFO:tasks.workunit.client.0.smithi059.stdout:6/720: truncate d9/d27/d39/f88 56041 0 2024-04-25T16:23:18.293 INFO:tasks.workunit.client.0.smithi059.stdout:9/682: read d6/d35/d28/f76 [495992,94351] 0 2024-04-25T16:23:18.375 INFO:tasks.workunit.client.0.smithi059.stdout:4/640: dwrite d0/d4/df/d1c/d45/d54/d75/d82/fc7 [0,4194304] 0 2024-04-25T16:23:18.706 INFO:tasks.workunit.client.0.smithi059.stdout:0/636: write dc/dd/d3b/d66/d9b/fb3 [578333,111723] 0 2024-04-25T16:23:18.708 INFO:tasks.workunit.client.0.smithi059.stdout:7/644: write d0/d3f/fa3 [42798,113387] 0 2024-04-25T16:23:18.930 INFO:tasks.workunit.client.0.smithi059.stdout:6/721: creat d9/d1b/d58/d49/db0/fe1 x:0 0 0 2024-04-25T16:23:19.391 INFO:tasks.workunit.client.0.smithi059.stdout:0/637: truncate dc/d44/f50 1739263 0 2024-04-25T16:23:19.599 INFO:tasks.workunit.client.0.smithi059.stdout:3/714: rename d0/d1e/d31/l76 to d0/db/lf6 0 2024-04-25T16:23:19.610 INFO:tasks.workunit.client.0.smithi059.stdout:3/715: chown d0/db/l29 226 1 2024-04-25T16:23:19.632 INFO:tasks.workunit.client.0.smithi059.stdout:6/722: truncate d9/d16/d53/fb9 821882 0 2024-04-25T16:23:19.672 INFO:tasks.workunit.client.0.smithi059.stdout:2/663: write de/d16/d3e/f4f [865904,16171] 0 2024-04-25T16:23:19.709 INFO:tasks.workunit.client.0.smithi059.stdout:5/713: write d1/f11 [106109,39239] 0 2024-04-25T16:23:19.724 INFO:tasks.workunit.client.0.smithi059.stdout:5/714: chown d1/d1e/f20 12 1 2024-04-25T16:23:19.846 INFO:tasks.workunit.client.0.smithi059.stdout:1/702: link d7/d2a/d85/db7/d16/d5c/d74/fb4 d7/d2a/d62/fea 0 2024-04-25T16:23:19.869 INFO:tasks.workunit.client.0.smithi059.stdout:4/641: creat d0/d4/df/d1c/d45/d6f/dc4/fcb x:0 0 0 2024-04-25T16:23:20.045 INFO:tasks.workunit.client.0.smithi059.stdout:8/624: link d7/dd/d17/d23/d37/d5c/d87/d94/d7f/cae d7/dd/d17/d23/d37/d5c/d87/d94/d66/daa/cc4 0 2024-04-25T16:23:20.082 INFO:tasks.workunit.client.0.smithi059.stdout:6/723: mknod d9/d16/d54/ce2 0 2024-04-25T16:23:20.088 INFO:tasks.workunit.client.0.smithi059.stdout:2/664: dread - de/d5a/d7d/d80/fad zero size 2024-04-25T16:23:20.361 INFO:tasks.workunit.client.0.smithi059.stdout:0/638: rename dc/d37/fab to dc/d84/fcd 0 2024-04-25T16:23:20.367 INFO:tasks.workunit.client.0.smithi059.stdout:5/715: symlink d1/d1e/d27/d66/d70/d75/deb/lec 0 2024-04-25T16:23:20.377 INFO:tasks.workunit.client.0.smithi059.stdout:6/724: fsync d9/f79 0 2024-04-25T16:23:20.425 INFO:tasks.workunit.client.0.smithi059.stdout:0/639: chown dc/dd/d3b/d66/fa2 12763 1 2024-04-25T16:23:20.883 INFO:tasks.workunit.client.0.smithi059.stdout:7/645: getdents d0/d7/d16 0 2024-04-25T16:23:20.998 INFO:tasks.workunit.client.0.smithi059.stdout:3/716: rename d0/db/d2d/c3d to d0/db/d3f/d49/d65/cf7 0 2024-04-25T16:23:21.016 INFO:tasks.workunit.client.0.smithi059.stdout:5/716: creat d1/d48/d85/dbe/dde/fed x:0 0 0 2024-04-25T16:23:21.024 INFO:tasks.workunit.client.0.smithi059.stdout:0/640: fsync dc/dd/d5c/fac 0 2024-04-25T16:23:21.470 INFO:tasks.workunit.client.0.smithi059.stdout:9/683: link d6/fb d6/d35/d2f/fc1 0 2024-04-25T16:23:21.477 INFO:tasks.workunit.client.0.smithi059.stdout:7/646: fdatasync d0/d7/d16/f42 0 2024-04-25T16:23:21.482 INFO:tasks.workunit.client.0.smithi059.stdout:1/703: write d7/d2a/d85/db7/d16/d5c/f70 [1730155,16293] 0 2024-04-25T16:23:21.508 INFO:tasks.workunit.client.0.smithi059.stdout:4/642: link d0/l1a d0/d4/df/d48/da3/lcc 0 2024-04-25T16:23:21.544 INFO:tasks.workunit.client.0.smithi059.stdout:8/625: link d7/f91 d7/d16/d3a/fc5 0 2024-04-25T16:23:21.681 INFO:tasks.workunit.client.0.smithi059.stdout:6/725: dread d9/d27/d68/fa0 [0,4194304] 0 2024-04-25T16:23:21.755 INFO:tasks.workunit.client.0.smithi059.stdout:3/717: creat d0/d1e/d57/da8/ff8 x:0 0 0 2024-04-25T16:23:22.037 INFO:tasks.workunit.client.0.smithi059.stdout:5/717: rename d1/d48/d85/dbe/dde/cc0 to d1/d48/d85/dbe/cee 0 2024-04-25T16:23:22.093 INFO:tasks.workunit.client.0.smithi059.stdout:0/641: dread dc/df/d24/f39 [8388608,4194304] 0 2024-04-25T16:23:22.128 INFO:tasks.workunit.client.0.smithi059.stdout:5/718: rename d1/d1e to d1/d1e/d27/d66/d70/db9/def 22 2024-04-25T16:23:22.213 INFO:tasks.workunit.client.0.smithi059.stdout:2/665: dwrite de/d5a/d7d/fbb [0,4194304] 0 2024-04-25T16:23:22.452 INFO:tasks.workunit.client.0.smithi059.stdout:9/684: creat d6/d4e/d7a/fc2 x:0 0 0 2024-04-25T16:23:22.454 INFO:tasks.workunit.client.0.smithi059.stdout:4/643: creat d0/d79/fcd x:0 0 0 2024-04-25T16:23:22.471 INFO:tasks.workunit.client.0.smithi059.stdout:1/704: rmdir d7/d2a/d85/db7/d2d/d4a 39 2024-04-25T16:23:22.527 INFO:tasks.workunit.client.0.smithi059.stdout:7/647: creat d0/d7/d16/d20/d71/fcf x:0 0 0 2024-04-25T16:23:22.546 INFO:tasks.workunit.client.0.smithi059.stdout:7/648: chown d0/d7/d51/da9/db3/d33/d79/cc9 53 1 2024-04-25T16:23:22.579 INFO:tasks.workunit.client.0.smithi059.stdout:8/626: mknod d7/d2f/d43/cc6 0 2024-04-25T16:23:22.795 INFO:tasks.workunit.client.0.smithi059.stdout:3/718: unlink d0/l6a 0 2024-04-25T16:23:22.813 INFO:tasks.workunit.client.0.smithi059.stdout:3/719: dread - d0/d1e/f56 zero size 2024-04-25T16:23:22.961 INFO:tasks.workunit.client.0.smithi059.stdout:4/644: dread - d0/d4/f9f zero size 2024-04-25T16:23:22.990 INFO:tasks.workunit.client.0.smithi059.stdout:2/666: dread de/fc9 [0,4194304] 0 2024-04-25T16:23:22.999 INFO:tasks.workunit.client.0.smithi059.stdout:4/645: stat d0/d4/df/d44/l53 0 2024-04-25T16:23:23.004 INFO:tasks.workunit.client.0.smithi059.stdout:2/667: readlink de/d16/l93 0 2024-04-25T16:23:23.038 INFO:tasks.workunit.client.0.smithi059.stdout:7/649: fdatasync d0/d7/d51/da9/db3/d33/f8c 0 2024-04-25T16:23:23.051 INFO:tasks.workunit.client.0.smithi059.stdout:8/627: mknod d7/d2f/d76/cc7 0 2024-04-25T16:23:23.674 INFO:tasks.workunit.client.0.smithi059.stdout:1/705: symlink d7/d2a/d85/db7/d6a/leb 0 2024-04-25T16:23:23.686 INFO:tasks.workunit.client.0.smithi059.stdout:3/720: write d0/db/f5a [2373081,93671] 0 2024-04-25T16:23:23.838 INFO:tasks.workunit.client.0.smithi059.stdout:8/628: chown d7/d2f/l30 47 1 2024-04-25T16:23:23.970 INFO:tasks.workunit.client.0.smithi059.stdout:2/668: symlink de/d2a/d2e/d36/d2c/d40/leb 0 2024-04-25T16:23:24.115 INFO:tasks.workunit.client.0.smithi059.stdout:3/721: dread - d0/fcd zero size 2024-04-25T16:23:24.130 INFO:tasks.workunit.client.0.smithi059.stdout:6/726: write d9/d1b/f6b [4597045,107625] 0 2024-04-25T16:23:24.300 INFO:tasks.workunit.client.0.smithi059.stdout:1/706: dread d7/f30 [0,4194304] 0 2024-04-25T16:23:24.367 INFO:tasks.workunit.client.0.smithi059.stdout:5/719: getdents d1/dcd 0 2024-04-25T16:23:24.379 INFO:tasks.workunit.client.0.smithi059.stdout:5/720: chown d1/d1e/d27/d66/f8b 6054 1 2024-04-25T16:23:24.531 INFO:tasks.workunit.client.0.smithi059.stdout:6/727: mkdir d9/d16/d53/d6c/da6/dc6/de3 0 2024-04-25T16:23:24.582 INFO:tasks.workunit.client.0.smithi059.stdout:1/707: creat d7/d2a/fec x:0 0 0 2024-04-25T16:23:24.675 INFO:tasks.workunit.client.0.smithi059.stdout:4/646: getdents d0/d4/df/d1c/d45/d54/d75/d7e/d9e 0 2024-04-25T16:23:25.042 INFO:tasks.workunit.client.0.smithi059.stdout:9/685: write d6/f7e [1640273,124155] 0 2024-04-25T16:23:25.045 INFO:tasks.workunit.client.0.smithi059.stdout:0/642: write dc/d37/d47/d71/d9c/fc8 [732411,78360] 0 2024-04-25T16:23:25.050 INFO:tasks.workunit.client.0.smithi059.stdout:7/650: creat d0/d7/fd0 x:0 0 0 2024-04-25T16:23:25.081 INFO:tasks.workunit.client.0.smithi059.stdout:6/728: read d9/d16/d53/d55/fca [542128,124915] 0 2024-04-25T16:23:25.267 INFO:tasks.workunit.client.0.smithi059.stdout:1/708: mknod d7/d2a/d85/db7/d2d/ced 0 2024-04-25T16:23:25.307 INFO:tasks.workunit.client.0.smithi059.stdout:5/721: link d1/d1e/d8f/fa8 d1/d1e/d8f/dea/ff0 0 2024-04-25T16:23:25.324 INFO:tasks.workunit.client.0.smithi059.stdout:8/629: write d7/d16/f52 [1867388,5619] 0 2024-04-25T16:23:25.593 INFO:tasks.workunit.client.0.smithi059.stdout:0/643: mkdir dc/d37/d47/d71/d77/dce 0 2024-04-25T16:23:25.594 INFO:tasks.workunit.client.0.smithi059.stdout:3/722: getdents d0/db/d47/d98 0 2024-04-25T16:23:25.601 INFO:tasks.workunit.client.0.smithi059.stdout:2/669: write de/d5a/d9a/de9/fb9 [312566,93644] 0 2024-04-25T16:23:25.629 INFO:tasks.workunit.client.0.smithi059.stdout:8/630: mkdir d7/d16/d8f/dc8 0 2024-04-25T16:23:25.726 INFO:tasks.workunit.client.0.smithi059.stdout:2/670: chown de/d16/l93 1070074300 1 2024-04-25T16:23:25.737 INFO:tasks.workunit.client.0.smithi059.stdout:9/686: dread d6/d4e/d54/d5d/d48/d49/f7c [0,4194304] 0 2024-04-25T16:23:25.838 INFO:tasks.workunit.client.0.smithi059.stdout:6/729: write d9/d16/d53/d55/fca [514458,119424] 0 2024-04-25T16:23:25.841 INFO:tasks.workunit.client.0.smithi059.stdout:5/722: write d1/d1e/d27/f4e [1724291,77961] 0 2024-04-25T16:23:26.170 INFO:tasks.workunit.client.0.smithi059.stdout:4/647: getdents d0/d4/df/d1c/d45/d54/d75 0 2024-04-25T16:23:26.210 INFO:tasks.workunit.client.0.smithi059.stdout:0/644: dread dc/dd/d3b/fb1 [0,4194304] 0 2024-04-25T16:23:26.334 INFO:tasks.workunit.client.0.smithi059.stdout:3/723: symlink d0/d1e/d57/lf9 0 2024-04-25T16:23:26.362 INFO:tasks.workunit.client.0.smithi059.stdout:5/723: truncate d1/d1e/f41 1398163 0 2024-04-25T16:23:26.440 INFO:tasks.workunit.client.0.smithi059.stdout:5/724: readlink d1/d1e/d27/d66/d70/l9b 0 2024-04-25T16:23:26.502 INFO:tasks.workunit.client.0.smithi059.stdout:5/725: chown d1/d1e/l28 1895992280 1 2024-04-25T16:23:26.507 INFO:tasks.workunit.client.0.smithi059.stdout:4/648: unlink d0/d4/fab 0 2024-04-25T16:23:26.513 INFO:tasks.workunit.client.0.smithi059.stdout:8/631: dread d7/d16/d36/fa6 [0,4194304] 0 2024-04-25T16:23:26.538 INFO:tasks.workunit.client.0.smithi059.stdout:4/649: stat d0/d4/df/d1c/d45/d6f/lc8 0 2024-04-25T16:23:26.660 INFO:tasks.workunit.client.0.smithi059.stdout:1/709: getdents d7/d2a/d85/db7/dbb/db6 0 2024-04-25T16:23:26.682 INFO:tasks.workunit.client.0.smithi059.stdout:0/645: dread dc/dd/d3b/d66/d9b/fc1 [0,4194304] 0 2024-04-25T16:23:26.747 INFO:tasks.workunit.client.0.smithi059.stdout:7/651: getdents d0/d7/d51/da9/db3/d33/d87 0 2024-04-25T16:23:26.762 INFO:tasks.workunit.client.0.smithi059.stdout:3/724: stat d0/l10 0 2024-04-25T16:23:26.898 INFO:tasks.workunit.client.0.smithi059.stdout:5/726: mknod d1/dcd/d50/cf1 0 2024-04-25T16:23:26.902 INFO:tasks.workunit.client.0.smithi059.stdout:8/632: readlink d7/l25 0 2024-04-25T16:23:26.932 INFO:tasks.workunit.client.0.smithi059.stdout:5/727: chown d1/d1e/d27/d66/d70/d24/fc6 60897584 1 2024-04-25T16:23:26.946 INFO:tasks.workunit.client.0.smithi059.stdout:4/650: chown d0/d4/df/d1c/d45/d54/d75/d82/d8f/fc1 1777 1 2024-04-25T16:23:27.071 INFO:tasks.workunit.client.0.smithi059.stdout:6/730: creat d9/d1b/d58/fe4 x:0 0 0 2024-04-25T16:23:27.134 INFO:tasks.workunit.client.0.smithi059.stdout:9/687: dwrite d6/d4e/f9f [0,4194304] 0 2024-04-25T16:23:27.200 INFO:tasks.workunit.client.0.smithi059.stdout:7/652: creat d0/d7/d16/d5a/fd1 x:0 0 0 2024-04-25T16:23:27.677 INFO:tasks.workunit.client.0.smithi059.stdout:9/688: truncate d6/d4e/d54/d5d/fbb 52650 0 2024-04-25T16:23:27.694 INFO:tasks.workunit.client.0.smithi059.stdout:9/689: dread - d6/d4e/d54/d5d/d48/d49/f72 zero size 2024-04-25T16:23:27.823 INFO:tasks.workunit.client.0.smithi059.stdout:7/653: truncate d0/d7/d16/d20/d71/f84 1515546 0 2024-04-25T16:23:27.843 INFO:tasks.workunit.client.0.smithi059.stdout:7/654: chown d0/d7/d51/da9/db3/d33/d79/d5d/f74 787782116 1 2024-04-25T16:23:27.877 INFO:tasks.workunit.client.0.smithi059.stdout:7/655: dread d0/d7/d51/da9/db3/d33/f8c [0,4194304] 0 2024-04-25T16:23:27.964 INFO:tasks.workunit.client.0.smithi059.stdout:8/633: creat d7/dd/d17/db4/d7e/da5/fc9 x:0 0 0 2024-04-25T16:23:28.282 INFO:tasks.workunit.client.0.smithi059.stdout:1/710: write d7/d21/f7c [1542613,56668] 0 2024-04-25T16:23:28.448 INFO:tasks.workunit.client.0.smithi059.stdout:3/725: mkdir d0/db/d2d/d7a/dfa 0 2024-04-25T16:23:28.471 INFO:tasks.workunit.client.0.smithi059.stdout:2/671: link de/d16/l4a de/d2a/d2e/lec 0 2024-04-25T16:23:28.483 INFO:tasks.workunit.client.0.smithi059.stdout:7/656: rename d0/d7/d16/d20/f59 to d0/d7/d16/d20/d71/fd2 0 2024-04-25T16:23:28.494 INFO:tasks.workunit.client.0.smithi059.stdout:8/634: mkdir d7/d16/d36/dca 0 2024-04-25T16:23:28.592 INFO:tasks.workunit.client.0.smithi059.stdout:5/728: dwrite d1/d1e/d27/d66/d70/fdf [0,4194304] 0 2024-04-25T16:23:28.672 INFO:tasks.workunit.client.0.smithi059.stdout:6/731: write d9/d16/f42 [5951629,109570] 0 2024-04-25T16:23:28.751 INFO:tasks.workunit.client.0.smithi059.stdout:9/690: mkdir d6/dae/dc3 0 2024-04-25T16:23:28.871 INFO:tasks.workunit.client.0.smithi059.stdout:3/726: fdatasync d0/db/d47/d98/fca 0 2024-04-25T16:23:28.881 INFO:tasks.workunit.client.0.smithi059.stdout:8/635: truncate d7/d2f/f4a 3964878 0 2024-04-25T16:23:28.887 INFO:tasks.workunit.client.0.smithi059.stdout:7/657: dread - d0/d7/dae/fb5 zero size 2024-04-25T16:23:28.889 INFO:tasks.workunit.client.0.smithi059.stdout:4/651: link d0/d4/df/d48/da3/ca8 d0/d4/df/d1c/d45/d54/cce 0 2024-04-25T16:23:28.939 INFO:tasks.workunit.client.0.smithi059.stdout:7/658: stat d0/d7/d16/f42 0 2024-04-25T16:23:29.049 INFO:tasks.workunit.client.0.smithi059.stdout:1/711: dread d7/d93/d8e/fa2 [0,4194304] 0 2024-04-25T16:23:29.063 INFO:tasks.workunit.client.0.smithi059.stdout:0/646: link dc/c2c dc/ccf 0 2024-04-25T16:23:29.102 INFO:tasks.workunit.client.0.smithi059.stdout:1/712: chown d7/d2a/d85/db7/d16/d7f 488614 1 2024-04-25T16:23:29.237 INFO:tasks.workunit.client.0.smithi059.stdout:2/672: creat de/d16/d9d/fed x:0 0 0 2024-04-25T16:23:29.246 INFO:tasks.workunit.client.0.smithi059.stdout:4/652: mkdir d0/d4/df/d44/dcf 0 2024-04-25T16:23:29.255 INFO:tasks.workunit.client.0.smithi059.stdout:7/659: creat d0/d7/dae/fd3 x:0 0 0 2024-04-25T16:23:29.287 INFO:tasks.workunit.client.0.smithi059.stdout:0/647: mkdir dc/d37/d47/d71/dd0 0 2024-04-25T16:23:29.407 INFO:tasks.workunit.client.0.smithi059.stdout:1/713: read d7/f26 [2921566,115584] 0 2024-04-25T16:23:29.413 INFO:tasks.workunit.client.0.smithi059.stdout:2/673: chown de/d5a/d9a/de9/cb6 134310 1 2024-04-25T16:23:29.442 INFO:tasks.workunit.client.0.smithi059.stdout:3/727: dread d0/db/d3f/d49/fc5 [0,4194304] 0 2024-04-25T16:23:29.496 INFO:tasks.workunit.client.0.smithi059.stdout:8/636: dread d7/dd/f83 [0,4194304] 0 2024-04-25T16:23:29.945 INFO:tasks.workunit.client.0.smithi059.stdout:6/732: dwrite d9/d16/f17 [4194304,4194304] 0 2024-04-25T16:23:29.963 INFO:tasks.workunit.client.0.smithi059.stdout:5/729: dwrite d1/d1e/d27/d66/d70/d75/f95 [0,4194304] 0 2024-04-25T16:23:29.966 INFO:tasks.workunit.client.0.smithi059.stdout:7/660: rename d0/d7/d51/da9/db3/d33/d87 to d0/d7/d51/da9/db3/d33/d79/d5d/dcb/dd4 0 2024-04-25T16:23:29.968 INFO:tasks.workunit.client.0.smithi059.stdout:9/691: dwrite d6/d4e/d54/d5d/d48/d49/f72 [0,4194304] 0 2024-04-25T16:23:30.101 INFO:tasks.workunit.client.0.smithi059.stdout:3/728: dread - d0/db/d2d/d7a/d86/ff3 zero size 2024-04-25T16:23:30.102 INFO:tasks.workunit.client.0.smithi059.stdout:1/714: fdatasync d7/d2a/d85/db7/d16/d7f/f9e 0 2024-04-25T16:23:30.186 INFO:tasks.workunit.client.0.smithi059.stdout:6/733: read d9/d16/d54/f94 [968388,74445] 0 2024-04-25T16:23:30.206 INFO:tasks.workunit.client.0.smithi059.stdout:2/674: dread de/d5a/d7d/fc3 [0,4194304] 0 2024-04-25T16:23:30.213 INFO:tasks.workunit.client.0.smithi059.stdout:9/692: chown d6/d35/d28/c34 14883990 1 2024-04-25T16:23:30.450 INFO:tasks.workunit.client.0.smithi059.stdout:5/730: creat d1/dcd/d44/dd1/ff2 x:0 0 0 2024-04-25T16:23:30.523 INFO:tasks.workunit.client.0.smithi059.stdout:1/715: symlink d7/d2a/d85/db7/d16/d5c/lee 0 2024-04-25T16:23:30.528 INFO:tasks.workunit.client.0.smithi059.stdout:6/734: fsync d9/d27/d39/f86 0 2024-04-25T16:23:30.640 INFO:tasks.workunit.client.0.smithi059.stdout:7/661: mkdir d0/d7/d16/d20/dab/dd5 0 2024-04-25T16:23:30.705 INFO:tasks.workunit.client.0.smithi059.stdout:2/675: mknod de/d5a/cee 0 2024-04-25T16:23:30.783 INFO:tasks.workunit.client.0.smithi059.stdout:7/662: sync 2024-04-25T16:23:30.871 INFO:tasks.workunit.client.0.smithi059.stdout:0/648: dwrite dc/d37/d47/d71/f94 [0,4194304] 0 2024-04-25T16:23:30.907 INFO:tasks.workunit.client.0.smithi059.stdout:4/653: dwrite d0/f2a [0,4194304] 0 2024-04-25T16:23:31.010 INFO:tasks.workunit.client.0.smithi059.stdout:3/729: dread d0/d1e/f90 [0,4194304] 0 2024-04-25T16:23:31.015 INFO:tasks.workunit.client.0.smithi059.stdout:5/731: mknod d1/dcd/d44/d79/d92/cf3 0 2024-04-25T16:23:31.073 INFO:tasks.workunit.client.0.smithi059.stdout:8/637: dwrite d7/d2f/d76/f97 [0,4194304] 0 2024-04-25T16:23:31.167 INFO:tasks.workunit.client.0.smithi059.stdout:8/638: chown d7/d16/d8f 47177 1 2024-04-25T16:23:31.266 INFO:tasks.workunit.client.0.smithi059.stdout:1/716: truncate d7/f26 3885000 0 2024-04-25T16:23:31.266 INFO:tasks.workunit.client.0.smithi059.stdout:6/735: stat d9/d27/d39/d7b/l91 0 2024-04-25T16:23:31.287 INFO:tasks.workunit.client.0.smithi059.stdout:1/717: chown d7/d2a/d85/db7/d6a/f79 69945 1 2024-04-25T16:23:31.484 INFO:tasks.workunit.client.0.smithi059.stdout:9/693: creat d6/d35/fc4 x:0 0 0 2024-04-25T16:23:31.498 INFO:tasks.workunit.client.0.smithi059.stdout:3/730: creat d0/db/d3f/d89/db3/ffb x:0 0 0 2024-04-25T16:23:31.529 INFO:tasks.workunit.client.0.smithi059.stdout:5/732: creat d1/d48/d85/dbe/dde/ff4 x:0 0 0 2024-04-25T16:23:31.596 INFO:tasks.workunit.client.0.smithi059.stdout:4/654: read d0/d4/df/d1c/d45/d54/d75/d82/f8e [499136,70580] 0 2024-04-25T16:23:31.623 INFO:tasks.workunit.client.0.smithi059.stdout:2/676: truncate de/d2a/d2e/d36/d2c/d40/f75 140462 0 2024-04-25T16:23:31.748 INFO:tasks.workunit.client.0.smithi059.stdout:1/718: unlink d7/d2a/d85/db7/dbb/db6/ce1 0 2024-04-25T16:23:31.931 INFO:tasks.workunit.client.0.smithi059.stdout:3/731: truncate d0/d1e/d57/fde 51456 0 2024-04-25T16:23:31.941 INFO:tasks.workunit.client.0.smithi059.stdout:2/677: unlink de/d5a/d7d/fbb 0 2024-04-25T16:23:31.945 INFO:tasks.workunit.client.0.smithi059.stdout:5/733: fsync d1/d48/d85/dbe/dde/f73 0 2024-04-25T16:23:31.965 INFO:tasks.workunit.client.0.smithi059.stdout:1/719: mkdir d7/d2a/d85/db7/d16/d72/def 0 2024-04-25T16:23:32.529 INFO:tasks.workunit.client.0.smithi059.stdout:9/694: mkdir d6/dae/dc3/dc5 0 2024-04-25T16:23:32.634 INFO:tasks.workunit.client.0.smithi059.stdout:5/734: rmdir d1/d1e/d27/d66/d70 39 2024-04-25T16:23:32.726 INFO:tasks.workunit.client.0.smithi059.stdout:1/720: creat d7/d2a/d85/db7/d77/ff0 x:0 0 0 2024-04-25T16:23:32.965 INFO:tasks.workunit.client.0.smithi059.stdout:9/695: fsync d6/d4e/d54/f8b 0 2024-04-25T16:23:33.089 INFO:tasks.workunit.client.0.smithi059.stdout:1/721: dread d7/fce [0,4194304] 0 2024-04-25T16:23:33.335 INFO:tasks.workunit.client.0.smithi059.stdout:7/663: write d0/d7/d16/f53 [629887,5836] 0 2024-04-25T16:23:33.480 INFO:tasks.workunit.client.0.smithi059.stdout:8/639: dwrite d7/dd/d17/d23/f63 [0,4194304] 0 2024-04-25T16:23:33.592 INFO:tasks.workunit.client.0.smithi059.stdout:4/655: dwrite d0/d4/df/d1c/f85 [0,4194304] 0 2024-04-25T16:23:33.661 INFO:tasks.workunit.client.0.smithi059.stdout:4/656: chown d0/d4/df/d48/da3/fbb 2347 1 2024-04-25T16:23:33.834 INFO:tasks.workunit.client.0.smithi059.stdout:4/657: rmdir d0/d4/df/d1c/d45/d54/d75 39 2024-04-25T16:23:34.253 INFO:tasks.workunit.client.0.smithi059.stdout:3/732: dwrite d0/db/f14 [0,4194304] 0 2024-04-25T16:23:34.349 INFO:tasks.workunit.client.0.smithi059.stdout:3/733: sync 2024-04-25T16:23:34.457 INFO:tasks.workunit.client.0.smithi059.stdout:2/678: dwrite de/d2a/d2e/d36/d2c/d40/fe4 [0,4194304] 0 2024-04-25T16:23:34.541 INFO:tasks.workunit.client.0.smithi059.stdout:1/722: getdents d7/d2a/d85/db7/d77/da3 0 2024-04-25T16:23:34.587 INFO:tasks.workunit.client.0.smithi059.stdout:0/649: mknod dc/cd1 0 2024-04-25T16:23:34.600 INFO:tasks.workunit.client.0.smithi059.stdout:6/736: unlink d9/f29 0 2024-04-25T16:23:34.620 INFO:tasks.workunit.client.0.smithi059.stdout:5/735: dwrite d1/dcd/d44/d79/d92/fc1 [0,4194304] 0 2024-04-25T16:23:34.695 INFO:tasks.workunit.client.0.smithi059.stdout:1/723: dread - d7/d2a/d85/d8d/faf zero size 2024-04-25T16:23:34.747 INFO:tasks.workunit.client.0.smithi059.stdout:7/664: write d0/d7/d16/f2a [3931884,86151] 0 2024-04-25T16:23:34.748 INFO:tasks.workunit.client.0.smithi059.stdout:9/696: write d6/d35/d28/f3e [2118765,18050] 0 2024-04-25T16:23:34.816 INFO:tasks.workunit.client.0.smithi059.stdout:9/697: sync 2024-04-25T16:23:34.833 INFO:tasks.workunit.client.0.smithi059.stdout:3/734: fdatasync d0/db/d47/d98/fca 0 2024-04-25T16:23:34.850 INFO:tasks.workunit.client.0.smithi059.stdout:3/735: dread - d0/db/d47/d5b/f8c zero size 2024-04-25T16:23:34.892 INFO:tasks.workunit.client.0.smithi059.stdout:2/679: creat de/d2a/d33/d65/dcf/fef x:0 0 0 2024-04-25T16:23:34.973 INFO:tasks.workunit.client.0.smithi059.stdout:6/737: unlink d9/d1b/c75 0 2024-04-25T16:23:35.031 INFO:tasks.workunit.client.0.smithi059.stdout:8/640: dwrite d7/dd/d17/d23/d37/f44 [0,4194304] 0 2024-04-25T16:23:35.167 INFO:tasks.workunit.client.0.smithi059.stdout:7/665: creat d0/d7/d51/da9/db3/d33/d79/d5d/d94/fd6 x:0 0 0 2024-04-25T16:23:35.182 INFO:tasks.workunit.client.0.smithi059.stdout:7/666: chown d0/d7/d16/d20/c72 0 1 2024-04-25T16:23:35.292 INFO:tasks.workunit.client.0.smithi059.stdout:9/698: creat d6/d35/d26/d6b/fc6 x:0 0 0 2024-04-25T16:23:35.339 INFO:tasks.workunit.client.0.smithi059.stdout:9/699: chown d6/d4e/d54/d5d 0 1 2024-04-25T16:23:35.422 INFO:tasks.workunit.client.0.smithi059.stdout:4/658: dwrite d0/d4/df/d1c/d45/d54/d75/d82/f8e [0,4194304] 0 2024-04-25T16:23:35.524 INFO:tasks.workunit.client.0.smithi059.stdout:0/650: truncate dc/d84/fcd 167195 0 2024-04-25T16:23:35.697 INFO:tasks.workunit.client.0.smithi059.stdout:1/724: write d7/d2a/d85/db7/d16/f24 [1441066,86872] 0 2024-04-25T16:23:35.811 INFO:tasks.workunit.client.0.smithi059.stdout:6/738: dread d9/d1b/f80 [0,4194304] 0 2024-04-25T16:23:35.908 INFO:tasks.workunit.client.0.smithi059.stdout:1/725: dread d7/d2a/d85/db7/d6a/dbc/fc1 [0,4194304] 0 2024-04-25T16:23:36.146 INFO:tasks.workunit.client.0.smithi059.stdout:3/736: symlink d0/db/d2d/de4/de6/lfc 0 2024-04-25T16:23:36.149 INFO:tasks.workunit.client.0.smithi059.stdout:2/680: mkdir de/d5a/d7d/d80/ddb/de3/df0 0 2024-04-25T16:23:36.153 INFO:tasks.workunit.client.0.smithi059.stdout:4/659: mkdir d0/d4/df/d1c/d45/d6f/dc4/dd0 0 2024-04-25T16:23:36.176 INFO:tasks.workunit.client.0.smithi059.stdout:9/700: dread - d6/d35/d2f/fa5 zero size 2024-04-25T16:23:36.200 INFO:tasks.workunit.client.0.smithi059.stdout:7/667: dread d0/d7/d51/da9/db3/d33/f93 [0,4194304] 0 2024-04-25T16:23:36.203 INFO:tasks.workunit.client.0.smithi059.stdout:0/651: chown dc/df/d24/f2e 111304426 1 2024-04-25T16:23:36.249 INFO:tasks.workunit.client.0.smithi059.stdout:0/652: readlink dc/d37/d47/l55 0 2024-04-25T16:23:36.270 INFO:tasks.workunit.client.0.smithi059.stdout:3/737: dread d0/d1e/fa3 [0,4194304] 0 2024-04-25T16:23:36.427 INFO:tasks.workunit.client.0.smithi059.stdout:1/726: truncate d7/d93/f76 14923 0 2024-04-25T16:23:36.678 INFO:tasks.workunit.client.0.smithi059.stdout:8/641: write d7/d2f/d76/f9d [1026103,125552] 0 2024-04-25T16:23:36.681 INFO:tasks.workunit.client.0.smithi059.stdout:5/736: write d1/d1e/d27/d66/d70/db9/fcf [1583035,50001] 0 2024-04-25T16:23:36.714 INFO:tasks.workunit.client.0.smithi059.stdout:8/642: chown d7/d2f/ca2 237055 1 2024-04-25T16:23:36.730 INFO:tasks.workunit.client.0.smithi059.stdout:5/737: dread d1/dcd/f9e [0,4194304] 0 2024-04-25T16:23:36.742 INFO:tasks.workunit.client.0.smithi059.stdout:8/643: chown d7/d2f/d76/f9d 460594 1 2024-04-25T16:23:36.751 INFO:tasks.workunit.client.0.smithi059.stdout:5/738: stat d1/dcd/d50/d8a/dd8 0 2024-04-25T16:23:36.931 INFO:tasks.workunit.client.0.smithi059.stdout:9/701: mkdir d6/d35/d26/d6b/dc7 0 2024-04-25T16:23:36.998 INFO:tasks.workunit.client.0.smithi059.stdout:4/660: rename d0/d4/df/d48/l50 to d0/d79/ld1 0 2024-04-25T16:23:37.024 INFO:tasks.workunit.client.0.smithi059.stdout:0/653: mkdir dc/d37/d47/d81/dd2 0 2024-04-25T16:23:37.310 INFO:tasks.workunit.client.0.smithi059.stdout:1/727: dread d7/d93/f4f [0,4194304] 0 2024-04-25T16:23:37.334 INFO:tasks.workunit.client.0.smithi059.stdout:1/728: read d7/d2a/d85/db7/d16/f24 [2546858,97579] 0 2024-04-25T16:23:37.362 INFO:tasks.workunit.client.0.smithi059.stdout:5/739: rmdir d1/d1e/d8f 39 2024-04-25T16:23:37.467 INFO:tasks.workunit.client.0.smithi059.stdout:8/644: mkdir d7/dd/d17/d23/d37/d5c/d87/d94/d7f/dcb 0 2024-04-25T16:23:37.477 INFO:tasks.workunit.client.0.smithi059.stdout:8/645: stat d7/dd/d17/db4/d7e 0 2024-04-25T16:23:37.627 INFO:tasks.workunit.client.0.smithi059.stdout:6/739: write d9/f10 [2146339,104136] 0 2024-04-25T16:23:37.644 INFO:tasks.workunit.client.0.smithi059.stdout:6/740: dread - d9/d27/d68/f6d zero size 2024-04-25T16:23:37.812 INFO:tasks.workunit.client.0.smithi059.stdout:0/654: fdatasync dc/dd/d3b/f80 0 2024-04-25T16:23:37.863 INFO:tasks.workunit.client.0.smithi059.stdout:0/655: dread dc/dd/f3c [0,4194304] 0 2024-04-25T16:23:38.023 INFO:tasks.workunit.client.0.smithi059.stdout:5/740: symlink d1/d1e/d27/lf5 0 2024-04-25T16:23:38.065 INFO:tasks.workunit.client.0.smithi059.stdout:8/646: creat d7/dd/d17/d23/d37/d5c/d87/d94/d66/daa/fcc x:0 0 0 2024-04-25T16:23:38.263 INFO:tasks.workunit.client.0.smithi059.stdout:2/681: dwrite de/d5a/d9a/de9/fb3 [0,4194304] 0 2024-04-25T16:23:38.447 INFO:tasks.workunit.client.0.smithi059.stdout:3/738: dwrite d0/d1e/f45 [0,4194304] 0 2024-04-25T16:23:38.551 INFO:tasks.workunit.client.0.smithi059.stdout:7/668: rmdir d0/d7/d51/da9/db3/d33/d79/d5d/d85/db9 0 2024-04-25T16:23:38.565 INFO:tasks.workunit.client.0.smithi059.stdout:7/669: stat d0/d7/d51/da9/db3/d33/dc6 0 2024-04-25T16:23:38.571 INFO:tasks.workunit.client.0.smithi059.stdout:7/670: chown d0/d7/dae 183927 1 2024-04-25T16:23:38.745 INFO:tasks.workunit.client.0.smithi059.stdout:5/741: truncate d1/d1e/d27/d66/d70/d75/f91 2688938 0 2024-04-25T16:23:38.791 INFO:tasks.workunit.client.0.smithi059.stdout:8/647: read - d7/dd/d17/db4/fac zero size 2024-04-25T16:23:38.897 INFO:tasks.workunit.client.0.smithi059.stdout:6/741: symlink d9/d16/d24/d5d/d77/le5 0 2024-04-25T16:23:38.942 INFO:tasks.workunit.client.0.smithi059.stdout:5/742: dread d1/d1e/f5c [0,4194304] 0 2024-04-25T16:23:38.996 INFO:tasks.workunit.client.0.smithi059.stdout:6/742: read - d9/d27/d39/f92 zero size 2024-04-25T16:23:39.001 INFO:tasks.workunit.client.0.smithi059.stdout:3/739: truncate d0/d1e/d31/dc7/fe5 2127798 0 2024-04-25T16:23:39.044 INFO:tasks.workunit.client.0.smithi059.stdout:9/702: dwrite d6/d35/d28/f76 [0,4194304] 0 2024-04-25T16:23:39.108 INFO:tasks.workunit.client.0.smithi059.stdout:7/671: unlink d0/d7/d16/d5a/f80 0 2024-04-25T16:23:39.145 INFO:tasks.workunit.client.0.smithi059.stdout:4/661: write d0/d4/df/d1c/d45/f62 [1865521,40192] 0 2024-04-25T16:23:39.254 INFO:tasks.workunit.client.0.smithi059.stdout:5/743: dread d1/d1e/d27/f30 [0,4194304] 0 2024-04-25T16:23:39.643 INFO:tasks.workunit.client.0.smithi059.stdout:8/648: mkdir d7/dd/d17/d23/d37/d5c/d87/d94/dcd 0 2024-04-25T16:23:39.647 INFO:tasks.workunit.client.0.smithi059.stdout:0/656: getdents dc/dd 0 2024-04-25T16:23:39.672 INFO:tasks.workunit.client.0.smithi059.stdout:1/729: write d7/d2a/d85/db7/f5a [2684477,61840] 0 2024-04-25T16:23:40.190 INFO:tasks.workunit.client.0.smithi059.stdout:2/682: getdents de/d2a/d2e/d36/d2c/d40/d57 0 2024-04-25T16:23:40.265 INFO:tasks.workunit.client.0.smithi059.stdout:9/703: symlink d6/d35/lc8 0 2024-04-25T16:23:40.294 INFO:tasks.workunit.client.0.smithi059.stdout:3/740: rename d0/db/d2d/f58 to d0/db/d3f/d6c/ffd 0 2024-04-25T16:23:40.301 INFO:tasks.workunit.client.0.smithi059.stdout:0/657: fdatasync dc/d44/f35 0 2024-04-25T16:23:40.325 INFO:tasks.workunit.client.0.smithi059.stdout:3/741: chown d0/db/d47/d98/cb5 19 1 2024-04-25T16:23:40.372 INFO:tasks.workunit.client.0.smithi059.stdout:1/730: mknod d7/d2a/d85/db7/d16/d5c/cf1 0 2024-04-25T16:23:40.594 INFO:tasks.workunit.client.0.smithi059.stdout:7/672: write d0/d7/d51/da9/db3/d33/d79/d5d/d85/fce [745394,119421] 0 2024-04-25T16:23:40.705 INFO:tasks.workunit.client.0.smithi059.stdout:4/662: dwrite d0/d4/df/d1c/d45/d54/fb7 [0,4194304] 0 2024-04-25T16:23:40.808 INFO:tasks.workunit.client.0.smithi059.stdout:2/683: read de/d16/fd0 [4090221,67749] 0 2024-04-25T16:23:40.868 INFO:tasks.workunit.client.0.smithi059.stdout:6/743: link d9/d16/d53/d55/c5b d9/d27/d39/ce6 0 2024-04-25T16:23:40.939 INFO:tasks.workunit.client.0.smithi059.stdout:6/744: chown d9/d1b/f6b 0 1 2024-04-25T16:23:40.939 INFO:tasks.workunit.client.0.smithi059.stdout:9/704: unlink d6/d35/f4b 0 2024-04-25T16:23:41.256 INFO:tasks.workunit.client.0.smithi059.stdout:0/658: stat dc/dd/l11 0 2024-04-25T16:23:41.265 INFO:tasks.workunit.client.0.smithi059.stdout:2/684: creat de/d5a/d7d/d80/ddb/de3/ff1 x:0 0 0 2024-04-25T16:23:41.847 INFO:tasks.workunit.client.0.smithi059.stdout:5/744: getdents d1/dcd/d50/db8 0 2024-04-25T16:23:41.853 INFO:tasks.workunit.client.0.smithi059.stdout:0/659: creat dc/dd/d3b/fd3 x:0 0 0 2024-04-25T16:23:41.877 INFO:tasks.workunit.client.0.smithi059.stdout:5/745: chown d1/d48/c6f 232191534 1 2024-04-25T16:23:41.881 INFO:tasks.workunit.client.0.smithi059.stdout:5/746: readlink d1/l1f 0 2024-04-25T16:23:42.053 INFO:tasks.workunit.client.0.smithi059.stdout:0/660: fdatasync dc/d84/f9a 0 2024-04-25T16:23:42.178 INFO:tasks.workunit.client.0.smithi059.stdout:5/747: symlink d1/d48/lf6 0 2024-04-25T16:23:42.215 INFO:tasks.workunit.client.0.smithi059.stdout:1/731: getdents d7/d21/d51 0 2024-04-25T16:23:42.522 INFO:tasks.workunit.client.0.smithi059.stdout:7/673: write d0/d7/fa7 [41225,47648] 0 2024-04-25T16:23:42.523 INFO:tasks.workunit.client.0.smithi059.stdout:4/663: write d0/d4/df/d1c/d45/d54/d75/d82/faf [903624,7682] 0 2024-04-25T16:23:42.540 INFO:tasks.workunit.client.0.smithi059.stdout:9/705: write d6/d4e/dba/fbe [707548,33962] 0 2024-04-25T16:23:42.813 INFO:tasks.workunit.client.0.smithi059.stdout:5/748: unlink d1/d1e/d27/d66/d70/d75/fae 0 2024-04-25T16:23:42.928 INFO:tasks.workunit.client.0.smithi059.stdout:2/685: link de/d2a/d2e/d36/d2c/fbf de/d2a/d2e/d36/ff2 0 2024-04-25T16:23:43.028 INFO:tasks.workunit.client.0.smithi059.stdout:9/706: mkdir d6/d35/d26/d6b/dc9 0 2024-04-25T16:23:43.275 INFO:tasks.workunit.client.0.smithi059.stdout:2/686: fdatasync de/d16/f43 0 2024-04-25T16:23:43.325 INFO:tasks.workunit.client.0.smithi059.stdout:9/707: symlink d6/d35/d2f/d39/d85/lca 0 2024-04-25T16:23:43.586 INFO:tasks.workunit.client.0.smithi059.stdout:0/661: creat dc/fd4 x:0 0 0 2024-04-25T16:23:43.590 INFO:tasks.workunit.client.0.smithi059.stdout:5/749: truncate d1/d1e/d27/d66/d70/d75/daa/fbf 1040152 0 2024-04-25T16:23:43.610 INFO:tasks.workunit.client.0.smithi059.stdout:0/662: chown dc/d44/l38 12927 1 2024-04-25T16:23:43.646 INFO:tasks.workunit.client.0.smithi059.stdout:2/687: symlink de/d5a/d7d/d80/ddb/de3/lf3 0 2024-04-25T16:23:43.665 INFO:tasks.workunit.client.0.smithi059.stdout:9/708: readlink d6/l42 0 2024-04-25T16:23:43.856 INFO:tasks.workunit.client.0.smithi059.stdout:0/663: fdatasync dc/d37/d47/d60/d6e/f8a 0 2024-04-25T16:23:43.918 INFO:tasks.workunit.client.0.smithi059.stdout:9/709: mknod d6/d4e/d7a/ccb 0 2024-04-25T16:23:44.007 INFO:tasks.workunit.client.0.smithi059.stdout:2/688: creat de/d2a/d2e/d36/d2c/d40/de5/ff4 x:0 0 0 2024-04-25T16:23:44.152 INFO:tasks.workunit.client.0.smithi059.stdout:8/649: rename d7/d16/l2b to d7/lce 0 2024-04-25T16:23:44.171 INFO:tasks.workunit.client.0.smithi059.stdout:8/650: chown d7/dd/d33/f73 144433219 1 2024-04-25T16:23:44.191 INFO:tasks.workunit.client.0.smithi059.stdout:0/664: creat dc/d44/d5f/d72/fd5 x:0 0 0 2024-04-25T16:23:44.200 INFO:tasks.workunit.client.0.smithi059.stdout:0/665: stat dc/dd/d3b/f7d 0 2024-04-25T16:23:44.374 INFO:tasks.workunit.client.0.smithi059.stdout:2/689: symlink de/d5a/d9a/de9/lf5 0 2024-04-25T16:23:44.375 INFO:tasks.workunit.client.0.smithi059.stdout:9/710: creat d6/dae/fcc x:0 0 0 2024-04-25T16:23:44.574 INFO:tasks.workunit.client.0.smithi059.stdout:3/742: rename d0/db/d3f/dce/cf4 to d0/d1e/d31/dc7/cfe 0 2024-04-25T16:23:44.579 INFO:tasks.workunit.client.0.smithi059.stdout:1/732: write d7/d2a/d85/db7/d2d/f37 [2153085,91019] 0 2024-04-25T16:23:44.602 INFO:tasks.workunit.client.0.smithi059.stdout:4/664: write d0/d4/df/f42 [1963825,18219] 0 2024-04-25T16:23:44.732 INFO:tasks.workunit.client.0.smithi059.stdout:2/690: truncate de/d2a/f35 8207556 0 2024-04-25T16:23:44.736 INFO:tasks.workunit.client.0.smithi059.stdout:8/651: getdents d7/d16/d8f/dc8 0 2024-04-25T16:23:44.749 INFO:tasks.workunit.client.0.smithi059.stdout:1/733: sync 2024-04-25T16:23:44.768 INFO:tasks.workunit.client.0.smithi059.stdout:7/674: write d0/d7/d51/da9/db3/d33/d79/d5d/dcb/dd4/fba [985447,101671] 0 2024-04-25T16:23:44.824 INFO:tasks.workunit.client.0.smithi059.stdout:6/745: rename d9/d16/d54/fad to d9/d16/d53/d6c/da6/fe7 0 2024-04-25T16:23:44.877 INFO:tasks.workunit.client.0.smithi059.stdout:3/743: symlink d0/db/d47/d7e/lff 0 2024-04-25T16:23:44.956 INFO:tasks.workunit.client.0.smithi059.stdout:0/666: unlink dc/df/d24/f74 0 2024-04-25T16:23:45.072 INFO:tasks.workunit.client.0.smithi059.stdout:2/691: creat de/d16/d7f/ff6 x:0 0 0 2024-04-25T16:23:45.167 INFO:tasks.workunit.client.0.smithi059.stdout:7/675: dread d0/f30 [0,4194304] 0 2024-04-25T16:23:45.177 INFO:tasks.workunit.client.0.smithi059.stdout:7/676: chown d0/d7/d16/d20 46 1 2024-04-25T16:23:45.284 INFO:tasks.workunit.client.0.smithi059.stdout:8/652: mknod d7/dd/d17/d23/d37/d5c/d87/d94/d66/daa/ccf 0 2024-04-25T16:23:45.374 INFO:tasks.workunit.client.0.smithi059.stdout:1/734: truncate d7/d93/f4f 769728 0 2024-04-25T16:23:45.474 INFO:tasks.workunit.client.0.smithi059.stdout:6/746: mkdir d9/d27/d39/d7b/de8 0 2024-04-25T16:23:45.563 INFO:tasks.workunit.client.0.smithi059.stdout:3/744: dread d0/d1e/f45 [0,4194304] 0 2024-04-25T16:23:45.603 INFO:tasks.workunit.client.0.smithi059.stdout:2/692: mkdir de/d16/d9d/df7 0 2024-04-25T16:23:45.608 INFO:tasks.workunit.client.0.smithi059.stdout:5/750: write d1/d1e/f20 [2350824,122772] 0 2024-04-25T16:23:45.684 INFO:tasks.workunit.client.0.smithi059.stdout:0/667: dread dc/d37/d47/f64 [0,4194304] 0 2024-04-25T16:23:45.747 INFO:tasks.workunit.client.0.smithi059.stdout:7/677: unlink d0/cc 0 2024-04-25T16:23:45.755 INFO:tasks.workunit.client.0.smithi059.stdout:8/653: creat d7/d2f/d76/fd0 x:0 0 0 2024-04-25T16:23:45.766 INFO:tasks.workunit.client.0.smithi059.stdout:0/668: sync 2024-04-25T16:23:45.993 INFO:tasks.workunit.client.0.smithi059.stdout:3/745: dread d0/db/f19 [0,4194304] 0 2024-04-25T16:23:46.027 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:23:46.030 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:23:46.040 INFO:tasks.workunit.client.0.smithi059.stdout:8/654: fdatasync d7/dd/d33/f73 0 2024-04-25T16:23:46.105 INFO:tasks.workunit.client.0.smithi059.stdout:7/678: mknod d0/d7/d16/d5a/cd7 0 2024-04-25T16:23:46.169 INFO:tasks.workunit.client.0.smithi059.stdout:0/669: unlink dc/d37/d47/fad 0 2024-04-25T16:23:46.280 INFO:tasks.workunit.client.0.smithi059.stdout:6/747: creat d9/d16/d53/d6c/da6/dc6/de3/fe9 x:0 0 0 2024-04-25T16:23:46.862 INFO:tasks.workunit.client.0.smithi059.stdout:8/655: symlink d7/d2f/d76/ld1 0 2024-04-25T16:23:46.935 INFO:tasks.workunit.client.0.smithi059.stdout:0/670: mkdir dc/d37/d47/d71/d9c/dd6 0 2024-04-25T16:23:46.967 INFO:tasks.workunit.client.0.smithi059.stdout:9/711: dwrite d6/d4e/d54/d5d/d48/d49/f72 [0,4194304] 0 2024-04-25T16:23:47.034 INFO:tasks.workunit.client.0.smithi059.stdout:4/665: write d0/d4/df/d44/f4d [1246410,23485] 0 2024-04-25T16:23:47.063 INFO:tasks.workunit.client.0.smithi059.stdout:3/746: creat d0/db/d3f/d89/dd5/f100 x:0 0 0 2024-04-25T16:23:47.270 INFO:tasks.workunit.client.0.smithi059.stdout:6/748: dread d9/d16/d24/d97/f9c [0,4194304] 0 2024-04-25T16:23:47.331 INFO:tasks.workunit.client.0.smithi059.stdout:8/656: dread d7/d2f/d76/f97 [0,4194304] 0 2024-04-25T16:23:47.419 INFO:tasks.workunit.client.0.smithi059.stdout:0/671: dread f9 [0,4194304] 0 2024-04-25T16:23:47.486 INFO:tasks.workunit.client.0.smithi059.stdout:4/666: dread d0/d4/df/d1c/d45/d54/d75/fa2 [0,4194304] 0 2024-04-25T16:23:47.597 INFO:tasks.workunit.client.0.smithi059.stdout:3/747: mkdir d0/db/d3f/d89/d101 0 2024-04-25T16:23:47.821 INFO:tasks.workunit.client.0.smithi059.stdout:8/657: truncate d7/dd/d17/d23/d37/d5c/fc3 393364 0 2024-04-25T16:23:47.829 INFO:tasks.workunit.client.0.smithi059.stdout:0/672: truncate dc/d37/d47/d60/d6e/f8a 2352864 0 2024-04-25T16:23:47.897 INFO:tasks.workunit.client.0.smithi059.stdout:1/735: dwrite d7/d2a/d85/db7/d77/da3/fc5 [0,4194304] 0 2024-04-25T16:23:48.049 INFO:tasks.workunit.client.0.smithi059.stdout:4/667: dread d0/d4/df/d1c/f85 [0,4194304] 0 2024-04-25T16:23:48.174 INFO:tasks.workunit.client.0.smithi059.stdout:2/693: dwrite de/d16/fcc [0,4194304] 0 2024-04-25T16:23:48.251 INFO:tasks.workunit.client.0.smithi059.stdout:5/751: dwrite d1/d48/d85/fb0 [0,4194304] 0 2024-04-25T16:23:48.350 INFO:tasks.workunit.client.0.smithi059.stdout:4/668: readlink d0/d4/df/d1c/d45/d54/d75/d82/lba 0 2024-04-25T16:23:48.793 INFO:tasks.workunit.client.0.smithi059.stdout:8/658: rename d7/d2f/d43/cc6 to d7/cd2 0 2024-04-25T16:23:48.809 INFO:tasks.workunit.client.0.smithi059.stdout:7/679: write d0/d7/d51/da9/db3/d33/fc1 [970676,8535] 0 2024-04-25T16:23:48.932 INFO:tasks.workunit.client.0.smithi059.stdout:2/694: creat de/d5a/d9a/de9/dea/ff8 x:0 0 0 2024-04-25T16:23:49.041 INFO:tasks.workunit.client.0.smithi059.stdout:8/659: symlink d7/dd/d17/d23/d37/d5c/d87/d94/d7f/ld3 0 2024-04-25T16:23:49.052 INFO:tasks.workunit.client.0.smithi059.stdout:2/695: sync 2024-04-25T16:23:49.066 INFO:tasks.workunit.client.0.smithi059.stdout:2/696: chown de/d2a/da7 2 1 2024-04-25T16:23:49.354 INFO:tasks.workunit.client.0.smithi059.stdout:4/669: getdents d0/d4 0 2024-04-25T16:23:49.366 INFO:tasks.workunit.client.0.smithi059.stdout:5/752: read d1/d1e/d8f/dea/ff0 [176809,6698] 0 2024-04-25T16:23:49.379 INFO:tasks.workunit.client.0.smithi059.stdout:4/670: chown d0/d4/df/c6e 6731077 1 2024-04-25T16:23:49.380 INFO:tasks.workunit.client.0.smithi059.stdout:5/753: chown d1/l1f 1300602 1 2024-04-25T16:23:49.422 INFO:tasks.workunit.client.0.smithi059.stdout:8/660: rename d7/d2f/c7a to d7/d16/d8c/cd4 0 2024-04-25T16:23:49.589 INFO:tasks.workunit.client.0.smithi059.stdout:6/749: dwrite d9/d1b/f8e [0,4194304] 0 2024-04-25T16:23:49.664 INFO:tasks.workunit.client.0.smithi059.stdout:3/748: write d0/d1e/f56 [528635,82131] 0 2024-04-25T16:23:49.774 INFO:tasks.workunit.client.0.smithi059.stdout:5/754: dread d1/fa [0,4194304] 0 2024-04-25T16:23:49.906 INFO:tasks.workunit.client.0.smithi059.stdout:8/661: creat d7/dd/d17/d23/d38/fd5 x:0 0 0 2024-04-25T16:23:49.912 INFO:tasks.workunit.client.0.smithi059.stdout:4/671: dread d0/d4/df/f66 [0,4194304] 0 2024-04-25T16:23:49.935 INFO:tasks.workunit.client.0.smithi059.stdout:4/672: chown d0/d4/df/faa 14867 1 2024-04-25T16:23:50.141 INFO:tasks.workunit.client.0.smithi059.stdout:6/750: dread d9/d16/d24/f2b [0,4194304] 0 2024-04-25T16:23:50.158 INFO:tasks.workunit.client.0.smithi059.stdout:0/673: dwrite dc/df/d5e/f8c [0,4194304] 0 2024-04-25T16:23:50.226 INFO:tasks.workunit.client.0.smithi059.stdout:9/712: mknod d6/ccd 0 2024-04-25T16:23:50.334 INFO:tasks.workunit.client.0.smithi059.stdout:6/751: readlink d9/d16/d53/d55/d71/d7e/la9 0 2024-04-25T16:23:50.392 INFO:tasks.workunit.client.0.smithi059.stdout:5/755: dread d1/d48/fbb [0,4194304] 0 2024-04-25T16:23:50.413 INFO:tasks.workunit.client.0.smithi059.stdout:1/736: write d7/de5/d8f/f25 [4208984,96950] 0 2024-04-25T16:23:50.535 INFO:tasks.workunit.client.0.smithi059.stdout:2/697: dwrite de/d67/f72 [8388608,4194304] 0 2024-04-25T16:23:51.059 INFO:tasks.workunit.client.0.smithi059.stdout:3/749: dwrite d0/d1e/d31/dc7/fda [0,4194304] 0 2024-04-25T16:23:51.122 INFO:tasks.workunit.client.0.smithi059.stdout:6/752: mknod d9/d16/d53/d6c/da6/dc6/cea 0 2024-04-25T16:23:51.136 INFO:tasks.workunit.client.0.smithi059.stdout:1/737: creat d7/d2a/ff2 x:0 0 0 2024-04-25T16:23:51.167 INFO:tasks.workunit.client.0.smithi059.stdout:6/753: chown d9/d27/c47 89327 1 2024-04-25T16:23:51.188 INFO:tasks.workunit.client.0.smithi059.stdout:6/754: chown d9/d16/d24/d5d/d77/le5 1781 1 2024-04-25T16:23:51.396 INFO:tasks.workunit.client.0.smithi059.stdout:7/680: creat d0/fd8 x:0 0 0 2024-04-25T16:23:51.397 INFO:tasks.workunit.client.0.smithi059.stdout:8/662: link d7/dd/d17/d23/d37/d5c/d87/d94/cba d7/dd/d17/d23/d37/d5c/d87/d94/d66/cd6 0 2024-04-25T16:23:51.442 INFO:tasks.workunit.client.0.smithi059.stdout:2/698: chown de/d2a/d2e/l23 2801 1 2024-04-25T16:23:51.724 INFO:tasks.workunit.client.0.smithi059.stdout:1/738: creat d7/d2a/d85/db7/d16/d5c/d74/da7/ff3 x:0 0 0 2024-04-25T16:23:51.726 INFO:tasks.workunit.client.0.smithi059.stdout:3/750: dread - d0/d1e/d31/f6b zero size 2024-04-25T16:23:52.039 INFO:tasks.workunit.client.0.smithi059.stdout:6/755: mkdir d9/d16/d53/d55/d71/d7e/dc4/deb 0 2024-04-25T16:23:52.054 INFO:tasks.workunit.client.0.smithi059.stdout:8/663: creat d7/dd/d17/db4/d7e/da5/fd7 x:0 0 0 2024-04-25T16:23:52.060 INFO:tasks.workunit.client.0.smithi059.stdout:0/674: link dc/d37/d47/d71/d77/l92 dc/dd/d3b/d66/ld7 0 2024-04-25T16:23:52.084 INFO:tasks.workunit.client.0.smithi059.stdout:7/681: readlink d0/d7/d51/da9/db3/l76 0 2024-04-25T16:23:52.206 INFO:tasks.workunit.client.0.smithi059.stdout:1/739: fsync d7/de5/f7b 0 2024-04-25T16:23:52.212 INFO:tasks.workunit.client.0.smithi059.stdout:3/751: mkdir d0/db/d47/d5b/d102 0 2024-04-25T16:23:52.710 INFO:tasks.workunit.client.0.smithi059.stdout:4/673: dwrite d0/d4/df/d48/da9/fbd [4194304,4194304] 0 2024-04-25T16:23:52.833 INFO:tasks.workunit.client.0.smithi059.stdout:7/682: mknod d0/d7/dae/cd9 0 2024-04-25T16:23:52.837 INFO:tasks.workunit.client.0.smithi059.stdout:9/713: link d6/d35/d28/f8c d6/d35/d26/fce 0 2024-04-25T16:23:52.896 INFO:tasks.workunit.client.0.smithi059.stdout:5/756: getdents d1/dcd/d50 0 2024-04-25T16:23:53.008 INFO:tasks.workunit.client.0.smithi059.stdout:1/740: chown d7/d2a/d85/db7/cbf 193 1 2024-04-25T16:23:53.047 INFO:tasks.workunit.client.0.smithi059.stdout:3/752: fdatasync d0/db/d47/d98/fca 0 2024-04-25T16:23:53.338 INFO:tasks.workunit.client.0.smithi059.stdout:4/674: fdatasync d0/d4/df/d1c/f6b 0 2024-04-25T16:23:53.403 INFO:tasks.workunit.client.0.smithi059.stdout:0/675: creat dc/d37/d47/d71/dd0/fd8 x:0 0 0 2024-04-25T16:23:53.477 INFO:tasks.workunit.client.0.smithi059.stdout:9/714: dread - d6/f68 zero size 2024-04-25T16:23:53.494 INFO:tasks.workunit.client.0.smithi059.stdout:9/715: chown d6/d4e/d54/d5d/d48/d49/f5e 779644 1 2024-04-25T16:23:53.563 INFO:tasks.workunit.client.0.smithi059.stdout:7/683: truncate d0/d7/d51/da9/db3/d33/d79/d5d/f75 476993 0 2024-04-25T16:23:53.582 INFO:tasks.workunit.client.0.smithi059.stdout:7/684: chown d0/d7/d51/da9/db3/d33 103 1 2024-04-25T16:23:53.612 INFO:tasks.workunit.client.0.smithi059.stdout:5/757: mknod d1/dcd/d50/db8/cf7 0 2024-04-25T16:23:53.706 INFO:tasks.workunit.client.0.smithi059.stdout:2/699: dwrite de/d5a/d7d/d80/fad [0,4194304] 0 2024-04-25T16:23:53.771 INFO:tasks.workunit.client.0.smithi059.stdout:1/741: mknod d7/d2a/d85/db7/d77/da3/cf4 0 2024-04-25T16:23:54.005 INFO:tasks.workunit.client.0.smithi059.stdout:6/756: creat d9/d16/d53/fec x:0 0 0 2024-04-25T16:23:54.142 INFO:tasks.workunit.client.0.smithi059.stdout:4/675: dread d0/d4/df/d1c/d45/f60 [0,4194304] 0 2024-04-25T16:23:54.187 INFO:tasks.workunit.client.0.smithi059.stdout:9/716: fdatasync d6/d35/d2f/d39/f9a 0 2024-04-25T16:23:54.344 INFO:tasks.workunit.client.0.smithi059.stdout:7/685: fsync d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/fbd 0 2024-04-25T16:23:54.359 INFO:tasks.workunit.client.0.smithi059.stdout:7/686: readlink d0/d7/l25 0 2024-04-25T16:23:54.516 INFO:tasks.workunit.client.0.smithi059.stdout:6/757: rmdir d9/d16/d24/d97 39 2024-04-25T16:23:54.525 INFO:tasks.workunit.client.0.smithi059.stdout:2/700: read - de/d5a/d7d/d80/ddb/de3/ff1 zero size 2024-04-25T16:23:54.601 INFO:tasks.workunit.client.0.smithi059.stdout:9/717: mknod d6/d35/d28/ccf 0 2024-04-25T16:23:54.603 INFO:tasks.workunit.client.0.smithi059.stdout:8/664: write d7/f1f [5183736,81903] 0 2024-04-25T16:23:54.772 INFO:tasks.workunit.client.0.smithi059.stdout:4/676: dwrite d0/d4/df/d44/f4d [0,4194304] 0 2024-04-25T16:23:54.790 INFO:tasks.workunit.client.0.smithi059.stdout:1/742: dread d7/f22 [4194304,4194304] 0 2024-04-25T16:23:55.071 INFO:tasks.workunit.client.0.smithi059.stdout:2/701: rmdir de/d2a/d33/d65/dcf 39 2024-04-25T16:23:55.077 INFO:tasks.workunit.client.0.smithi059.stdout:6/758: fsync d9/d16/d24/f2b 0 2024-04-25T16:23:55.084 INFO:tasks.workunit.client.0.smithi059.stdout:8/665: mknod d7/dd/d17/d23/d38/cd8 0 2024-04-25T16:23:55.097 INFO:tasks.workunit.client.0.smithi059.stdout:5/758: link d1/dcd/d50/fa2 d1/dcd/d44/d79/d92/ff8 0 2024-04-25T16:23:55.106 INFO:tasks.workunit.client.0.smithi059.stdout:1/743: mknod d7/d2a/d62/cf5 0 2024-04-25T16:23:55.121 INFO:tasks.workunit.client.0.smithi059.stdout:9/718: chown d6/d35/d2f/d39/cb0 2730206 1 2024-04-25T16:23:55.147 INFO:tasks.workunit.client.0.smithi059.stdout:8/666: readlink d7/d2f/l30 0 2024-04-25T16:23:55.207 INFO:tasks.workunit.client.0.smithi059.stdout:4/677: dread d0/d4/df/d44/f4f [0,4194304] 0 2024-04-25T16:23:55.236 INFO:tasks.workunit.client.0.smithi059.stdout:4/678: read d0/d4/df/d1c/d45/d54/d75/f90 [115308,73886] 0 2024-04-25T16:23:55.900 INFO:tasks.workunit.client.0.smithi059.stdout:3/753: write d0/db/d3f/fc4 [63212,122447] 0 2024-04-25T16:23:55.982 INFO:tasks.workunit.client.0.smithi059.stdout:0/676: dwrite dc/dd/d5c/fac [0,4194304] 0 2024-04-25T16:23:56.054 INFO:tasks.workunit.client.0.smithi059.stdout:7/687: write d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/f6e [720822,16067] 0 2024-04-25T16:23:56.062 INFO:tasks.workunit.client.0.smithi059.stdout:5/759: mkdir d1/dcd/df9 0 2024-04-25T16:23:56.070 INFO:tasks.workunit.client.0.smithi059.stdout:6/759: fdatasync d9/d1b/d58/d49/fd4 0 2024-04-25T16:23:56.196 INFO:tasks.workunit.client.0.smithi059.stdout:2/702: dread de/d67/fc2 [0,4194304] 0 2024-04-25T16:23:56.241 INFO:tasks.workunit.client.0.smithi059.stdout:8/667: dread d7/d16/f52 [0,4194304] 0 2024-04-25T16:23:56.298 INFO:tasks.workunit.client.0.smithi059.stdout:5/760: dread d1/d1e/d8f/dea/ff0 [0,4194304] 0 2024-04-25T16:23:56.356 INFO:tasks.workunit.client.0.smithi059.stdout:1/744: mknod d7/d2a/d85/db7/d6a/cf6 0 2024-04-25T16:23:56.555 INFO:tasks.workunit.client.0.smithi059.stdout:0/677: mknod dc/d44/d5f/cd9 0 2024-04-25T16:23:56.699 INFO:tasks.workunit.client.0.smithi059.stdout:9/719: dwrite d6/d4e/d54/d5d/d95/fab [0,4194304] 0 2024-04-25T16:23:57.162 INFO:tasks.workunit.client.0.smithi059.stdout:8/668: mknod d7/dd/d17/d23/d37/d5c/d87/d94/d7f/cd9 0 2024-04-25T16:23:57.336 INFO:tasks.workunit.client.0.smithi059.stdout:8/669: chown d7/d16/d3a/la9 762581746 1 2024-04-25T16:23:57.422 INFO:tasks.workunit.client.0.smithi059.stdout:1/745: rmdir d7/d21/d51 39 2024-04-25T16:23:57.435 INFO:tasks.workunit.client.0.smithi059.stdout:0/678: symlink dc/dd/d3b/d66/lda 0 2024-04-25T16:23:57.477 INFO:tasks.workunit.client.0.smithi059.stdout:9/720: mknod d6/d4e/d54/d5d/d48/d6e/cd0 0 2024-04-25T16:23:57.495 INFO:tasks.workunit.client.0.smithi059.stdout:3/754: dwrite d0/db/d3f/d49/d65/fc3 [0,4194304] 0 2024-04-25T16:23:57.580 INFO:tasks.workunit.client.0.smithi059.stdout:4/679: dwrite d0/d4/df/d1c/d45/d54/d75/d82/d8f/fa7 [0,4194304] 0 2024-04-25T16:23:57.599 INFO:tasks.workunit.client.0.smithi059.stdout:5/761: dread d1/f5b [0,4194304] 0 2024-04-25T16:23:57.803 INFO:tasks.workunit.client.0.smithi059.stdout:0/679: dread dc/dd/f3c [0,4194304] 0 2024-04-25T16:23:57.812 INFO:tasks.workunit.client.0.smithi059.stdout:7/688: rename d0/d3f/f50 to d0/d7/d16/d20/dab/fda 0 2024-04-25T16:23:57.879 INFO:tasks.workunit.client.0.smithi059.stdout:6/760: dwrite d9/d16/d53/d55/d71/d7e/f8a [0,4194304] 0 2024-04-25T16:23:57.946 INFO:tasks.workunit.client.0.smithi059.stdout:4/680: dread d0/d4/df/f19 [0,4194304] 0 2024-04-25T16:23:57.964 INFO:tasks.workunit.client.0.smithi059.stdout:0/680: stat dc/d37/d47/d71/d9c 0 2024-04-25T16:23:58.014 INFO:tasks.workunit.client.0.smithi059.stdout:1/746: unlink d7/d2a/d85/db7/d6a/le0 0 2024-04-25T16:23:58.028 INFO:tasks.workunit.client.0.smithi059.stdout:3/755: creat d0/d1e/d95/f103 x:0 0 0 2024-04-25T16:23:58.033 INFO:tasks.workunit.client.0.smithi059.stdout:2/703: write de/d16/d9d/fba [726417,129341] 0 2024-04-25T16:23:58.159 INFO:tasks.workunit.client.0.smithi059.stdout:9/721: symlink d6/d4e/d54/d5d/d95/ld1 0 2024-04-25T16:23:58.173 INFO:tasks.workunit.client.0.smithi059.stdout:5/762: creat d1/dcd/d44/d79/ffa x:0 0 0 2024-04-25T16:23:58.268 INFO:tasks.workunit.client.0.smithi059.stdout:9/722: dwrite d6/d4e/d54/d5d/d48/d49/f5c [0,4194304] 0 2024-04-25T16:23:58.483 INFO:tasks.workunit.client.0.smithi059.stdout:6/761: creat d9/d16/d53/d55/d6e/fed x:0 0 0 2024-04-25T16:23:58.487 INFO:tasks.workunit.client.0.smithi059.stdout:0/681: unlink dc/dd/l11 0 2024-04-25T16:23:58.870 INFO:tasks.workunit.client.0.smithi059.stdout:9/723: creat d6/d4e/fd2 x:0 0 0 2024-04-25T16:23:59.029 INFO:tasks.workunit.client.0.smithi059.stdout:0/682: creat dc/df/d5e/fdb x:0 0 0 2024-04-25T16:23:59.073 INFO:tasks.workunit.client.0.smithi059.stdout:4/681: getdents d0/d4/df/d74 0 2024-04-25T16:23:59.090 INFO:tasks.workunit.client.0.smithi059.stdout:4/682: readlink d0/d4/df/d1c/d45/d54/d75/d7e/lc5 0 2024-04-25T16:23:59.122 INFO:tasks.workunit.client.0.smithi059.stdout:6/762: symlink d9/d1b/d58/d49/db0/lee 0 2024-04-25T16:23:59.420 INFO:tasks.workunit.client.0.smithi059.stdout:6/763: unlink d9/d27/d39/c90 0 2024-04-25T16:23:59.787 INFO:tasks.workunit.client.0.smithi059.stdout:3/756: rmdir d0/db/d2d/d7a/dd6 0 2024-04-25T16:23:59.790 INFO:tasks.workunit.client.0.smithi059.stdout:1/747: write d7/d2a/d85/db7/d16/d7f/f9e [1385075,5737] 0 2024-04-25T16:23:59.852 INFO:tasks.workunit.client.0.smithi059.stdout:7/689: dwrite d0/d7/d51/da9/db3/d33/d79/fc4 [0,4194304] 0 2024-04-25T16:23:59.926 INFO:tasks.workunit.client.0.smithi059.stdout:8/670: creat d7/dd/d17/d23/fda x:0 0 0 2024-04-25T16:23:59.950 INFO:tasks.workunit.client.0.smithi059.stdout:9/724: symlink d6/dae/dc3/dc5/ld3 0 2024-04-25T16:23:59.972 INFO:tasks.workunit.client.0.smithi059.stdout:5/763: write d1/d1e/d8f/fc2 [135366,128660] 0 2024-04-25T16:24:00.068 INFO:tasks.workunit.client.0.smithi059.stdout:0/683: symlink dc/d37/d47/d81/dd2/ldc 0 2024-04-25T16:24:00.111 INFO:tasks.workunit.client.0.smithi059.stdout:0/684: dread dc/dd/f9d [0,4194304] 0 2024-04-25T16:24:00.312 INFO:tasks.workunit.client.0.smithi059.stdout:4/683: dwrite d0/d4/df/d1c/d45/f60 [0,4194304] 0 2024-04-25T16:24:00.415 INFO:tasks.workunit.client.0.smithi059.stdout:2/704: link de/d2a/d33/d65/dcf/fd1 de/d2a/d2e/d36/d59/ff9 0 2024-04-25T16:24:00.416 INFO:tasks.workunit.client.0.smithi059.stdout:7/690: fsync d0/d7/f29 0 2024-04-25T16:24:00.486 INFO:tasks.workunit.client.0.smithi059.stdout:3/757: dread d0/db/d3f/d6c/fa5 [0,4194304] 0 2024-04-25T16:24:00.491 INFO:tasks.workunit.client.0.smithi059.stdout:0/685: symlink dc/d37/d47/d71/d9c/ldd 0 2024-04-25T16:24:00.674 INFO:tasks.workunit.client.0.smithi059.stdout:0/686: sync 2024-04-25T16:24:00.674 INFO:tasks.workunit.client.0.smithi059.stdout:4/684: truncate d0/d4/f56 3341957 0 2024-04-25T16:24:00.678 INFO:tasks.workunit.client.0.smithi059.stdout:2/705: mknod de/d2a/d33/d65/dcf/cfa 0 2024-04-25T16:24:00.680 INFO:tasks.workunit.client.0.smithi059.stdout:1/748: fsync d7/d93/f76 0 2024-04-25T16:24:00.823 INFO:tasks.workunit.client.0.smithi059.stdout:7/691: rename d0/d7/f8a to d0/d7/d16/d20/dab/fdb 0 2024-04-25T16:24:00.829 INFO:tasks.workunit.client.0.smithi059.stdout:3/758: symlink d0/db/d3f/d6c/l104 0 2024-04-25T16:24:00.890 INFO:tasks.workunit.client.0.smithi059.stdout:7/692: sync 2024-04-25T16:24:01.179 INFO:tasks.workunit.client.0.smithi059.stdout:1/749: chown d7/f9 101 1 2024-04-25T16:24:01.268 INFO:tasks.workunit.client.0.smithi059.stdout:8/671: write d7/d2f/d43/f6f [110531,69350] 0 2024-04-25T16:24:01.273 INFO:tasks.workunit.client.0.smithi059.stdout:2/706: symlink de/da1/lfb 0 2024-04-25T16:24:01.332 INFO:tasks.workunit.client.0.smithi059.stdout:5/764: write d1/d1e/d27/fb3 [30669,102537] 0 2024-04-25T16:24:01.355 INFO:tasks.workunit.client.0.smithi059.stdout:8/672: chown d7/d2f/d43/l75 19060 1 2024-04-25T16:24:01.363 INFO:tasks.workunit.client.0.smithi059.stdout:3/759: read d0/db/d47/f2e [3418910,84574] 0 2024-04-25T16:24:01.386 INFO:tasks.workunit.client.0.smithi059.stdout:6/764: link d9/ldd d9/d16/d24/d97/dc3/lef 0 2024-04-25T16:24:01.438 INFO:tasks.workunit.client.0.smithi059.stdout:1/750: truncate d7/d93/d8e/fa2 4782670 0 2024-04-25T16:24:01.449 INFO:tasks.workunit.client.0.smithi059.stdout:6/765: sync 2024-04-25T16:24:01.489 INFO:tasks.workunit.client.0.smithi059.stdout:9/725: dwrite f2 [0,4194304] 0 2024-04-25T16:24:01.518 INFO:tasks.workunit.client.0.smithi059.stdout:6/766: sync 2024-04-25T16:24:01.685 INFO:tasks.workunit.client.0.smithi059.stdout:3/760: dread d0/d1e/f32 [4194304,4194304] 0 2024-04-25T16:24:02.048 INFO:tasks.workunit.client.0.smithi059.stdout:0/687: unlink dc/d84/fcd 0 2024-04-25T16:24:02.057 INFO:tasks.workunit.client.0.smithi059.stdout:2/707: mkdir de/d5a/d7d/d80/ddb/dfc 0 2024-04-25T16:24:02.070 INFO:tasks.workunit.client.0.smithi059.stdout:8/673: unlink d7/f15 0 2024-04-25T16:24:02.083 INFO:tasks.workunit.client.0.smithi059.stdout:5/765: creat d1/d1e/d27/d66/d70/d75/ffb x:0 0 0 2024-04-25T16:24:02.093 INFO:tasks.workunit.client.0.smithi059.stdout:1/751: creat d7/de5/ff7 x:0 0 0 2024-04-25T16:24:02.224 INFO:tasks.workunit.client.0.smithi059.stdout:6/767: rmdir d9/d16/d53/d55/d71/d7e/d9e 39 2024-04-25T16:24:02.255 INFO:tasks.workunit.client.0.smithi059.stdout:3/761: rename d0/f7 to d0/db/d3f/d89/f105 0 2024-04-25T16:24:02.311 INFO:tasks.workunit.client.0.smithi059.stdout:0/688: dread dc/df/f16 [0,4194304] 0 2024-04-25T16:24:02.389 INFO:tasks.workunit.client.0.smithi059.stdout:6/768: chown d9/d27/d39/f92 875214297 1 2024-04-25T16:24:02.403 INFO:tasks.workunit.client.0.smithi059.stdout:5/766: dwrite d1/d1e/d27/d66/d70/d75/ffb [0,4194304] 0 2024-04-25T16:24:02.408 INFO:tasks.workunit.client.0.smithi059.stdout:4/685: getdents d0/d4/df/d1c/d45/d54 0 2024-04-25T16:24:02.514 INFO:tasks.workunit.client.0.smithi059.stdout:0/689: readlink dc/d37/d47/d71/d9c/ldd 0 2024-04-25T16:24:02.584 INFO:tasks.workunit.client.0.smithi059.stdout:0/690: sync 2024-04-25T16:24:03.213 INFO:tasks.workunit.client.0.smithi059.stdout:4/686: mkdir d0/d4/df/d1c/d45/d54/d75/d82/dd2 0 2024-04-25T16:24:03.336 INFO:tasks.workunit.client.0.smithi059.stdout:0/691: symlink dc/d37/d47/d60/d6e/lde 0 2024-04-25T16:24:03.458 INFO:tasks.workunit.client.0.smithi059.stdout:2/708: creat de/d2a/d33/d65/ffd x:0 0 0 2024-04-25T16:24:03.462 INFO:tasks.workunit.client.0.smithi059.stdout:3/762: fdatasync d0/db/d2d/f9a 0 2024-04-25T16:24:04.157 INFO:tasks.workunit.client.0.smithi059.stdout:9/726: write d6/d35/d28/f3e [2184677,2425] 0 2024-04-25T16:24:04.157 INFO:tasks.workunit.client.0.smithi059.stdout:4/687: getdents d0/d4 0 2024-04-25T16:24:04.377 INFO:tasks.workunit.client.0.smithi059.stdout:8/674: rename d7/dd/lb3 to d7/d16/d8c/ldb 0 2024-04-25T16:24:04.406 INFO:tasks.workunit.client.0.smithi059.stdout:9/727: write d6/f47 [3409970,69414] 0 2024-04-25T16:24:04.438 INFO:tasks.workunit.client.0.smithi059.stdout:1/752: write d7/f12 [3274662,26417] 0 2024-04-25T16:24:04.675 INFO:tasks.workunit.client.0.smithi059.stdout:4/688: dread d0/d4/df/d48/f4e [0,4194304] 0 2024-04-25T16:24:04.709 INFO:tasks.workunit.client.0.smithi059.stdout:1/753: symlink d7/d2a/d85/db7/d16/d7f/lf8 0 2024-04-25T16:24:04.719 INFO:tasks.workunit.client.0.smithi059.stdout:6/769: write d9/d16/d53/d55/f93 [3548891,57049] 0 2024-04-25T16:24:04.796 INFO:tasks.workunit.client.0.smithi059.stdout:8/675: dread d7/dd/d17/d23/d37/d5c/fc3 [0,4194304] 0 2024-04-25T16:24:04.872 INFO:tasks.workunit.client.0.smithi059.stdout:5/767: dwrite d1/dcd/d44/d79/f90 [0,4194304] 0 2024-04-25T16:24:04.873 INFO:tasks.workunit.client.0.smithi059.stdout:1/754: chown d7/d2a/db8/cd8 132984366 1 2024-04-25T16:24:04.958 INFO:tasks.workunit.client.0.smithi059.stdout:7/693: creat d0/d7/d51/da9/db3/d33/d4c/d4e/fdc x:0 0 0 2024-04-25T16:24:05.010 INFO:tasks.workunit.client.0.smithi059.stdout:4/689: dread d0/d4/df/d1c/d45/f60 [0,4194304] 0 2024-04-25T16:24:05.089 INFO:tasks.workunit.client.0.smithi059.stdout:2/709: rename de/d5a/d9a/de9/lf5 to de/d5a/lfe 0 2024-04-25T16:24:05.099 INFO:tasks.workunit.client.0.smithi059.stdout:2/710: dread - de/da1/fb0 zero size 2024-04-25T16:24:05.106 INFO:tasks.workunit.client.0.smithi059.stdout:2/711: chown de/d5a 105772545 1 2024-04-25T16:24:05.115 INFO:tasks.workunit.client.0.smithi059.stdout:2/712: chown de/d5a/d7d/d80 7 1 2024-04-25T16:24:05.169 INFO:tasks.workunit.client.0.smithi059.stdout:9/728: creat d6/d35/fd4 x:0 0 0 2024-04-25T16:24:05.200 INFO:tasks.workunit.client.0.smithi059.stdout:6/770: dread - d9/d16/d53/d6c/da6/dc6/de3/fe9 zero size 2024-04-25T16:24:05.276 INFO:tasks.workunit.client.0.smithi059.stdout:3/763: write d0/db/d3f/d6c/fa5 [348527,33821] 0 2024-04-25T16:24:05.329 INFO:tasks.workunit.client.0.smithi059.stdout:5/768: unlink d1/d48/da3/l8c 0 2024-04-25T16:24:05.445 INFO:tasks.workunit.client.0.smithi059.stdout:2/713: creat de/da1/fff x:0 0 0 2024-04-25T16:24:05.491 INFO:tasks.workunit.client.0.smithi059.stdout:0/692: dwrite dc/fc7 [0,4194304] 0 2024-04-25T16:24:05.602 INFO:tasks.workunit.client.0.smithi059.stdout:7/694: truncate d0/d7/f7c 274744 0 2024-04-25T16:24:05.605 INFO:tasks.workunit.client.0.smithi059.stdout:8/676: dread d7/dd/d17/d23/f2a [0,4194304] 0 2024-04-25T16:24:05.622 INFO:tasks.workunit.client.0.smithi059.stdout:6/771: truncate d9/d27/d68/fa0 510785 0 2024-04-25T16:24:05.637 INFO:tasks.workunit.client.0.smithi059.stdout:9/729: read d6/d35/d2f/d39/f4f [388432,83795] 0 2024-04-25T16:24:05.661 INFO:tasks.workunit.client.0.smithi059.stdout:3/764: mknod d0/db/d3f/dce/dec/c106 0 2024-04-25T16:24:05.671 INFO:tasks.workunit.client.0.smithi059.stdout:6/772: readlink d9/d16/l3a 0 2024-04-25T16:24:05.694 INFO:tasks.workunit.client.0.smithi059.stdout:9/730: chown d6/d35/fd4 3464 1 2024-04-25T16:24:05.701 INFO:tasks.workunit.client.0.smithi059.stdout:8/677: chown d7/dd/d17/d23/d37/d5c/f7c 1 1 2024-04-25T16:24:05.736 INFO:tasks.workunit.client.0.smithi059.stdout:9/731: dread - d6/d35/d6c/f6d zero size 2024-04-25T16:24:05.769 INFO:tasks.workunit.client.0.smithi059.stdout:9/732: chown d6/d4e/f8a 470 1 2024-04-25T16:24:05.802 INFO:tasks.workunit.client.0.smithi059.stdout:1/755: unlink d7/fc 0 2024-04-25T16:24:05.929 INFO:tasks.workunit.client.0.smithi059.stdout:5/769: mknod d1/dcd/d50/d8a/cfc 0 2024-04-25T16:24:05.976 INFO:tasks.workunit.client.0.smithi059.stdout:2/714: unlink de/d2a/c64 0 2024-04-25T16:24:06.075 INFO:tasks.workunit.client.0.smithi059.stdout:2/715: sync 2024-04-25T16:24:06.091 INFO:tasks.workunit.client.0.smithi059.stdout:0/693: mknod dc/d37/d47/d60/cdf 0 2024-04-25T16:24:06.159 INFO:tasks.workunit.client.0.smithi059.stdout:3/765: rename d0/db/d3f/cd0 to d0/db/d2d/d7a/c107 0 2024-04-25T16:24:06.273 INFO:tasks.workunit.client.0.smithi059.stdout:7/695: truncate d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/f6e 1600905 0 2024-04-25T16:24:06.367 INFO:tasks.workunit.client.0.smithi059.stdout:9/733: fsync d6/dae/fcc 0 2024-04-25T16:24:06.508 INFO:tasks.workunit.client.0.smithi059.stdout:2/716: mkdir de/d16/d82/da6/d100 0 2024-04-25T16:24:06.521 INFO:tasks.workunit.client.0.smithi059.stdout:6/773: mknod d9/d16/d24/d5d/cf0 0 2024-04-25T16:24:06.531 INFO:tasks.workunit.client.0.smithi059.stdout:2/717: stat de/d5a/d7d 0 2024-04-25T16:24:07.025 INFO:tasks.workunit.client.0.smithi059.stdout:5/770: creat d1/dcd/d44/d79/dda/ffd x:0 0 0 2024-04-25T16:24:07.140 INFO:tasks.workunit.client.0.smithi059.stdout:6/774: creat d9/d27/d39/ff1 x:0 0 0 2024-04-25T16:24:07.203 INFO:tasks.workunit.client.0.smithi059.stdout:4/690: write d0/d4/df/f42 [1947602,31259] 0 2024-04-25T16:24:07.315 INFO:tasks.workunit.client.0.smithi059.stdout:3/766: rename d0/db/d47/f26 to d0/db/d2d/d7a/f108 0 2024-04-25T16:24:07.378 INFO:tasks.workunit.client.0.smithi059.stdout:9/734: symlink d6/d4e/d54/ld5 0 2024-04-25T16:24:07.413 INFO:tasks.workunit.client.0.smithi059.stdout:1/756: mknod d7/d21/d51/cf9 0 2024-04-25T16:24:07.581 INFO:tasks.workunit.client.0.smithi059.stdout:4/691: truncate d0/d4/df/d44/f4f 3495245 0 2024-04-25T16:24:07.746 INFO:tasks.workunit.client.0.smithi059.stdout:9/735: chown d6/d35/d26/d6b/la8 21947843 1 2024-04-25T16:24:07.832 INFO:tasks.workunit.client.0.smithi059.stdout:1/757: chown d7/d2a/d85/db7/d77 1 1 2024-04-25T16:24:07.928 INFO:tasks.workunit.client.0.smithi059.stdout:2/718: fsync de/d2a/d2e/f8b 0 2024-04-25T16:24:08.050 INFO:tasks.workunit.client.0.smithi059.stdout:4/692: creat d0/d4/df/d48/da3/da4/fd3 x:0 0 0 2024-04-25T16:24:08.169 INFO:tasks.workunit.client.0.smithi059.stdout:8/678: dwrite d7/dd/d17/d23/d37/d5c/fc3 [0,4194304] 0 2024-04-25T16:24:08.412 INFO:tasks.workunit.client.0.smithi059.stdout:1/758: truncate d7/d2a/ff2 107203 0 2024-04-25T16:24:08.436 INFO:tasks.workunit.client.0.smithi059.stdout:0/694: dwrite dc/df/d5e/fba [0,4194304] 0 2024-04-25T16:24:08.602 INFO:tasks.workunit.client.0.smithi059.stdout:4/693: dread - d0/d4/df/d1c/d45/d54/d75/d7e/f91 zero size 2024-04-25T16:24:08.692 INFO:tasks.workunit.client.0.smithi059.stdout:8/679: write d7/d2f/d43/f6f [1788586,39219] 0 2024-04-25T16:24:08.758 INFO:tasks.workunit.client.0.smithi059.stdout:9/736: mkdir d6/d35/d26/d6b/dc9/dd6 0 2024-04-25T16:24:08.768 INFO:tasks.workunit.client.0.smithi059.stdout:9/737: dread - d6/d35/fd4 zero size 2024-04-25T16:24:09.129 INFO:tasks.workunit.client.0.smithi059.stdout:3/767: getdents d0/d1e 0 2024-04-25T16:24:09.129 INFO:tasks.workunit.client.0.smithi059.stdout:7/696: rename d0/d7/d51/da9/db3/d33/fc7 to d0/d7/d51/da9/db3/d33/d4c/d4e/fdd 0 2024-04-25T16:24:09.149 INFO:tasks.workunit.client.0.smithi059.stdout:9/738: symlink d6/d4e/d7a/ld7 0 2024-04-25T16:24:09.172 INFO:tasks.workunit.client.0.smithi059.stdout:3/768: stat d0/d1e/d57/dc9/le0 0 2024-04-25T16:24:09.197 INFO:tasks.workunit.client.0.smithi059.stdout:7/697: dread d0/d7/f40 [0,4194304] 0 2024-04-25T16:24:09.222 INFO:tasks.workunit.client.0.smithi059.stdout:3/769: write d0/db/d3f/d6c/fa5 [1475157,21770] 0 2024-04-25T16:24:09.238 INFO:tasks.workunit.client.0.smithi059.stdout:0/695: creat dc/d37/d47/d71/d9c/dca/fe0 x:0 0 0 2024-04-25T16:24:09.515 INFO:tasks.workunit.client.0.smithi059.stdout:5/771: dwrite d1/dcd/d44/d79/f93 [4194304,4194304] 0 2024-04-25T16:24:09.947 INFO:tasks.workunit.client.0.smithi059.stdout:6/775: write d9/d16/d53/d6c/da6/fab [515651,45683] 0 2024-04-25T16:24:09.982 INFO:tasks.workunit.client.0.smithi059.stdout:0/696: creat dc/d37/d47/d81/dd2/fe1 x:0 0 0 2024-04-25T16:24:10.074 INFO:tasks.workunit.client.0.smithi059.stdout:5/772: fdatasync d1/d1e/d27/d66/d70/d75/f95 0 2024-04-25T16:24:10.154 INFO:tasks.workunit.client.0.smithi059.stdout:2/719: write de/d16/d82/fac [4719459,7343] 0 2024-04-25T16:24:10.184 INFO:tasks.workunit.client.0.smithi059.stdout:5/773: sync 2024-04-25T16:24:10.342 INFO:tasks.workunit.client.0.smithi059.stdout:3/770: rename d0/db/feb to d0/db/d47/f109 0 2024-04-25T16:24:10.357 INFO:tasks.workunit.client.0.smithi059.stdout:1/759: dwrite d7/d2a/d85/db7/fa4 [0,4194304] 0 2024-04-25T16:24:10.454 INFO:tasks.workunit.client.0.smithi059.stdout:3/771: readlink d0/db/d3f/d49/l51 0 2024-04-25T16:24:10.557 INFO:tasks.workunit.client.0.smithi059.stdout:4/694: dwrite d0/d4/f35 [0,4194304] 0 2024-04-25T16:24:10.742 INFO:tasks.workunit.client.0.smithi059.stdout:7/698: creat d0/d7/d51/da9/db3/d33/d4c/d4e/fde x:0 0 0 2024-04-25T16:24:10.742 INFO:tasks.workunit.client.0.smithi059.stdout:0/697: mknod dc/df/d5e/dc6/ce2 0 2024-04-25T16:24:10.754 INFO:tasks.workunit.client.0.smithi059.stdout:5/774: rename d1/d1e/d8f to d1/dcd/d44/d79/dda/dfe 0 2024-04-25T16:24:10.878 INFO:tasks.workunit.client.0.smithi059.stdout:1/760: truncate d7/d2a/db8/fd3 759462 0 2024-04-25T16:24:10.905 INFO:tasks.workunit.client.0.smithi059.stdout:8/680: dwrite d7/dd/d17/d23/d37/d5c/d87/d94/d7f/fad [0,4194304] 0 2024-04-25T16:24:11.108 INFO:tasks.workunit.client.0.smithi059.stdout:9/739: dwrite d6/d35/d26/d6b/fc6 [0,4194304] 0 2024-04-25T16:24:11.181 INFO:tasks.workunit.client.0.smithi059.stdout:5/775: fsync d1/dcd/f55 0 2024-04-25T16:24:11.184 INFO:tasks.workunit.client.0.smithi059.stdout:9/740: sync 2024-04-25T16:24:11.302 INFO:tasks.workunit.client.0.smithi059.stdout:0/698: mknod dc/d37/d47/d71/ce3 0 2024-04-25T16:24:11.358 INFO:tasks.workunit.client.0.smithi059.stdout:7/699: unlink d0/d7/d51/da9/db3/d33/d4c/d4e/fdc 0 2024-04-25T16:24:11.409 INFO:tasks.workunit.client.0.smithi059.stdout:3/772: mkdir d0/d1e/d57/da8/dba/d10a 0 2024-04-25T16:24:11.532 INFO:tasks.workunit.client.0.smithi059.stdout:4/695: truncate d0/d4/f56 4373188 0 2024-04-25T16:24:11.667 INFO:tasks.workunit.client.0.smithi059.stdout:8/681: rename d7/dd/c13 to d7/dd/d17/d23/d37/d8b/cdc 0 2024-04-25T16:24:11.948 INFO:tasks.workunit.client.0.smithi059.stdout:9/741: creat d6/d35/d26/fd8 x:0 0 0 2024-04-25T16:24:12.195 INFO:tasks.workunit.client.0.smithi059.stdout:6/776: dwrite d9/f10 [0,4194304] 0 2024-04-25T16:24:12.259 INFO:tasks.workunit.client.0.smithi059.stdout:4/696: fsync d0/d4/df/d1c/d45/d54/d75/d7e/f91 0 2024-04-25T16:24:12.569 INFO:tasks.workunit.client.0.smithi059.stdout:0/699: mkdir dc/dd/d3b/d66/dbb/de4 0 2024-04-25T16:24:12.572 INFO:tasks.workunit.client.0.smithi059.stdout:3/773: symlink d0/l10b 0 2024-04-25T16:24:12.774 INFO:tasks.workunit.client.0.smithi059.stdout:2/720: write de/d5a/fc5 [306976,81370] 0 2024-04-25T16:24:13.044 INFO:tasks.workunit.client.0.smithi059.stdout:1/761: dwrite d7/d2a/d85/db7/d16/f24 [0,4194304] 0 2024-04-25T16:24:13.281 INFO:tasks.workunit.client.0.smithi059.stdout:7/700: write d0/d7/d16/f42 [1059904,58768] 0 2024-04-25T16:24:13.369 INFO:tasks.workunit.client.0.smithi059.stdout:2/721: mkdir de/d16/d3e/d101 0 2024-04-25T16:24:13.428 INFO:tasks.workunit.client.0.smithi059.stdout:5/776: dwrite d1/d1e/d27/f4e [0,4194304] 0 2024-04-25T16:24:13.575 INFO:tasks.workunit.client.0.smithi059.stdout:9/742: dwrite d6/d4e/dba/fbe [0,4194304] 0 2024-04-25T16:24:13.648 INFO:tasks.workunit.client.0.smithi059.stdout:0/700: mkdir dc/d44/d5f/dc2/de5 0 2024-04-25T16:24:13.655 INFO:tasks.workunit.client.0.smithi059.stdout:6/777: mknod d9/d16/cf2 0 2024-04-25T16:24:13.663 INFO:tasks.workunit.client.0.smithi059.stdout:3/774: symlink d0/db/d2d/l10c 0 2024-04-25T16:24:13.884 INFO:tasks.workunit.client.0.smithi059.stdout:0/701: dread dc/d44/f73 [0,4194304] 0 2024-04-25T16:24:14.088 INFO:tasks.workunit.client.0.smithi059.stdout:7/701: mknod d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/cdf 0 2024-04-25T16:24:14.096 INFO:tasks.workunit.client.0.smithi059.stdout:2/722: creat de/d16/d3e/f102 x:0 0 0 2024-04-25T16:24:14.113 INFO:tasks.workunit.client.0.smithi059.stdout:8/682: getdents d7/dd/d17/d23/d37/d5c/d87/d94/d66/daa 0 2024-04-25T16:24:14.166 INFO:tasks.workunit.client.0.smithi059.stdout:7/702: chown d0/d7/d51/da9/db3/d33/d79/l90 1429 1 2024-04-25T16:24:14.380 INFO:tasks.workunit.client.0.smithi059.stdout:1/762: unlink d7/d2a/db8/fd3 0 2024-04-25T16:24:14.388 INFO:tasks.workunit.client.0.smithi059.stdout:3/775: truncate d0/d1e/d31/f40 1087283 0 2024-04-25T16:24:14.443 INFO:tasks.workunit.client.0.smithi059.stdout:1/763: chown d7/d2a/d85/db7/d6a/fde 432021 1 2024-04-25T16:24:14.535 INFO:tasks.workunit.client.0.smithi059.stdout:8/683: chown d7/dd/d17/d23/d37/d5c/d87/d94/d66/cd6 22888934 1 2024-04-25T16:24:14.549 INFO:tasks.workunit.client.0.smithi059.stdout:4/697: dwrite d0/d79/f93 [0,4194304] 0 2024-04-25T16:24:14.625 INFO:tasks.workunit.client.0.smithi059.stdout:9/743: creat d6/d35/d26/d6b/dc9/dd6/fd9 x:0 0 0 2024-04-25T16:24:14.630 INFO:tasks.workunit.client.0.smithi059.stdout:7/703: dread - d0/d3f/f5e zero size 2024-04-25T16:24:14.672 INFO:tasks.workunit.client.0.smithi059.stdout:7/704: chown d0/d7/d16/l6b 27735 1 2024-04-25T16:24:14.770 INFO:tasks.workunit.client.0.smithi059.stdout:6/778: mknod d9/d16/d53/d55/d71/d7e/cf3 0 2024-04-25T16:24:14.788 INFO:tasks.workunit.client.0.smithi059.stdout:6/779: read d9/f10 [3086161,114711] 0 2024-04-25T16:24:14.868 INFO:tasks.workunit.client.0.smithi059.stdout:1/764: mknod d7/d2a/d62/cfa 0 2024-04-25T16:24:14.940 INFO:tasks.workunit.client.0.smithi059.stdout:8/684: mknod d7/d16/d8f/cdd 0 2024-04-25T16:24:15.004 INFO:tasks.workunit.client.0.smithi059.stdout:1/765: sync 2024-04-25T16:24:15.026 INFO:tasks.workunit.client.0.smithi059.stdout:4/698: mkdir d0/d4/df/d1c/d45/d54/dd4 0 2024-04-25T16:24:15.058 INFO:tasks.workunit.client.0.smithi059.stdout:8/685: sync 2024-04-25T16:24:15.063 INFO:tasks.workunit.client.0.smithi059.stdout:9/744: read d6/d4e/d54/d5d/d48/d49/f5c [1443699,74255] 0 2024-04-25T16:24:15.086 INFO:tasks.workunit.client.0.smithi059.stdout:9/745: chown d6/d4e/d54/d5d/d95/ld1 807 1 2024-04-25T16:24:15.292 INFO:tasks.workunit.client.0.smithi059.stdout:7/705: rename d0/d7/f9e to d0/d7/d16/d20/dab/dd5/fe0 0 2024-04-25T16:24:15.347 INFO:tasks.workunit.client.0.smithi059.stdout:0/702: link dc/dd/f9d dc/dd/dbd/fe6 0 2024-04-25T16:24:15.423 INFO:tasks.workunit.client.0.smithi059.stdout:5/777: dwrite d1/dcd/f5d [4194304,4194304] 0 2024-04-25T16:24:15.485 INFO:tasks.workunit.client.0.smithi059.stdout:2/723: link de/d16/fd0 de/d16/d3e/d101/f103 0 2024-04-25T16:24:15.534 INFO:tasks.workunit.client.0.smithi059.stdout:5/778: dread d1/dd/f6e [0,4194304] 0 2024-04-25T16:24:15.671 INFO:tasks.workunit.client.0.smithi059.stdout:1/766: symlink d7/d2a/d62/lfb 0 2024-04-25T16:24:15.774 INFO:tasks.workunit.client.0.smithi059.stdout:8/686: stat d7/dd/d33/d57/c6e 0 2024-04-25T16:24:15.826 INFO:tasks.workunit.client.0.smithi059.stdout:9/746: fdatasync d6/f1b 0 2024-04-25T16:24:15.880 INFO:tasks.workunit.client.0.smithi059.stdout:7/706: symlink d0/d7/dae/le1 0 2024-04-25T16:24:15.900 INFO:tasks.workunit.client.0.smithi059.stdout:7/707: chown d0/d7/d51/da9/db3/d33/d79/d5d/d94/la5 79098956 1 2024-04-25T16:24:16.040 INFO:tasks.workunit.client.0.smithi059.stdout:5/779: mknod d1/d48/d85/dbe/cff 0 2024-04-25T16:24:16.044 INFO:tasks.workunit.client.0.smithi059.stdout:3/776: link d0/db/d3f/d49/d65/ccc d0/db/d47/d7e/ded/c10d 0 2024-04-25T16:24:16.084 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:24:16.088 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:24:16.124 INFO:tasks.workunit.client.0.smithi059.stdout:1/767: mknod d7/d2a/cfc 0 2024-04-25T16:24:16.481 INFO:tasks.workunit.client.0.smithi059.stdout:8/687: rename d7/dd/d17/d23 to d7/d16/d36/dca/dde 0 2024-04-25T16:24:16.530 INFO:tasks.workunit.client.0.smithi059.stdout:9/747: mknod d6/d4e/dba/cda 0 2024-04-25T16:24:16.948 INFO:tasks.workunit.client.0.smithi059.stdout:6/780: creat d9/d1b/d58/ff4 x:0 0 0 2024-04-25T16:24:17.106 INFO:tasks.workunit.client.0.smithi059.stdout:5/780: rmdir d1/dd 39 2024-04-25T16:24:17.231 INFO:tasks.workunit.client.0.smithi059.stdout:3/777: mkdir d0/db/d47/d5b/d10e 0 2024-04-25T16:24:17.240 INFO:tasks.workunit.client.0.smithi059.stdout:1/768: symlink d7/d2a/d85/db7/d77/lfd 0 2024-04-25T16:24:17.262 INFO:tasks.workunit.client.0.smithi059.stdout:3/778: chown d0/db/d47/d5b/c77 15 1 2024-04-25T16:24:17.385 INFO:tasks.workunit.client.0.smithi059.stdout:9/748: creat d6/d35/d26/d6b/fdb x:0 0 0 2024-04-25T16:24:17.410 INFO:tasks.workunit.client.0.smithi059.stdout:2/724: write de/d5a/d9a/fa4 [1263564,17248] 0 2024-04-25T16:24:17.430 INFO:tasks.workunit.client.0.smithi059.stdout:2/725: chown de/d2a/d2e/d36/d2c/d40/f49 414949468 1 2024-04-25T16:24:17.647 INFO:tasks.workunit.client.0.smithi059.stdout:5/781: symlink d1/d1e/d27/d66/d70/d24/l100 0 2024-04-25T16:24:17.725 INFO:tasks.workunit.client.0.smithi059.stdout:1/769: symlink d7/d2a/d85/db7/d16/d7f/dbe/lfe 0 2024-04-25T16:24:17.854 INFO:tasks.workunit.client.0.smithi059.stdout:3/779: mkdir d0/db/d3f/d49/d10f 0 2024-04-25T16:24:18.265 INFO:tasks.workunit.client.0.smithi059.stdout:7/708: dwrite d0/d7/d51/da9/db3/d33/d4c/d4e/fa8 [0,4194304] 0 2024-04-25T16:24:18.634 INFO:tasks.workunit.client.0.smithi059.stdout:6/781: mkdir d9/d16/d24/d97/dc3/df5 0 2024-04-25T16:24:18.636 INFO:tasks.workunit.client.0.smithi059.stdout:0/703: getdents dc/dd/d5c/dbe 0 2024-04-25T16:24:18.638 INFO:tasks.workunit.client.0.smithi059.stdout:5/782: unlink d1/l1f 0 2024-04-25T16:24:18.669 INFO:tasks.workunit.client.0.smithi059.stdout:1/770: chown d7/d2a/d85/db7/d2d/d4a/lda 485934 1 2024-04-25T16:24:18.737 INFO:tasks.workunit.client.0.smithi059.stdout:6/782: dread d9/f4b [0,4194304] 0 2024-04-25T16:24:18.758 INFO:tasks.workunit.client.0.smithi059.stdout:9/749: mkdir d6/d35/d28/dc0/ddc 0 2024-04-25T16:24:18.761 INFO:tasks.workunit.client.0.smithi059.stdout:3/780: creat d0/d1e/d31/f110 x:0 0 0 2024-04-25T16:24:18.779 INFO:tasks.workunit.client.0.smithi059.stdout:8/688: write d7/dd/f9c [390140,4199] 0 2024-04-25T16:24:18.833 INFO:tasks.workunit.client.0.smithi059.stdout:9/750: chown d6/d4e/d54/d5d/f45 102 1 2024-04-25T16:24:18.857 INFO:tasks.workunit.client.0.smithi059.stdout:7/709: mkdir d0/d7/dae/de2 0 2024-04-25T16:24:18.894 INFO:tasks.workunit.client.0.smithi059.stdout:0/704: chown dc/dd/f3c 10 1 2024-04-25T16:24:18.941 INFO:tasks.workunit.client.0.smithi059.stdout:5/783: creat d1/dcd/d44/d79/dda/f101 x:0 0 0 2024-04-25T16:24:19.000 INFO:tasks.workunit.client.0.smithi059.stdout:1/771: mkdir d7/d2a/d85/d8d/dff 0 2024-04-25T16:24:19.359 INFO:tasks.workunit.client.0.smithi059.stdout:6/783: mkdir d9/d16/d24/d5d/d77/df6 0 2024-04-25T16:24:19.363 INFO:tasks.workunit.client.0.smithi059.stdout:8/689: unlink d7/dd/f83 0 2024-04-25T16:24:19.377 INFO:tasks.workunit.client.0.smithi059.stdout:6/784: stat d9/d16/c57 0 2024-04-25T16:24:19.392 INFO:tasks.workunit.client.0.smithi059.stdout:8/690: read d7/d16/fa7 [5598339,63937] 0 2024-04-25T16:24:19.406 INFO:tasks.workunit.client.0.smithi059.stdout:8/691: chown d7/f8e 46978 1 2024-04-25T16:24:19.419 INFO:tasks.workunit.client.0.smithi059.stdout:9/751: mknod d6/d4e/d54/d5d/d95/cdd 0 2024-04-25T16:24:19.731 INFO:tasks.workunit.client.0.smithi059.stdout:1/772: creat d7/d2a/d85/db7/d16/d5c/d74/f100 x:0 0 0 2024-04-25T16:24:19.769 INFO:tasks.workunit.client.0.smithi059.stdout:3/781: symlink d0/db/d2d/d7a/dfa/l111 0 2024-04-25T16:24:19.856 INFO:tasks.workunit.client.0.smithi059.stdout:2/726: write de/d5a/d7d/d80/fad [2127776,68919] 0 2024-04-25T16:24:19.856 INFO:tasks.workunit.client.0.smithi059.stdout:6/785: dread - d9/d16/d24/d97/fba zero size 2024-04-25T16:24:19.868 INFO:tasks.workunit.client.0.smithi059.stdout:4/699: dwrite d0/d4/df/d1c/d45/d54/d75/fa2 [0,4194304] 0 2024-04-25T16:24:19.970 INFO:tasks.workunit.client.0.smithi059.stdout:9/752: read f2 [7163926,63408] 0 2024-04-25T16:24:20.000 INFO:tasks.workunit.client.0.smithi059.stdout:9/753: chown d6/d35/d28 56913 1 2024-04-25T16:24:20.152 INFO:tasks.workunit.client.0.smithi059.stdout:9/754: sync 2024-04-25T16:24:20.310 INFO:tasks.workunit.client.0.smithi059.stdout:1/773: truncate d7/d2a/d85/db7/d77/ff0 522624 0 2024-04-25T16:24:20.324 INFO:tasks.workunit.client.0.smithi059.stdout:2/727: creat de/d5a/d7d/d80/ddb/de3/f104 x:0 0 0 2024-04-25T16:24:20.431 INFO:tasks.workunit.client.0.smithi059.stdout:4/700: rmdir d0/d4/df/d1c/d45/d6f 39 2024-04-25T16:24:20.438 INFO:tasks.workunit.client.0.smithi059.stdout:6/786: creat d9/d16/d24/d5d/d77/ff7 x:0 0 0 2024-04-25T16:24:20.846 INFO:tasks.workunit.client.0.smithi059.stdout:3/782: truncate d0/db/d2d/fab 142206 0 2024-04-25T16:24:20.850 INFO:tasks.workunit.client.0.smithi059.stdout:8/692: rmdir d7/d16/d36/dca/dde/d37/d5c/d78 0 2024-04-25T16:24:20.912 INFO:tasks.workunit.client.0.smithi059.stdout:0/705: write dc/df/d24/f39 [3332653,74136] 0 2024-04-25T16:24:20.927 INFO:tasks.workunit.client.0.smithi059.stdout:5/784: write d1/dcd/d44/d79/d92/f97 [371686,13435] 0 2024-04-25T16:24:20.980 INFO:tasks.workunit.client.0.smithi059.stdout:6/787: read d9/d27/f84 [4108104,49389] 0 2024-04-25T16:24:21.086 INFO:tasks.workunit.client.0.smithi059.stdout:7/710: dwrite d0/d7/f40 [0,4194304] 0 2024-04-25T16:24:21.181 INFO:tasks.workunit.client.0.smithi059.stdout:7/711: chown d0/d3f/f6a 43 1 2024-04-25T16:24:21.325 INFO:tasks.workunit.client.0.smithi059.stdout:6/788: fdatasync d9/d1b/d58/d49/fd4 0 2024-04-25T16:24:21.406 INFO:tasks.workunit.client.0.smithi059.stdout:8/693: truncate d7/d2f/f4a 2375970 0 2024-04-25T16:24:21.571 INFO:tasks.workunit.client.0.smithi059.stdout:6/789: dread d9/d1b/f6b [4194304,4194304] 0 2024-04-25T16:24:21.660 INFO:tasks.workunit.client.0.smithi059.stdout:9/755: write d6/d35/d28/f5b [6193290,92958] 0 2024-04-25T16:24:21.664 INFO:tasks.workunit.client.0.smithi059.stdout:8/694: creat d7/d16/da3/fdf x:0 0 0 2024-04-25T16:24:21.705 INFO:tasks.workunit.client.0.smithi059.stdout:4/701: write d0/d4/df/d1c/f85 [328006,131065] 0 2024-04-25T16:24:21.724 INFO:tasks.workunit.client.0.smithi059.stdout:4/702: readlink d0/d4/df/d1c/d45/l89 0 2024-04-25T16:24:21.886 INFO:tasks.workunit.client.0.smithi059.stdout:5/785: rename d1/d48/d85/dbe/cff to d1/d1e/d27/d66/c102 0 2024-04-25T16:24:21.891 INFO:tasks.workunit.client.0.smithi059.stdout:2/728: write de/d2a/d2e/f30 [2649259,78600] 0 2024-04-25T16:24:22.195 INFO:tasks.workunit.client.0.smithi059.stdout:1/774: write d7/d2a/d85/db7/d16/d7f/dbe/fd5 [4265334,54244] 0 2024-04-25T16:24:22.226 INFO:tasks.workunit.client.0.smithi059.stdout:0/706: write dc/df/d5e/f8c [1683028,43736] 0 2024-04-25T16:24:22.384 INFO:tasks.workunit.client.0.smithi059.stdout:3/783: getdents d0/db/d3f/d89/db3 0 2024-04-25T16:24:22.426 INFO:tasks.workunit.client.0.smithi059.stdout:4/703: symlink d0/d4/df/d48/d5f/ld5 0 2024-04-25T16:24:22.485 INFO:tasks.workunit.client.0.smithi059.stdout:6/790: write d9/d16/d24/f3c [4616237,24141] 0 2024-04-25T16:24:22.604 INFO:tasks.workunit.client.0.smithi059.stdout:5/786: read d1/d1e/d27/d66/d70/d75/fdd [83365,43398] 0 2024-04-25T16:24:22.733 INFO:tasks.workunit.client.0.smithi059.stdout:8/695: mkdir d7/d16/de0 0 2024-04-25T16:24:22.834 INFO:tasks.workunit.client.0.smithi059.stdout:3/784: creat d0/d1e/d57/f112 x:0 0 0 2024-04-25T16:24:22.909 INFO:tasks.workunit.client.0.smithi059.stdout:4/704: symlink d0/d4/df/d48/da3/da4/ld6 0 2024-04-25T16:24:23.036 INFO:tasks.workunit.client.0.smithi059.stdout:4/705: dread d0/d4/df/d44/f46 [0,4194304] 0 2024-04-25T16:24:23.214 INFO:tasks.workunit.client.0.smithi059.stdout:8/696: readlink d7/l51 0 2024-04-25T16:24:23.449 INFO:tasks.workunit.client.0.smithi059.stdout:7/712: rename d0/d7/d51/da9/fbb to d0/d7/d51/da9/db3/d33/d79/d5d/fe3 0 2024-04-25T16:24:23.467 INFO:tasks.workunit.client.0.smithi059.stdout:9/756: write d6/d4e/f8a [4882942,28495] 0 2024-04-25T16:24:23.562 INFO:tasks.workunit.client.0.smithi059.stdout:0/707: link dc/d37/cb4 dc/d37/d47/d71/ce7 0 2024-04-25T16:24:23.723 INFO:tasks.workunit.client.0.smithi059.stdout:9/757: stat d6/d4e/d54/l77 0 2024-04-25T16:24:23.808 INFO:tasks.workunit.client.0.smithi059.stdout:1/775: dwrite d7/d2a/d85/d8d/faf [0,4194304] 0 2024-04-25T16:24:23.911 INFO:tasks.workunit.client.0.smithi059.stdout:8/697: creat d7/d16/d36/dca/dde/d37/d5c/d87/d94/d7f/dcb/fe1 x:0 0 0 2024-04-25T16:24:23.974 INFO:tasks.workunit.client.0.smithi059.stdout:2/729: rename de/c3c to de/d16/d82/da6/c105 0 2024-04-25T16:24:24.124 INFO:tasks.workunit.client.0.smithi059.stdout:6/791: getdents d9/d16/d24/d97/dc3 0 2024-04-25T16:24:24.431 INFO:tasks.workunit.client.0.smithi059.stdout:5/787: write d1/d1e/d27/fbd [156525,112455] 0 2024-04-25T16:24:24.501 INFO:tasks.workunit.client.0.smithi059.stdout:3/785: rename d0/db/d3f/d49/la1 to d0/d1e/d57/da8/dba/d10a/l113 0 2024-04-25T16:24:24.582 INFO:tasks.workunit.client.0.smithi059.stdout:9/758: mkdir d6/d35/dde 0 2024-04-25T16:24:24.614 INFO:tasks.workunit.client.0.smithi059.stdout:5/788: dread d1/d1e/d27/d66/d70/f61 [0,4194304] 0 2024-04-25T16:24:24.621 INFO:tasks.workunit.client.0.smithi059.stdout:6/792: creat d9/d16/d53/d55/ff8 x:0 0 0 2024-04-25T16:24:24.657 INFO:tasks.workunit.client.0.smithi059.stdout:6/793: chown d9/f72 38923790 1 2024-04-25T16:24:24.773 INFO:tasks.workunit.client.0.smithi059.stdout:9/759: dread d6/d35/d2f/d39/f4f [0,4194304] 0 2024-04-25T16:24:24.797 INFO:tasks.workunit.client.0.smithi059.stdout:7/713: rename d0/d7/d16/f42 to d0/d7/d16/d5a/fe4 0 2024-04-25T16:24:24.855 INFO:tasks.workunit.client.0.smithi059.stdout:3/786: mkdir d0/db/d2d/d7a/d114 0 2024-04-25T16:24:24.913 INFO:tasks.workunit.client.0.smithi059.stdout:5/789: creat d1/d1e/d27/d66/d70/f103 x:0 0 0 2024-04-25T16:24:25.160 INFO:tasks.workunit.client.0.smithi059.stdout:9/760: creat d6/d35/d28/fdf x:0 0 0 2024-04-25T16:24:25.237 INFO:tasks.workunit.client.0.smithi059.stdout:4/706: dwrite d0/d4/df/d48/da9/fbd [8388608,4194304] 0 2024-04-25T16:24:25.241 INFO:tasks.workunit.client.0.smithi059.stdout:0/708: rename dc/d37/d47/l55 to dc/dd/d5c/le8 0 2024-04-25T16:24:25.332 INFO:tasks.workunit.client.0.smithi059.stdout:4/707: chown d0/d4/df/f42 2389920 1 2024-04-25T16:24:25.571 INFO:tasks.workunit.client.0.smithi059.stdout:1/776: link d7/d21/d51/da6/fdd d7/d2a/d85/db7/d77/da3/f101 0 2024-04-25T16:24:25.671 INFO:tasks.workunit.client.0.smithi059.stdout:7/714: mkdir d0/de5 0 2024-04-25T16:24:25.780 INFO:tasks.workunit.client.0.smithi059.stdout:9/761: creat d6/d35/d2f/d39/fe0 x:0 0 0 2024-04-25T16:24:25.842 INFO:tasks.workunit.client.0.smithi059.stdout:0/709: creat dc/d37/d47/d60/d6e/fe9 x:0 0 0 2024-04-25T16:24:25.861 INFO:tasks.workunit.client.0.smithi059.stdout:0/710: read dc/df/d24/f2e [125009,35756] 0 2024-04-25T16:24:25.934 INFO:tasks.workunit.client.0.smithi059.stdout:4/708: dread - d0/d79/fcd zero size 2024-04-25T16:24:26.035 INFO:tasks.workunit.client.0.smithi059.stdout:6/794: creat d9/d27/ff9 x:0 0 0 2024-04-25T16:24:26.074 INFO:tasks.workunit.client.0.smithi059.stdout:8/698: dwrite d7/d16/d36/dca/dde/d37/d5c/d87/d94/d66/daa/fcc [0,4194304] 0 2024-04-25T16:24:26.612 INFO:tasks.workunit.client.0.smithi059.stdout:7/715: fdatasync d0/d7/d51/da9/db3/d33/d79/d5d/d94/fd6 0 2024-04-25T16:24:26.670 INFO:tasks.workunit.client.0.smithi059.stdout:9/762: symlink d6/d35/d26/le1 0 2024-04-25T16:24:26.672 INFO:tasks.workunit.client.0.smithi059.stdout:2/730: write de/d2a/da7/fdc [1815660,41012] 0 2024-04-25T16:24:26.679 INFO:tasks.workunit.client.0.smithi059.stdout:3/787: write d0/db/d47/d5b/f8c [471970,45749] 0 2024-04-25T16:24:26.691 INFO:tasks.workunit.client.0.smithi059.stdout:0/711: creat dc/df/d5e/fea x:0 0 0 2024-04-25T16:24:26.720 INFO:tasks.workunit.client.0.smithi059.stdout:6/795: truncate d9/d1b/f8e 3444312 0 2024-04-25T16:24:26.733 INFO:tasks.workunit.client.0.smithi059.stdout:0/712: readlink l8 0 2024-04-25T16:24:26.746 INFO:tasks.workunit.client.0.smithi059.stdout:4/709: chown d0/d4/df/c38 39639085 1 2024-04-25T16:24:26.828 INFO:tasks.workunit.client.0.smithi059.stdout:6/796: write d9/d16/d24/d97/f9c [3010782,80336] 0 2024-04-25T16:24:26.951 INFO:tasks.workunit.client.0.smithi059.stdout:7/716: creat d0/d7/dae/fe6 x:0 0 0 2024-04-25T16:24:27.028 INFO:tasks.workunit.client.0.smithi059.stdout:3/788: dread d0/d1e/f32 [0,4194304] 0 2024-04-25T16:24:27.092 INFO:tasks.workunit.client.0.smithi059.stdout:5/790: dwrite d1/dcd/d44/fe3 [0,4194304] 0 2024-04-25T16:24:27.593 INFO:tasks.workunit.client.0.smithi059.stdout:4/710: creat d0/d4/df/d74/fd7 x:0 0 0 2024-04-25T16:24:27.756 INFO:tasks.workunit.client.0.smithi059.stdout:3/789: creat d0/db/d3f/d49/d65/dae/f115 x:0 0 0 2024-04-25T16:24:27.774 INFO:tasks.workunit.client.0.smithi059.stdout:5/791: read d1/d48/d85/fb0 [1679968,8694] 0 2024-04-25T16:24:27.790 INFO:tasks.workunit.client.0.smithi059.stdout:1/777: write d7/de5/f73 [1094629,54638] 0 2024-04-25T16:24:27.834 INFO:tasks.workunit.client.0.smithi059.stdout:1/778: dread d7/d2a/d85/db7/d16/f50 [0,4194304] 0 2024-04-25T16:24:27.876 INFO:tasks.workunit.client.0.smithi059.stdout:3/790: sync 2024-04-25T16:24:28.024 INFO:tasks.workunit.client.0.smithi059.stdout:2/731: mknod de/d2a/d33/c106 0 2024-04-25T16:24:28.078 INFO:tasks.workunit.client.0.smithi059.stdout:2/732: dread de/d2a/d33/f7e [4194304,4194304] 0 2024-04-25T16:24:28.087 INFO:tasks.workunit.client.0.smithi059.stdout:2/733: readlink de/da1/ld2 0 2024-04-25T16:24:28.477 INFO:tasks.workunit.client.0.smithi059.stdout:5/792: creat d1/dcd/f104 x:0 0 0 2024-04-25T16:24:28.481 INFO:tasks.workunit.client.0.smithi059.stdout:8/699: getdents d7/d16/d36/dca/dde/d37/d5c/d87/d94/d66/daa/dbd 0 2024-04-25T16:24:28.513 INFO:tasks.workunit.client.0.smithi059.stdout:1/779: mkdir d7/de5/d102 0 2024-04-25T16:24:28.517 INFO:tasks.workunit.client.0.smithi059.stdout:3/791: rmdir d0/db/d47/d7e 39 2024-04-25T16:24:28.668 INFO:tasks.workunit.client.0.smithi059.stdout:2/734: symlink de/d5a/d9a/de9/l107 0 2024-04-25T16:24:28.746 INFO:tasks.workunit.client.0.smithi059.stdout:4/711: mknod d0/d4/df/d1c/d45/cd8 0 2024-04-25T16:24:28.794 INFO:tasks.workunit.client.0.smithi059.stdout:9/763: write d6/d35/d26/d6b/fc6 [3446036,115742] 0 2024-04-25T16:24:28.852 INFO:tasks.workunit.client.0.smithi059.stdout:6/797: getdents d9 0 2024-04-25T16:24:28.859 INFO:tasks.workunit.client.0.smithi059.stdout:4/712: dread d0/d4/df/d48/da9/fbd [4194304,4194304] 0 2024-04-25T16:24:28.894 INFO:tasks.workunit.client.0.smithi059.stdout:5/793: rename d1/dcd/fbc to d1/d48/d85/dbe/dde/f105 0 2024-04-25T16:24:28.983 INFO:tasks.workunit.client.0.smithi059.stdout:8/700: symlink d7/d16/d36/dca/dde/d37/d5c/d87/d94/d66/le2 0 2024-04-25T16:24:28.992 INFO:tasks.workunit.client.0.smithi059.stdout:8/701: readlink d7/d16/d3a/la1 0 2024-04-25T16:24:29.091 INFO:tasks.workunit.client.0.smithi059.stdout:3/792: mkdir d0/d1e/d57/d116 0 2024-04-25T16:24:29.295 INFO:tasks.workunit.client.0.smithi059.stdout:7/717: getdents d0/d7/d51/da9/db3/d33/d79/d5d/db7 0 2024-04-25T16:24:29.417 INFO:tasks.workunit.client.0.smithi059.stdout:2/735: truncate de/d2a/d2e/f30 4029678 0 2024-04-25T16:24:29.662 INFO:tasks.workunit.client.0.smithi059.stdout:0/713: dwrite dc/d37/d47/d60/d6e/f8a [0,4194304] 0 2024-04-25T16:24:29.978 INFO:tasks.workunit.client.0.smithi059.stdout:1/780: rename d7/d2a/d85/db7/d16/c78 to d7/de5/d102/c103 0 2024-04-25T16:24:30.009 INFO:tasks.workunit.client.0.smithi059.stdout:3/793: creat d0/db/d2d/de4/f117 x:0 0 0 2024-04-25T16:24:30.068 INFO:tasks.workunit.client.0.smithi059.stdout:8/702: dread d7/d16/d36/dca/dde/f64 [0,4194304] 0 2024-04-25T16:24:30.092 INFO:tasks.workunit.client.0.smithi059.stdout:8/703: read d7/d16/d36/fa6 [666438,104735] 0 2024-04-25T16:24:30.510 INFO:tasks.workunit.client.0.smithi059.stdout:5/794: rename d1/d1e/d27/d66/d70/d75/daa/ce1 to d1/dcd/d50/d8a/c106 0 2024-04-25T16:24:30.520 INFO:tasks.workunit.client.0.smithi059.stdout:5/795: chown d1/d48/d85/dbe 513375 1 2024-04-25T16:24:30.528 INFO:tasks.workunit.client.0.smithi059.stdout:5/796: read - d1/dcd/f104 zero size 2024-04-25T16:24:30.592 INFO:tasks.workunit.client.0.smithi059.stdout:1/781: read d7/d2a/d85/db7/d16/d5c/f70 [998095,24480] 0 2024-04-25T16:24:30.633 INFO:tasks.workunit.client.0.smithi059.stdout:8/704: rmdir d7/dd/d17/db4 39 2024-04-25T16:24:30.647 INFO:tasks.workunit.client.0.smithi059.stdout:8/705: dread - d7/d16/d36/dca/dde/f71 zero size 2024-04-25T16:24:30.667 INFO:tasks.workunit.client.0.smithi059.stdout:9/764: write d6/d35/fd4 [419854,119847] 0 2024-04-25T16:24:30.697 INFO:tasks.workunit.client.0.smithi059.stdout:6/798: link d9/d27/d39/f86 d9/d16/d53/d74/ffa 0 2024-04-25T16:24:30.817 INFO:tasks.workunit.client.0.smithi059.stdout:4/713: dwrite d0/d4/df/d1c/f8d [0,4194304] 0 2024-04-25T16:24:30.889 INFO:tasks.workunit.client.0.smithi059.stdout:2/736: creat de/f108 x:0 0 0 2024-04-25T16:24:30.892 INFO:tasks.workunit.client.0.smithi059.stdout:8/706: dread d7/d16/d36/dca/dde/d37/f44 [0,4194304] 0 2024-04-25T16:24:30.931 INFO:tasks.workunit.client.0.smithi059.stdout:1/782: unlink d7/d21/d51/cf9 0 2024-04-25T16:24:30.964 INFO:tasks.workunit.client.0.smithi059.stdout:5/797: fdatasync d1/dcd/d50/fa2 0 2024-04-25T16:24:31.254 INFO:tasks.workunit.client.0.smithi059.stdout:7/718: write d0/d7/d51/da9/db3/d33/d4c/d4e/f77 [3334289,117805] 0 2024-04-25T16:24:31.393 INFO:tasks.workunit.client.0.smithi059.stdout:4/714: stat d0/d4/df/d48/d5f/fc9 0 2024-04-25T16:24:31.411 INFO:tasks.workunit.client.0.smithi059.stdout:4/715: chown d0/d4/df/d1c/d45/d54/d75/d82/fc7 10 1 2024-04-25T16:24:31.496 INFO:tasks.workunit.client.0.smithi059.stdout:2/737: chown de/d2a/d2e/d36/d2c/d40/f75 37161 1 2024-04-25T16:24:31.615 INFO:tasks.workunit.client.0.smithi059.stdout:5/798: creat d1/dcd/d44/d79/f107 x:0 0 0 2024-04-25T16:24:31.788 INFO:tasks.workunit.client.0.smithi059.stdout:3/794: link d0/c23 d0/db/d3f/d49/d65/dae/c118 0 2024-04-25T16:24:31.805 INFO:tasks.workunit.client.0.smithi059.stdout:9/765: write d6/d35/d2f/f4d [1436322,75094] 0 2024-04-25T16:24:31.921 INFO:tasks.workunit.client.0.smithi059.stdout:6/799: dwrite d9/d16/d24/d97/fcf [0,4194304] 0 2024-04-25T16:24:31.988 INFO:tasks.workunit.client.0.smithi059.stdout:7/719: creat d0/d7/d51/da9/db3/d33/d79/fe7 x:0 0 0 2024-04-25T16:24:31.994 INFO:tasks.workunit.client.0.smithi059.stdout:4/716: creat d0/d79/fd9 x:0 0 0 2024-04-25T16:24:32.100 INFO:tasks.workunit.client.0.smithi059.stdout:7/720: sync 2024-04-25T16:24:32.122 INFO:tasks.workunit.client.0.smithi059.stdout:7/721: dread - d0/d7/d51/da9/db3/d33/d79/d5d/fa6 zero size 2024-04-25T16:24:32.324 INFO:tasks.workunit.client.0.smithi059.stdout:0/714: link dc/df/d24/l67 dc/df/d24/leb 0 2024-04-25T16:24:32.372 INFO:tasks.workunit.client.0.smithi059.stdout:8/707: write d7/d16/da3/fbc [711782,61742] 0 2024-04-25T16:24:32.608 INFO:tasks.workunit.client.0.smithi059.stdout:2/738: creat de/d2a/d2e/d36/d2c/d40/de5/f109 x:0 0 0 2024-04-25T16:24:32.626 INFO:tasks.workunit.client.0.smithi059.stdout:2/739: read de/d2a/d2e/d36/f25 [293704,70981] 0 2024-04-25T16:24:32.763 INFO:tasks.workunit.client.0.smithi059.stdout:9/766: creat d6/d4e/d54/d5d/d95/fe2 x:0 0 0 2024-04-25T16:24:33.370 INFO:tasks.workunit.client.0.smithi059.stdout:6/800: mknod d9/d16/d53/d74/cfb 0 2024-04-25T16:24:33.376 INFO:tasks.workunit.client.0.smithi059.stdout:7/722: mkdir d0/d7/d51/da9/db3/d33/dc6/de8 0 2024-04-25T16:24:33.467 INFO:tasks.workunit.client.0.smithi059.stdout:6/801: sync 2024-04-25T16:24:33.545 INFO:tasks.workunit.client.0.smithi059.stdout:2/740: rmdir de/d2a/d2e 39 2024-04-25T16:24:33.641 INFO:tasks.workunit.client.0.smithi059.stdout:9/767: fdatasync d6/d4e/d54/f62 0 2024-04-25T16:24:33.892 INFO:tasks.workunit.client.0.smithi059.stdout:4/717: creat d0/d4/df/d1c/d45/d54/dd4/fda x:0 0 0 2024-04-25T16:24:33.907 INFO:tasks.workunit.client.0.smithi059.stdout:4/718: chown d0/d4/df/d48/d5f/ld5 5189 1 2024-04-25T16:24:34.139 INFO:tasks.workunit.client.0.smithi059.stdout:5/799: link d1/d48/c76 d1/d48/d85/dbe/dde/c108 0 2024-04-25T16:24:34.266 INFO:tasks.workunit.client.0.smithi059.stdout:9/768: mkdir d6/d35/d26/d6b/de3 0 2024-04-25T16:24:34.358 INFO:tasks.workunit.client.0.smithi059.stdout:3/795: dwrite d0/db/f19 [0,4194304] 0 2024-04-25T16:24:34.471 INFO:tasks.workunit.client.0.smithi059.stdout:6/802: symlink d9/d27/lfc 0 2024-04-25T16:24:34.547 INFO:tasks.workunit.client.0.smithi059.stdout:7/723: dread d0/d7/d51/da9/db3/d33/d79/d5d/fe3 [4194304,4194304] 0 2024-04-25T16:24:34.566 INFO:tasks.workunit.client.0.smithi059.stdout:5/800: symlink d1/d1e/d27/d66/d70/d24/l109 0 2024-04-25T16:24:34.628 INFO:tasks.workunit.client.0.smithi059.stdout:0/715: getdents dc/d44/d5f 0 2024-04-25T16:24:34.688 INFO:tasks.workunit.client.0.smithi059.stdout:8/708: link d7/d16/d36/dca/dde/d37/d5c/d87/d94/d7f/dcb/fe1 d7/fe3 0 2024-04-25T16:24:34.703 INFO:tasks.workunit.client.0.smithi059.stdout:0/716: readlink dc/df/l1c 0 2024-04-25T16:24:34.710 INFO:tasks.workunit.client.0.smithi059.stdout:5/801: chown d1/d1e/d27/d66/d70/d24 56617 1 2024-04-25T16:24:34.746 INFO:tasks.workunit.client.0.smithi059.stdout:9/769: unlink d6/d35/d26/c41 0 2024-04-25T16:24:34.746 INFO:tasks.workunit.client.0.smithi059.stdout:4/719: dread d0/d4/df/d1c/d45/d54/d75/d82/f8e [0,4194304] 0 2024-04-25T16:24:34.836 INFO:tasks.workunit.client.0.smithi059.stdout:8/709: dread - d7/d16/d36/dca/dde/d37/f82 zero size 2024-04-25T16:24:34.904 INFO:tasks.workunit.client.0.smithi059.stdout:7/724: dread d0/d7/fa [12582912,4194304] 0 2024-04-25T16:24:34.917 INFO:tasks.workunit.client.0.smithi059.stdout:7/725: chown d0/d7/d16/d5a/fd1 1239 1 2024-04-25T16:24:35.082 INFO:tasks.workunit.client.0.smithi059.stdout:1/783: rename d7/de5/d8f/l81 to d7/l104 0 2024-04-25T16:24:35.091 INFO:tasks.workunit.client.0.smithi059.stdout:1/784: stat d7/d2a/d85/db7/d77 0 2024-04-25T16:24:35.219 INFO:tasks.workunit.client.0.smithi059.stdout:3/796: mknod d0/db/d2d/d7a/c119 0 2024-04-25T16:24:35.289 INFO:tasks.workunit.client.0.smithi059.stdout:2/741: truncate de/d2a/d2e/d36/d2c/d40/f47 705474 0 2024-04-25T16:24:35.402 INFO:tasks.workunit.client.0.smithi059.stdout:9/770: read d6/d35/d28/f50 [1963925,65074] 0 2024-04-25T16:24:35.527 INFO:tasks.workunit.client.0.smithi059.stdout:7/726: dread - d0/d7/d51/da9/db3/fb2 zero size 2024-04-25T16:24:35.643 INFO:tasks.workunit.client.0.smithi059.stdout:1/785: truncate d7/d2a/f67 17494 0 2024-04-25T16:24:35.815 INFO:tasks.workunit.client.0.smithi059.stdout:6/803: creat d9/d1b/ffd x:0 0 0 2024-04-25T16:24:35.902 INFO:tasks.workunit.client.0.smithi059.stdout:9/771: creat d6/d35/d26/d6b/fe4 x:0 0 0 2024-04-25T16:24:36.002 INFO:tasks.workunit.client.0.smithi059.stdout:8/710: fdatasync d7/dd/d17/db4/d7e/da5/fc9 0 2024-04-25T16:24:36.033 INFO:tasks.workunit.client.0.smithi059.stdout:7/727: dread - d0/d7/d16/d20/d71/fcf zero size 2024-04-25T16:24:36.093 INFO:tasks.workunit.client.0.smithi059.stdout:1/786: unlink d7/d2a/d62/lfb 0 2024-04-25T16:24:36.118 INFO:tasks.workunit.client.0.smithi059.stdout:3/797: mkdir d0/db/d47/d5b/d102/d11a 0 2024-04-25T16:24:36.235 INFO:tasks.workunit.client.0.smithi059.stdout:6/804: dread d9/d16/d53/d6c/da6/fc2 [0,4194304] 0 2024-04-25T16:24:36.239 INFO:tasks.workunit.client.0.smithi059.stdout:9/772: mknod d6/d35/d26/d6b/ce5 0 2024-04-25T16:24:36.522 INFO:tasks.workunit.client.0.smithi059.stdout:5/802: write d1/d1e/d27/d66/d70/fc7 [1006800,130091] 0 2024-04-25T16:24:36.539 INFO:tasks.workunit.client.0.smithi059.stdout:5/803: chown d1/d48/d85/cc9 12158 1 2024-04-25T16:24:36.634 INFO:tasks.workunit.client.0.smithi059.stdout:4/720: write d0/d4/df/d48/da3/fbb [63787,79253] 0 2024-04-25T16:24:36.659 INFO:tasks.workunit.client.0.smithi059.stdout:4/721: stat d0/d4/df/d1c/d45/d54/d75/f80 0 2024-04-25T16:24:36.692 INFO:tasks.workunit.client.0.smithi059.stdout:3/798: dread d0/db/d2d/d7a/f108 [0,4194304] 0 2024-04-25T16:24:36.720 INFO:tasks.workunit.client.0.smithi059.stdout:0/717: getdents dc/d37/d47 0 2024-04-25T16:24:36.875 INFO:tasks.workunit.client.0.smithi059.stdout:9/773: write d6/d35/fd4 [694951,28697] 0 2024-04-25T16:24:36.891 INFO:tasks.workunit.client.0.smithi059.stdout:9/774: stat d6/d4e/d54/ld5 0 2024-04-25T16:24:36.910 INFO:tasks.workunit.client.0.smithi059.stdout:9/775: read d6/f1b [1279376,76603] 0 2024-04-25T16:24:37.204 INFO:tasks.workunit.client.0.smithi059.stdout:1/787: fsync d7/de5/f5d 0 2024-04-25T16:24:37.269 INFO:tasks.workunit.client.0.smithi059.stdout:4/722: truncate d0/d4/df/d74/f78 111086 0 2024-04-25T16:24:37.327 INFO:tasks.workunit.client.0.smithi059.stdout:0/718: fsync dc/dd/d3b/fd3 0 2024-04-25T16:24:37.340 INFO:tasks.workunit.client.0.smithi059.stdout:0/719: read - dc/dd/d3b/f7d zero size 2024-04-25T16:24:37.421 INFO:tasks.workunit.client.0.smithi059.stdout:8/711: write d7/d2f/fa8 [737144,71940] 0 2024-04-25T16:24:37.484 INFO:tasks.workunit.client.0.smithi059.stdout:9/776: symlink d6/d4e/d54/d5d/d95/le6 0 2024-04-25T16:24:37.526 INFO:tasks.workunit.client.0.smithi059.stdout:8/712: sync 2024-04-25T16:24:38.146 INFO:tasks.workunit.client.0.smithi059.stdout:0/720: symlink dc/d37/d47/d81/dd2/lec 0 2024-04-25T16:24:38.235 INFO:tasks.workunit.client.0.smithi059.stdout:5/804: dwrite d1/dcd/d44/d79/dda/f101 [0,4194304] 0 2024-04-25T16:24:38.239 INFO:tasks.workunit.client.0.smithi059.stdout:6/805: dwrite d9/d16/d24/d97/f9c [0,4194304] 0 2024-04-25T16:24:38.299 INFO:tasks.workunit.client.0.smithi059.stdout:9/777: symlink d6/d4e/dba/le7 0 2024-04-25T16:24:38.370 INFO:tasks.workunit.client.0.smithi059.stdout:5/805: readlink d1/l33 0 2024-04-25T16:24:38.386 INFO:tasks.workunit.client.0.smithi059.stdout:9/778: chown d6/d4e/d7a/ccb 10 1 2024-04-25T16:24:38.496 INFO:tasks.workunit.client.0.smithi059.stdout:9/779: dread d6/d35/fd4 [0,4194304] 0 2024-04-25T16:24:38.585 INFO:tasks.workunit.client.0.smithi059.stdout:5/806: dread d1/d1e/f37 [4194304,4194304] 0 2024-04-25T16:24:38.892 INFO:tasks.workunit.client.0.smithi059.stdout:3/799: link d0/db/d47/d98/ff1 d0/db/d2d/de1/df2/f11b 0 2024-04-25T16:24:39.777 INFO:tasks.workunit.client.0.smithi059.stdout:1/788: write d7/d2a/d85/db7/d2d/fca [532403,14922] 0 2024-04-25T16:24:39.794 INFO:tasks.workunit.client.0.smithi059.stdout:2/742: rename de/d2a/d2e/d6a/ca9 to de/c10a 0 2024-04-25T16:24:39.798 INFO:tasks.workunit.client.0.smithi059.stdout:4/723: write d0/d4/df/d74/f78 [909522,75706] 0 2024-04-25T16:24:39.808 INFO:tasks.workunit.client.0.smithi059.stdout:0/721: link dc/df/d24/l34 dc/d44/led 0 2024-04-25T16:24:39.831 INFO:tasks.workunit.client.0.smithi059.stdout:3/800: unlink d0/db/d47/c83 0 2024-04-25T16:24:39.926 INFO:tasks.workunit.client.0.smithi059.stdout:9/780: getdents d6/d35/d28 0 2024-04-25T16:24:40.006 INFO:tasks.workunit.client.0.smithi059.stdout:6/806: dwrite d9/f21 [0,4194304] 0 2024-04-25T16:24:40.074 INFO:tasks.workunit.client.0.smithi059.stdout:7/728: rename d0/d7/d51/da9/db3/d33/d79/cc9 to d0/d7/d51/da9/db3/d33/d79/d5d/dcb/dd4/ce9 0 2024-04-25T16:24:40.111 INFO:tasks.workunit.client.0.smithi059.stdout:7/729: dread - d0/d7/d51/da9/db3/fb2 zero size 2024-04-25T16:24:40.232 INFO:tasks.workunit.client.0.smithi059.stdout:4/724: mkdir d0/d4/df/d74/ddb 0 2024-04-25T16:24:40.234 INFO:tasks.workunit.client.0.smithi059.stdout:0/722: creat dc/d44/d5f/dc2/fee x:0 0 0 2024-04-25T16:24:40.235 INFO:tasks.workunit.client.0.smithi059.stdout:9/781: rmdir d6/dae/dc3 39 2024-04-25T16:24:40.273 INFO:tasks.workunit.client.0.smithi059.stdout:4/725: chown d0/d4/df/d1c/d45/f27 72801 1 2024-04-25T16:24:40.564 INFO:tasks.workunit.client.0.smithi059.stdout:8/713: rename d7/d16/d36/dca/dde/d38/f7b to d7/d16/d36/dca/fe4 0 2024-04-25T16:24:40.582 INFO:tasks.workunit.client.0.smithi059.stdout:6/807: fdatasync d9/d1b/d58/ff4 0 2024-04-25T16:24:40.593 INFO:tasks.workunit.client.0.smithi059.stdout:3/801: creat d0/db/d3f/d6c/dea/de9/f11c x:0 0 0 2024-04-25T16:24:40.661 INFO:tasks.workunit.client.0.smithi059.stdout:6/808: chown d9/d16/d53/d6c/ca1 1 1 2024-04-25T16:24:40.738 INFO:tasks.workunit.client.0.smithi059.stdout:2/743: dwrite de/d16/d3e/f4f [0,4194304] 0 2024-04-25T16:24:40.854 INFO:tasks.workunit.client.0.smithi059.stdout:4/726: rmdir d0 39 2024-04-25T16:24:40.908 INFO:tasks.workunit.client.0.smithi059.stdout:1/789: dwrite d7/f26 [0,4194304] 0 2024-04-25T16:24:40.990 INFO:tasks.workunit.client.0.smithi059.stdout:1/790: chown d7/d2a/d85/db7/d6a/ld2 216 1 2024-04-25T16:24:41.007 INFO:tasks.workunit.client.0.smithi059.stdout:7/730: symlink d0/d7/d51/da9/db3/d33/d79/d5d/lea 0 2024-04-25T16:24:41.100 INFO:tasks.workunit.client.0.smithi059.stdout:9/782: write d6/d4e/fb4 [22946,39174] 0 2024-04-25T16:24:41.121 INFO:tasks.workunit.client.0.smithi059.stdout:9/783: chown d6/d4e/d54/f8b 19755307 1 2024-04-25T16:24:41.248 INFO:tasks.workunit.client.0.smithi059.stdout:0/723: dwrite dc/dd/f3c [0,4194304] 0 2024-04-25T16:24:41.410 INFO:tasks.workunit.client.0.smithi059.stdout:8/714: dwrite d7/dd/d17/db4/d7e/fc1 [0,4194304] 0 2024-04-25T16:24:41.621 INFO:tasks.workunit.client.0.smithi059.stdout:5/807: rename d1/d48/d85/dbe/dde/f105 to d1/dcd/d50/d8a/f10a 0 2024-04-25T16:24:41.652 INFO:tasks.workunit.client.0.smithi059.stdout:3/802: symlink d0/d1e/d57/d116/l11d 0 2024-04-25T16:24:41.711 INFO:tasks.workunit.client.0.smithi059.stdout:7/731: dread d0/d3f/faf [0,4194304] 0 2024-04-25T16:24:41.822 INFO:tasks.workunit.client.0.smithi059.stdout:8/715: creat d7/d2f/d76/fe5 x:0 0 0 2024-04-25T16:24:41.953 INFO:tasks.workunit.client.0.smithi059.stdout:4/727: unlink d0/d4/df/d1c/d45/l89 0 2024-04-25T16:24:41.961 INFO:tasks.workunit.client.0.smithi059.stdout:5/808: creat d1/d1e/d27/d66/d70/f10b x:0 0 0 2024-04-25T16:24:42.049 INFO:tasks.workunit.client.0.smithi059.stdout:7/732: fdatasync d0/d7/d51/da9/db3/fb2 0 2024-04-25T16:24:42.420 INFO:tasks.workunit.client.0.smithi059.stdout:1/791: write d7/d21/f7c [1721961,90874] 0 2024-04-25T16:24:42.511 INFO:tasks.workunit.client.0.smithi059.stdout:9/784: write d6/f1b [788308,111326] 0 2024-04-25T16:24:42.512 INFO:tasks.workunit.client.0.smithi059.stdout:2/744: rename de/f96 to de/d2a/d2e/de1/f10b 0 2024-04-25T16:24:42.534 INFO:tasks.workunit.client.0.smithi059.stdout:2/745: stat de/d2a/d33/f7e 0 2024-04-25T16:24:42.639 INFO:tasks.workunit.client.0.smithi059.stdout:4/728: unlink d0/d4/df/d48/c96 0 2024-04-25T16:24:42.661 INFO:tasks.workunit.client.0.smithi059.stdout:8/716: dread d7/d2f/f4a [0,4194304] 0 2024-04-25T16:24:42.846 INFO:tasks.workunit.client.0.smithi059.stdout:5/809: dread d1/d1e/d27/d66/d70/fdf [0,4194304] 0 2024-04-25T16:24:42.904 INFO:tasks.workunit.client.0.smithi059.stdout:6/809: dwrite d9/d16/d53/fb9 [0,4194304] 0 2024-04-25T16:24:43.205 INFO:tasks.workunit.client.0.smithi059.stdout:9/785: truncate d6/d35/d2f/d39/f4f 3972082 0 2024-04-25T16:24:43.398 INFO:tasks.workunit.client.0.smithi059.stdout:8/717: truncate d7/d2f/d76/fd0 29260 0 2024-04-25T16:24:43.506 INFO:tasks.workunit.client.0.smithi059.stdout:0/724: unlink dc/f36 0 2024-04-25T16:24:43.517 INFO:tasks.workunit.client.0.smithi059.stdout:8/718: sync 2024-04-25T16:24:43.520 INFO:tasks.workunit.client.0.smithi059.stdout:6/810: chown d9/d27/d39/f88 488512898 1 2024-04-25T16:24:43.569 INFO:tasks.workunit.client.0.smithi059.stdout:1/792: dread d7/d93/fb3 [0,4194304] 0 2024-04-25T16:24:43.669 INFO:tasks.workunit.client.0.smithi059.stdout:9/786: creat d6/d35/d28/fe8 x:0 0 0 2024-04-25T16:24:43.853 INFO:tasks.workunit.client.0.smithi059.stdout:4/729: truncate d0/d4/df/d48/f6c 928137 0 2024-04-25T16:24:43.860 INFO:tasks.workunit.client.0.smithi059.stdout:0/725: creat dc/df/d5e/dc6/fef x:0 0 0 2024-04-25T16:24:43.880 INFO:tasks.workunit.client.0.smithi059.stdout:6/811: symlink d9/d27/d39/d7b/lfe 0 2024-04-25T16:24:43.951 INFO:tasks.workunit.client.0.smithi059.stdout:6/812: sync 2024-04-25T16:24:44.026 INFO:tasks.workunit.client.0.smithi059.stdout:6/813: sync 2024-04-25T16:24:44.047 INFO:tasks.workunit.client.0.smithi059.stdout:1/793: dread d7/f28 [0,4194304] 0 2024-04-25T16:24:44.125 INFO:tasks.workunit.client.0.smithi059.stdout:8/719: symlink d7/d16/d36/dca/dde/d37/d5c/d87/le6 0 2024-04-25T16:24:44.137 INFO:tasks.workunit.client.0.smithi059.stdout:8/720: stat d7/d16/d36/dca/dde/d37 0 2024-04-25T16:24:44.199 INFO:tasks.workunit.client.0.smithi059.stdout:0/726: mkdir dc/df0 0 2024-04-25T16:24:44.348 INFO:tasks.workunit.client.0.smithi059.stdout:8/721: creat d7/dd/fe7 x:0 0 0 2024-04-25T16:24:44.487 INFO:tasks.workunit.client.0.smithi059.stdout:1/794: symlink d7/d2a/d85/db7/d2d/d4a/l105 0 2024-04-25T16:24:44.490 INFO:tasks.workunit.client.0.smithi059.stdout:0/727: mknod dc/d44/d5f/d72/cf1 0 2024-04-25T16:24:44.826 INFO:tasks.workunit.client.0.smithi059.stdout:7/733: unlink d0/d7/fd0 0 2024-04-25T16:24:44.906 INFO:tasks.workunit.client.0.smithi059.stdout:2/746: rename de/d2a/d2e/l50 to de/d16/d7f/l10c 0 2024-04-25T16:24:44.934 INFO:tasks.workunit.client.0.smithi059.stdout:3/803: write d0/d1e/d95/f103 [859141,121527] 0 2024-04-25T16:24:44.982 INFO:tasks.workunit.client.0.smithi059.stdout:0/728: symlink dc/d37/d47/d81/dd2/lf2 0 2024-04-25T16:24:45.155 INFO:tasks.workunit.client.0.smithi059.stdout:1/795: truncate d7/d2a/d85/db7/d16/d5c/d74/da7/ff3 465576 0 2024-04-25T16:24:45.165 INFO:tasks.workunit.client.0.smithi059.stdout:7/734: creat d0/d7/d16/d20/feb x:0 0 0 2024-04-25T16:24:45.217 INFO:tasks.workunit.client.0.smithi059.stdout:1/796: chown d7/d2a/d85/db7/d77/da3/cf4 1149154 1 2024-04-25T16:24:45.268 INFO:tasks.workunit.client.0.smithi059.stdout:3/804: mkdir d0/d1e/d95/d11e 0 2024-04-25T16:24:45.308 INFO:tasks.workunit.client.0.smithi059.stdout:0/729: rmdir dc/dd/d3b 39 2024-04-25T16:24:45.374 INFO:tasks.workunit.client.0.smithi059.stdout:7/735: dread d0/d7/d51/da9/db3/d33/d79/f7b [0,4194304] 0 2024-04-25T16:24:45.577 INFO:tasks.workunit.client.0.smithi059.stdout:2/747: symlink de/d2a/d33/d65/l10d 0 2024-04-25T16:24:45.693 INFO:tasks.workunit.client.0.smithi059.stdout:9/787: dwrite d6/d4e/d54/f8b [0,4194304] 0 2024-04-25T16:24:45.802 INFO:tasks.workunit.client.0.smithi059.stdout:3/805: unlink d0/db/d2d/l10c 0 2024-04-25T16:24:45.849 INFO:tasks.workunit.client.0.smithi059.stdout:6/814: write d9/d16/fb6 [80437,90947] 0 2024-04-25T16:24:45.868 INFO:tasks.workunit.client.0.smithi059.stdout:6/815: read d9/f23 [366013,78323] 0 2024-04-25T16:24:46.160 INFO:tasks.workunit.client.0.smithi059.stdout:3/806: mkdir d0/d1e/d11f 0 2024-04-25T16:24:46.167 INFO:tasks.workunit.client.0.smithi059.stdout:4/730: unlink d0/d4/c3f 0 2024-04-25T16:24:46.174 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:24:46.176 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:24:46.177 INFO:tasks.workunit.client.0.smithi059.stdout:5/810: rename d1/fa to d1/d1e/dca/f10c 0 2024-04-25T16:24:46.182 INFO:tasks.workunit.client.0.smithi059.stdout:8/722: write d7/d16/d36/dca/dde/f63 [4781434,48002] 0 2024-04-25T16:24:46.264 INFO:tasks.workunit.client.0.smithi059.stdout:6/816: read d9/d16/d24/d97/fcf [13566,60908] 0 2024-04-25T16:24:46.457 INFO:tasks.workunit.client.0.smithi059.stdout:1/797: write d7/de5/f73 [3140507,30332] 0 2024-04-25T16:24:46.581 INFO:tasks.workunit.client.0.smithi059.stdout:7/736: dwrite d0/d7/f10 [0,4194304] 0 2024-04-25T16:24:46.763 INFO:tasks.workunit.client.0.smithi059.stdout:2/748: dwrite de/f108 [0,4194304] 0 2024-04-25T16:24:46.824 INFO:tasks.workunit.client.0.smithi059.stdout:2/749: chown de/d5a 8018742 1 2024-04-25T16:24:46.859 INFO:tasks.workunit.client.0.smithi059.stdout:8/723: mknod d7/dd/ce8 0 2024-04-25T16:24:46.938 INFO:tasks.workunit.client.0.smithi059.stdout:9/788: dwrite f2 [0,4194304] 0 2024-04-25T16:24:47.011 INFO:tasks.workunit.client.0.smithi059.stdout:4/731: truncate d0/d4/df/d1c/f6b 974169 0 2024-04-25T16:24:47.013 INFO:tasks.workunit.client.0.smithi059.stdout:3/807: creat d0/db/d2d/de1/f120 x:0 0 0 2024-04-25T16:24:47.032 INFO:tasks.workunit.client.0.smithi059.stdout:1/798: rmdir d7/d2a/d85/db7/d77/da3 39 2024-04-25T16:24:47.045 INFO:tasks.workunit.client.0.smithi059.stdout:0/730: rename dc/df/d24/c6c to dc/dd/d5c/dbe/cf3 0 2024-04-25T16:24:47.106 INFO:tasks.workunit.client.0.smithi059.stdout:6/817: dread d9/d16/d53/d6c/da6/fab [0,4194304] 0 2024-04-25T16:24:47.259 INFO:tasks.workunit.client.0.smithi059.stdout:0/731: dread dc/df/f16 [0,4194304] 0 2024-04-25T16:24:47.406 INFO:tasks.workunit.client.0.smithi059.stdout:2/750: dread - de/d16/d7f/ff6 zero size 2024-04-25T16:24:47.481 INFO:tasks.workunit.client.0.smithi059.stdout:9/789: unlink d6/d4e/d54/d5d/d48/d6e/f9e 0 2024-04-25T16:24:47.511 INFO:tasks.workunit.client.0.smithi059.stdout:2/751: sync 2024-04-25T16:24:47.605 INFO:tasks.workunit.client.0.smithi059.stdout:5/811: rename d1/dcd/d44/d79/dda/ffd to d1/dcd/d50/db8/f10d 0 2024-04-25T16:24:47.746 INFO:tasks.workunit.client.0.smithi059.stdout:3/808: creat d0/db/d3f/d89/dd5/f121 x:0 0 0 2024-04-25T16:24:47.796 INFO:tasks.workunit.client.0.smithi059.stdout:1/799: symlink d7/d2a/d62/l106 0 2024-04-25T16:24:47.841 INFO:tasks.workunit.client.0.smithi059.stdout:6/818: symlink d9/d16/d24/d97/dc3/lff 0 2024-04-25T16:24:48.150 INFO:tasks.workunit.client.0.smithi059.stdout:0/732: mkdir dc/d44/df4 0 2024-04-25T16:24:48.344 INFO:tasks.workunit.client.0.smithi059.stdout:2/752: creat de/d16/d9d/f10e x:0 0 0 2024-04-25T16:24:48.352 INFO:tasks.workunit.client.0.smithi059.stdout:5/812: chown d1/d48/c76 5077 1 2024-04-25T16:24:48.526 INFO:tasks.workunit.client.0.smithi059.stdout:7/737: write d0/d7/d51/da9/db3/d33/d79/d5d/fa6 [507526,39473] 0 2024-04-25T16:24:48.527 INFO:tasks.workunit.client.0.smithi059.stdout:1/800: stat d7/de5/d102/c103 0 2024-04-25T16:24:48.564 INFO:tasks.workunit.client.0.smithi059.stdout:6/819: rmdir d9/d16/d24 39 2024-04-25T16:24:48.673 INFO:tasks.workunit.client.0.smithi059.stdout:8/724: dwrite d7/d2f/f4a [0,4194304] 0 2024-04-25T16:24:48.745 INFO:tasks.workunit.client.0.smithi059.stdout:9/790: symlink d6/d35/d28/dc0/ddc/le9 0 2024-04-25T16:24:48.757 INFO:tasks.workunit.client.0.smithi059.stdout:9/791: chown d6/d35/d28/f69 211255455 1 2024-04-25T16:24:49.013 INFO:tasks.workunit.client.0.smithi059.stdout:5/813: creat d1/d48/d85/dbe/dde/f10e x:0 0 0 2024-04-25T16:24:49.094 INFO:tasks.workunit.client.0.smithi059.stdout:3/809: mknod d0/db/d2d/d7a/d114/c122 0 2024-04-25T16:24:49.380 INFO:tasks.workunit.client.0.smithi059.stdout:4/732: write d0/d4/df/d48/d5f/fc9 [3433177,7370] 0 2024-04-25T16:24:49.795 INFO:tasks.workunit.client.0.smithi059.stdout:0/733: link dc/cb7 dc/d37/cf5 0 2024-04-25T16:24:49.923 INFO:tasks.workunit.client.0.smithi059.stdout:4/733: mknod d0/d4/df/d1c/d45/d54/d75/cdc 0 2024-04-25T16:24:50.061 INFO:tasks.workunit.client.0.smithi059.stdout:2/753: rename de/d5a/d7d/d80/ddb/dfc to de/d5a/d10f 0 2024-04-25T16:24:50.074 INFO:tasks.workunit.client.0.smithi059.stdout:2/754: readlink de/d67/l9f 0 2024-04-25T16:24:50.198 INFO:tasks.workunit.client.0.smithi059.stdout:0/734: truncate dc/d37/d47/d71/d9c/fc8 382545 0 2024-04-25T16:24:50.212 INFO:tasks.workunit.client.0.smithi059.stdout:4/734: truncate d0/d4/df/faa 303732 0 2024-04-25T16:24:50.343 INFO:tasks.workunit.client.0.smithi059.stdout:9/792: creat d6/d35/fea x:0 0 0 2024-04-25T16:24:50.414 INFO:tasks.workunit.client.0.smithi059.stdout:5/814: creat d1/f10f x:0 0 0 2024-04-25T16:24:50.546 INFO:tasks.workunit.client.0.smithi059.stdout:0/735: dread dc/d44/d5f/f7e [0,4194304] 0 2024-04-25T16:24:50.557 INFO:tasks.workunit.client.0.smithi059.stdout:4/735: mknod d0/d4/df/d1c/d45/d54/d75/d7e/d9e/cdd 0 2024-04-25T16:24:50.780 INFO:tasks.workunit.client.0.smithi059.stdout:5/815: mkdir d1/dcd/d110 0 2024-04-25T16:24:51.002 INFO:tasks.workunit.client.0.smithi059.stdout:3/810: rename d0/db/d47/d7e/ded/fee to d0/d1e/d57/d116/f123 0 2024-04-25T16:24:51.011 INFO:tasks.workunit.client.0.smithi059.stdout:1/801: write d7/d2a/d85/db7/d6a/f79 [1955691,71233] 0 2024-04-25T16:24:51.081 INFO:tasks.workunit.client.0.smithi059.stdout:4/736: mkdir d0/d4/df/d48/dde 0 2024-04-25T16:24:51.163 INFO:tasks.workunit.client.0.smithi059.stdout:6/820: dwrite d9/d27/f84 [0,4194304] 0 2024-04-25T16:24:51.265 INFO:tasks.workunit.client.0.smithi059.stdout:8/725: dwrite d7/dd/d33/f41 [0,4194304] 0 2024-04-25T16:24:51.668 INFO:tasks.workunit.client.0.smithi059.stdout:7/738: dwrite d0/d7/d16/d20/dab/dd5/fe0 [0,4194304] 0 2024-04-25T16:24:51.763 INFO:tasks.workunit.client.0.smithi059.stdout:5/816: rename d1/d48/lf6 to d1/dcd/d50/d8a/dd8/l111 0 2024-04-25T16:24:51.773 INFO:tasks.workunit.client.0.smithi059.stdout:9/793: write d6/d35/d2f/f3c [1024918,106134] 0 2024-04-25T16:24:51.838 INFO:tasks.workunit.client.0.smithi059.stdout:8/726: dread - d7/f8e zero size 2024-04-25T16:24:51.990 INFO:tasks.workunit.client.0.smithi059.stdout:7/739: mknod d0/d7/d16/d20/cec 0 2024-04-25T16:24:52.003 INFO:tasks.workunit.client.0.smithi059.stdout:2/755: dwrite de/d16/f43 [0,4194304] 0 2024-04-25T16:24:52.103 INFO:tasks.workunit.client.0.smithi059.stdout:3/811: dread d0/db/f19 [0,4194304] 0 2024-04-25T16:24:52.143 INFO:tasks.workunit.client.0.smithi059.stdout:1/802: rename d7/d2a/cfc to d7/d2a/d85/d8d/c107 0 2024-04-25T16:24:52.181 INFO:tasks.workunit.client.0.smithi059.stdout:2/756: stat de/d16/d82/c90 0 2024-04-25T16:24:52.184 INFO:tasks.workunit.client.0.smithi059.stdout:7/740: fsync d0/d7/f10 0 2024-04-25T16:24:52.193 INFO:tasks.workunit.client.0.smithi059.stdout:0/736: dwrite dc/d37/d47/d71/f94 [4194304,4194304] 0 2024-04-25T16:24:52.328 INFO:tasks.workunit.client.0.smithi059.stdout:7/741: stat d0/d7/c11 0 2024-04-25T16:24:52.336 INFO:tasks.workunit.client.0.smithi059.stdout:6/821: dwrite d9/d27/d39/da5/fd5 [0,4194304] 0 2024-04-25T16:24:52.440 INFO:tasks.workunit.client.0.smithi059.stdout:4/737: getdents d0/d4/df/d1c/d45/d6f/dc4/dd0 0 2024-04-25T16:24:52.473 INFO:tasks.workunit.client.0.smithi059.stdout:6/822: chown d9/d16/d53/d6c/da6/dc6/cea 3 1 2024-04-25T16:24:52.745 INFO:tasks.workunit.client.0.smithi059.stdout:9/794: write d6/d4e/f9f [5011562,53035] 0 2024-04-25T16:24:52.768 INFO:tasks.workunit.client.0.smithi059.stdout:5/817: write d1/d1e/d27/d66/f69 [1236267,64132] 0 2024-04-25T16:24:53.129 INFO:tasks.workunit.client.0.smithi059.stdout:4/738: creat d0/d4/df/d1c/fdf x:0 0 0 2024-04-25T16:24:53.139 INFO:tasks.workunit.client.0.smithi059.stdout:4/739: chown d0/d79/l94 0 1 2024-04-25T16:24:53.173 INFO:tasks.workunit.client.0.smithi059.stdout:7/742: symlink d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/led 0 2024-04-25T16:24:53.225 INFO:tasks.workunit.client.0.smithi059.stdout:6/823: fsync d9/d1b/f7a 0 2024-04-25T16:24:53.379 INFO:tasks.workunit.client.0.smithi059.stdout:2/757: mknod de/d2a/d2e/d36/c110 0 2024-04-25T16:24:53.585 INFO:tasks.workunit.client.0.smithi059.stdout:0/737: creat dc/d44/df4/ff6 x:0 0 0 2024-04-25T16:24:53.589 INFO:tasks.workunit.client.0.smithi059.stdout:9/795: unlink d6/d4e/d54/d5d/d48/f5a 0 2024-04-25T16:24:53.627 INFO:tasks.workunit.client.0.smithi059.stdout:4/740: truncate d0/d4/f35 142098 0 2024-04-25T16:24:53.667 INFO:tasks.workunit.client.0.smithi059.stdout:7/743: unlink d0/d7/d16/d20/l3e 0 2024-04-25T16:24:53.984 INFO:tasks.workunit.client.0.smithi059.stdout:6/824: dread d9/d1b/f73 [0,4194304] 0 2024-04-25T16:24:54.119 INFO:tasks.workunit.client.0.smithi059.stdout:2/758: mknod de/d5a/d9a/de9/dea/c111 0 2024-04-25T16:24:54.256 INFO:tasks.workunit.client.0.smithi059.stdout:5/818: symlink d1/dcd/d44/d79/dda/dfe/dea/l112 0 2024-04-25T16:24:54.337 INFO:tasks.workunit.client.0.smithi059.stdout:9/796: creat d6/d35/d2f/d39/d85/feb x:0 0 0 2024-04-25T16:24:54.422 INFO:tasks.workunit.client.0.smithi059.stdout:3/812: write d0/db/d47/d98/ff1 [675390,54275] 0 2024-04-25T16:24:54.426 INFO:tasks.workunit.client.0.smithi059.stdout:9/797: dread - d6/d35/d2f/fa5 zero size 2024-04-25T16:24:54.456 INFO:tasks.workunit.client.0.smithi059.stdout:7/744: unlink d0/d3f/faf 0 2024-04-25T16:24:54.483 INFO:tasks.workunit.client.0.smithi059.stdout:8/727: getdents d7/d16/d36/dca/dde/d37/d5c/d87/d94/d66 0 2024-04-25T16:24:54.526 INFO:tasks.workunit.client.0.smithi059.stdout:3/813: sync 2024-04-25T16:24:54.558 INFO:tasks.workunit.client.0.smithi059.stdout:0/738: dread dc/d37/d47/d71/d77/f85 [0,4194304] 0 2024-04-25T16:24:54.660 INFO:tasks.workunit.client.0.smithi059.stdout:2/759: mkdir de/d2a/d2e/d36/d2c/d40/d57/d112 0 2024-04-25T16:24:54.736 INFO:tasks.workunit.client.0.smithi059.stdout:5/819: rename d1/d1e/d27/d66/d70/db9 to d1/d1e/dca/d113 0 2024-04-25T16:24:54.809 INFO:tasks.workunit.client.0.smithi059.stdout:1/803: getdents d7/d2a/d85/db7/d2d/d4a 0 2024-04-25T16:24:55.038 INFO:tasks.workunit.client.0.smithi059.stdout:7/745: symlink d0/d7/d16/d5a/lee 0 2024-04-25T16:24:55.067 INFO:tasks.workunit.client.0.smithi059.stdout:0/739: chown dc/c2c 379 1 2024-04-25T16:24:55.111 INFO:tasks.workunit.client.0.smithi059.stdout:9/798: mknod d6/d35/d26/d6b/dc9/cec 0 2024-04-25T16:24:55.183 INFO:tasks.workunit.client.0.smithi059.stdout:8/728: truncate d7/dd/d17/db4/d7e/da5/fc9 339573 0 2024-04-25T16:24:55.258 INFO:tasks.workunit.client.0.smithi059.stdout:6/825: creat d9/d16/d24/d97/f100 x:0 0 0 2024-04-25T16:24:55.374 INFO:tasks.workunit.client.0.smithi059.stdout:2/760: dread de/d5a/d9a/fa4 [0,4194304] 0 2024-04-25T16:24:55.384 INFO:tasks.workunit.client.0.smithi059.stdout:5/820: creat d1/d1e/d27/d66/d70/f114 x:0 0 0 2024-04-25T16:24:55.444 INFO:tasks.workunit.client.0.smithi059.stdout:1/804: chown d7/de5/d8f/l90 2001 1 2024-04-25T16:24:55.501 INFO:tasks.workunit.client.0.smithi059.stdout:7/746: creat d0/d7/d51/da9/db3/d33/d79/d5d/db7/fef x:0 0 0 2024-04-25T16:24:55.848 INFO:tasks.workunit.client.0.smithi059.stdout:3/814: creat d0/db/d47/d5b/d10e/f124 x:0 0 0 2024-04-25T16:24:55.946 INFO:tasks.workunit.client.0.smithi059.stdout:8/729: unlink d7/dd/c27 0 2024-04-25T16:24:56.265 INFO:tasks.workunit.client.0.smithi059.stdout:5/821: fdatasync d1/dcd/d44/f67 0 2024-04-25T16:24:56.456 INFO:tasks.workunit.client.0.smithi059.stdout:7/747: rmdir d0/d7/d16/d20/dab 39 2024-04-25T16:24:56.457 INFO:tasks.workunit.client.0.smithi059.stdout:1/805: creat d7/d2a/d85/db7/d2d/d4a/f108 x:0 0 0 2024-04-25T16:24:56.490 INFO:tasks.workunit.client.0.smithi059.stdout:9/799: creat d6/dae/dc3/fed x:0 0 0 2024-04-25T16:24:56.540 INFO:tasks.workunit.client.0.smithi059.stdout:0/740: truncate dc/dd/d3b/d66/d9b/f70 4000690 0 2024-04-25T16:24:56.586 INFO:tasks.workunit.client.0.smithi059.stdout:6/826: dwrite d9/f10 [0,4194304] 0 2024-04-25T16:24:56.587 INFO:tasks.workunit.client.0.smithi059.stdout:3/815: rmdir d0/db/d2d/de1 39 2024-04-25T16:24:56.778 INFO:tasks.workunit.client.0.smithi059.stdout:2/761: mkdir de/d16/d3e/d101/d113 0 2024-04-25T16:24:56.946 INFO:tasks.workunit.client.0.smithi059.stdout:7/748: symlink d0/d7/dae/lf0 0 2024-04-25T16:24:56.960 INFO:tasks.workunit.client.0.smithi059.stdout:9/800: creat d6/d4e/dba/fee x:0 0 0 2024-04-25T16:24:57.004 INFO:tasks.workunit.client.0.smithi059.stdout:6/827: mknod d9/d27/d39/c101 0 2024-04-25T16:24:57.133 INFO:tasks.workunit.client.0.smithi059.stdout:6/828: sync 2024-04-25T16:24:57.158 INFO:tasks.workunit.client.0.smithi059.stdout:0/741: truncate dc/d37/d47/d81/dd2/fe1 86875 0 2024-04-25T16:24:57.473 INFO:tasks.workunit.client.0.smithi059.stdout:4/741: dread d0/d4/df/f19 [0,4194304] 0 2024-04-25T16:24:57.656 INFO:tasks.workunit.client.0.smithi059.stdout:8/730: creat d7/d16/d36/dca/dde/d37/d5c/d87/d94/fe9 x:0 0 0 2024-04-25T16:24:57.730 INFO:tasks.workunit.client.0.smithi059.stdout:5/822: dwrite d1/d1e/d27/d66/f8b [0,4194304] 0 2024-04-25T16:24:57.794 INFO:tasks.workunit.client.0.smithi059.stdout:9/801: mknod d6/d4e/d54/d5d/d48/d6e/cef 0 2024-04-25T16:24:57.943 INFO:tasks.workunit.client.0.smithi059.stdout:6/829: rename d9/d16/d53/d55/d6e to d9/d16/d24/d97/dc3/df5/d102 0 2024-04-25T16:24:58.194 INFO:tasks.workunit.client.0.smithi059.stdout:3/816: write d0/db/d3f/fc4 [994042,12976] 0 2024-04-25T16:24:58.375 INFO:tasks.workunit.client.0.smithi059.stdout:4/742: truncate d0/d4/df/d1c/d45/d54/d75/fbc 606310 0 2024-04-25T16:24:58.390 INFO:tasks.workunit.client.0.smithi059.stdout:4/743: chown d0/d4/df/d1c/d45/f9b 1571373 1 2024-04-25T16:24:58.550 INFO:tasks.workunit.client.0.smithi059.stdout:8/731: symlink d7/d16/d8f/lea 0 2024-04-25T16:24:58.759 INFO:tasks.workunit.client.0.smithi059.stdout:6/830: creat d9/d1b/d58/d49/db0/f103 x:0 0 0 2024-04-25T16:24:58.848 INFO:tasks.workunit.client.0.smithi059.stdout:5/823: dread d1/dcd/d44/d79/dda/f101 [0,4194304] 0 2024-04-25T16:24:58.857 INFO:tasks.workunit.client.0.smithi059.stdout:3/817: fdatasync d0/db/d47/d5b/f88 0 2024-04-25T16:24:58.910 INFO:tasks.workunit.client.0.smithi059.stdout:2/762: dwrite de/d2a/d2e/fb7 [0,4194304] 0 2024-04-25T16:24:58.943 INFO:tasks.workunit.client.0.smithi059.stdout:3/818: sync 2024-04-25T16:24:58.977 INFO:tasks.workunit.client.0.smithi059.stdout:4/744: creat d0/d4/df/d1c/fe0 x:0 0 0 2024-04-25T16:24:59.099 INFO:tasks.workunit.client.0.smithi059.stdout:7/749: write d0/d7/d51/da9/db3/d33/d79/d5d/d94/fa2 [4863367,98736] 0 2024-04-25T16:24:59.184 INFO:tasks.workunit.client.0.smithi059.stdout:1/806: getdents d7/d2a/d85/db7/dbb 0 2024-04-25T16:24:59.244 INFO:tasks.workunit.client.0.smithi059.stdout:8/732: fsync d7/dd/d17/f4e 0 2024-04-25T16:24:59.358 INFO:tasks.workunit.client.0.smithi059.stdout:6/831: unlink d9/d16/d24/d97/fcf 0 2024-04-25T16:24:59.427 INFO:tasks.workunit.client.0.smithi059.stdout:6/832: sync 2024-04-25T16:24:59.441 INFO:tasks.workunit.client.0.smithi059.stdout:6/833: fdatasync d9/d16/d24/d97/f100 0 2024-04-25T16:24:59.516 INFO:tasks.workunit.client.0.smithi059.stdout:2/763: chown de/d16/f6b 1560039 1 2024-04-25T16:24:59.921 INFO:tasks.workunit.client.0.smithi059.stdout:6/834: fdatasync d9/d16/fb6 0 2024-04-25T16:25:00.098 INFO:tasks.workunit.client.0.smithi059.stdout:5/824: creat d1/dd/f115 x:0 0 0 2024-04-25T16:25:00.123 INFO:tasks.workunit.client.0.smithi059.stdout:3/819: creat d0/d1e/d11f/f125 x:0 0 0 2024-04-25T16:25:00.225 INFO:tasks.workunit.client.0.smithi059.stdout:4/745: creat d0/d4/df/d1c/d45/d54/dd4/fe1 x:0 0 0 2024-04-25T16:25:00.251 INFO:tasks.workunit.client.0.smithi059.stdout:9/802: dwrite d6/d35/d2f/f4d [0,4194304] 0 2024-04-25T16:25:00.383 INFO:tasks.workunit.client.0.smithi059.stdout:9/803: chown d6/d4e/d54/f62 34 1 2024-04-25T16:25:00.434 INFO:tasks.workunit.client.0.smithi059.stdout:0/742: dwrite dc/d44/f50 [0,4194304] 0 2024-04-25T16:25:00.544 INFO:tasks.workunit.client.0.smithi059.stdout:5/825: creat d1/dcd/d44/f116 x:0 0 0 2024-04-25T16:25:00.577 INFO:tasks.workunit.client.0.smithi059.stdout:3/820: dread d0/db/d47/d5b/fc8 [0,4194304] 0 2024-04-25T16:25:00.621 INFO:tasks.workunit.client.0.smithi059.stdout:4/746: mkdir d0/d4/df/d48/da3/de2 0 2024-04-25T16:25:00.690 INFO:tasks.workunit.client.0.smithi059.stdout:8/733: dwrite d7/dd/d17/f4e [0,4194304] 0 2024-04-25T16:25:00.702 INFO:tasks.workunit.client.0.smithi059.stdout:4/747: sync 2024-04-25T16:25:00.764 INFO:tasks.workunit.client.0.smithi059.stdout:9/804: unlink d6/d4e/d54/l70 0 2024-04-25T16:25:01.103 INFO:tasks.workunit.client.0.smithi059.stdout:7/750: dwrite d0/d7/d51/da9/db3/d33/d79/fc4 [0,4194304] 0 2024-04-25T16:25:01.175 INFO:tasks.workunit.client.0.smithi059.stdout:1/807: dwrite d7/d2a/d85/db7/dbb/fdb [0,4194304] 0 2024-04-25T16:25:01.255 INFO:tasks.workunit.client.0.smithi059.stdout:2/764: rename de/d5a/d9a/de9/dea/c111 to de/d2a/d2e/d36/d2c/d40/c114 0 2024-04-25T16:25:01.449 INFO:tasks.workunit.client.0.smithi059.stdout:6/835: dwrite d9/d1b/d58/ff4 [0,4194304] 0 2024-04-25T16:25:01.662 INFO:tasks.workunit.client.0.smithi059.stdout:8/734: dread d7/dd/d33/f41 [0,4194304] 0 2024-04-25T16:25:01.699 INFO:tasks.workunit.client.0.smithi059.stdout:3/821: dread d0/d1e/d57/fc2 [0,4194304] 0 2024-04-25T16:25:01.738 INFO:tasks.workunit.client.0.smithi059.stdout:2/765: chown de/c10a 1765753296 1 2024-04-25T16:25:01.789 INFO:tasks.workunit.client.0.smithi059.stdout:5/826: write d1/d1e/d27/d66/d70/d24/f62 [381355,55016] 0 2024-04-25T16:25:01.789 INFO:tasks.workunit.client.0.smithi059.stdout:0/743: rename dc/d37/d47/d60/d6e to dc/d37/d47/df7 0 2024-04-25T16:25:01.818 INFO:tasks.workunit.client.0.smithi059.stdout:1/808: rmdir d7/d2a/d85/db7/dbb 39 2024-04-25T16:25:01.825 INFO:tasks.workunit.client.0.smithi059.stdout:9/805: dread d6/f18 [0,4194304] 0 2024-04-25T16:25:01.867 INFO:tasks.workunit.client.0.smithi059.stdout:5/827: readlink d1/d1e/d27/d66/d70/d75/deb/lec 0 2024-04-25T16:25:01.892 INFO:tasks.workunit.client.0.smithi059.stdout:5/828: dread - d1/d1e/d27/d66/d70/f22 zero size 2024-04-25T16:25:02.108 INFO:tasks.workunit.client.0.smithi059.stdout:7/751: dwrite d0/d7/d16/f53 [0,4194304] 0 2024-04-25T16:25:02.193 INFO:tasks.workunit.client.0.smithi059.stdout:7/752: chown d0/d7/d51/da9/db3/d33/d79 28487421 1 2024-04-25T16:25:02.282 INFO:tasks.workunit.client.0.smithi059.stdout:9/806: mkdir d6/d35/d26/df0 0 2024-04-25T16:25:02.291 INFO:tasks.workunit.client.0.smithi059.stdout:0/744: rename dc/d37/d47/f75 to dc/d37/d47/d71/d77/dce/ff8 0 2024-04-25T16:25:02.965 INFO:tasks.workunit.client.0.smithi059.stdout:2/766: dwrite fd [0,4194304] 0 2024-04-25T16:25:02.968 INFO:tasks.workunit.client.0.smithi059.stdout:8/735: dwrite d7/d2f/f47 [0,4194304] 0 2024-04-25T16:25:03.091 INFO:tasks.workunit.client.0.smithi059.stdout:3/822: truncate d0/fa 4966748 0 2024-04-25T16:25:03.097 INFO:tasks.workunit.client.0.smithi059.stdout:7/753: mkdir d0/d7/d51/da9/db3/d33/d79/d5d/d85/df1 0 2024-04-25T16:25:03.104 INFO:tasks.workunit.client.0.smithi059.stdout:1/809: mkdir d7/d2a/d85/db7/d6a/d109 0 2024-04-25T16:25:03.500 INFO:tasks.workunit.client.0.smithi059.stdout:8/736: read d7/d16/da3/fbe [357288,119033] 0 2024-04-25T16:25:03.732 INFO:tasks.workunit.client.0.smithi059.stdout:6/836: dwrite d9/d16/f1f [4194304,4194304] 0 2024-04-25T16:25:03.801 INFO:tasks.workunit.client.0.smithi059.stdout:1/810: creat d7/d2a/d85/db7/d16/d5c/d74/f10a x:0 0 0 2024-04-25T16:25:03.867 INFO:tasks.workunit.client.0.smithi059.stdout:4/748: link d0/d4/df/d1c/d45/d54/d75/d7e/d9e/cb9 d0/d4/df/ce3 0 2024-04-25T16:25:03.886 INFO:tasks.workunit.client.0.smithi059.stdout:8/737: read - d7/d16/d36/dca/dde/d38/fd5 zero size 2024-04-25T16:25:04.013 INFO:tasks.workunit.client.0.smithi059.stdout:8/738: dread d7/d16/d36/fa6 [0,4194304] 0 2024-04-25T16:25:04.604 INFO:tasks.workunit.client.0.smithi059.stdout:5/829: creat d1/d1e/f117 x:0 0 0 2024-04-25T16:25:04.611 INFO:tasks.workunit.client.0.smithi059.stdout:3/823: write d0/db/fb6 [313006,126439] 0 2024-04-25T16:25:04.752 INFO:tasks.workunit.client.0.smithi059.stdout:9/807: getdents d6/d35/d26 0 2024-04-25T16:25:04.782 INFO:tasks.workunit.client.0.smithi059.stdout:2/767: link de/d16/l93 de/d2a/d2e/d36/d59/l115 0 2024-04-25T16:25:04.820 INFO:tasks.workunit.client.0.smithi059.stdout:0/745: link dc/d37/d47/d81/dd2/fe1 dc/d44/ff9 0 2024-04-25T16:25:05.119 INFO:tasks.workunit.client.0.smithi059.stdout:5/830: fdatasync d1/f8 0 2024-04-25T16:25:05.167 INFO:tasks.workunit.client.0.smithi059.stdout:7/754: dwrite d0/d7/d16/d20/d71/fd2 [4194304,4194304] 0 2024-04-25T16:25:05.332 INFO:tasks.workunit.client.0.smithi059.stdout:4/749: rename d0/d4/df/d48/da3/ca8 to d0/d4/df/d1c/ce4 0 2024-04-25T16:25:05.332 INFO:tasks.workunit.client.0.smithi059.stdout:3/824: dread - d0/db/d3f/d89/f71 zero size 2024-04-25T16:25:05.340 INFO:tasks.workunit.client.0.smithi059.stdout:8/739: mknod d7/ceb 0 2024-04-25T16:25:05.349 INFO:tasks.workunit.client.0.smithi059.stdout:9/808: mkdir d6/d4e/dba/df1 0 2024-04-25T16:25:05.362 INFO:tasks.workunit.client.0.smithi059.stdout:6/837: write d9/d16/d24/d97/dc3/df5/d102/fed [202836,52398] 0 2024-04-25T16:25:05.407 INFO:tasks.workunit.client.0.smithi059.stdout:4/750: dread - d0/d4/f9f zero size 2024-04-25T16:25:05.431 INFO:tasks.workunit.client.0.smithi059.stdout:6/838: chown d9/d1b/d58/d49/c6f 60936 1 2024-04-25T16:25:05.440 INFO:tasks.workunit.client.0.smithi059.stdout:1/811: write d7/d2a/d85/db7/d6a/dbc/fc1 [533398,17699] 0 2024-04-25T16:25:05.447 INFO:tasks.workunit.client.0.smithi059.stdout:0/746: rmdir dc/dd/d3b 39 2024-04-25T16:25:05.754 INFO:tasks.workunit.client.0.smithi059.stdout:5/831: rename d1/dcd/d44/lc5 to d1/d1e/d27/d66/d70/d24/l118 0 2024-04-25T16:25:05.805 INFO:tasks.workunit.client.0.smithi059.stdout:8/740: fdatasync d7/d2f/d76/d85/fb6 0 2024-04-25T16:25:05.837 INFO:tasks.workunit.client.0.smithi059.stdout:3/825: rmdir d0/db/d3f/dce 39 2024-04-25T16:25:05.911 INFO:tasks.workunit.client.0.smithi059.stdout:4/751: rmdir d0/d4/df/d44 39 2024-04-25T16:25:05.951 INFO:tasks.workunit.client.0.smithi059.stdout:3/826: sync 2024-04-25T16:25:06.007 INFO:tasks.workunit.client.0.smithi059.stdout:6/839: chown d9/d16/d24/d97/dc3/lef 827 1 2024-04-25T16:25:06.113 INFO:tasks.workunit.client.0.smithi059.stdout:7/755: write d0/d7/d16/d20/fc5 [1231889,31253] 0 2024-04-25T16:25:06.659 INFO:tasks.workunit.client.0.smithi059.stdout:2/768: rmdir de/d5a/d7d/d80/ddb/de3/df0 0 2024-04-25T16:25:06.676 INFO:tasks.workunit.client.0.smithi059.stdout:8/741: creat d7/dd/d17/db4/d7e/da5/fec x:0 0 0 2024-04-25T16:25:06.683 INFO:tasks.workunit.client.0.smithi059.stdout:9/809: truncate d6/d35/d2f/d39/f4f 3529540 0 2024-04-25T16:25:06.700 INFO:tasks.workunit.client.0.smithi059.stdout:3/827: unlink d0/db/d2d/de4/de6/le8 0 2024-04-25T16:25:06.714 INFO:tasks.workunit.client.0.smithi059.stdout:0/747: rename dc/c2c to dc/dd/d3b/d66/dbb/cfa 0 2024-04-25T16:25:06.788 INFO:tasks.workunit.client.0.smithi059.stdout:5/832: dread d1/d48/da3/f52 [0,4194304] 0 2024-04-25T16:25:06.955 INFO:tasks.workunit.client.0.smithi059.stdout:6/840: dread d9/d16/d53/d74/ffa [0,4194304] 0 2024-04-25T16:25:06.974 INFO:tasks.workunit.client.0.smithi059.stdout:1/812: dread d7/d2a/d85/db7/d77/da3/fc5 [0,4194304] 0 2024-04-25T16:25:07.074 INFO:tasks.workunit.client.0.smithi059.stdout:8/742: creat d7/d16/d3a/fed x:0 0 0 2024-04-25T16:25:07.075 INFO:tasks.workunit.client.0.smithi059.stdout:0/748: fsync dc/d37/fa3 0 2024-04-25T16:25:07.085 INFO:tasks.workunit.client.0.smithi059.stdout:4/752: read - d0/d4/df/d44/fbe zero size 2024-04-25T16:25:07.529 INFO:tasks.workunit.client.0.smithi059.stdout:5/833: mknod d1/dcd/d50/c119 0 2024-04-25T16:25:07.661 INFO:tasks.workunit.client.0.smithi059.stdout:9/810: truncate d6/d4e/d54/d5d/d48/d49/f7c 3532547 0 2024-04-25T16:25:07.673 INFO:tasks.workunit.client.0.smithi059.stdout:9/811: chown d6/d4e/d54/d5d/f59 14977229 1 2024-04-25T16:25:07.714 INFO:tasks.workunit.client.0.smithi059.stdout:1/813: mknod d7/d21/d51/da6/c10b 0 2024-04-25T16:25:07.724 INFO:tasks.workunit.client.0.smithi059.stdout:1/814: readlink d7/d2a/d85/d8d/lc3 0 2024-04-25T16:25:07.940 INFO:tasks.workunit.client.0.smithi059.stdout:2/769: rename de/d16/c21 to de/d2a/d33/d65/dcf/c116 0 2024-04-25T16:25:07.977 INFO:tasks.workunit.client.0.smithi059.stdout:2/770: dread de/d16/d7f/faf [0,4194304] 0 2024-04-25T16:25:08.003 INFO:tasks.workunit.client.0.smithi059.stdout:0/749: fdatasync dc/df/d24/f6d 0 2024-04-25T16:25:08.105 INFO:tasks.workunit.client.0.smithi059.stdout:8/743: creat d7/d16/d36/dca/dde/d37/d5c/d87/d94/d66/daa/dbd/fee x:0 0 0 2024-04-25T16:25:08.165 INFO:tasks.workunit.client.0.smithi059.stdout:4/753: truncate d0/d4/df/d48/da9/fbd 1906619 0 2024-04-25T16:25:08.221 INFO:tasks.workunit.client.0.smithi059.stdout:4/754: chown d0/d4/df/d1c/fe0 22561 1 2024-04-25T16:25:08.221 INFO:tasks.workunit.client.0.smithi059.stdout:5/834: rmdir d1/dcd 39 2024-04-25T16:25:08.277 INFO:tasks.workunit.client.0.smithi059.stdout:7/756: dwrite d0/f56 [0,4194304] 0 2024-04-25T16:25:08.566 INFO:tasks.workunit.client.0.smithi059.stdout:3/828: rename d0/db/d3f/d49/c94 to d0/db/d3f/d6c/dea/c126 0 2024-04-25T16:25:08.618 INFO:tasks.workunit.client.0.smithi059.stdout:2/771: fdatasync de/d67/f72 0 2024-04-25T16:25:09.080 INFO:tasks.workunit.client.0.smithi059.stdout:5/835: dread d1/d1e/d27/d66/d70/fc7 [0,4194304] 0 2024-04-25T16:25:09.283 INFO:tasks.workunit.client.0.smithi059.stdout:6/841: link d9/d16/d53/d55/d71/d7e/f8a d9/d16/d54/f104 0 2024-04-25T16:25:09.377 INFO:tasks.workunit.client.0.smithi059.stdout:6/842: sync 2024-04-25T16:25:09.690 INFO:tasks.workunit.client.0.smithi059.stdout:5/836: fsync d1/d48/da3/fc8 0 2024-04-25T16:25:09.757 INFO:tasks.workunit.client.0.smithi059.stdout:1/815: write d7/d2a/d85/db7/d16/f50 [1962348,21830] 0 2024-04-25T16:25:09.795 INFO:tasks.workunit.client.0.smithi059.stdout:9/812: rmdir d6/d35/d28/daf 0 2024-04-25T16:25:09.887 INFO:tasks.workunit.client.0.smithi059.stdout:3/829: symlink d0/db/d3f/d49/d10f/l127 0 2024-04-25T16:25:10.392 INFO:tasks.workunit.client.0.smithi059.stdout:0/750: dwrite dc/d37/d47/d71/d9c/dca/fe0 [0,4194304] 0 2024-04-25T16:25:10.551 INFO:tasks.workunit.client.0.smithi059.stdout:3/830: creat d0/d1e/d57/dc9/f128 x:0 0 0 2024-04-25T16:25:10.563 INFO:tasks.workunit.client.0.smithi059.stdout:8/744: dwrite d7/d2f/f4a [0,4194304] 0 2024-04-25T16:25:10.701 INFO:tasks.workunit.client.0.smithi059.stdout:4/755: link d0/d4/df/d1c/d45/d54/d75/d7e/d9e/cb9 d0/d4/df/d48/da3/ce5 0 2024-04-25T16:25:10.941 INFO:tasks.workunit.client.0.smithi059.stdout:7/757: getdents d0/d7/d51/da9/db3/d33/d79/d5d/dcb 0 2024-04-25T16:25:10.945 INFO:tasks.workunit.client.0.smithi059.stdout:1/816: symlink d7/d2a/d85/db7/dbb/dc2/l10c 0 2024-04-25T16:25:10.962 INFO:tasks.workunit.client.0.smithi059.stdout:3/831: truncate d0/db/d3f/d89/dd5/f100 80471 0 2024-04-25T16:25:10.965 INFO:tasks.workunit.client.0.smithi059.stdout:8/745: creat d7/d2f/d76/fef x:0 0 0 2024-04-25T16:25:10.997 INFO:tasks.workunit.client.0.smithi059.stdout:2/772: link de/d2a/d2e/d36/d2c/d40/de5/f109 de/f117 0 2024-04-25T16:25:11.294 INFO:tasks.workunit.client.0.smithi059.stdout:7/758: dread d0/d7/d51/da9/db3/f2e [0,4194304] 0 2024-04-25T16:25:11.368 INFO:tasks.workunit.client.0.smithi059.stdout:8/746: fdatasync d7/dd/d33/f73 0 2024-04-25T16:25:11.374 INFO:tasks.workunit.client.0.smithi059.stdout:1/817: rename d7/d21/l7e to d7/d2a/d85/db7/d16/d7f/dbe/l10d 0 2024-04-25T16:25:11.432 INFO:tasks.workunit.client.0.smithi059.stdout:2/773: creat de/d5a/d9a/de9/dea/f118 x:0 0 0 2024-04-25T16:25:11.588 INFO:tasks.workunit.client.0.smithi059.stdout:7/759: creat d0/d7/d51/ff2 x:0 0 0 2024-04-25T16:25:11.669 INFO:tasks.workunit.client.0.smithi059.stdout:1/818: fdatasync d7/d2a/d85/db7/d6a/fde 0 2024-04-25T16:25:11.682 INFO:tasks.workunit.client.0.smithi059.stdout:1/819: readlink d7/d2a/d85/db7/l57 0 2024-04-25T16:25:11.787 INFO:tasks.workunit.client.0.smithi059.stdout:8/747: rename d7/d16/d36/dca/dde/d37/d5c/d87/d94/lb0 to d7/d16/d36/dca/lf0 0 2024-04-25T16:25:11.881 INFO:tasks.workunit.client.0.smithi059.stdout:2/774: mkdir de/d2a/da7/d119 0 2024-04-25T16:25:12.156 INFO:tasks.workunit.client.0.smithi059.stdout:1/820: truncate d7/d2a/d85/db7/d2d/fca 14252 0 2024-04-25T16:25:12.196 INFO:tasks.workunit.client.0.smithi059.stdout:8/748: truncate d7/dd/faf 86651 0 2024-04-25T16:25:12.218 INFO:tasks.workunit.client.0.smithi059.stdout:6/843: dwrite d9/d16/d24/d97/f9c [4194304,4194304] 0 2024-04-25T16:25:12.219 INFO:tasks.workunit.client.0.smithi059.stdout:8/749: readlink d7/l10 0 2024-04-25T16:25:12.429 INFO:tasks.workunit.client.0.smithi059.stdout:6/844: dread d9/d16/d53/d6c/da6/fbf [0,4194304] 0 2024-04-25T16:25:12.452 INFO:tasks.workunit.client.0.smithi059.stdout:1/821: mkdir d7/d21/d51/d10e 0 2024-04-25T16:25:12.558 INFO:tasks.workunit.client.0.smithi059.stdout:2/775: truncate de/d2a/d2e/d36/d2c/d40/f52 1827512 0 2024-04-25T16:25:12.641 INFO:tasks.workunit.client.0.smithi059.stdout:5/837: write d1/d48/d85/dbe/dde/ff4 [478205,61571] 0 2024-04-25T16:25:12.656 INFO:tasks.workunit.client.0.smithi059.stdout:9/813: write d6/d4e/d54/d5d/d48/f78 [1626171,79729] 0 2024-04-25T16:25:12.817 INFO:tasks.workunit.client.0.smithi059.stdout:2/776: creat de/d16/d82/f11a x:0 0 0 2024-04-25T16:25:12.821 INFO:tasks.workunit.client.0.smithi059.stdout:6/845: symlink d9/d16/d24/d5d/d77/dd2/l105 0 2024-04-25T16:25:12.839 INFO:tasks.workunit.client.0.smithi059.stdout:1/822: mknod d7/d21/d51/d10e/c10f 0 2024-04-25T16:25:12.942 INFO:tasks.workunit.client.0.smithi059.stdout:9/814: creat d6/d4e/d7a/ff2 x:0 0 0 2024-04-25T16:25:13.005 INFO:tasks.workunit.client.0.smithi059.stdout:9/815: dread d6/d4e/d54/d5d/f71 [0,4194304] 0 2024-04-25T16:25:13.090 INFO:tasks.workunit.client.0.smithi059.stdout:0/751: dwrite dc/df/d5e/f8c [0,4194304] 0 2024-04-25T16:25:13.093 INFO:tasks.workunit.client.0.smithi059.stdout:9/816: sync 2024-04-25T16:25:13.225 INFO:tasks.workunit.client.0.smithi059.stdout:0/752: dread dc/dd/d3b/f45 [0,4194304] 0 2024-04-25T16:25:13.416 INFO:tasks.workunit.client.0.smithi059.stdout:3/832: write d0/db/d47/d5b/d10e/f124 [237531,52591] 0 2024-04-25T16:25:13.693 INFO:tasks.workunit.client.0.smithi059.stdout:0/753: symlink dc/dd/d3b/d66/dbb/de4/lfb 0 2024-04-25T16:25:13.774 INFO:tasks.workunit.client.0.smithi059.stdout:0/754: chown dc/dd/d5c/fac 0 1 2024-04-25T16:25:13.822 INFO:tasks.workunit.client.0.smithi059.stdout:4/756: dwrite d0/d4/df/d1c/d45/d54/d75/d82/d8f/fb5 [8388608,4194304] 0 2024-04-25T16:25:14.010 INFO:tasks.workunit.client.0.smithi059.stdout:7/760: dwrite d0/d7/f23 [0,4194304] 0 2024-04-25T16:25:14.228 INFO:tasks.workunit.client.0.smithi059.stdout:8/750: dwrite d7/d2f/d43/f6f [0,4194304] 0 2024-04-25T16:25:14.294 INFO:tasks.workunit.client.0.smithi059.stdout:8/751: sync 2024-04-25T16:25:14.469 INFO:tasks.workunit.client.0.smithi059.stdout:4/757: unlink d0/d4/df/d1c/d45/d54/d75/fa2 0 2024-04-25T16:25:14.709 INFO:tasks.workunit.client.0.smithi059.stdout:8/752: mknod d7/d16/d36/dca/dde/d38/cf1 0 2024-04-25T16:25:14.805 INFO:tasks.workunit.client.0.smithi059.stdout:0/755: unlink dc/d37/d47/d71/f7a 0 2024-04-25T16:25:14.813 INFO:tasks.workunit.client.0.smithi059.stdout:0/756: chown dc/d37/c65 3 1 2024-04-25T16:25:14.855 INFO:tasks.workunit.client.0.smithi059.stdout:4/758: chown d0/d4/df/d48/da3/ce5 46 1 2024-04-25T16:25:15.011 INFO:tasks.workunit.client.0.smithi059.stdout:0/757: creat dc/d37/d47/d60/ffc x:0 0 0 2024-04-25T16:25:15.058 INFO:tasks.workunit.client.0.smithi059.stdout:1/823: dwrite d7/d2a/d85/db7/dbb/fdb [0,4194304] 0 2024-04-25T16:25:15.326 INFO:tasks.workunit.client.0.smithi059.stdout:4/759: fsync d0/d4/df/d1c/d45/f2d 0 2024-04-25T16:25:15.483 INFO:tasks.workunit.client.0.smithi059.stdout:2/777: dwrite de/d16/f8e [0,4194304] 0 2024-04-25T16:25:15.485 INFO:tasks.workunit.client.0.smithi059.stdout:9/817: dwrite d6/d4e/d54/d5d/d48/d49/f7c [0,4194304] 0 2024-04-25T16:25:15.615 INFO:tasks.workunit.client.0.smithi059.stdout:1/824: truncate d7/d2a/d85/db7/f87 341814 0 2024-04-25T16:25:15.619 INFO:tasks.workunit.client.0.smithi059.stdout:0/758: creat dc/dd/d3b/d66/d9b/ffd x:0 0 0 2024-04-25T16:25:15.654 INFO:tasks.workunit.client.0.smithi059.stdout:9/818: stat d6/d4e/d54/d5d/d48/d49/f72 0 2024-04-25T16:25:15.867 INFO:tasks.workunit.client.0.smithi059.stdout:7/761: dwrite d0/d7/d51/da9/db3/d33/d79/d5d/dcb/dd4/fba [0,4194304] 0 2024-04-25T16:25:15.870 INFO:tasks.workunit.client.0.smithi059.stdout:4/760: readlink d0/d4/df/d1c/d45/l1d 0 2024-04-25T16:25:15.930 INFO:tasks.workunit.client.0.smithi059.stdout:3/833: write d0/d1e/d31/dc7/fe5 [481877,18676] 0 2024-04-25T16:25:15.993 INFO:tasks.workunit.client.0.smithi059.stdout:7/762: chown d0/d7/d51/da9/db3/d33/d79/d5d/d94/la5 3723150 1 2024-04-25T16:25:16.045 INFO:tasks.workunit.client.0.smithi059.stdout:9/819: rmdir d6/d4e/d7a 39 2024-04-25T16:25:16.057 INFO:tasks.workunit.client.0.smithi059.stdout:8/753: write d7/dd/d17/f4e [3076583,102706] 0 2024-04-25T16:25:16.236 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:25:16.239 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:25:16.337 INFO:tasks.workunit.client.0.smithi059.stdout:6/846: mkdir d9/d16/d24/d106 0 2024-04-25T16:25:16.434 INFO:tasks.workunit.client.0.smithi059.stdout:3/834: mkdir d0/db/d3f/d49/d129 0 2024-04-25T16:25:16.512 INFO:tasks.workunit.client.0.smithi059.stdout:2/778: symlink de/d16/l11b 0 2024-04-25T16:25:16.561 INFO:tasks.workunit.client.0.smithi059.stdout:0/759: symlink dc/d44/d5f/dc2/de5/lfe 0 2024-04-25T16:25:16.584 INFO:tasks.workunit.client.0.smithi059.stdout:7/763: truncate d0/d7/d51/da9/db3/f4a 1224099 0 2024-04-25T16:25:16.656 INFO:tasks.workunit.client.0.smithi059.stdout:9/820: creat d6/d35/d26/ff3 x:0 0 0 2024-04-25T16:25:16.712 INFO:tasks.workunit.client.0.smithi059.stdout:8/754: creat d7/dd/d17/db4/d7e/da5/ff2 x:0 0 0 2024-04-25T16:25:16.784 INFO:tasks.workunit.client.0.smithi059.stdout:5/838: link d1/d1e/f20 d1/f11a 0 2024-04-25T16:25:16.901 INFO:tasks.workunit.client.0.smithi059.stdout:3/835: chown d0/db/d2d/de1/f120 36 1 2024-04-25T16:25:16.966 INFO:tasks.workunit.client.0.smithi059.stdout:4/761: creat d0/d4/df/d44/dcf/fe6 x:0 0 0 2024-04-25T16:25:17.194 INFO:tasks.workunit.client.0.smithi059.stdout:4/762: dread d0/d4/df/d1c/d45/d54/d75/d82/d8f/fb5 [0,4194304] 0 2024-04-25T16:25:17.318 INFO:tasks.workunit.client.0.smithi059.stdout:5/839: mknod d1/d48/d85/c11b 0 2024-04-25T16:25:17.526 INFO:tasks.workunit.client.0.smithi059.stdout:2/779: fsync de/d2a/d2e/d36/d2c/d40/fcb 0 2024-04-25T16:25:17.701 INFO:tasks.workunit.client.0.smithi059.stdout:1/825: write d7/f9 [3587620,37590] 0 2024-04-25T16:25:17.900 INFO:tasks.workunit.client.0.smithi059.stdout:8/755: mkdir d7/d16/de0/df3 0 2024-04-25T16:25:17.943 INFO:tasks.workunit.client.0.smithi059.stdout:4/763: fsync d0/d4/df/d1c/d45/d54/d75/d82/d8f/fa7 0 2024-04-25T16:25:17.991 INFO:tasks.workunit.client.0.smithi059.stdout:5/840: symlink d1/d1e/d27/l11c 0 2024-04-25T16:25:18.061 INFO:tasks.workunit.client.0.smithi059.stdout:3/836: creat d0/d1e/d31/df0/f12a x:0 0 0 2024-04-25T16:25:18.071 INFO:tasks.workunit.client.0.smithi059.stdout:3/837: chown d0/db/d47/d5b 1 1 2024-04-25T16:25:18.083 INFO:tasks.workunit.client.0.smithi059.stdout:3/838: dread - d0/db/d47/d98/fc0 zero size 2024-04-25T16:25:18.086 INFO:tasks.workunit.client.0.smithi059.stdout:4/764: sync 2024-04-25T16:25:18.103 INFO:tasks.workunit.client.0.smithi059.stdout:3/839: readlink d0/db/d3f/d6c/l104 0 2024-04-25T16:25:18.269 INFO:tasks.workunit.client.0.smithi059.stdout:2/780: rmdir de/d2a/d2e/d36/d2c/d40 39 2024-04-25T16:25:18.371 INFO:tasks.workunit.client.0.smithi059.stdout:9/821: link d6/d35/d6c/fb3 d6/dae/dc3/ff4 0 2024-04-25T16:25:18.413 INFO:tasks.workunit.client.0.smithi059.stdout:6/847: dwrite d9/f10 [0,4194304] 0 2024-04-25T16:25:18.522 INFO:tasks.workunit.client.0.smithi059.stdout:0/760: write dc/d37/d47/d60/f61 [743274,34666] 0 2024-04-25T16:25:18.553 INFO:tasks.workunit.client.0.smithi059.stdout:6/848: stat d9/d16/d24/l45 0 2024-04-25T16:25:18.561 INFO:tasks.workunit.client.0.smithi059.stdout:1/826: dread d7/d2a/d85/db7/d2d/f37 [0,4194304] 0 2024-04-25T16:25:18.902 INFO:tasks.workunit.client.0.smithi059.stdout:2/781: rmdir de/d16/d82/da6 39 2024-04-25T16:25:18.914 INFO:tasks.workunit.client.0.smithi059.stdout:4/765: dread d0/d4/df/d1c/d45/f62 [0,4194304] 0 2024-04-25T16:25:19.014 INFO:tasks.workunit.client.0.smithi059.stdout:9/822: chown d6/d4e/d7a 1303781552 1 2024-04-25T16:25:19.217 INFO:tasks.workunit.client.0.smithi059.stdout:1/827: creat d7/d2a/d85/db7/dbb/db6/f110 x:0 0 0 2024-04-25T16:25:19.441 INFO:tasks.workunit.client.0.smithi059.stdout:3/840: rename d0/db/d2d/f3c to d0/db/d2d/d7a/f12b 0 2024-04-25T16:25:19.539 INFO:tasks.workunit.client.0.smithi059.stdout:5/841: truncate d1/dcd/d44/fe3 4320592 0 2024-04-25T16:25:19.547 INFO:tasks.workunit.client.0.smithi059.stdout:4/766: symlink d0/d4/df/d1c/d45/d54/d75/d7e/d9e/le7 0 2024-04-25T16:25:19.678 INFO:tasks.workunit.client.0.smithi059.stdout:7/764: dwrite d0/d7/fac [0,4194304] 0 2024-04-25T16:25:19.757 INFO:tasks.workunit.client.0.smithi059.stdout:6/849: fsync d9/d16/d53/d6c/da6/fd3 0 2024-04-25T16:25:19.765 INFO:tasks.workunit.client.0.smithi059.stdout:5/842: chown d1/d1e/d27/d66/d70/d24/f38 169 1 2024-04-25T16:25:19.800 INFO:tasks.workunit.client.0.smithi059.stdout:2/782: rename de/d16/d82/f11a to de/d16/d3e/d101/f11c 0 2024-04-25T16:25:19.917 INFO:tasks.workunit.client.0.smithi059.stdout:9/823: truncate d6/fb9 855615 0 2024-04-25T16:25:20.076 INFO:tasks.workunit.client.0.smithi059.stdout:1/828: dread d7/d2a/d85/db7/d2d/d4a/fb5 [0,4194304] 0 2024-04-25T16:25:20.223 INFO:tasks.workunit.client.0.smithi059.stdout:1/829: dread d7/f9 [0,4194304] 0 2024-04-25T16:25:20.242 INFO:tasks.workunit.client.0.smithi059.stdout:1/830: chown d7/d2a/d85/db7/d16/d5c/d74/f100 448 1 2024-04-25T16:25:20.302 INFO:tasks.workunit.client.0.smithi059.stdout:7/765: mkdir d0/d7/d51/da9/db3/d33/d79/d5d/d85/df3 0 2024-04-25T16:25:20.446 INFO:tasks.workunit.client.0.smithi059.stdout:5/843: fsync d1/d1e/d27/d66/d70/d24/fa6 0 2024-04-25T16:25:20.515 INFO:tasks.workunit.client.0.smithi059.stdout:8/756: write d7/dd/f9c [358728,35478] 0 2024-04-25T16:25:20.622 INFO:tasks.workunit.client.0.smithi059.stdout:3/841: rename d0/d1e/d31/cc6 to d0/d1e/d31/dc7/c12c 0 2024-04-25T16:25:20.635 INFO:tasks.workunit.client.0.smithi059.stdout:3/842: stat d0/db/d47/d5b/fc8 0 2024-04-25T16:25:20.805 INFO:tasks.workunit.client.0.smithi059.stdout:1/831: creat d7/d2a/d85/db7/d16/d5c/d74/da7/f111 x:0 0 0 2024-04-25T16:25:20.958 INFO:tasks.workunit.client.0.smithi059.stdout:2/783: fsync de/d2a/d2e/d36/d2c/d40/f75 0 2024-04-25T16:25:21.112 INFO:tasks.workunit.client.0.smithi059.stdout:8/757: read d7/d16/d36/dca/fe4 [903019,120427] 0 2024-04-25T16:25:21.163 INFO:tasks.workunit.client.0.smithi059.stdout:8/758: dread d7/dd/d33/f41 [0,4194304] 0 2024-04-25T16:25:21.166 INFO:tasks.workunit.client.0.smithi059.stdout:9/824: symlink d6/d4e/d54/d5d/lf5 0 2024-04-25T16:25:21.184 INFO:tasks.workunit.client.0.smithi059.stdout:8/759: readlink d7/dd/d17/l1b 0 2024-04-25T16:25:21.578 INFO:tasks.workunit.client.0.smithi059.stdout:2/784: stat de/d16/l24 0 2024-04-25T16:25:21.629 INFO:tasks.workunit.client.0.smithi059.stdout:4/767: getdents d0/d4/df/d1c/d45/d6f/dc4 0 2024-04-25T16:25:21.749 INFO:tasks.workunit.client.0.smithi059.stdout:0/761: dwrite dc/d37/d47/d81/dd2/fe1 [0,4194304] 0 2024-04-25T16:25:21.872 INFO:tasks.workunit.client.0.smithi059.stdout:1/832: getdents d7/d2a/d85/db7/d16/d72/def 0 2024-04-25T16:25:22.010 INFO:tasks.workunit.client.0.smithi059.stdout:6/850: write d9/f79 [7361282,106595] 0 2024-04-25T16:25:22.194 INFO:tasks.workunit.client.0.smithi059.stdout:6/851: dread d9/d16/f26 [0,4194304] 0 2024-04-25T16:25:22.203 INFO:tasks.workunit.client.0.smithi059.stdout:0/762: fdatasync dc/dd/d3b/f45 0 2024-04-25T16:25:22.225 INFO:tasks.workunit.client.0.smithi059.stdout:6/852: chown d9/d16/d24/d5d/d77 72 1 2024-04-25T16:25:22.244 INFO:tasks.workunit.client.0.smithi059.stdout:6/853: chown d9/d16/d53/d55/d71/d7e/dc4/deb 395348 1 2024-04-25T16:25:22.261 INFO:tasks.workunit.client.0.smithi059.stdout:6/854: chown d9/d16/d24/d5d/d77/cd0 10976987 1 2024-04-25T16:25:22.267 INFO:tasks.workunit.client.0.smithi059.stdout:6/855: stat d9/d27/ff9 0 2024-04-25T16:25:22.461 INFO:tasks.workunit.client.0.smithi059.stdout:1/833: rename d7/d2a/d85/db7/d16/d72/fac to d7/d2a/d85/db7/d16/d72/def/f112 0 2024-04-25T16:25:22.606 INFO:tasks.workunit.client.0.smithi059.stdout:2/785: mkdir de/d2a/d2e/d36/d11d 0 2024-04-25T16:25:22.737 INFO:tasks.workunit.client.0.smithi059.stdout:0/763: creat dc/df/d5e/dc6/fff x:0 0 0 2024-04-25T16:25:22.789 INFO:tasks.workunit.client.0.smithi059.stdout:6/856: rmdir d9/d16/d24/d97 39 2024-04-25T16:25:22.943 INFO:tasks.workunit.client.0.smithi059.stdout:0/764: dread dc/d37/d47/d60/f61 [0,4194304] 0 2024-04-25T16:25:23.081 INFO:tasks.workunit.client.0.smithi059.stdout:7/766: dwrite d0/d7/d16/d20/feb [0,4194304] 0 2024-04-25T16:25:23.321 INFO:tasks.workunit.client.0.smithi059.stdout:1/834: dread d7/d2a/d85/db7/d16/d5c/d74/fb4 [0,4194304] 0 2024-04-25T16:25:23.323 INFO:tasks.workunit.client.0.smithi059.stdout:5/844: dwrite d1/f3 [4194304,4194304] 0 2024-04-25T16:25:23.445 INFO:tasks.workunit.client.0.smithi059.stdout:3/843: dwrite d0/d1e/d31/dc7/fda [0,4194304] 0 2024-04-25T16:25:23.522 INFO:tasks.workunit.client.0.smithi059.stdout:8/760: write d7/d16/d36/dca/dde/d37/f44 [3509783,129137] 0 2024-04-25T16:25:23.539 INFO:tasks.workunit.client.0.smithi059.stdout:9/825: write d6/d35/d26/d6b/dc9/dd6/fd9 [841420,78142] 0 2024-04-25T16:25:23.673 INFO:tasks.workunit.client.0.smithi059.stdout:4/768: dwrite d0/d4/df/d48/d5f/fbf [0,4194304] 0 2024-04-25T16:25:23.741 INFO:tasks.workunit.client.0.smithi059.stdout:4/769: chown d0/d4/df/d48/d5f/f6a 802 1 2024-04-25T16:25:23.763 INFO:tasks.workunit.client.0.smithi059.stdout:5/845: fdatasync d1/dcd/d50/d8a/fd3 0 2024-04-25T16:25:23.835 INFO:tasks.workunit.client.0.smithi059.stdout:9/826: rmdir d6/d4e/dba 39 2024-04-25T16:25:24.004 INFO:tasks.workunit.client.0.smithi059.stdout:8/761: mkdir d7/dd/d33/df4 0 2024-04-25T16:25:24.310 INFO:tasks.workunit.client.0.smithi059.stdout:4/770: unlink d0/d4/df/d1c/d45/d54/d75/d7e/lb1 0 2024-04-25T16:25:24.387 INFO:tasks.workunit.client.0.smithi059.stdout:5/846: creat d1/dcd/d44/f11d x:0 0 0 2024-04-25T16:25:24.477 INFO:tasks.workunit.client.0.smithi059.stdout:2/786: write de/d5a/d9a/de9/fb9 [688062,59685] 0 2024-04-25T16:25:24.517 INFO:tasks.workunit.client.0.smithi059.stdout:8/762: symlink d7/dd/d33/lf5 0 2024-04-25T16:25:24.612 INFO:tasks.workunit.client.0.smithi059.stdout:4/771: rmdir d0/d4/df/d1c/d45/d54/d75/d7e 39 2024-04-25T16:25:24.722 INFO:tasks.workunit.client.0.smithi059.stdout:6/857: write d9/d16/d24/f2b [167484,115882] 0 2024-04-25T16:25:24.745 INFO:tasks.workunit.client.0.smithi059.stdout:5/847: read d1/dcd/d50/d8a/f99 [1528784,101561] 0 2024-04-25T16:25:24.799 INFO:tasks.workunit.client.0.smithi059.stdout:8/763: mknod d7/d16/d36/dca/dde/d37/d5c/d87/d94/d66/cf6 0 2024-04-25T16:25:24.909 INFO:tasks.workunit.client.0.smithi059.stdout:4/772: truncate d0/d4/df/d1c/d45/f2d 1076652 0 2024-04-25T16:25:25.100 INFO:tasks.workunit.client.0.smithi059.stdout:7/767: write d0/d7/d16/d20/d71/fcf [826520,3358] 0 2024-04-25T16:25:25.101 INFO:tasks.workunit.client.0.smithi059.stdout:1/835: write d7/d93/d8e/f9a [633182,5569] 0 2024-04-25T16:25:25.228 INFO:tasks.workunit.client.0.smithi059.stdout:2/787: fsync de/d2a/d2e/de1/f10b 0 2024-04-25T16:25:25.293 INFO:tasks.workunit.client.0.smithi059.stdout:8/764: creat d7/d16/d36/ff7 x:0 0 0 2024-04-25T16:25:25.302 INFO:tasks.workunit.client.0.smithi059.stdout:8/765: chown d7/d2f/ca2 4 1 2024-04-25T16:25:25.310 INFO:tasks.workunit.client.0.smithi059.stdout:8/766: stat d7/d16/d36/dca 0 2024-04-25T16:25:25.452 INFO:tasks.workunit.client.0.smithi059.stdout:6/858: dread d9/d16/d24/d97/dc3/df5/d102/fed [0,4194304] 0 2024-04-25T16:25:25.469 INFO:tasks.workunit.client.0.smithi059.stdout:4/773: dread - d0/d4/df/d1c/d45/f9c zero size 2024-04-25T16:25:25.497 INFO:tasks.workunit.client.0.smithi059.stdout:1/836: chown d7/d2a/d85/db7/f87 2 1 2024-04-25T16:25:25.545 INFO:tasks.workunit.client.0.smithi059.stdout:3/844: write d0/d1e/d57/fde [820389,96189] 0 2024-04-25T16:25:25.668 INFO:tasks.workunit.client.0.smithi059.stdout:2/788: creat de/d5a/d9a/de9/f11e x:0 0 0 2024-04-25T16:25:25.804 INFO:tasks.workunit.client.0.smithi059.stdout:6/859: mknod d9/d1b/d58/d49/c107 0 2024-04-25T16:25:25.872 INFO:tasks.workunit.client.0.smithi059.stdout:1/837: fsync d7/d2a/d85/d8d/faf 0 2024-04-25T16:25:25.930 INFO:tasks.workunit.client.0.smithi059.stdout:5/848: creat d1/f11e x:0 0 0 2024-04-25T16:25:25.938 INFO:tasks.workunit.client.0.smithi059.stdout:9/827: write d6/d35/d26/fce [4605229,93542] 0 2024-04-25T16:25:25.954 INFO:tasks.workunit.client.0.smithi059.stdout:3/845: rmdir d0/db 39 2024-04-25T16:25:25.977 INFO:tasks.workunit.client.0.smithi059.stdout:9/828: chown d6/d4e/d54/ld5 1691 1 2024-04-25T16:25:25.997 INFO:tasks.workunit.client.0.smithi059.stdout:9/829: stat d6/d35/d28/f5b 0 2024-04-25T16:25:26.073 INFO:tasks.workunit.client.0.smithi059.stdout:3/846: dwrite d0/d1e/d31/dc7/fda [0,4194304] 0 2024-04-25T16:25:26.264 INFO:tasks.workunit.client.0.smithi059.stdout:4/774: fdatasync d0/d4/f56 0 2024-04-25T16:25:26.326 INFO:tasks.workunit.client.0.smithi059.stdout:7/768: creat d0/d7/d16/d20/ff4 x:0 0 0 2024-04-25T16:25:26.450 INFO:tasks.workunit.client.0.smithi059.stdout:0/765: unlink dc/f29 0 2024-04-25T16:25:26.504 INFO:tasks.workunit.client.0.smithi059.stdout:0/766: dread dc/d44/ff9 [0,4194304] 0 2024-04-25T16:25:26.612 INFO:tasks.workunit.client.0.smithi059.stdout:5/849: creat d1/dcd/d44/d79/dda/f11f x:0 0 0 2024-04-25T16:25:26.735 INFO:tasks.workunit.client.0.smithi059.stdout:9/830: mknod d6/d35/d28/cf6 0 2024-04-25T16:25:27.112 INFO:tasks.workunit.client.0.smithi059.stdout:0/767: mknod dc/dd/d3b/d66/dbb/de4/c100 0 2024-04-25T16:25:27.130 INFO:tasks.workunit.client.0.smithi059.stdout:2/789: write de/d16/d3e/d101/f11c [449141,56157] 0 2024-04-25T16:25:27.201 INFO:tasks.workunit.client.0.smithi059.stdout:8/767: getdents d7/d16/d36/dca/dde/d37/d5c/d87/d94 0 2024-04-25T16:25:27.336 INFO:tasks.workunit.client.0.smithi059.stdout:1/838: write d7/d93/fb2 [941218,15545] 0 2024-04-25T16:25:27.417 INFO:tasks.workunit.client.0.smithi059.stdout:6/860: dwrite d9/d16/d53/d6c/da6/fab [0,4194304] 0 2024-04-25T16:25:27.419 INFO:tasks.workunit.client.0.smithi059.stdout:1/839: chown d7/d2a/d85/fc9 7233 1 2024-04-25T16:25:27.554 INFO:tasks.workunit.client.0.smithi059.stdout:0/768: truncate dc/d37/d47/d71/f94 8320455 0 2024-04-25T16:25:27.584 INFO:tasks.workunit.client.0.smithi059.stdout:6/861: dread d9/d16/d24/d5d/d77/f87 [4194304,4194304] 0 2024-04-25T16:25:27.597 INFO:tasks.workunit.client.0.smithi059.stdout:3/847: getdents d0/db/d3f/d89/d101 0 2024-04-25T16:25:27.640 INFO:tasks.workunit.client.0.smithi059.stdout:8/768: fdatasync d7/f93 0 2024-04-25T16:25:28.172 INFO:tasks.workunit.client.0.smithi059.stdout:7/769: dwrite d0/d3f/f6a [4194304,4194304] 0 2024-04-25T16:25:28.236 INFO:tasks.workunit.client.0.smithi059.stdout:5/850: rename d1/dd/fba to d1/f120 0 2024-04-25T16:25:28.281 INFO:tasks.workunit.client.0.smithi059.stdout:9/831: rename d6/d4e/d54/f8b to d6/d4e/d54/ff7 0 2024-04-25T16:25:28.334 INFO:tasks.workunit.client.0.smithi059.stdout:1/840: readlink d7/d2a/d85/db7/d2d/d4a/lda 0 2024-04-25T16:25:28.336 INFO:tasks.workunit.client.0.smithi059.stdout:9/832: rename d6/d4e to d6/d4e/d54/d5d/d48/d6e/df8 22 2024-04-25T16:25:28.412 INFO:tasks.workunit.client.0.smithi059.stdout:4/775: dwrite d0/d4/df/d1c/fa0 [0,4194304] 0 2024-04-25T16:25:28.491 INFO:tasks.workunit.client.0.smithi059.stdout:2/790: write de/d5a/fc5 [908080,11112] 0 2024-04-25T16:25:28.712 INFO:tasks.workunit.client.0.smithi059.stdout:6/862: truncate d9/d16/d53/fec 1047008 0 2024-04-25T16:25:28.981 INFO:tasks.workunit.client.0.smithi059.stdout:9/833: dread d6/d35/d2f/f99 [0,4194304] 0 2024-04-25T16:25:29.120 INFO:tasks.workunit.client.0.smithi059.stdout:2/791: mknod de/d2a/da7/c11f 0 2024-04-25T16:25:29.345 INFO:tasks.workunit.client.0.smithi059.stdout:8/769: symlink d7/d16/lf8 0 2024-04-25T16:25:29.349 INFO:tasks.workunit.client.0.smithi059.stdout:5/851: mkdir d1/d1e/d27/d66/d121 0 2024-04-25T16:25:29.372 INFO:tasks.workunit.client.0.smithi059.stdout:8/770: dread - d7/d16/d36/dca/dde/f71 zero size 2024-04-25T16:25:29.788 INFO:tasks.workunit.client.0.smithi059.stdout:0/769: write dc/dd/d3b/d66/f87 [993571,49282] 0 2024-04-25T16:25:29.856 INFO:tasks.workunit.client.0.smithi059.stdout:4/776: rename d0/d79/ld1 to d0/d4/df/d1c/d45/d54/d75/d82/dd2/le8 0 2024-04-25T16:25:29.931 INFO:tasks.workunit.client.0.smithi059.stdout:9/834: dread d6/d35/f1f [0,4194304] 0 2024-04-25T16:25:29.946 INFO:tasks.workunit.client.0.smithi059.stdout:9/835: chown d6/d35/lc8 302364882 1 2024-04-25T16:25:29.974 INFO:tasks.workunit.client.0.smithi059.stdout:5/852: creat d1/dd/f122 x:0 0 0 2024-04-25T16:25:29.987 INFO:tasks.workunit.client.0.smithi059.stdout:9/836: readlink d6/d4e/d54/d5d/lf5 0 2024-04-25T16:25:30.122 INFO:tasks.workunit.client.0.smithi059.stdout:6/863: stat d9/d16/d53/fec 0 2024-04-25T16:25:30.148 INFO:tasks.workunit.client.0.smithi059.stdout:0/770: truncate dc/fc7 1537459 0 2024-04-25T16:25:30.290 INFO:tasks.workunit.client.0.smithi059.stdout:7/770: getdents d0/d7/d51/da9/db3 0 2024-04-25T16:25:30.419 INFO:tasks.workunit.client.0.smithi059.stdout:7/771: sync 2024-04-25T16:25:30.547 INFO:tasks.workunit.client.0.smithi059.stdout:9/837: mkdir d6/d35/d28/dc0/df9 0 2024-04-25T16:25:30.606 INFO:tasks.workunit.client.0.smithi059.stdout:3/848: write d0/d1e/d31/f40 [1567843,27810] 0 2024-04-25T16:25:30.688 INFO:tasks.workunit.client.0.smithi059.stdout:6/864: mknod d9/d27/d68/c108 0 2024-04-25T16:25:30.693 INFO:tasks.workunit.client.0.smithi059.stdout:0/771: symlink dc/dd/d3b/d66/d9b/l101 0 2024-04-25T16:25:30.914 INFO:tasks.workunit.client.0.smithi059.stdout:9/838: fdatasync d6/d4e/d54/d5d/d48/d49/f7c 0 2024-04-25T16:25:30.995 INFO:tasks.workunit.client.0.smithi059.stdout:0/772: symlink dc/dd/d5c/l102 0 2024-04-25T16:25:31.040 INFO:tasks.workunit.client.0.smithi059.stdout:2/792: rename de/d5a/d7d/d80/l9c to de/d2a/d2e/d36/l120 0 2024-04-25T16:25:31.222 INFO:tasks.workunit.client.0.smithi059.stdout:9/839: dread - d6/d35/fc4 zero size 2024-04-25T16:25:31.248 INFO:tasks.workunit.client.0.smithi059.stdout:1/841: write d7/d93/d8e/fa2 [4939645,90579] 0 2024-04-25T16:25:31.508 INFO:tasks.workunit.client.0.smithi059.stdout:8/771: write d7/d16/d3a/fed [675224,46471] 0 2024-04-25T16:25:31.680 INFO:tasks.workunit.client.0.smithi059.stdout:4/777: creat d0/d4/df/d1c/d45/d54/d75/fe9 x:0 0 0 2024-04-25T16:25:31.736 INFO:tasks.workunit.client.0.smithi059.stdout:0/773: creat dc/d44/df4/f103 x:0 0 0 2024-04-25T16:25:31.852 INFO:tasks.workunit.client.0.smithi059.stdout:5/853: getdents d1/dcd/d50 0 2024-04-25T16:25:31.995 INFO:tasks.workunit.client.0.smithi059.stdout:8/772: mknod d7/dd/d33/d57/cf9 0 2024-04-25T16:25:32.153 INFO:tasks.workunit.client.0.smithi059.stdout:3/849: rename d0/db/lf6 to d0/d1e/d31/l12d 0 2024-04-25T16:25:32.360 INFO:tasks.workunit.client.0.smithi059.stdout:9/840: mknod d6/d35/d26/df0/cfa 0 2024-04-25T16:25:32.475 INFO:tasks.workunit.client.0.smithi059.stdout:6/865: write d9/d16/f52 [3257394,1276] 0 2024-04-25T16:25:32.632 INFO:tasks.workunit.client.0.smithi059.stdout:4/778: creat d0/d4/df/d1c/d45/d54/d75/d7e/fea x:0 0 0 2024-04-25T16:25:32.719 INFO:tasks.workunit.client.0.smithi059.stdout:4/779: sync 2024-04-25T16:25:32.927 INFO:tasks.workunit.client.0.smithi059.stdout:7/772: link d0/d7/d51/da9/db3/d33/f8c d0/d7/d16/d20/dab/dd5/ff5 0 2024-04-25T16:25:33.041 INFO:tasks.workunit.client.0.smithi059.stdout:9/841: chown d6/d35/c3d 344720688 1 2024-04-25T16:25:33.062 INFO:tasks.workunit.client.0.smithi059.stdout:9/842: read d6/d4e/d54/d5d/d48/d49/f7c [772459,81796] 0 2024-04-25T16:25:33.220 INFO:tasks.workunit.client.0.smithi059.stdout:8/773: creat d7/d16/de0/df3/ffa x:0 0 0 2024-04-25T16:25:33.395 INFO:tasks.workunit.client.0.smithi059.stdout:4/780: dread - d0/d79/fd9 zero size 2024-04-25T16:25:33.433 INFO:tasks.workunit.client.0.smithi059.stdout:7/773: mknod d0/d7/d51/da9/db3/d33/d79/cf6 0 2024-04-25T16:25:33.525 INFO:tasks.workunit.client.0.smithi059.stdout:0/774: dwrite dc/d37/d47/d71/d9c/dca/fe0 [0,4194304] 0 2024-04-25T16:25:33.592 INFO:tasks.workunit.client.0.smithi059.stdout:2/793: write de/d2a/d2e/d36/d59/ff9 [520001,31243] 0 2024-04-25T16:25:33.641 INFO:tasks.workunit.client.0.smithi059.stdout:2/794: chown de/d2a/d2e/d36/d2c/d40/d57/c69 6443144 1 2024-04-25T16:25:33.652 INFO:tasks.workunit.client.0.smithi059.stdout:2/795: chown de/d5a/d7d/d80/ce2 127696571 1 2024-04-25T16:25:33.703 INFO:tasks.workunit.client.0.smithi059.stdout:1/842: getdents d7/d2a/d85/db7/d77 0 2024-04-25T16:25:33.765 INFO:tasks.workunit.client.0.smithi059.stdout:5/854: dwrite d1/d1e/d27/d66/d70/f39 [4194304,4194304] 0 2024-04-25T16:25:33.838 INFO:tasks.workunit.client.0.smithi059.stdout:6/866: fsync d9/d16/d53/d55/fcd 0 2024-04-25T16:25:33.839 INFO:tasks.workunit.client.0.smithi059.stdout:8/774: creat d7/d16/da3/ffb x:0 0 0 2024-04-25T16:25:34.128 INFO:tasks.workunit.client.0.smithi059.stdout:7/774: rename d0/d7/d51/da9/db3/d33/d79/d5d/fa6 to d0/d7/d51/da9/db3/d33/d79/d5d/d85/ff7 0 2024-04-25T16:25:34.312 INFO:tasks.workunit.client.0.smithi059.stdout:1/843: rmdir d7/d2a/d62 39 2024-04-25T16:25:34.476 INFO:tasks.workunit.client.0.smithi059.stdout:6/867: unlink d9/d27/d39/d7b/fc8 0 2024-04-25T16:25:34.717 INFO:tasks.workunit.client.0.smithi059.stdout:8/775: creat d7/d16/d8f/dc8/ffc x:0 0 0 2024-04-25T16:25:34.749 INFO:tasks.workunit.client.0.smithi059.stdout:4/781: mknod d0/d4/df/d1c/ceb 0 2024-04-25T16:25:34.774 INFO:tasks.workunit.client.0.smithi059.stdout:4/782: dread d0/d4/df/f19 [0,4194304] 0 2024-04-25T16:25:34.794 INFO:tasks.workunit.client.0.smithi059.stdout:8/776: sync 2024-04-25T16:25:34.830 INFO:tasks.workunit.client.0.smithi059.stdout:6/868: dread d9/d16/d53/f82 [0,4194304] 0 2024-04-25T16:25:35.104 INFO:tasks.workunit.client.0.smithi059.stdout:2/796: getdents de/d5a/d7d/d80/ddb/de3 0 2024-04-25T16:25:35.175 INFO:tasks.workunit.client.0.smithi059.stdout:3/850: dwrite d0/db/d3f/d89/dd5/f100 [0,4194304] 0 2024-04-25T16:25:35.240 INFO:tasks.workunit.client.0.smithi059.stdout:8/777: fsync d7/dd/d17/db4/fac 0 2024-04-25T16:25:35.282 INFO:tasks.workunit.client.0.smithi059.stdout:8/778: chown d7/d16/d36/dca/dde/d37/d5c/d87/d94/d7f/dcb 9208 1 2024-04-25T16:25:35.416 INFO:tasks.workunit.client.0.smithi059.stdout:0/775: write dc/dd/d3b/d66/d9b/ffd [93342,124068] 0 2024-04-25T16:25:35.487 INFO:tasks.workunit.client.0.smithi059.stdout:6/869: dread d9/f59 [0,4194304] 0 2024-04-25T16:25:35.491 INFO:tasks.workunit.client.0.smithi059.stdout:0/776: readlink dc/dd/d3b/d66/d9b/l101 0 2024-04-25T16:25:35.660 INFO:tasks.workunit.client.0.smithi059.stdout:4/783: mknod d0/d4/df/d1c/d45/d54/d75/cec 0 2024-04-25T16:25:35.667 INFO:tasks.workunit.client.0.smithi059.stdout:9/843: write d6/d35/d6c/fb3 [703673,127367] 0 2024-04-25T16:25:35.718 INFO:tasks.workunit.client.0.smithi059.stdout:1/844: link d7/d2a/d85/db7/d77/da3/f101 d7/de5/d8f/f113 0 2024-04-25T16:25:35.827 INFO:tasks.workunit.client.0.smithi059.stdout:1/845: dread d7/d2a/d85/db7/f63 [0,4194304] 0 2024-04-25T16:25:35.834 INFO:tasks.workunit.client.0.smithi059.stdout:5/855: dwrite d1/dd/f13 [0,4194304] 0 2024-04-25T16:25:35.905 INFO:tasks.workunit.client.0.smithi059.stdout:5/856: chown d1/l1b 822486 1 2024-04-25T16:25:36.231 INFO:tasks.workunit.client.0.smithi059.stdout:6/870: truncate d9/d1b/f6b 1680368 0 2024-04-25T16:25:36.258 INFO:tasks.workunit.client.0.smithi059.stdout:3/851: rename d0/d1e/fa3 to d0/db/d2d/de1/df2/f12e 0 2024-04-25T16:25:36.421 INFO:tasks.workunit.client.0.smithi059.stdout:7/775: unlink d0/d7/f73 0 2024-04-25T16:25:36.484 INFO:tasks.workunit.client.0.smithi059.stdout:8/779: write d7/d16/d36/dca/dde/d37/d5c/d87/d94/d7f/dcb/fe1 [583433,75041] 0 2024-04-25T16:25:36.597 INFO:tasks.workunit.client.0.smithi059.stdout:0/777: dwrite dc/dd/d3b/d66/f6f [0,4194304] 0 2024-04-25T16:25:36.688 INFO:tasks.workunit.client.0.smithi059.stdout:2/797: dwrite de/d2a/d2e/f30 [0,4194304] 0 2024-04-25T16:25:36.767 INFO:tasks.workunit.client.0.smithi059.stdout:0/778: chown dc/d37/d47/d81/dd2/ldc 3 1 2024-04-25T16:25:36.786 INFO:tasks.workunit.client.0.smithi059.stdout:4/784: creat d0/d4/df/d48/da3/fed x:0 0 0 2024-04-25T16:25:36.790 INFO:tasks.workunit.client.0.smithi059.stdout:9/844: mkdir d6/d4e/d54/d5d/d48/d49/dfb 0 2024-04-25T16:25:36.794 INFO:tasks.workunit.client.0.smithi059.stdout:1/846: rmdir d7/d2a/d85/db7/d6a 39 2024-04-25T16:25:36.809 INFO:tasks.workunit.client.0.smithi059.stdout:5/857: rename d1/d1e/d27/d66/d70/f61 to d1/d1e/dca/d113/dcc/f123 0 2024-04-25T16:25:36.886 INFO:tasks.workunit.client.0.smithi059.stdout:3/852: dread - d0/d1e/d31/df0/f12a zero size 2024-04-25T16:25:37.107 INFO:tasks.workunit.client.0.smithi059.stdout:8/780: symlink d7/d16/d8f/dc8/lfd 0 2024-04-25T16:25:37.169 INFO:tasks.workunit.client.0.smithi059.stdout:9/845: truncate d6/d4e/d54/d5d/d48/fb6 1437049 0 2024-04-25T16:25:37.269 INFO:tasks.workunit.client.0.smithi059.stdout:9/846: sync 2024-04-25T16:25:37.307 INFO:tasks.workunit.client.0.smithi059.stdout:1/847: dread d7/f29 [0,4194304] 0 2024-04-25T16:25:37.501 INFO:tasks.workunit.client.0.smithi059.stdout:7/776: creat d0/d7/dae/de2/ff8 x:0 0 0 2024-04-25T16:25:37.577 INFO:tasks.workunit.client.0.smithi059.stdout:6/871: creat d9/d16/d53/d55/d71/f109 x:0 0 0 2024-04-25T16:25:37.668 INFO:tasks.workunit.client.0.smithi059.stdout:0/779: write dc/df/f1d [1743371,26366] 0 2024-04-25T16:25:37.721 INFO:tasks.workunit.client.0.smithi059.stdout:2/798: dwrite de/d5a/d9a/faa [0,4194304] 0 2024-04-25T16:25:37.784 INFO:tasks.workunit.client.0.smithi059.stdout:8/781: rmdir d7/d16/d36/dca/dde/d37/d5c/d87/d94/d7f 39 2024-04-25T16:25:37.791 INFO:tasks.workunit.client.0.smithi059.stdout:4/785: write d0/d4/df/d48/da3/da4/fd3 [703133,93768] 0 2024-04-25T16:25:37.819 INFO:tasks.workunit.client.0.smithi059.stdout:3/853: unlink d0/fa 0 2024-04-25T16:25:38.317 INFO:tasks.workunit.client.0.smithi059.stdout:0/780: rmdir dc/dd/d3b/d66/d9b 39 2024-04-25T16:25:38.323 INFO:tasks.workunit.client.0.smithi059.stdout:2/799: fdatasync de/d2a/d33/f7e 0 2024-04-25T16:25:38.324 INFO:tasks.workunit.client.0.smithi059.stdout:6/872: read d9/d16/d53/d6c/da6/fab [1954511,37490] 0 2024-04-25T16:25:38.465 INFO:tasks.workunit.client.0.smithi059.stdout:9/847: symlink d6/d35/d28/dc0/df9/lfc 0 2024-04-25T16:25:38.468 INFO:tasks.workunit.client.0.smithi059.stdout:8/782: fdatasync d7/d16/d3a/f9a 0 2024-04-25T16:25:38.479 INFO:tasks.workunit.client.0.smithi059.stdout:3/854: dread - d0/db/d3f/d6c/dea/de9/f11c zero size 2024-04-25T16:25:38.943 INFO:tasks.workunit.client.0.smithi059.stdout:5/858: link d1/dcd/d44/dd1/fd7 d1/d1e/d27/d66/f124 0 2024-04-25T16:25:39.187 INFO:tasks.workunit.client.0.smithi059.stdout:4/786: mknod d0/d4/df/d48/dde/cee 0 2024-04-25T16:25:39.259 INFO:tasks.workunit.client.0.smithi059.stdout:0/781: dread dc/d44/f50 [0,4194304] 0 2024-04-25T16:25:39.291 INFO:tasks.workunit.client.0.smithi059.stdout:0/782: chown dc/f4e 225 1 2024-04-25T16:25:39.329 INFO:tasks.workunit.client.0.smithi059.stdout:8/783: creat d7/d16/d3a/ffe x:0 0 0 2024-04-25T16:25:39.449 INFO:tasks.workunit.client.0.smithi059.stdout:7/777: rmdir d0/d7/d51/da9/db3/d33/d79/d5d/d85/df3 0 2024-04-25T16:25:39.619 INFO:tasks.workunit.client.0.smithi059.stdout:1/848: rename d7/d2a/d85/db7/d16/c97 to d7/d2a/d85/db7/d2d/d4a/c114 0 2024-04-25T16:25:40.052 INFO:tasks.workunit.client.0.smithi059.stdout:4/787: creat d0/d4/df/d48/d5f/fef x:0 0 0 2024-04-25T16:25:40.066 INFO:tasks.workunit.client.0.smithi059.stdout:4/788: chown d0/d4/df/d44/l53 3563 1 2024-04-25T16:25:40.101 INFO:tasks.workunit.client.0.smithi059.stdout:9/848: truncate d6/fbc 626122 0 2024-04-25T16:25:40.179 INFO:tasks.workunit.client.0.smithi059.stdout:3/855: fdatasync d0/d1e/f32 0 2024-04-25T16:25:40.280 INFO:tasks.workunit.client.0.smithi059.stdout:0/783: write dc/dd/d3b/d66/d9b/ffd [731048,118233] 0 2024-04-25T16:25:40.299 INFO:tasks.workunit.client.0.smithi059.stdout:0/784: stat dc/dd/d3b/d66/fb2 0 2024-04-25T16:25:40.419 INFO:tasks.workunit.client.0.smithi059.stdout:1/849: dread d7/d2a/f67 [0,4194304] 0 2024-04-25T16:25:40.433 INFO:tasks.workunit.client.0.smithi059.stdout:0/785: dread dc/f3a [0,4194304] 0 2024-04-25T16:25:40.458 INFO:tasks.workunit.client.0.smithi059.stdout:2/800: write de/da1/fff [951536,7774] 0 2024-04-25T16:25:40.459 INFO:tasks.workunit.client.0.smithi059.stdout:6/873: write d9/d16/d53/d6c/da6/fe7 [3828065,127747] 0 2024-04-25T16:25:40.493 INFO:tasks.workunit.client.0.smithi059.stdout:6/874: readlink d9/d16/l3e 0 2024-04-25T16:25:40.530 INFO:tasks.workunit.client.0.smithi059.stdout:3/856: creat d0/db/d47/d7e/f12f x:0 0 0 2024-04-25T16:25:41.022 INFO:tasks.workunit.client.0.smithi059.stdout:7/778: link d0/d3f/f6a d0/d7/d51/da9/db3/d33/dc6/de8/ff9 0 2024-04-25T16:25:41.032 INFO:tasks.workunit.client.0.smithi059.stdout:7/779: chown d0/d7/fa7 186253 1 2024-04-25T16:25:41.267 INFO:tasks.workunit.client.0.smithi059.stdout:3/857: unlink d0/l9 0 2024-04-25T16:25:41.354 INFO:tasks.workunit.client.0.smithi059.stdout:4/789: getdents d0/d4/df/d1c/d45/d54/d75/d7e/d9e 0 2024-04-25T16:25:41.586 INFO:tasks.workunit.client.0.smithi059.stdout:2/801: creat de/d2a/d2e/d36/d2c/d40/f121 x:0 0 0 2024-04-25T16:25:41.752 INFO:tasks.workunit.client.0.smithi059.stdout:9/849: write d6/dae/dc3/fed [932185,7941] 0 2024-04-25T16:25:41.804 INFO:tasks.workunit.client.0.smithi059.stdout:1/850: getdents d7/de5 0 2024-04-25T16:25:41.905 INFO:tasks.workunit.client.0.smithi059.stdout:6/875: getdents d9/d16/d24/d5d/d77 0 2024-04-25T16:25:41.921 INFO:tasks.workunit.client.0.smithi059.stdout:8/784: dwrite d7/d16/f52 [0,4194304] 0 2024-04-25T16:25:42.015 INFO:tasks.workunit.client.0.smithi059.stdout:5/859: dwrite d1/d1e/d27/d66/f124 [0,4194304] 0 2024-04-25T16:25:42.090 INFO:tasks.workunit.client.0.smithi059.stdout:0/786: write dc/d37/d47/d81/f83 [563239,47985] 0 2024-04-25T16:25:42.139 INFO:tasks.workunit.client.0.smithi059.stdout:2/802: fdatasync de/d2a/d2e/d36/d2c/d40/f47 0 2024-04-25T16:25:42.150 INFO:tasks.workunit.client.0.smithi059.stdout:7/780: write d0/d7/d51/da9/db3/d33/d79/d5d/fe3 [3327081,114991] 0 2024-04-25T16:25:42.208 INFO:tasks.workunit.client.0.smithi059.stdout:0/787: read dc/d37/d47/f64 [3220991,35769] 0 2024-04-25T16:25:42.601 INFO:tasks.workunit.client.0.smithi059.stdout:1/851: creat d7/d2a/d85/db7/d77/da3/f115 x:0 0 0 2024-04-25T16:25:42.609 INFO:tasks.workunit.client.0.smithi059.stdout:8/785: fdatasync d7/d16/d36/dca/dde/d38/fa4 0 2024-04-25T16:25:42.635 INFO:tasks.workunit.client.0.smithi059.stdout:4/790: dwrite d0/d4/df/d48/f6c [0,4194304] 0 2024-04-25T16:25:42.650 INFO:tasks.workunit.client.0.smithi059.stdout:3/858: dwrite d0/db/d3f/d49/f7b [0,4194304] 0 2024-04-25T16:25:42.785 INFO:tasks.workunit.client.0.smithi059.stdout:2/803: fsync de/d2a/d2e/de1/f10b 0 2024-04-25T16:25:42.797 INFO:tasks.workunit.client.0.smithi059.stdout:0/788: mkdir dc/dd/d5c/d104 0 2024-04-25T16:25:42.823 INFO:tasks.workunit.client.0.smithi059.stdout:5/860: dread d1/dcd/d44/d79/dda/dfe/fc2 [0,4194304] 0 2024-04-25T16:25:42.855 INFO:tasks.workunit.client.0.smithi059.stdout:1/852: chown d7/d2a/d85/d8d/c98 14 1 2024-04-25T16:25:42.861 INFO:tasks.workunit.client.0.smithi059.stdout:0/789: stat dc/dd/d5c/fb9 0 2024-04-25T16:25:42.999 INFO:tasks.workunit.client.0.smithi059.stdout:2/804: dread de/fc9 [0,4194304] 0 2024-04-25T16:25:43.182 INFO:tasks.workunit.client.0.smithi059.stdout:6/876: symlink d9/d1b/d58/l10a 0 2024-04-25T16:25:43.212 INFO:tasks.workunit.client.0.smithi059.stdout:9/850: dwrite d6/d4e/d54/fa9 [0,4194304] 0 2024-04-25T16:25:43.341 INFO:tasks.workunit.client.0.smithi059.stdout:3/859: chown d0/fcd 14019306 1 2024-04-25T16:25:43.558 INFO:tasks.workunit.client.0.smithi059.stdout:5/861: mkdir d1/dd/d125 0 2024-04-25T16:25:43.603 INFO:tasks.workunit.client.0.smithi059.stdout:4/791: rmdir d0/d4/df/d1c/d45/d54/d75/d82/d8f 39 2024-04-25T16:25:43.642 INFO:tasks.workunit.client.0.smithi059.stdout:4/792: dread d0/d4/df/d1c/d45/d54/d75/f80 [0,4194304] 0 2024-04-25T16:25:43.660 INFO:tasks.workunit.client.0.smithi059.stdout:7/781: write d0/d7/d51/da9/db3/fb2 [445595,12719] 0 2024-04-25T16:25:44.301 INFO:tasks.workunit.client.0.smithi059.stdout:1/853: creat d7/d2a/d85/db7/d6a/dbc/f116 x:0 0 0 2024-04-25T16:25:44.449 INFO:tasks.workunit.client.0.smithi059.stdout:9/851: symlink d6/d4e/lfd 0 2024-04-25T16:25:44.525 INFO:tasks.workunit.client.0.smithi059.stdout:3/860: mknod d0/db/d3f/d89/d101/c130 0 2024-04-25T16:25:44.600 INFO:tasks.workunit.client.0.smithi059.stdout:1/854: symlink d7/d21/d51/d10e/l117 0 2024-04-25T16:25:44.681 INFO:tasks.workunit.client.0.smithi059.stdout:9/852: rmdir d6/d35/d28 39 2024-04-25T16:25:44.889 INFO:tasks.workunit.client.0.smithi059.stdout:6/877: creat d9/d16/d24/d5d/f10b x:0 0 0 2024-04-25T16:25:44.890 INFO:tasks.workunit.client.0.smithi059.stdout:3/861: mknod d0/db/d2d/de4/de6/c131 0 2024-04-25T16:25:44.917 INFO:tasks.workunit.client.0.smithi059.stdout:0/790: getdents dc/dd/d3b/d66/d9b 0 2024-04-25T16:25:45.017 INFO:tasks.workunit.client.0.smithi059.stdout:2/805: write de/d5a/d9a/fa4 [556863,71659] 0 2024-04-25T16:25:45.046 INFO:tasks.workunit.client.0.smithi059.stdout:8/786: dwrite d7/d16/d36/dca/dde/d37/d5c/f7c [0,4194304] 0 2024-04-25T16:25:45.129 INFO:tasks.workunit.client.0.smithi059.stdout:7/782: getdents d0/d7/d51/da9/db3/d33 0 2024-04-25T16:25:45.190 INFO:tasks.workunit.client.0.smithi059.stdout:0/791: symlink dc/dd/d5c/dbe/l105 0 2024-04-25T16:25:45.315 INFO:tasks.workunit.client.0.smithi059.stdout:0/792: stat dc/dd/d3b/d66/d9b/l8e 0 2024-04-25T16:25:45.320 INFO:tasks.workunit.client.0.smithi059.stdout:8/787: dread d7/d16/d3a/f50 [0,4194304] 0 2024-04-25T16:25:45.334 INFO:tasks.workunit.client.0.smithi059.stdout:1/855: creat d7/d2a/d85/db7/d2d/d4a/f118 x:0 0 0 2024-04-25T16:25:45.397 INFO:tasks.workunit.client.0.smithi059.stdout:6/878: rename d9/d16/d24/d5d/d77 to d9/d16/dc0/d10c 0 2024-04-25T16:25:45.489 INFO:tasks.workunit.client.0.smithi059.stdout:2/806: mknod de/d2a/d2e/de1/c122 0 2024-04-25T16:25:45.506 INFO:tasks.workunit.client.0.smithi059.stdout:2/807: chown de/d5a/d7d/d80/ddb/de3/f104 1 1 2024-04-25T16:25:45.803 INFO:tasks.workunit.client.0.smithi059.stdout:9/853: creat d6/dae/ffe x:0 0 0 2024-04-25T16:25:45.807 INFO:tasks.workunit.client.0.smithi059.stdout:0/793: creat dc/dd/d3b/d66/dbb/f106 x:0 0 0 2024-04-25T16:25:45.839 INFO:tasks.workunit.client.0.smithi059.stdout:5/862: unlink d1/f11e 0 2024-04-25T16:25:45.897 INFO:tasks.workunit.client.0.smithi059.stdout:8/788: creat d7/dd/d17/db4/d7e/da5/fff x:0 0 0 2024-04-25T16:25:45.970 INFO:tasks.workunit.client.0.smithi059.stdout:6/879: read d9/d16/d24/d97/fd6 [137265,40883] 0 2024-04-25T16:25:46.002 INFO:tasks.workunit.client.0.smithi059.stdout:8/789: sync 2024-04-25T16:25:46.190 INFO:tasks.workunit.client.0.smithi059.stdout:8/790: dwrite d7/d16/d36/dca/fe4 [0,4194304] 0 2024-04-25T16:25:46.260 INFO:tasks.workunit.client.0.smithi059.stdout:8/791: sync 2024-04-25T16:25:46.303 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:25:46.305 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:25:46.319 INFO:tasks.workunit.client.0.smithi059.stdout:1/856: symlink d7/d2a/d85/db7/d6a/d109/l119 0 2024-04-25T16:25:46.333 INFO:tasks.workunit.client.0.smithi059.stdout:6/880: rename d9/d16/d53/d74/ffa to d9/d16/d53/d6c/da6/f10d 0 2024-04-25T16:25:46.336 INFO:tasks.workunit.client.0.smithi059.stdout:4/793: dwrite d0/d4/df/d48/da3/fed [0,4194304] 0 2024-04-25T16:25:46.428 INFO:tasks.workunit.client.0.smithi059.stdout:1/857: chown d7/d2a/c5f 32401097 1 2024-04-25T16:25:46.812 INFO:tasks.workunit.client.0.smithi059.stdout:3/862: write d0/db/d47/d98/ff1 [883515,73868] 0 2024-04-25T16:25:46.895 INFO:tasks.workunit.client.0.smithi059.stdout:7/783: dwrite d0/d7/d51/da9/db3/d33/d79/f7b [0,4194304] 0 2024-04-25T16:25:47.047 INFO:tasks.workunit.client.0.smithi059.stdout:1/858: creat d7/d2a/d85/db7/dbb/db6/f11a x:0 0 0 2024-04-25T16:25:47.170 INFO:tasks.workunit.client.0.smithi059.stdout:2/808: dwrite de/d2a/d2e/f98 [0,4194304] 0 2024-04-25T16:25:47.235 INFO:tasks.workunit.client.0.smithi059.stdout:3/863: dread - d0/d1e/d57/f112 zero size 2024-04-25T16:25:47.284 INFO:tasks.workunit.client.0.smithi059.stdout:0/794: dwrite dc/dd/d3b/f80 [0,4194304] 0 2024-04-25T16:25:47.417 INFO:tasks.workunit.client.0.smithi059.stdout:9/854: link d6/d35/d28/l2b d6/d35/d6c/lff 0 2024-04-25T16:25:47.440 INFO:tasks.workunit.client.0.smithi059.stdout:1/859: fsync d7/d2a/d85/db7/d16/d5c/d74/f10a 0 2024-04-25T16:25:47.485 INFO:tasks.workunit.client.0.smithi059.stdout:5/863: dwrite d1/dcd/d44/d79/dda/f101 [0,4194304] 0 2024-04-25T16:25:47.580 INFO:tasks.workunit.client.0.smithi059.stdout:7/784: symlink d0/d7/d51/da9/db3/d33/d79/d5d/lfa 0 2024-04-25T16:25:47.683 INFO:tasks.workunit.client.0.smithi059.stdout:6/881: write d9/d27/d39/f88 [323762,4661] 0 2024-04-25T16:25:47.715 INFO:tasks.workunit.client.0.smithi059.stdout:0/795: dread dc/dd/d3b/f45 [0,4194304] 0 2024-04-25T16:25:47.812 INFO:tasks.workunit.client.0.smithi059.stdout:0/796: sync 2024-04-25T16:25:48.116 INFO:tasks.workunit.client.0.smithi059.stdout:4/794: write d0/d4/df/d1c/d45/d54/d75/d82/d8f/fb5 [363111,123082] 0 2024-04-25T16:25:48.136 INFO:tasks.workunit.client.0.smithi059.stdout:4/795: read d0/d4/df/f19 [63651,82834] 0 2024-04-25T16:25:48.155 INFO:tasks.workunit.client.0.smithi059.stdout:4/796: chown d0/d4/df/d1c/d45/d54/d75/fe9 144 1 2024-04-25T16:25:48.178 INFO:tasks.workunit.client.0.smithi059.stdout:8/792: getdents d7/d16/d8f 0 2024-04-25T16:25:48.193 INFO:tasks.workunit.client.0.smithi059.stdout:8/793: chown d7/dd/d17/db4/d7e/fc1 2074124 1 2024-04-25T16:25:48.469 INFO:tasks.workunit.client.0.smithi059.stdout:9/855: unlink d6/d35/d2f/d39/fe0 0 2024-04-25T16:25:48.521 INFO:tasks.workunit.client.0.smithi059.stdout:1/860: fsync d7/d2a/d85/d8d/fcd 0 2024-04-25T16:25:48.737 INFO:tasks.workunit.client.0.smithi059.stdout:7/785: mknod d0/d7/d16/d20/dab/dd5/cfb 0 2024-04-25T16:25:48.819 INFO:tasks.workunit.client.0.smithi059.stdout:0/797: mknod dc/d44/d5f/c107 0 2024-04-25T16:25:48.892 INFO:tasks.workunit.client.0.smithi059.stdout:3/864: mkdir d0/db/d132 0 2024-04-25T16:25:49.012 INFO:tasks.workunit.client.0.smithi059.stdout:8/794: symlink d7/d16/d3a/l100 0 2024-04-25T16:25:49.366 INFO:tasks.workunit.client.0.smithi059.stdout:1/861: unlink d7/d2a/d85/db7/d16/d5c/cf1 0 2024-04-25T16:25:49.604 INFO:tasks.workunit.client.0.smithi059.stdout:0/798: mknod dc/d37/d47/d71/dd0/c108 0 2024-04-25T16:25:49.678 INFO:tasks.workunit.client.0.smithi059.stdout:4/797: mkdir d0/d4/df/d1c/d45/d54/df0 0 2024-04-25T16:25:49.834 INFO:tasks.workunit.client.0.smithi059.stdout:2/809: rename de/d16/d82 to de/d2a/d2e/d36/d123 0 2024-04-25T16:25:50.102 INFO:tasks.workunit.client.0.smithi059.stdout:7/786: mkdir d0/de5/dfc 0 2024-04-25T16:25:50.107 INFO:tasks.workunit.client.0.smithi059.stdout:5/864: write d1/dcd/f9e [322319,66032] 0 2024-04-25T16:25:50.114 INFO:tasks.workunit.client.0.smithi059.stdout:0/799: fsync dc/dd/d3b/d66/d9b/fb3 0 2024-04-25T16:25:50.294 INFO:tasks.workunit.client.0.smithi059.stdout:8/795: rename d7/d16/d36/dca/dde to d7/d16/de0/d101 0 2024-04-25T16:25:50.485 INFO:tasks.workunit.client.0.smithi059.stdout:0/800: fdatasync dc/dd/f23 0 2024-04-25T16:25:50.550 INFO:tasks.workunit.client.0.smithi059.stdout:5/865: mknod d1/dcd/d44/dd1/c126 0 2024-04-25T16:25:50.746 INFO:tasks.workunit.client.0.smithi059.stdout:1/862: rename d7/d2a/f67 to d7/d2a/d85/db7/dbb/db6/f11b 0 2024-04-25T16:25:51.054 INFO:tasks.workunit.client.0.smithi059.stdout:5/866: truncate d1/dd/f12 3533593 0 2024-04-25T16:25:51.056 INFO:tasks.workunit.client.0.smithi059.stdout:9/856: dwrite d6/d4e/d54/d5d/d48/f86 [0,4194304] 0 2024-04-25T16:25:51.124 INFO:tasks.workunit.client.0.smithi059.stdout:3/865: link d0/db/f19 d0/db/d3f/dce/dec/f133 0 2024-04-25T16:25:51.151 INFO:tasks.workunit.client.0.smithi059.stdout:5/867: dread - d1/d1e/d27/d66/fac zero size 2024-04-25T16:25:51.156 INFO:tasks.workunit.client.0.smithi059.stdout:6/882: write d9/d16/d53/d55/d71/d7e/f8a [4453036,48956] 0 2024-04-25T16:25:51.313 INFO:tasks.workunit.client.0.smithi059.stdout:9/857: dread d6/d35/d28/f50 [0,4194304] 0 2024-04-25T16:25:51.327 INFO:tasks.workunit.client.0.smithi059.stdout:1/863: mkdir d7/d2a/d11c 0 2024-04-25T16:25:51.351 INFO:tasks.workunit.client.0.smithi059.stdout:9/858: chown d6/d4e/d54/d5d/d95/fe2 207963568 1 2024-04-25T16:25:51.357 INFO:tasks.workunit.client.0.smithi059.stdout:9/859: stat d6/dae/ffe 0 2024-04-25T16:25:51.367 INFO:tasks.workunit.client.0.smithi059.stdout:9/860: read - d6/d35/d2f/fa5 zero size 2024-04-25T16:25:51.406 INFO:tasks.workunit.client.0.smithi059.stdout:3/866: mknod d0/db/d2d/d7a/c134 0 2024-04-25T16:25:51.515 INFO:tasks.workunit.client.0.smithi059.stdout:5/868: symlink d1/d1e/d27/d66/d70/d24/l127 0 2024-04-25T16:25:51.528 INFO:tasks.workunit.client.0.smithi059.stdout:5/869: readlink d1/d1e/d27/lf5 0 2024-04-25T16:25:51.575 INFO:tasks.workunit.client.0.smithi059.stdout:9/861: fdatasync d6/d4e/d7a/fc2 0 2024-04-25T16:25:51.726 INFO:tasks.workunit.client.0.smithi059.stdout:7/787: mknod d0/d7/cfd 0 2024-04-25T16:25:51.990 INFO:tasks.workunit.client.0.smithi059.stdout:8/796: creat d7/d16/de0/d101/d37/d5c/d87/d94/f102 x:0 0 0 2024-04-25T16:25:52.012 INFO:tasks.workunit.client.0.smithi059.stdout:2/810: dwrite de/d2a/d2e/d36/d59/ff9 [0,4194304] 0 2024-04-25T16:25:52.102 INFO:tasks.workunit.client.0.smithi059.stdout:6/883: creat d9/d27/f10e x:0 0 0 2024-04-25T16:25:52.114 INFO:tasks.workunit.client.0.smithi059.stdout:2/811: dread - de/d5a/d7d/d80/ddb/de3/ff1 zero size 2024-04-25T16:25:52.128 INFO:tasks.workunit.client.0.smithi059.stdout:5/870: rmdir d1/d48/d85/dbe/dde 39 2024-04-25T16:25:52.182 INFO:tasks.workunit.client.0.smithi059.stdout:6/884: dread d9/f59 [0,4194304] 0 2024-04-25T16:25:52.194 INFO:tasks.workunit.client.0.smithi059.stdout:6/885: stat d9/d16/dc0/d10c/lcb 0 2024-04-25T16:25:52.466 INFO:tasks.workunit.client.0.smithi059.stdout:9/862: rename d6/d4e/d54/d5d/d48/d49/f58 to d6/d35/d6c/f100 0 2024-04-25T16:25:52.513 INFO:tasks.workunit.client.0.smithi059.stdout:3/867: unlink d0/d1e/f45 0 2024-04-25T16:25:52.524 INFO:tasks.workunit.client.0.smithi059.stdout:7/788: mkdir d0/d7/d51/da9/db3/d33/d79/d5d/d94/dfe 0 2024-04-25T16:25:52.607 INFO:tasks.workunit.client.0.smithi059.stdout:2/812: mkdir de/da1/d124 0 2024-04-25T16:25:52.649 INFO:tasks.workunit.client.0.smithi059.stdout:4/798: dwrite d0/d4/df/d1c/d45/d54/d75/d7e/fac [0,4194304] 0 2024-04-25T16:25:52.727 INFO:tasks.workunit.client.0.smithi059.stdout:6/886: fdatasync d9/f59 0 2024-04-25T16:25:52.731 INFO:tasks.workunit.client.0.smithi059.stdout:0/801: write dc/d44/d5f/f7e [3730864,45027] 0 2024-04-25T16:25:52.805 INFO:tasks.workunit.client.0.smithi059.stdout:0/802: read dc/d37/fa3 [3346053,8803] 0 2024-04-25T16:25:52.843 INFO:tasks.workunit.client.0.smithi059.stdout:2/813: dread de/d2a/d33/d65/dcf/fd1 [0,4194304] 0 2024-04-25T16:25:53.153 INFO:tasks.workunit.client.0.smithi059.stdout:9/863: rmdir d6/d35/d28/dc0/df9 39 2024-04-25T16:25:53.163 INFO:tasks.workunit.client.0.smithi059.stdout:9/864: chown d6/d35/d28/fe8 610 1 2024-04-25T16:25:53.313 INFO:tasks.workunit.client.0.smithi059.stdout:1/864: getdents d7/d21/d51 0 2024-04-25T16:25:53.809 INFO:tasks.workunit.client.0.smithi059.stdout:6/887: truncate d9/f21 4204903 0 2024-04-25T16:25:53.815 INFO:tasks.workunit.client.0.smithi059.stdout:4/799: chown d0/d4/df/d48/d5f/l9a 10172414 1 2024-04-25T16:25:53.837 INFO:tasks.workunit.client.0.smithi059.stdout:6/888: read d9/d1b/d58/d49/fd4 [296456,17705] 0 2024-04-25T16:25:53.988 INFO:tasks.workunit.client.0.smithi059.stdout:1/865: mkdir d7/d21/d51/da6/d11d 0 2024-04-25T16:25:54.050 INFO:tasks.workunit.client.0.smithi059.stdout:1/866: chown d7/d93/fb2 4163 1 2024-04-25T16:25:54.053 INFO:tasks.workunit.client.0.smithi059.stdout:5/871: dwrite d1/dcd/d44/d79/d92/ff8 [0,4194304] 0 2024-04-25T16:25:54.489 INFO:tasks.workunit.client.0.smithi059.stdout:4/800: creat d0/d4/df/d1c/d45/d54/d75/d82/d8f/ff1 x:0 0 0 2024-04-25T16:25:54.858 INFO:tasks.workunit.client.0.smithi059.stdout:9/865: symlink d6/l101 0 2024-04-25T16:25:54.866 INFO:tasks.workunit.client.0.smithi059.stdout:8/797: mkdir d7/d16/de0/d101/d37/d5c/d87/d94/d66/daa/d103 0 2024-04-25T16:25:55.100 INFO:tasks.workunit.client.0.smithi059.stdout:0/803: write dc/d37/d47/f64 [18163,99265] 0 2024-04-25T16:25:55.199 INFO:tasks.workunit.client.0.smithi059.stdout:3/868: dwrite d0/db/d2d/d7a/f108 [0,4194304] 0 2024-04-25T16:25:55.261 INFO:tasks.workunit.client.0.smithi059.stdout:1/867: mkdir d7/d21/d51/da6/d11d/d11e 0 2024-04-25T16:25:55.696 INFO:tasks.workunit.client.0.smithi059.stdout:7/789: rmdir d0/de5 39 2024-04-25T16:25:55.752 INFO:tasks.workunit.client.0.smithi059.stdout:2/814: dwrite f1 [0,4194304] 0 2024-04-25T16:25:55.820 INFO:tasks.workunit.client.0.smithi059.stdout:0/804: fdatasync dc/dd/d5c/fac 0 2024-04-25T16:25:55.848 INFO:tasks.workunit.client.0.smithi059.stdout:2/815: chown de/d2a/d2e/d36/la3 2673143 1 2024-04-25T16:25:55.933 INFO:tasks.workunit.client.0.smithi059.stdout:6/889: mknod d9/d27/c10f 0 2024-04-25T16:25:55.937 INFO:tasks.workunit.client.0.smithi059.stdout:1/868: unlink d7/d2a/d85/d8d/lc3 0 2024-04-25T16:25:55.943 INFO:tasks.workunit.client.0.smithi059.stdout:9/866: rename d6/f68 to d6/d4e/dba/f102 0 2024-04-25T16:25:55.972 INFO:tasks.workunit.client.0.smithi059.stdout:1/869: chown d7/d2a/db8/cd8 1 1 2024-04-25T16:25:56.111 INFO:tasks.workunit.client.0.smithi059.stdout:4/801: write d0/d4/df/d1c/d45/d54/dd4/fe1 [277324,22225] 0 2024-04-25T16:25:56.210 INFO:tasks.workunit.client.0.smithi059.stdout:0/805: mkdir dc/d37/d47/d109 0 2024-04-25T16:25:56.224 INFO:tasks.workunit.client.0.smithi059.stdout:8/798: write d7/f93 [4107565,10170] 0 2024-04-25T16:25:56.316 INFO:tasks.workunit.client.0.smithi059.stdout:2/816: mknod de/d5a/d9a/de9/c125 0 2024-04-25T16:25:56.321 INFO:tasks.workunit.client.0.smithi059.stdout:9/867: fdatasync d6/d35/d28/f40 0 2024-04-25T16:25:56.351 INFO:tasks.workunit.client.0.smithi059.stdout:8/799: sync 2024-04-25T16:25:56.373 INFO:tasks.workunit.client.0.smithi059.stdout:8/800: chown d7/f8e 854703198 1 2024-04-25T16:25:56.447 INFO:tasks.workunit.client.0.smithi059.stdout:1/870: dread d7/d2a/d85/db7/d2d/d4a/f4b [0,4194304] 0 2024-04-25T16:25:56.451 INFO:tasks.workunit.client.0.smithi059.stdout:8/801: sync 2024-04-25T16:25:56.528 INFO:tasks.workunit.client.0.smithi059.stdout:8/802: sync 2024-04-25T16:25:56.654 INFO:tasks.workunit.client.0.smithi059.stdout:5/872: write d1/d1e/d27/d66/f8b [3026845,114483] 0 2024-04-25T16:25:56.722 INFO:tasks.workunit.client.0.smithi059.stdout:6/890: symlink d9/d16/dc0/d10c/df6/l110 0 2024-04-25T16:25:56.729 INFO:tasks.workunit.client.0.smithi059.stdout:3/869: write d0/d1e/f6e [701307,29994] 0 2024-04-25T16:25:56.765 INFO:tasks.workunit.client.0.smithi059.stdout:2/817: truncate de/d2a/d2e/d36/d2c/d40/f47 748383 0 2024-04-25T16:25:56.820 INFO:tasks.workunit.client.0.smithi059.stdout:5/873: dread d1/d1e/d27/d66/f8b [0,4194304] 0 2024-04-25T16:25:57.002 INFO:tasks.workunit.client.0.smithi059.stdout:8/803: creat d7/d16/d36/dca/f104 x:0 0 0 2024-04-25T16:25:57.074 INFO:tasks.workunit.client.0.smithi059.stdout:0/806: mknod dc/dd/d3b/d66/c10a 0 2024-04-25T16:25:57.384 INFO:tasks.workunit.client.0.smithi059.stdout:4/802: write d0/fc [1623135,79701] 0 2024-04-25T16:25:57.394 INFO:tasks.workunit.client.0.smithi059.stdout:7/790: link d0/d7/d51/la4 d0/d7/d51/lff 0 2024-04-25T16:25:57.425 INFO:tasks.workunit.client.0.smithi059.stdout:5/874: creat d1/dcd/d50/d8a/dd8/f128 x:0 0 0 2024-04-25T16:25:57.441 INFO:tasks.workunit.client.0.smithi059.stdout:3/870: dread - d0/db/d2d/de1/f120 zero size 2024-04-25T16:25:57.444 INFO:tasks.workunit.client.0.smithi059.stdout:9/868: creat d6/d4e/d54/d5d/f103 x:0 0 0 2024-04-25T16:25:57.450 INFO:tasks.workunit.client.0.smithi059.stdout:8/804: rmdir d7/d16/de0/d101/d37/d8b 39 2024-04-25T16:25:57.528 INFO:tasks.workunit.client.0.smithi059.stdout:9/869: read - d6/d35/d6c/f6d zero size 2024-04-25T16:25:57.534 INFO:tasks.workunit.client.0.smithi059.stdout:8/805: chown d7/d2f/d76/fef 2025253 1 2024-04-25T16:25:57.566 INFO:tasks.workunit.client.0.smithi059.stdout:1/871: link d7/d2a/d85/db7/d16/d5c/d74/da7/fc6 d7/d21/d51/f11f 0 2024-04-25T16:25:57.685 INFO:tasks.workunit.client.0.smithi059.stdout:4/803: dread d0/d4/df/d74/f78 [0,4194304] 0 2024-04-25T16:25:57.697 INFO:tasks.workunit.client.0.smithi059.stdout:4/804: readlink d0/d4/df/d1c/l2b 0 2024-04-25T16:25:57.733 INFO:tasks.workunit.client.0.smithi059.stdout:7/791: rmdir d0/d7/d16/d20/dab 39 2024-04-25T16:25:58.002 INFO:tasks.workunit.client.0.smithi059.stdout:3/871: symlink d0/db/d47/d5b/d102/l135 0 2024-04-25T16:25:58.010 INFO:tasks.workunit.client.0.smithi059.stdout:8/806: symlink d7/dd/d17/db4/d7e/l105 0 2024-04-25T16:25:58.169 INFO:tasks.workunit.client.0.smithi059.stdout:4/805: fdatasync d0/d4/f1b 0 2024-04-25T16:25:58.217 INFO:tasks.workunit.client.0.smithi059.stdout:9/870: dread d6/d35/d26/d6b/dc9/dd6/fd9 [0,4194304] 0 2024-04-25T16:25:58.325 INFO:tasks.workunit.client.0.smithi059.stdout:7/792: mknod d0/d7/d51/da9/db3/d33/d79/d5d/d85/c100 0 2024-04-25T16:25:58.383 INFO:tasks.workunit.client.0.smithi059.stdout:6/891: write d9/d16/d53/f82 [280749,94104] 0 2024-04-25T16:25:58.408 INFO:tasks.workunit.client.0.smithi059.stdout:3/872: rmdir d0/d1e/d57/dc9 39 2024-04-25T16:25:58.503 INFO:tasks.workunit.client.0.smithi059.stdout:5/875: creat d1/d1e/f129 x:0 0 0 2024-04-25T16:25:58.585 INFO:tasks.workunit.client.0.smithi059.stdout:2/818: dwrite de/d2a/d2e/d36/d2c/d40/fcb [0,4194304] 0 2024-04-25T16:25:58.777 INFO:tasks.workunit.client.0.smithi059.stdout:0/807: dwrite dc/d44/f73 [0,4194304] 0 2024-04-25T16:25:58.838 INFO:tasks.workunit.client.0.smithi059.stdout:4/806: truncate d0/d4/df/d1c/fa0 4948658 0 2024-04-25T16:25:58.859 INFO:tasks.workunit.client.0.smithi059.stdout:7/793: read - d0/d7/d16/d20/ff4 zero size 2024-04-25T16:25:58.888 INFO:tasks.workunit.client.0.smithi059.stdout:7/794: chown d0/d7/f28 94748294 1 2024-04-25T16:25:58.938 INFO:tasks.workunit.client.0.smithi059.stdout:3/873: fdatasync d0/db/d3f/fc4 0 2024-04-25T16:25:59.198 INFO:tasks.workunit.client.0.smithi059.stdout:1/872: dwrite d7/d2a/d85/db7/d77/ff0 [0,4194304] 0 2024-04-25T16:25:59.204 INFO:tasks.workunit.client.0.smithi059.stdout:5/876: unlink d1/d1e/d27/l3b 0 2024-04-25T16:25:59.263 INFO:tasks.workunit.client.0.smithi059.stdout:1/873: stat l5 0 2024-04-25T16:25:59.273 INFO:tasks.workunit.client.0.smithi059.stdout:2/819: symlink de/d2a/d2e/d36/d2c/d40/de5/l126 0 2024-04-25T16:25:59.398 INFO:tasks.workunit.client.0.smithi059.stdout:6/892: mkdir d9/d16/d53/d55/d71/d7e/d9e/d111 0 2024-04-25T16:25:59.502 INFO:tasks.workunit.client.0.smithi059.stdout:4/807: dread - d0/d4/df/d1c/d45/d54/dd4/fda zero size 2024-04-25T16:25:59.507 INFO:tasks.workunit.client.0.smithi059.stdout:0/808: chown dc/d37/d47/d71/d9c/fc8 892356429 1 2024-04-25T16:25:59.596 INFO:tasks.workunit.client.0.smithi059.stdout:7/795: truncate d0/d7/d51/da9/db3/d33/d79/d5d/d94/fd6 155723 0 2024-04-25T16:25:59.817 INFO:tasks.workunit.client.0.smithi059.stdout:3/874: mknod d0/db/d3f/d49/c136 0 2024-04-25T16:25:59.824 INFO:tasks.workunit.client.0.smithi059.stdout:5/877: creat d1/dcd/d44/d79/dda/dfe/f12a x:0 0 0 2024-04-25T16:25:59.843 INFO:tasks.workunit.client.0.smithi059.stdout:1/874: mkdir d7/d21/d51/da6/d11d/d120 0 2024-04-25T16:25:59.910 INFO:tasks.workunit.client.0.smithi059.stdout:3/875: sync 2024-04-25T16:26:00.123 INFO:tasks.workunit.client.0.smithi059.stdout:7/796: mknod d0/d7/dae/de2/c101 0 2024-04-25T16:26:00.256 INFO:tasks.workunit.client.0.smithi059.stdout:8/807: dwrite d7/d16/de0/d101/f63 [0,4194304] 0 2024-04-25T16:26:00.322 INFO:tasks.workunit.client.0.smithi059.stdout:6/893: symlink d9/d1b/d58/d49/db0/dd7/l112 0 2024-04-25T16:26:00.323 INFO:tasks.workunit.client.0.smithi059.stdout:1/875: chown d7/d2a/d85/db7/d16/d72/c7a 4 1 2024-04-25T16:26:00.529 INFO:tasks.workunit.client.0.smithi059.stdout:3/876: rename d0/db/d3f/d89/db3/ffb to d0/db/d132/f137 0 2024-04-25T16:26:00.537 INFO:tasks.workunit.client.0.smithi059.stdout:7/797: creat d0/d7/d16/d5a/f102 x:0 0 0 2024-04-25T16:26:00.606 INFO:tasks.workunit.client.0.smithi059.stdout:7/798: chown d0/d7/f1f 0 1 2024-04-25T16:26:00.636 INFO:tasks.workunit.client.0.smithi059.stdout:8/808: mknod d7/dd/d17/db4/d7e/c106 0 2024-04-25T16:26:00.710 INFO:tasks.workunit.client.0.smithi059.stdout:9/871: dwrite d6/d35/fd4 [0,4194304] 0 2024-04-25T16:26:00.784 INFO:tasks.workunit.client.0.smithi059.stdout:6/894: fdatasync d9/d16/d53/d6c/da6/fc2 0 2024-04-25T16:26:00.818 INFO:tasks.workunit.client.0.smithi059.stdout:1/876: dread d7/d93/d8e/f9a [0,4194304] 0 2024-04-25T16:26:00.834 INFO:tasks.workunit.client.0.smithi059.stdout:6/895: chown d9/d1b/f48 140665852 1 2024-04-25T16:26:01.005 INFO:tasks.workunit.client.0.smithi059.stdout:3/877: fsync d0/db/d3f/d6c/fac 0 2024-04-25T16:26:01.020 INFO:tasks.workunit.client.0.smithi059.stdout:3/878: stat d0/db/d2d/de1/df2/ccf 0 2024-04-25T16:26:01.145 INFO:tasks.workunit.client.0.smithi059.stdout:0/809: getdents dc/d37/d47/d71/d9c/dca 0 2024-04-25T16:26:01.158 INFO:tasks.workunit.client.0.smithi059.stdout:0/810: chown dc/d37/d47/d81/dd2/ldc 54301376 1 2024-04-25T16:26:01.384 INFO:tasks.workunit.client.0.smithi059.stdout:1/877: truncate d7/d2a/d85/db7/d6a/fde 877770 0 2024-04-25T16:26:01.386 INFO:tasks.workunit.client.0.smithi059.stdout:1/878: chown d7 148293 1 2024-04-25T16:26:01.602 INFO:tasks.workunit.client.0.smithi059.stdout:0/811: mkdir dc/d37/d47/d71/d77/dce/d10b 0 2024-04-25T16:26:01.667 INFO:tasks.workunit.client.0.smithi059.stdout:1/879: rmdir d7 39 2024-04-25T16:26:01.752 INFO:tasks.workunit.client.0.smithi059.stdout:2/820: write de/d2a/d2e/f8b [292457,44082] 0 2024-04-25T16:26:01.929 INFO:tasks.workunit.client.0.smithi059.stdout:7/799: link d0/d7/d51/da9/db3/d33/d79/d5d/lea d0/d7/d51/da9/db3/d33/d79/l103 0 2024-04-25T16:26:01.980 INFO:tasks.workunit.client.0.smithi059.stdout:0/812: dread - dc/d37/d47/d81/fc0 zero size 2024-04-25T16:26:02.068 INFO:tasks.workunit.client.0.smithi059.stdout:0/813: sync 2024-04-25T16:26:02.522 INFO:tasks.workunit.client.0.smithi059.stdout:7/800: creat d0/d7/d51/f104 x:0 0 0 2024-04-25T16:26:02.528 INFO:tasks.workunit.client.0.smithi059.stdout:5/878: write d1/d1e/d27/fbd [60672,54501] 0 2024-04-25T16:26:02.578 INFO:tasks.workunit.client.0.smithi059.stdout:6/896: write d9/d16/d53/d55/d71/f109 [996063,4657] 0 2024-04-25T16:26:02.684 INFO:tasks.workunit.client.0.smithi059.stdout:9/872: write d6/fb [406601,97311] 0 2024-04-25T16:26:02.702 INFO:tasks.workunit.client.0.smithi059.stdout:3/879: write d0/d1e/d95/f103 [1707145,40578] 0 2024-04-25T16:26:02.777 INFO:tasks.workunit.client.0.smithi059.stdout:0/814: write dc/d37/d47/d81/fc0 [334553,6061] 0 2024-04-25T16:26:02.950 INFO:tasks.workunit.client.0.smithi059.stdout:4/808: dwrite d0/d4/df/d1c/d45/d54/f77 [0,4194304] 0 2024-04-25T16:26:03.035 INFO:tasks.workunit.client.0.smithi059.stdout:8/809: dwrite d7/d16/da3/fdf [0,4194304] 0 2024-04-25T16:26:03.048 INFO:tasks.workunit.client.0.smithi059.stdout:1/880: dread d7/d2a/d85/db7/d16/d7f/f9e [0,4194304] 0 2024-04-25T16:26:03.119 INFO:tasks.workunit.client.0.smithi059.stdout:8/810: sync 2024-04-25T16:26:03.170 INFO:tasks.workunit.client.0.smithi059.stdout:7/801: write d0/d7/f10 [1158996,78965] 0 2024-04-25T16:26:03.359 INFO:tasks.workunit.client.0.smithi059.stdout:5/879: dwrite d1/dd/fa5 [0,4194304] 0 2024-04-25T16:26:03.362 INFO:tasks.workunit.client.0.smithi059.stdout:6/897: dwrite d9/d1b/ffd [0,4194304] 0 2024-04-25T16:26:03.501 INFO:tasks.workunit.client.0.smithi059.stdout:0/815: mkdir dc/d37/d47/df7/d10c 0 2024-04-25T16:26:03.527 INFO:tasks.workunit.client.0.smithi059.stdout:2/821: getdents de/d2a/d2e 0 2024-04-25T16:26:03.640 INFO:tasks.workunit.client.0.smithi059.stdout:3/880: creat d0/d1e/d57/da8/dba/d10a/f138 x:0 0 0 2024-04-25T16:26:03.654 INFO:tasks.workunit.client.0.smithi059.stdout:4/809: symlink d0/d4/df/d48/da3/da4/lf2 0 2024-04-25T16:26:03.845 INFO:tasks.workunit.client.0.smithi059.stdout:9/873: creat d6/d35/d28/dc0/f104 x:0 0 0 2024-04-25T16:26:03.846 INFO:tasks.workunit.client.0.smithi059.stdout:5/880: mkdir d1/dcd/d44/d79/dda/dfe/d12b 0 2024-04-25T16:26:03.881 INFO:tasks.workunit.client.0.smithi059.stdout:2/822: mknod de/d2a/d2e/d36/d59/c127 0 2024-04-25T16:26:04.155 INFO:tasks.workunit.client.0.smithi059.stdout:8/811: symlink d7/l107 0 2024-04-25T16:26:04.214 INFO:tasks.workunit.client.0.smithi059.stdout:3/881: dread d0/d1e/f81 [0,4194304] 0 2024-04-25T16:26:04.474 INFO:tasks.workunit.client.0.smithi059.stdout:2/823: creat de/d2a/d2e/d36/d2c/d40/d57/f128 x:0 0 0 2024-04-25T16:26:04.805 INFO:tasks.workunit.client.0.smithi059.stdout:1/881: dwrite d7/de5/ff7 [0,4194304] 0 2024-04-25T16:26:04.879 INFO:tasks.workunit.client.0.smithi059.stdout:1/882: write d7/de5/ff7 [1898864,81296] 0 2024-04-25T16:26:04.962 INFO:tasks.workunit.client.0.smithi059.stdout:2/824: fdatasync de/d16/d9d/fba 0 2024-04-25T16:26:04.973 INFO:tasks.workunit.client.0.smithi059.stdout:2/825: readlink de/d5a/d9a/lb4 0 2024-04-25T16:26:05.127 INFO:tasks.workunit.client.0.smithi059.stdout:4/810: creat d0/d4/df/d48/ff3 x:0 0 0 2024-04-25T16:26:05.133 INFO:tasks.workunit.client.0.smithi059.stdout:3/882: truncate d0/db/d2d/de1/df2/f12e 987934 0 2024-04-25T16:26:05.152 INFO:tasks.workunit.client.0.smithi059.stdout:7/802: write d0/d7/d16/d20/d71/fd2 [1532743,112097] 0 2024-04-25T16:26:05.234 INFO:tasks.workunit.client.0.smithi059.stdout:4/811: chown d0/d4/df/d1c/c24 2 1 2024-04-25T16:26:05.291 INFO:tasks.workunit.client.0.smithi059.stdout:0/816: dwrite dc/dd/fae [0,4194304] 0 2024-04-25T16:26:05.346 INFO:tasks.workunit.client.0.smithi059.stdout:4/812: chown d0/d4/df/f8b 79 1 2024-04-25T16:26:05.368 INFO:tasks.workunit.client.0.smithi059.stdout:0/817: dread - dc/d44/d5f/f88 zero size 2024-04-25T16:26:05.390 INFO:tasks.workunit.client.0.smithi059.stdout:1/883: rename d7/d2a/d85/db7/d6a to d7/d2a/d85/db7/d16/d7f/dbe/d121 0 2024-04-25T16:26:05.396 INFO:tasks.workunit.client.0.smithi059.stdout:4/813: write d0/d4/df/d1c/d45/d54/f77 [2337504,117339] 0 2024-04-25T16:26:05.457 INFO:tasks.workunit.client.0.smithi059.stdout:6/898: write d9/d1b/f8e [457,101271] 0 2024-04-25T16:26:05.464 INFO:tasks.workunit.client.0.smithi059.stdout:2/826: creat de/d5a/d7d/d80/f129 x:0 0 0 2024-04-25T16:26:05.581 INFO:tasks.workunit.client.0.smithi059.stdout:3/883: unlink d0/db/d3f/d49/fc5 0 2024-04-25T16:26:05.725 INFO:tasks.workunit.client.0.smithi059.stdout:1/884: dread d7/d2a/d85/db7/d2d/f37 [0,4194304] 0 2024-04-25T16:26:05.775 INFO:tasks.workunit.client.0.smithi059.stdout:9/874: dwrite d6/dae/dc3/fed [0,4194304] 0 2024-04-25T16:26:05.894 INFO:tasks.workunit.client.0.smithi059.stdout:5/881: dwrite d1/dcd/d44/d79/dda/f11f [0,4194304] 0 2024-04-25T16:26:06.045 INFO:tasks.workunit.client.0.smithi059.stdout:0/818: symlink dc/d37/d47/d71/d9c/dca/l10d 0 2024-04-25T16:26:06.097 INFO:tasks.workunit.client.0.smithi059.stdout:4/814: fsync d0/d4/df/d44/f4d 0 2024-04-25T16:26:06.255 INFO:tasks.workunit.client.0.smithi059.stdout:2/827: creat de/d16/d9d/f12a x:0 0 0 2024-04-25T16:26:06.262 INFO:tasks.workunit.client.0.smithi059.stdout:6/899: creat d9/d27/d39/d7b/f113 x:0 0 0 2024-04-25T16:26:06.385 INFO:tasks.workunit.client.0.smithi059.stdout:7/803: dwrite d0/d7/d16/d5a/fd1 [0,4194304] 0 2024-04-25T16:26:06.643 INFO:tasks.workunit.client.0.smithi059.stdout:9/875: rename d6/d35/d28/dc0/ddc to d6/d35/d26/d6b/d105 0 2024-04-25T16:26:06.644 INFO:tasks.workunit.client.0.smithi059.stdout:3/884: dread - d0/db/d3f/d49/d65/dae/f115 zero size 2024-04-25T16:26:06.769 INFO:tasks.workunit.client.0.smithi059.stdout:5/882: symlink d1/dcd/d44/d79/dda/l12c 0 2024-04-25T16:26:06.772 INFO:tasks.workunit.client.0.smithi059.stdout:0/819: truncate dc/dd/d3b/d66/d9b/fb3 1313142 0 2024-04-25T16:26:06.789 INFO:tasks.workunit.client.0.smithi059.stdout:8/812: getdents d7/d16/de0/d101/d37/d5c/d87/d94/d7f 0 2024-04-25T16:26:06.806 INFO:tasks.workunit.client.0.smithi059.stdout:4/815: read d0/d4/df/f42 [419613,4482] 0 2024-04-25T16:26:06.821 INFO:tasks.workunit.client.0.smithi059.stdout:5/883: read - d1/dcd/d44/d79/f7e zero size 2024-04-25T16:26:06.839 INFO:tasks.workunit.client.0.smithi059.stdout:4/816: chown d0/d4/df/d48/d5f/l9a 0 1 2024-04-25T16:26:06.860 INFO:tasks.workunit.client.0.smithi059.stdout:0/820: sync 2024-04-25T16:26:06.872 INFO:tasks.workunit.client.0.smithi059.stdout:0/821: chown dc/d37/d47/d81/fc0 18 1 2024-04-25T16:26:06.968 INFO:tasks.workunit.client.0.smithi059.stdout:6/900: symlink d9/d16/d24/d97/dc3/l114 0 2024-04-25T16:26:06.998 INFO:tasks.workunit.client.0.smithi059.stdout:6/901: dread d9/d16/d53/d6c/da6/fd3 [0,4194304] 0 2024-04-25T16:26:07.276 INFO:tasks.workunit.client.0.smithi059.stdout:8/813: creat d7/dd/f108 x:0 0 0 2024-04-25T16:26:07.297 INFO:tasks.workunit.client.0.smithi059.stdout:1/885: write d7/f28 [2525481,40284] 0 2024-04-25T16:26:07.498 INFO:tasks.workunit.client.0.smithi059.stdout:9/876: symlink d6/dae/l106 0 2024-04-25T16:26:07.535 INFO:tasks.workunit.client.0.smithi059.stdout:9/877: dread d6/d35/d2f/fc1 [0,4194304] 0 2024-04-25T16:26:07.547 INFO:tasks.workunit.client.0.smithi059.stdout:9/878: chown d6/d4e/fb4 7775278 1 2024-04-25T16:26:07.594 INFO:tasks.workunit.client.0.smithi059.stdout:5/884: mkdir d1/d1e/d12d 0 2024-04-25T16:26:07.622 INFO:tasks.workunit.client.0.smithi059.stdout:7/804: write d0/d7/d51/da9/db3/d33/d79/d5d/db7/fef [1009270,79757] 0 2024-04-25T16:26:07.707 INFO:tasks.workunit.client.0.smithi059.stdout:8/814: creat d7/d16/d3a/f109 x:0 0 0 2024-04-25T16:26:07.796 INFO:tasks.workunit.client.0.smithi059.stdout:3/885: write d0/db/d2d/de4/f117 [589869,7735] 0 2024-04-25T16:26:07.797 INFO:tasks.workunit.client.0.smithi059.stdout:0/822: creat dc/d37/d47/d71/d77/dce/d10b/f10e x:0 0 0 2024-04-25T16:26:07.813 INFO:tasks.workunit.client.0.smithi059.stdout:0/823: readlink l8 0 2024-04-25T16:26:07.832 INFO:tasks.workunit.client.0.smithi059.stdout:0/824: readlink dc/d44/d5f/dc2/de5/lfe 0 2024-04-25T16:26:08.042 INFO:tasks.workunit.client.0.smithi059.stdout:9/879: dread - d6/d4e/d54/d5d/d95/fe2 zero size 2024-04-25T16:26:08.142 INFO:tasks.workunit.client.0.smithi059.stdout:6/902: dwrite d9/d16/dc0/d10c/ff7 [0,4194304] 0 2024-04-25T16:26:08.202 INFO:tasks.workunit.client.0.smithi059.stdout:5/885: truncate d1/d1e/d27/d66/d70/f10b 121042 0 2024-04-25T16:26:08.246 INFO:tasks.workunit.client.0.smithi059.stdout:5/886: stat d1/d1e/d27/d66/d70 0 2024-04-25T16:26:08.249 INFO:tasks.workunit.client.0.smithi059.stdout:6/903: chown d9/d1b/d58/d49/db0/lee 3 1 2024-04-25T16:26:08.279 INFO:tasks.workunit.client.0.smithi059.stdout:6/904: dread d9/d16/d24/d97/dc3/df5/d102/fed [0,4194304] 0 2024-04-25T16:26:08.319 INFO:tasks.workunit.client.0.smithi059.stdout:5/887: sync 2024-04-25T16:26:08.474 INFO:tasks.workunit.client.0.smithi059.stdout:0/825: creat dc/d37/d47/d71/d77/dce/f10f x:0 0 0 2024-04-25T16:26:08.573 INFO:tasks.workunit.client.0.smithi059.stdout:2/828: getdents de/d2a/d2e/d36/d2c 0 2024-04-25T16:26:08.730 INFO:tasks.workunit.client.0.smithi059.stdout:9/880: mkdir d6/d4e/d54/d5d/d95/d107 0 2024-04-25T16:26:08.933 INFO:tasks.workunit.client.0.smithi059.stdout:7/805: write d0/f56 [159895,117807] 0 2024-04-25T16:26:08.976 INFO:tasks.workunit.client.0.smithi059.stdout:3/886: creat d0/d1e/d95/d11e/f139 x:0 0 0 2024-04-25T16:26:09.074 INFO:tasks.workunit.client.0.smithi059.stdout:6/905: dread - d9/d1b/d58/d49/db0/f103 zero size 2024-04-25T16:26:09.305 INFO:tasks.workunit.client.0.smithi059.stdout:0/826: unlink dc/dd/d3b/d66/lda 0 2024-04-25T16:26:09.311 INFO:tasks.workunit.client.0.smithi059.stdout:2/829: mkdir de/d5a/d9a/de9/dea/d12b 0 2024-04-25T16:26:09.318 INFO:tasks.workunit.client.0.smithi059.stdout:8/815: write d7/d2f/d43/f96 [4361617,119517] 0 2024-04-25T16:26:09.366 INFO:tasks.workunit.client.0.smithi059.stdout:1/886: write d7/fce [4964747,69067] 0 2024-04-25T16:26:09.976 INFO:tasks.workunit.client.0.smithi059.stdout:7/806: dread d0/d7/d51/da9/db3/d33/d79/d5d/d85/ff7 [0,4194304] 0 2024-04-25T16:26:10.030 INFO:tasks.workunit.client.0.smithi059.stdout:3/887: dread - d0/d1e/d57/da8/ff8 zero size 2024-04-25T16:26:10.109 INFO:tasks.workunit.client.0.smithi059.stdout:2/830: read de/f86 [123226,9627] 0 2024-04-25T16:26:10.178 INFO:tasks.workunit.client.0.smithi059.stdout:0/827: creat dc/dd/d3b/f110 x:0 0 0 2024-04-25T16:26:10.439 INFO:tasks.workunit.client.0.smithi059.stdout:5/888: write d1/d1e/d27/d66/d70/f23 [4109422,87817] 0 2024-04-25T16:26:10.508 INFO:tasks.workunit.client.0.smithi059.stdout:1/887: mknod d7/d21/d51/c122 0 2024-04-25T16:26:10.518 INFO:tasks.workunit.client.0.smithi059.stdout:5/889: sync 2024-04-25T16:26:10.592 INFO:tasks.workunit.client.0.smithi059.stdout:8/816: dread d7/dd/d33/d57/fa0 [0,4194304] 0 2024-04-25T16:26:10.731 INFO:tasks.workunit.client.0.smithi059.stdout:3/888: mkdir d0/d1e/d31/dc7/d13a 0 2024-04-25T16:26:10.771 INFO:tasks.workunit.client.0.smithi059.stdout:3/889: chown d0/db/d3f/d49/d65/dae/f115 75 1 2024-04-25T16:26:10.783 INFO:tasks.workunit.client.0.smithi059.stdout:3/890: chown d0/db/d3f/d49/f7b 15 1 2024-04-25T16:26:10.981 INFO:tasks.workunit.client.0.smithi059.stdout:9/881: creat d6/d4e/d54/d5d/d48/f108 x:0 0 0 2024-04-25T16:26:10.991 INFO:tasks.workunit.client.0.smithi059.stdout:9/882: chown d6/d4e/d54/d5d 20439 1 2024-04-25T16:26:11.000 INFO:tasks.workunit.client.0.smithi059.stdout:9/883: chown d6/d35/d6c/f79 1 1 2024-04-25T16:26:11.010 INFO:tasks.workunit.client.0.smithi059.stdout:9/884: stat d6/d35/d26/d6b/fdb 0 2024-04-25T16:26:11.138 INFO:tasks.workunit.client.0.smithi059.stdout:8/817: creat d7/d16/d36/f10a x:0 0 0 2024-04-25T16:26:11.277 INFO:tasks.workunit.client.0.smithi059.stdout:1/888: dread d7/d2a/d85/db7/d16/d5c/d74/fe4 [0,4194304] 0 2024-04-25T16:26:11.283 INFO:tasks.workunit.client.0.smithi059.stdout:7/807: rename d0/d7/d16/d20/dab/dd5/fe0 to d0/d7/d51/da9/db3/d33/d79/d5d/d94/f105 0 2024-04-25T16:26:11.512 INFO:tasks.workunit.client.0.smithi059.stdout:3/891: chown d0/d1e/d11f 0 1 2024-04-25T16:26:11.521 INFO:tasks.workunit.client.0.smithi059.stdout:3/892: readlink d0/db/d3f/d89/lb0 0 2024-04-25T16:26:11.574 INFO:tasks.workunit.client.0.smithi059.stdout:2/831: creat de/d2a/d2e/d36/d11d/f12c x:0 0 0 2024-04-25T16:26:11.930 INFO:tasks.workunit.client.0.smithi059.stdout:7/808: dread d0/d7/d51/da9/db3/d33/d79/fc4 [0,4194304] 0 2024-04-25T16:26:12.012 INFO:tasks.workunit.client.0.smithi059.stdout:9/885: rename d6/d35/d6c/f100 to d6/d35/d26/f109 0 2024-04-25T16:26:12.301 INFO:tasks.workunit.client.0.smithi059.stdout:4/817: creat d0/ff4 x:0 0 0 2024-04-25T16:26:12.327 INFO:tasks.workunit.client.0.smithi059.stdout:6/906: dwrite d9/d27/d68/fa0 [0,4194304] 0 2024-04-25T16:26:12.431 INFO:tasks.workunit.client.0.smithi059.stdout:6/907: chown d9/d16/d24/d106 374 1 2024-04-25T16:26:12.455 INFO:tasks.workunit.client.0.smithi059.stdout:7/809: rename d0/d7/d16/d20/d71 to d0/d7/d51/da9/db3/d33/d79/d5d/d94/d106 0 2024-04-25T16:26:12.517 INFO:tasks.workunit.client.0.smithi059.stdout:0/828: dwrite dc/dd/d3b/d66/d9b/f82 [0,4194304] 0 2024-04-25T16:26:12.659 INFO:tasks.workunit.client.0.smithi059.stdout:4/818: dread d0/d4/f35 [0,4194304] 0 2024-04-25T16:26:12.690 INFO:tasks.workunit.client.0.smithi059.stdout:5/890: dwrite d1/dcd/d44/fe3 [0,4194304] 0 2024-04-25T16:26:12.796 INFO:tasks.workunit.client.0.smithi059.stdout:2/832: creat de/d5a/f12d x:0 0 0 2024-04-25T16:26:12.977 INFO:tasks.workunit.client.0.smithi059.stdout:8/818: write d7/d2f/d76/f97 [3137908,47732] 0 2024-04-25T16:26:13.149 INFO:tasks.workunit.client.0.smithi059.stdout:1/889: dwrite d7/d2a/d85/db7/d16/d5c/f70 [0,4194304] 0 2024-04-25T16:26:13.158 INFO:tasks.workunit.client.0.smithi059.stdout:3/893: dwrite d0/db/d3f/d49/f7b [0,4194304] 0 2024-04-25T16:26:13.220 INFO:tasks.workunit.client.0.smithi059.stdout:7/810: rename d0/d7/f1d to d0/d7/d51/da9/f107 0 2024-04-25T16:26:13.289 INFO:tasks.workunit.client.0.smithi059.stdout:0/829: symlink dc/d37/d47/d71/l111 0 2024-04-25T16:26:13.329 INFO:tasks.workunit.client.0.smithi059.stdout:3/894: chown d0/d1e/d31/cbf 9 1 2024-04-25T16:26:13.428 INFO:tasks.workunit.client.0.smithi059.stdout:3/895: sync 2024-04-25T16:26:13.601 INFO:tasks.workunit.client.0.smithi059.stdout:5/891: unlink d1/dd/cd6 0 2024-04-25T16:26:13.863 INFO:tasks.workunit.client.0.smithi059.stdout:6/908: dwrite d9/d16/d24/d97/dc3/df5/d102/fed [0,4194304] 0 2024-04-25T16:26:13.927 INFO:tasks.workunit.client.0.smithi059.stdout:6/909: chown d9/d1b/f73 4357273 1 2024-04-25T16:26:14.266 INFO:tasks.workunit.client.0.smithi059.stdout:2/833: mkdir de/d2a/d33/d12e 0 2024-04-25T16:26:14.506 INFO:tasks.workunit.client.0.smithi059.stdout:0/830: symlink dc/df/d5e/dc6/l112 0 2024-04-25T16:26:14.541 INFO:tasks.workunit.client.0.smithi059.stdout:7/811: dread d0/d7/f7c [0,4194304] 0 2024-04-25T16:26:14.630 INFO:tasks.workunit.client.0.smithi059.stdout:5/892: mkdir d1/dcd/d50/d8a/d12e 0 2024-04-25T16:26:14.637 INFO:tasks.workunit.client.0.smithi059.stdout:3/896: chown d0/l8 2008 1 2024-04-25T16:26:14.777 INFO:tasks.workunit.client.0.smithi059.stdout:6/910: truncate d9/d27/d39/ff1 471401 0 2024-04-25T16:26:14.915 INFO:tasks.workunit.client.0.smithi059.stdout:9/886: getdents d6/d35/d26/d6b/dc9/dd6 0 2024-04-25T16:26:14.969 INFO:tasks.workunit.client.0.smithi059.stdout:0/831: dread - dc/df/d5e/dc6/fff zero size 2024-04-25T16:26:15.057 INFO:tasks.workunit.client.0.smithi059.stdout:7/812: mkdir d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/d108 0 2024-04-25T16:26:15.062 INFO:tasks.workunit.client.0.smithi059.stdout:4/819: dwrite d0/d4/df/d48/d5f/fb8 [0,4194304] 0 2024-04-25T16:26:15.524 INFO:tasks.workunit.client.0.smithi059.stdout:8/819: link d7/dd/d17/db4/d7e/l105 d7/d16/de0/l10b 0 2024-04-25T16:26:15.537 INFO:tasks.workunit.client.0.smithi059.stdout:8/820: dread - d7/dd/d17/db4/fac zero size 2024-04-25T16:26:15.652 INFO:tasks.workunit.client.0.smithi059.stdout:1/890: rename d7/d2a/d85/db7/f63 to d7/d2a/d85/db7/d16/f123 0 2024-04-25T16:26:15.658 INFO:tasks.workunit.client.0.smithi059.stdout:0/832: truncate dc/dd/fae 3699468 0 2024-04-25T16:26:15.753 INFO:tasks.workunit.client.0.smithi059.stdout:4/820: mkdir d0/d4/df/d1c/d45/d54/d75/d7e/df5 0 2024-04-25T16:26:15.831 INFO:tasks.workunit.client.0.smithi059.stdout:8/821: rmdir d7/d16/d36/dca 39 2024-04-25T16:26:15.942 INFO:tasks.workunit.client.0.smithi059.stdout:5/893: link d1/dcd/d50/db8/ce2 d1/dcd/d44/d79/dda/dfe/d12b/c12f 0 2024-04-25T16:26:15.948 INFO:tasks.workunit.client.0.smithi059.stdout:5/894: chown d1/l6a 0 1 2024-04-25T16:26:16.182 INFO:tasks.workunit.client.0.smithi059.stdout:4/821: creat d0/d4/df/d74/ff6 x:0 0 0 2024-04-25T16:26:16.361 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:26:16.364 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:26:16.378 INFO:tasks.workunit.client.0.smithi059.stdout:8/822: creat d7/d16/de0/d101/d37/d5c/d87/d94/d7f/f10c x:0 0 0 2024-04-25T16:26:16.413 INFO:tasks.workunit.client.0.smithi059.stdout:9/887: link d6/d4e/d54/d5d/d48/d49/cbf d6/d35/d26/d6b/dc9/dd6/c10a 0 2024-04-25T16:26:16.485 INFO:tasks.workunit.client.0.smithi059.stdout:2/834: write de/d16/d7f/fdd [959444,80128] 0 2024-04-25T16:26:16.547 INFO:tasks.workunit.client.0.smithi059.stdout:4/822: fdatasync d0/d4/df/d48/ff3 0 2024-04-25T16:26:16.572 INFO:tasks.workunit.client.0.smithi059.stdout:4/823: truncate d0/d4/df/d74/ff6 873715 0 2024-04-25T16:26:16.654 INFO:tasks.workunit.client.0.smithi059.stdout:5/895: symlink d1/d1e/l130 0 2024-04-25T16:26:16.750 INFO:tasks.workunit.client.0.smithi059.stdout:2/835: dread de/d2a/d2e/d36/d2c/d40/f52 [0,4194304] 0 2024-04-25T16:26:16.758 INFO:tasks.workunit.client.0.smithi059.stdout:8/823: getdents d7/d16/d8f/dc0 0 2024-04-25T16:26:16.781 INFO:tasks.workunit.client.0.smithi059.stdout:4/824: stat d0/d4/df/d1c/d45/d54/fb7 0 2024-04-25T16:26:16.791 INFO:tasks.workunit.client.0.smithi059.stdout:6/911: write d9/fb2 [1028491,60143] 0 2024-04-25T16:26:16.877 INFO:tasks.workunit.client.0.smithi059.stdout:5/896: dread d1/d1e/d27/d66/d70/d24/f62 [0,4194304] 0 2024-04-25T16:26:17.038 INFO:tasks.workunit.client.0.smithi059.stdout:8/824: fdatasync d7/dd/d33/d57/fa0 0 2024-04-25T16:26:17.041 INFO:tasks.workunit.client.0.smithi059.stdout:9/888: link d6/d35/fea d6/d4e/d54/d5d/d48/d49/dfb/f10b 0 2024-04-25T16:26:17.509 INFO:tasks.workunit.client.0.smithi059.stdout:7/813: dwrite d0/d7/fa [4194304,4194304] 0 2024-04-25T16:26:17.585 INFO:tasks.workunit.client.0.smithi059.stdout:8/825: fdatasync d7/d2f/fa8 0 2024-04-25T16:26:17.688 INFO:tasks.workunit.client.0.smithi059.stdout:3/897: dwrite d0/d1e/f8f [0,4194304] 0 2024-04-25T16:26:17.814 INFO:tasks.workunit.client.0.smithi059.stdout:8/826: creat d7/d16/de0/f10d x:0 0 0 2024-04-25T16:26:17.885 INFO:tasks.workunit.client.0.smithi059.stdout:3/898: read - d0/d1e/d31/f6b zero size 2024-04-25T16:26:17.965 INFO:tasks.workunit.client.0.smithi059.stdout:1/891: dwrite d7/d2a/d85/db7/d16/f46 [0,4194304] 0 2024-04-25T16:26:18.052 INFO:tasks.workunit.client.0.smithi059.stdout:0/833: dwrite dc/d37/d47/d71/d77/f85 [4194304,4194304] 0 2024-04-25T16:26:18.153 INFO:tasks.workunit.client.0.smithi059.stdout:3/899: dread d0/db/d47/d5b/fd2 [0,4194304] 0 2024-04-25T16:26:18.367 INFO:tasks.workunit.client.0.smithi059.stdout:6/912: write d9/f95 [573878,107447] 0 2024-04-25T16:26:18.370 INFO:tasks.workunit.client.0.smithi059.stdout:2/836: write de/d5a/f77 [357380,14501] 0 2024-04-25T16:26:18.555 INFO:tasks.workunit.client.0.smithi059.stdout:2/837: read de/d5a/d7d/fc3 [699387,52838] 0 2024-04-25T16:26:18.617 INFO:tasks.workunit.client.0.smithi059.stdout:6/913: chown d9/d27/d68/c108 1644740 1 2024-04-25T16:26:18.656 INFO:tasks.workunit.client.0.smithi059.stdout:4/825: dwrite d0/d4/df/d1c/d45/d54/d75/d82/d8f/fb5 [8388608,4194304] 0 2024-04-25T16:26:18.708 INFO:tasks.workunit.client.0.smithi059.stdout:5/897: dwrite d1/dcd/d44/d79/d92/fc1 [0,4194304] 0 2024-04-25T16:26:18.769 INFO:tasks.workunit.client.0.smithi059.stdout:7/814: dwrite d0/d7/d51/da9/db3/d33/d79/d5d/d85/ff7 [0,4194304] 0 2024-04-25T16:26:18.855 INFO:tasks.workunit.client.0.smithi059.stdout:4/826: chown d0/d4/df/c3c 0 1 2024-04-25T16:26:18.894 INFO:tasks.workunit.client.0.smithi059.stdout:9/889: link d6/d35/d28/c90 d6/d35/d26/c10c 0 2024-04-25T16:26:18.907 INFO:tasks.workunit.client.0.smithi059.stdout:0/834: mkdir dc/d44/d5f/dc2/de5/d113 0 2024-04-25T16:26:18.930 INFO:tasks.workunit.client.0.smithi059.stdout:4/827: readlink d0/d4/df/d48/da3/da4/ld6 0 2024-04-25T16:26:18.950 INFO:tasks.workunit.client.0.smithi059.stdout:3/900: rename d0/db/d3f/d6c/dea/cb8 to d0/db/d47/d5b/d102/c13b 0 2024-04-25T16:26:19.254 INFO:tasks.workunit.client.0.smithi059.stdout:2/838: chown de/d2a/c45 2 1 2024-04-25T16:26:19.452 INFO:tasks.workunit.client.0.smithi059.stdout:5/898: creat d1/dcd/d50/f131 x:0 0 0 2024-04-25T16:26:19.519 INFO:tasks.workunit.client.0.smithi059.stdout:7/815: dread d0/d7/d16/f53 [0,4194304] 0 2024-04-25T16:26:19.710 INFO:tasks.workunit.client.0.smithi059.stdout:8/827: symlink d7/l10e 0 2024-04-25T16:26:19.717 INFO:tasks.workunit.client.0.smithi059.stdout:8/828: stat d7/d16/f9e 0 2024-04-25T16:26:19.789 INFO:tasks.workunit.client.0.smithi059.stdout:0/835: read dc/d44/f73 [1187370,105630] 0 2024-04-25T16:26:19.850 INFO:tasks.workunit.client.0.smithi059.stdout:8/829: dread d7/d16/d36/fa6 [0,4194304] 0 2024-04-25T16:26:20.050 INFO:tasks.workunit.client.0.smithi059.stdout:9/890: dread d6/d35/d26/f109 [0,4194304] 0 2024-04-25T16:26:20.062 INFO:tasks.workunit.client.0.smithi059.stdout:3/901: dread d0/d1e/f56 [0,4194304] 0 2024-04-25T16:26:20.100 INFO:tasks.workunit.client.0.smithi059.stdout:5/899: read d1/dcd/d44/f67 [1006609,80977] 0 2024-04-25T16:26:20.122 INFO:tasks.workunit.client.0.smithi059.stdout:0/836: mknod dc/d37/d47/d60/c114 0 2024-04-25T16:26:20.130 INFO:tasks.workunit.client.0.smithi059.stdout:1/892: write d7/d2a/d85/db7/dbb/fdb [1320866,80878] 0 2024-04-25T16:26:20.181 INFO:tasks.workunit.client.0.smithi059.stdout:8/830: fdatasync d7/dd/d17/db4/d7e/da5/ff2 0 2024-04-25T16:26:20.312 INFO:tasks.workunit.client.0.smithi059.stdout:2/839: link de/d2a/d2e/d36/d59/ff9 de/d67/f12f 0 2024-04-25T16:26:20.461 INFO:tasks.workunit.client.0.smithi059.stdout:3/902: symlink d0/d1e/d31/l13c 0 2024-04-25T16:26:20.493 INFO:tasks.workunit.client.0.smithi059.stdout:0/837: dread - dc/df/d5e/fea zero size 2024-04-25T16:26:20.921 INFO:tasks.workunit.client.0.smithi059.stdout:6/914: getdents d9/d16/d24/d97 0 2024-04-25T16:26:21.032 INFO:tasks.workunit.client.0.smithi059.stdout:0/838: symlink dc/d37/d47/d71/d77/dce/d10b/l115 0 2024-04-25T16:26:21.113 INFO:tasks.workunit.client.0.smithi059.stdout:1/893: mknod d7/d2a/d85/db7/dbb/de6/c124 0 2024-04-25T16:26:21.168 INFO:tasks.workunit.client.0.smithi059.stdout:4/828: link d0/d4/df/d1c/d45/d54/d75/fbc d0/d4/df/d48/da9/ff7 0 2024-04-25T16:26:21.247 INFO:tasks.workunit.client.0.smithi059.stdout:2/840: mknod de/d2a/d2e/d36/d123/da6/c130 0 2024-04-25T16:26:21.383 INFO:tasks.workunit.client.0.smithi059.stdout:6/915: rename d9/d16/d53/d55/l83 to d9/d16/d53/d55/d71/d7e/d9e/dd8/l115 0 2024-04-25T16:26:21.506 INFO:tasks.workunit.client.0.smithi059.stdout:1/894: creat d7/d21/d51/f125 x:0 0 0 2024-04-25T16:26:21.508 INFO:tasks.workunit.client.0.smithi059.stdout:0/839: dread - dc/d37/d47/d60/ffc zero size 2024-04-25T16:26:21.577 INFO:tasks.workunit.client.0.smithi059.stdout:2/841: readlink de/d2a/d2e/d36/d2c/d40/d57/lae 0 2024-04-25T16:26:21.578 INFO:tasks.workunit.client.0.smithi059.stdout:7/816: write d0/d7/d51/da9/db3/d33/d79/d5d/d94/fa2 [879793,82500] 0 2024-04-25T16:26:21.672 INFO:tasks.workunit.client.0.smithi059.stdout:1/895: readlink d7/l104 0 2024-04-25T16:26:21.683 INFO:tasks.workunit.client.0.smithi059.stdout:2/842: dread - de/da1/fb0 zero size 2024-04-25T16:26:21.707 INFO:tasks.workunit.client.0.smithi059.stdout:0/840: dread dc/dd/d5c/fac [0,4194304] 0 2024-04-25T16:26:21.741 INFO:tasks.workunit.client.0.smithi059.stdout:0/841: chown dc/d37/d47/d81/dd2 930 1 2024-04-25T16:26:21.773 INFO:tasks.workunit.client.0.smithi059.stdout:0/842: dread dc/dd/d3b/fb1 [0,4194304] 0 2024-04-25T16:26:22.056 INFO:tasks.workunit.client.0.smithi059.stdout:9/891: write d6/d35/fc4 [771647,19700] 0 2024-04-25T16:26:22.060 INFO:tasks.workunit.client.0.smithi059.stdout:5/900: write d1/d1e/d27/d66/d70/d75/fdd [815293,119026] 0 2024-04-25T16:26:22.179 INFO:tasks.workunit.client.0.smithi059.stdout:5/901: sync 2024-04-25T16:26:22.221 INFO:tasks.workunit.client.0.smithi059.stdout:8/831: write d7/d16/da3/fbc [1194383,91731] 0 2024-04-25T16:26:22.245 INFO:tasks.workunit.client.0.smithi059.stdout:6/916: write d9/f72 [4206219,16560] 0 2024-04-25T16:26:22.254 INFO:tasks.workunit.client.0.smithi059.stdout:2/843: mkdir de/d2a/d2e/d36/d2c/d131 0 2024-04-25T16:26:22.312 INFO:tasks.workunit.client.0.smithi059.stdout:2/844: sync 2024-04-25T16:26:22.386 INFO:tasks.workunit.client.0.smithi059.stdout:2/845: sync 2024-04-25T16:26:22.491 INFO:tasks.workunit.client.0.smithi059.stdout:3/903: dwrite d0/db/d47/d5b/f88 [0,4194304] 0 2024-04-25T16:26:22.493 INFO:tasks.workunit.client.0.smithi059.stdout:2/846: chown de/d16/f7b 67092586 1 2024-04-25T16:26:22.564 INFO:tasks.workunit.client.0.smithi059.stdout:1/896: dread d7/d2a/d85/db7/d16/f24 [0,4194304] 0 2024-04-25T16:26:22.605 INFO:tasks.workunit.client.0.smithi059.stdout:5/902: chown d1/d48/d85/dbe/dde 62460 1 2024-04-25T16:26:22.685 INFO:tasks.workunit.client.0.smithi059.stdout:5/903: dread - d1/d48/da3/fc8 zero size 2024-04-25T16:26:22.711 INFO:tasks.workunit.client.0.smithi059.stdout:6/917: creat d9/d16/dc0/d10c/f116 x:0 0 0 2024-04-25T16:26:22.789 INFO:tasks.workunit.client.0.smithi059.stdout:7/817: dwrite d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/fbd [0,4194304] 0 2024-04-25T16:26:22.926 INFO:tasks.workunit.client.0.smithi059.stdout:0/843: dwrite dc/dd/d3b/d66/f87 [0,4194304] 0 2024-04-25T16:26:23.005 INFO:tasks.workunit.client.0.smithi059.stdout:4/829: truncate d0/d4/df/d1c/d45/d54/d75/fbc 663627 0 2024-04-25T16:26:23.012 INFO:tasks.workunit.client.0.smithi059.stdout:3/904: unlink d0/d1e/d95/f103 0 2024-04-25T16:26:23.029 INFO:tasks.workunit.client.0.smithi059.stdout:9/892: truncate d6/d4e/d54/d5d/fbb 16287 0 2024-04-25T16:26:23.053 INFO:tasks.workunit.client.0.smithi059.stdout:0/844: chown dc/la8 14478 1 2024-04-25T16:26:23.069 INFO:tasks.workunit.client.0.smithi059.stdout:0/845: chown dc/d44/ca7 7 1 2024-04-25T16:26:23.269 INFO:tasks.workunit.client.0.smithi059.stdout:5/904: fdatasync d1/dcd/f55 0 2024-04-25T16:26:23.273 INFO:tasks.workunit.client.0.smithi059.stdout:6/918: creat d9/d16/dc0/d10c/f117 x:0 0 0 2024-04-25T16:26:23.444 INFO:tasks.workunit.client.0.smithi059.stdout:3/905: mkdir d0/d1e/d57/da8/d13d 0 2024-04-25T16:26:23.873 INFO:tasks.workunit.client.0.smithi059.stdout:8/832: creat d7/d16/de0/d101/d37/d5c/d87/d94/dcd/f10f x:0 0 0 2024-04-25T16:26:23.976 INFO:tasks.workunit.client.0.smithi059.stdout:7/818: truncate d0/f9a 1794275 0 2024-04-25T16:26:24.191 INFO:tasks.workunit.client.0.smithi059.stdout:1/897: creat d7/d2a/d85/f126 x:0 0 0 2024-04-25T16:26:24.207 INFO:tasks.workunit.client.0.smithi059.stdout:4/830: write d0/d4/df/d1c/d45/f9b [4058214,86500] 0 2024-04-25T16:26:24.209 INFO:tasks.workunit.client.0.smithi059.stdout:0/846: write dc/f4e [184570,41944] 0 2024-04-25T16:26:24.235 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:40:36.839 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:26:24.242 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:40:36.847 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:26:24.249 INFO:tasks.workunit.client.0.smithi059.stdout:4/831: chown d0/d4/df/d1c/f8d 138264 1 2024-04-25T16:26:24.258 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:40:36.821 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:26:24.261 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:40:36.824 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:26:24.263 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:40:36.827 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:26:24.266 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:40:36.830 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:26:24.360 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:40:36.965 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:26:24.373 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:40:36.937 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:26:24.380 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:40:36.944 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:26:24.432 INFO:tasks.workunit.client.0.smithi059.stdout:4/832: dread d0/d4/df/d1c/f3d [0,4194304] 0 2024-04-25T16:26:24.925 INFO:tasks.workunit.client.0.smithi059.stdout:2/847: getdents de/d5a/d9a 0 2024-04-25T16:26:25.037 INFO:tasks.workunit.client.0.smithi059.stdout:9/893: creat d6/dae/f10d x:0 0 0 2024-04-25T16:26:25.140 INFO:tasks.workunit.client.0.smithi059.stdout:3/906: mknod d0/d1e/d57/dc9/c13e 0 2024-04-25T16:26:25.234 INFO:tasks.workunit.client.0.smithi059.stdout:3/907: chown d0/db/d47/d5b/c78 23 1 2024-04-25T16:26:25.309 INFO:tasks.workunit.client.0.smithi059.stdout:4/833: dread d0/d4/df/d1c/d45/d54/d75/d82/faf [0,4194304] 0 2024-04-25T16:26:25.327 INFO:tasks.workunit.client.0.smithi059.stdout:5/905: dwrite d1/d1e/f2d [0,4194304] 0 2024-04-25T16:26:25.406 INFO:tasks.workunit.client.0.smithi059.stdout:2/848: creat de/d2a/d2e/de1/f132 x:0 0 0 2024-04-25T16:26:25.454 INFO:tasks.workunit.client.0.smithi059.stdout:1/898: symlink d7/d2a/d85/l127 0 2024-04-25T16:26:25.512 INFO:tasks.workunit.client.0.smithi059.stdout:6/919: dwrite d9/d27/d68/fa0 [0,4194304] 0 2024-04-25T16:26:25.590 INFO:tasks.workunit.client.0.smithi059.stdout:0/847: fdatasync dc/df/d24/fb5 0 2024-04-25T16:26:25.612 INFO:tasks.workunit.client.0.smithi059.stdout:8/833: write d7/d2f/d76/f97 [4205218,96534] 0 2024-04-25T16:26:25.712 INFO:tasks.workunit.client.0.smithi059.stdout:4/834: dwrite d0/d4/df/d1c/d45/f9b [4194304,4194304] 0 2024-04-25T16:26:25.712 INFO:tasks.workunit.client.0.smithi059.stdout:8/834: sync 2024-04-25T16:26:25.784 INFO:tasks.workunit.client.0.smithi059.stdout:2/849: truncate fb 3939836 0 2024-04-25T16:26:25.830 INFO:tasks.workunit.client.0.smithi059.stdout:5/906: symlink d1/d1e/dca/d113/dcc/l132 0 2024-04-25T16:26:25.928 INFO:tasks.workunit.client.0.smithi059.stdout:1/899: creat d7/d2a/d85/db7/dbb/dc2/f128 x:0 0 0 2024-04-25T16:26:25.987 INFO:tasks.workunit.client.0.smithi059.stdout:1/900: sync 2024-04-25T16:26:26.037 INFO:tasks.workunit.client.0.smithi059.stdout:7/819: getdents d0/d7 0 2024-04-25T16:26:26.083 INFO:tasks.workunit.client.0.smithi059.stdout:3/908: getdents d0/d1e/d31/dc7/d13a 0 2024-04-25T16:26:26.146 INFO:tasks.workunit.client.0.smithi059.stdout:6/920: dread d9/d1b/f8e [0,4194304] 0 2024-04-25T16:26:26.289 INFO:tasks.workunit.client.0.smithi059.stdout:8/835: mknod d7/d16/de0/d101/d38/c110 0 2024-04-25T16:26:26.303 INFO:tasks.workunit.client.0.smithi059.stdout:4/835: read d0/d4/df/d1c/d45/d54/d75/d82/d8f/fb5 [11376880,75269] 0 2024-04-25T16:26:26.486 INFO:tasks.workunit.client.0.smithi059.stdout:3/909: creat d0/db/d3f/dce/f13f x:0 0 0 2024-04-25T16:26:26.503 INFO:tasks.workunit.client.0.smithi059.stdout:3/910: dread - d0/db/d3f/d49/d65/dae/f115 zero size 2024-04-25T16:26:26.634 INFO:tasks.workunit.client.0.smithi059.stdout:9/894: dwrite d6/d35/d26/ff3 [0,4194304] 0 2024-04-25T16:26:26.700 INFO:tasks.workunit.client.0.smithi059.stdout:6/921: rename d9/d27/d68/fa0 to d9/d27/d39/da5/f118 0 2024-04-25T16:26:27.121 INFO:tasks.workunit.client.0.smithi059.stdout:9/895: dread d6/fbc [0,4194304] 0 2024-04-25T16:26:27.260 INFO:tasks.workunit.client.0.smithi059.stdout:2/850: rename de/d2a/d2e/d36/d2c/d40/d57/l5b to de/d5a/d7d/d80/l133 0 2024-04-25T16:26:27.264 INFO:tasks.workunit.client.0.smithi059.stdout:6/922: rmdir d9/d16/dc0/d10c 39 2024-04-25T16:26:27.316 INFO:tasks.workunit.client.0.smithi059.stdout:0/848: getdents dc/d37/d47/df7 0 2024-04-25T16:26:27.337 INFO:tasks.workunit.client.0.smithi059.stdout:2/851: sync 2024-04-25T16:26:27.395 INFO:tasks.workunit.client.0.smithi059.stdout:6/923: read - d9/d1b/d58/d49/db0/f103 zero size 2024-04-25T16:26:27.426 INFO:tasks.workunit.client.0.smithi059.stdout:5/907: dwrite d1/dcd/d44/fa4 [0,4194304] 0 2024-04-25T16:26:27.518 INFO:tasks.workunit.client.0.smithi059.stdout:4/836: write d0/d4/df/d1c/d45/d54/d75/d82/d8f/fa7 [2030770,90830] 0 2024-04-25T16:26:27.522 INFO:tasks.workunit.client.0.smithi059.stdout:3/911: truncate d0/db/d3f/d89/f105 2927830 0 2024-04-25T16:26:27.590 INFO:tasks.workunit.client.0.smithi059.stdout:1/901: dwrite d7/d2a/d85/db7/f45 [0,4194304] 0 2024-04-25T16:26:27.662 INFO:tasks.workunit.client.0.smithi059.stdout:4/837: readlink d0/d4/df/d1c/d45/d54/d75/d82/lba 0 2024-04-25T16:26:27.788 INFO:tasks.workunit.client.0.smithi059.stdout:4/838: dread d0/d4/df/d48/f81 [4194304,4194304] 0 2024-04-25T16:26:27.827 INFO:tasks.workunit.client.0.smithi059.stdout:8/836: creat d7/f111 x:0 0 0 2024-04-25T16:26:27.854 INFO:tasks.workunit.client.0.smithi059.stdout:5/908: mknod d1/d48/da3/c133 0 2024-04-25T16:26:27.863 INFO:tasks.workunit.client.0.smithi059.stdout:6/924: creat d9/d16/d53/d55/f119 x:0 0 0 2024-04-25T16:26:28.105 INFO:tasks.workunit.client.0.smithi059.stdout:7/820: dwrite d0/d7/d51/da9/db3/d33/d4c/f81 [0,4194304] 0 2024-04-25T16:26:28.227 INFO:tasks.workunit.client.0.smithi059.stdout:3/912: dread d0/db/d3f/f5e [0,4194304] 0 2024-04-25T16:26:28.240 INFO:tasks.workunit.client.0.smithi059.stdout:3/913: chown d0/l8 64949 1 2024-04-25T16:26:28.375 INFO:tasks.workunit.client.0.smithi059.stdout:4/839: truncate d0/d4/df/d44/fb3 32781 0 2024-04-25T16:26:28.382 INFO:tasks.workunit.client.0.smithi059.stdout:2/852: creat de/da1/d124/f134 x:0 0 0 2024-04-25T16:26:28.512 INFO:tasks.workunit.client.0.smithi059.stdout:0/849: fdatasync dc/dd/fae 0 2024-04-25T16:26:28.514 INFO:tasks.workunit.client.0.smithi059.stdout:8/837: mknod d7/d16/da3/c112 0 2024-04-25T16:26:28.518 INFO:tasks.workunit.client.0.smithi059.stdout:1/902: symlink d7/l129 0 2024-04-25T16:26:28.545 INFO:tasks.workunit.client.0.smithi059.stdout:8/838: readlink d7/dd/d17/l1b 0 2024-04-25T16:26:28.958 INFO:tasks.workunit.client.0.smithi059.stdout:7/821: symlink d0/d7/d51/da9/db3/d33/l109 0 2024-04-25T16:26:29.027 INFO:tasks.workunit.client.0.smithi059.stdout:3/914: fdatasync d0/db/d47/f48 0 2024-04-25T16:26:29.051 INFO:tasks.workunit.client.0.smithi059.stdout:3/915: readlink d0/db/l79 0 2024-04-25T16:26:29.131 INFO:tasks.workunit.client.0.smithi059.stdout:9/896: rmdir d6/d4e/dba/df1 0 2024-04-25T16:26:29.272 INFO:tasks.workunit.client.0.smithi059.stdout:0/850: creat dc/df/d5e/dc6/f116 x:0 0 0 2024-04-25T16:26:29.363 INFO:tasks.workunit.client.0.smithi059.stdout:1/903: creat d7/d2a/d85/db7/d16/d7f/dbe/d121/dbc/f12a x:0 0 0 2024-04-25T16:26:29.679 INFO:tasks.workunit.client.0.smithi059.stdout:3/916: creat d0/db/d47/d7e/f140 x:0 0 0 2024-04-25T16:26:30.001 INFO:tasks.workunit.client.0.smithi059.stdout:1/904: dread d7/d2a/d85/db7/d16/d7f/dbe/d121/f79 [0,4194304] 0 2024-04-25T16:26:30.745 INFO:tasks.workunit.client.0.smithi059.stdout:7/822: dwrite d0/d7/d51/f104 [0,4194304] 0 2024-04-25T16:26:30.835 INFO:tasks.workunit.client.0.smithi059.stdout:0/851: write dc/dd/f20 [2197202,114814] 0 2024-04-25T16:26:30.837 INFO:tasks.workunit.client.0.smithi059.stdout:9/897: write d6/dae/ffe [452479,45970] 0 2024-04-25T16:26:31.028 INFO:tasks.workunit.client.0.smithi059.stdout:1/905: link d7/de5/ff7 d7/f12b 0 2024-04-25T16:26:31.030 INFO:tasks.workunit.client.0.smithi059.stdout:3/917: write d0/db/d2d/f4e [866078,50391] 0 2024-04-25T16:26:31.261 INFO:tasks.workunit.client.0.smithi059.stdout:6/925: rename d9/d27/d39/d7b/cbe to d9/d16/dc0/c11a 0 2024-04-25T16:26:31.287 INFO:tasks.workunit.client.0.smithi059.stdout:6/926: read d9/f59 [222763,8604] 0 2024-04-25T16:26:31.467 INFO:tasks.workunit.client.0.smithi059.stdout:1/906: dwrite d7/d2a/db8/fc0 [0,4194304] 0 2024-04-25T16:26:31.703 INFO:tasks.workunit.client.0.smithi059.stdout:9/898: truncate d6/d4e/d54/d5d/d48/fb6 870994 0 2024-04-25T16:26:31.704 INFO:tasks.workunit.client.0.smithi059.stdout:7/823: creat d0/de5/f10a x:0 0 0 2024-04-25T16:26:31.728 INFO:tasks.workunit.client.0.smithi059.stdout:9/899: chown d6/d4e/d54/d5d/l3a 60811 1 2024-04-25T16:26:31.734 INFO:tasks.workunit.client.0.smithi059.stdout:5/909: rename d1/d1e/d27/d66/d70/fc7 to d1/dcd/d50/d8a/dd8/f134 0 2024-04-25T16:26:31.748 INFO:tasks.workunit.client.0.smithi059.stdout:5/910: readlink d1/d1e/le0 0 2024-04-25T16:26:31.757 INFO:tasks.workunit.client.0.smithi059.stdout:5/911: readlink d1/d1e/d27/l11c 0 2024-04-25T16:26:31.767 INFO:tasks.workunit.client.0.smithi059.stdout:5/912: chown d1/d48/d85/fb1 5 1 2024-04-25T16:26:31.948 INFO:tasks.workunit.client.0.smithi059.stdout:9/900: fsync f1 0 2024-04-25T16:26:31.970 INFO:tasks.workunit.client.0.smithi059.stdout:5/913: fdatasync d1/d1e/d27/d66/d70/d24/fa6 0 2024-04-25T16:26:31.971 INFO:tasks.workunit.client.0.smithi059.stdout:0/852: getdents dc/d37/d47/d71/d9c 0 2024-04-25T16:26:32.003 INFO:tasks.workunit.client.0.smithi059.stdout:9/901: chown d6/d35/d26/d6b/d105 0 1 2024-04-25T16:26:32.013 INFO:tasks.workunit.client.0.smithi059.stdout:5/914: stat d1/d1e/d27/d66/d70/d75 0 2024-04-25T16:26:32.413 INFO:tasks.workunit.client.0.smithi059.stdout:3/918: dwrite d0/db/d2d/de1/f120 [0,4194304] 0 2024-04-25T16:26:32.418 INFO:tasks.workunit.client.0.smithi059.stdout:6/927: dwrite d9/d16/d53/d6c/da6/fbf [0,4194304] 0 2024-04-25T16:26:32.543 INFO:tasks.workunit.client.0.smithi059.stdout:2/853: rename de/d2a/d33/c5f to de/c135 0 2024-04-25T16:26:32.575 INFO:tasks.workunit.client.0.smithi059.stdout:6/928: stat d9/d16/d53/d55/f119 0 2024-04-25T16:26:32.595 INFO:tasks.workunit.client.0.smithi059.stdout:9/902: mknod d6/d4e/c10e 0 2024-04-25T16:26:32.733 INFO:tasks.workunit.client.0.smithi059.stdout:2/854: mkdir de/d5a/d9a/de9/d136 0 2024-04-25T16:26:32.734 INFO:tasks.workunit.client.0.smithi059.stdout:3/919: creat d0/db/d47/d98/f141 x:0 0 0 2024-04-25T16:26:33.014 INFO:tasks.workunit.client.0.smithi059.stdout:6/929: mknod d9/d16/d24/d97/c11b 0 2024-04-25T16:26:33.064 INFO:tasks.workunit.client.0.smithi059.stdout:7/824: write d0/d7/d51/da9/db3/d33/dc6/de8/ff9 [9178112,76590] 0 2024-04-25T16:26:33.143 INFO:tasks.workunit.client.0.smithi059.stdout:4/840: rename d0/d4/c7d to d0/d4/df/d1c/d45/cf8 0 2024-04-25T16:26:33.204 INFO:tasks.workunit.client.0.smithi059.stdout:3/920: dwrite d0/db/f1a [0,4194304] 0 2024-04-25T16:26:33.352 INFO:tasks.workunit.client.0.smithi059.stdout:9/903: mknod d6/d35/d28/dc0/df9/c10f 0 2024-04-25T16:26:33.357 INFO:tasks.workunit.client.0.smithi059.stdout:2/855: symlink de/l137 0 2024-04-25T16:26:33.403 INFO:tasks.workunit.client.0.smithi059.stdout:7/825: rmdir d0/d3f 39 2024-04-25T16:26:33.458 INFO:tasks.workunit.client.0.smithi059.stdout:6/930: mknod d9/d16/d53/d55/d71/d7e/d9e/c11c 0 2024-04-25T16:26:33.661 INFO:tasks.workunit.client.0.smithi059.stdout:8/839: rename d7/dd/d17/f4e to d7/dd/d17/db4/d7e/f113 0 2024-04-25T16:26:33.679 INFO:tasks.workunit.client.0.smithi059.stdout:7/826: creat d0/d7/d16/d20/dab/dd5/f10b x:0 0 0 2024-04-25T16:26:33.680 INFO:tasks.workunit.client.0.smithi059.stdout:3/921: dread - d0/d1e/d11f/f125 zero size 2024-04-25T16:26:33.714 INFO:tasks.workunit.client.0.smithi059.stdout:3/922: chown d0/d1e/d31/l34 65182 1 2024-04-25T16:26:33.731 INFO:tasks.workunit.client.0.smithi059.stdout:3/923: chown d0/db/d3f/d49/d65/dae/lbb 18934904 1 2024-04-25T16:26:34.079 INFO:tasks.workunit.client.0.smithi059.stdout:2/856: mknod de/d2a/d2e/d36/d2c/d131/c138 0 2024-04-25T16:26:34.893 INFO:tasks.workunit.client.0.smithi059.stdout:1/907: rename d7/d21/l86 to d7/d2a/d85/db7/d16/d7f/dbe/d121/l12c 0 2024-04-25T16:26:35.170 INFO:tasks.workunit.client.0.smithi059.stdout:6/931: write d9/d1b/d58/d49/db0/fe1 [575506,96820] 0 2024-04-25T16:26:35.317 INFO:tasks.workunit.client.0.smithi059.stdout:9/904: write d6/fb9 [1405464,24520] 0 2024-04-25T16:26:35.420 INFO:tasks.workunit.client.0.smithi059.stdout:1/908: mkdir d7/d2a/d85/d8d/dff/d12d 0 2024-04-25T16:26:35.501 INFO:tasks.workunit.client.0.smithi059.stdout:2/857: write de/d2a/d2e/d36/d2c/d40/d57/f8a [851512,121264] 0 2024-04-25T16:26:35.895 INFO:tasks.workunit.client.0.smithi059.stdout:9/905: unlink d6/d4e/d54/d5d/c37 0 2024-04-25T16:26:35.901 INFO:tasks.workunit.client.0.smithi059.stdout:3/924: write d0/db/d3f/d6c/ffd [2122464,70695] 0 2024-04-25T16:26:35.906 INFO:tasks.workunit.client.0.smithi059.stdout:0/853: rename dc/d44/d5f/d72/laa to dc/dd/l117 0 2024-04-25T16:26:35.920 INFO:tasks.workunit.client.0.smithi059.stdout:1/909: dread - d7/d2a/d85/f126 zero size 2024-04-25T16:26:35.928 INFO:tasks.workunit.client.0.smithi059.stdout:7/827: rmdir d0/d7/d51/da9/db3/d33/d79 39 2024-04-25T16:26:36.169 INFO:tasks.workunit.client.0.smithi059.stdout:5/915: rename d1/d48/d85/dbe/dde/ff4 to d1/dcd/d44/d79/dda/dfe/f135 0 2024-04-25T16:26:36.321 INFO:tasks.workunit.client.0.smithi059.stdout:7/828: chown d0/d7/d51/da9/db3/d33/d79/cf6 100 1 2024-04-25T16:26:36.343 INFO:tasks.workunit.client.0.smithi059.stdout:9/906: read d6/d4e/d54/d5d/d48/d6e/fa4 [4755317,49718] 0 2024-04-25T16:26:36.407 INFO:tasks.workunit.client.0.smithi059.stdout:6/932: write d9/d16/f26 [1167566,46595] 0 2024-04-25T16:26:36.682 INFO:tasks.workunit.client.0.smithi059.stdout:4/841: rename d0/d4/df/d1c/d45/d6f/l73 to d0/d4/df/d1c/d45/d54/d75/d82/dd2/lf9 0 2024-04-25T16:26:36.782 INFO:tasks.workunit.client.0.smithi059.stdout:5/916: mkdir d1/d48/da3/d136 0 2024-04-25T16:26:36.877 INFO:tasks.workunit.client.0.smithi059.stdout:1/910: write d7/d2a/d85/db7/dbb/fdb [3235962,21895] 0 2024-04-25T16:26:36.904 INFO:tasks.workunit.client.0.smithi059.stdout:9/907: read - d6/d4e/dba/fee zero size 2024-04-25T16:26:36.927 INFO:tasks.workunit.client.0.smithi059.stdout:2/858: dwrite de/d2a/d2e/d36/d2c/d40/f47 [0,4194304] 0 2024-04-25T16:26:37.030 INFO:tasks.workunit.client.0.smithi059.stdout:2/859: chown de/d2a/d2e/fb2 39999 1 2024-04-25T16:26:37.054 INFO:tasks.workunit.client.0.smithi059.stdout:3/925: creat d0/d1e/d57/f142 x:0 0 0 2024-04-25T16:26:37.080 INFO:tasks.workunit.client.0.smithi059.stdout:7/829: creat d0/d7/d51/da9/db3/d33/d4c/f10c x:0 0 0 2024-04-25T16:26:37.121 INFO:tasks.workunit.client.0.smithi059.stdout:9/908: read d6/d35/d26/d6b/fc6 [1630485,89850] 0 2024-04-25T16:26:37.284 INFO:tasks.workunit.client.0.smithi059.stdout:5/917: write d1/dcd/d44/f11d [576602,60295] 0 2024-04-25T16:26:37.301 INFO:tasks.workunit.client.0.smithi059.stdout:1/911: creat d7/d2a/d85/db7/d16/d5c/f12e x:0 0 0 2024-04-25T16:26:37.314 INFO:tasks.workunit.client.0.smithi059.stdout:6/933: dread d9/d16/dc0/d10c/f87 [0,4194304] 0 2024-04-25T16:26:37.422 INFO:tasks.workunit.client.0.smithi059.stdout:2/860: creat de/d2a/d2e/d36/d59/f139 x:0 0 0 2024-04-25T16:26:37.624 INFO:tasks.workunit.client.0.smithi059.stdout:9/909: unlink d6/d4e/d54/d5d/f71 0 2024-04-25T16:26:37.628 INFO:tasks.workunit.client.0.smithi059.stdout:8/840: rename d7/d2f/l30 to d7/l114 0 2024-04-25T16:26:37.670 INFO:tasks.workunit.client.0.smithi059.stdout:8/841: read - d7/d16/de0/d101/f71 zero size 2024-04-25T16:26:37.885 INFO:tasks.workunit.client.0.smithi059.stdout:5/918: creat d1/dcd/d50/d8a/dd8/f137 x:0 0 0 2024-04-25T16:26:37.899 INFO:tasks.workunit.client.0.smithi059.stdout:2/861: dread - de/d5a/d9a/de9/dea/ff8 zero size 2024-04-25T16:26:37.905 INFO:tasks.workunit.client.0.smithi059.stdout:5/919: chown d1/d1e/d27/f4e 470846 1 2024-04-25T16:26:38.039 INFO:tasks.workunit.client.0.smithi059.stdout:0/854: rename dc/dd/l46 to dc/d37/d47/d81/l118 0 2024-04-25T16:26:38.045 INFO:tasks.workunit.client.0.smithi059.stdout:3/926: dwrite d0/db/d47/f2e [4194304,4194304] 0 2024-04-25T16:26:38.113 INFO:tasks.workunit.client.0.smithi059.stdout:9/910: truncate d6/d4e/dba/fbe 983615 0 2024-04-25T16:26:38.181 INFO:tasks.workunit.client.0.smithi059.stdout:1/912: mknod d7/d2a/d85/db7/c12f 0 2024-04-25T16:26:38.281 INFO:tasks.workunit.client.0.smithi059.stdout:6/934: dwrite d9/d27/d39/f88 [0,4194304] 0 2024-04-25T16:26:38.484 INFO:tasks.workunit.client.0.smithi059.stdout:7/830: getdents d0/d7/d51/da9/db3/d33/d79/d5d/dcb 0 2024-04-25T16:26:38.492 INFO:tasks.workunit.client.0.smithi059.stdout:4/842: rename d0/d4/df/d1c/d45/d54/d75/d7e/fea to d0/d4/df/d48/da3/da4/ffa 0 2024-04-25T16:26:38.642 INFO:tasks.workunit.client.0.smithi059.stdout:3/927: mknod d0/d1e/d95/d11e/c143 0 2024-04-25T16:26:38.724 INFO:tasks.workunit.client.0.smithi059.stdout:6/935: dread d9/d1b/f6b [0,4194304] 0 2024-04-25T16:26:38.739 INFO:tasks.workunit.client.0.smithi059.stdout:6/936: chown d9/d16/d53/d55/d71/f109 419058 1 2024-04-25T16:26:38.906 INFO:tasks.workunit.client.0.smithi059.stdout:5/920: getdents d1/d1e/d27/d66/d121 0 2024-04-25T16:26:39.023 INFO:tasks.workunit.client.0.smithi059.stdout:2/862: truncate de/f117 111781 0 2024-04-25T16:26:39.145 INFO:tasks.workunit.client.0.smithi059.stdout:0/855: write dc/f3a [1013255,48945] 0 2024-04-25T16:26:39.265 INFO:tasks.workunit.client.0.smithi059.stdout:9/911: write d6/f47 [5731745,117825] 0 2024-04-25T16:26:39.577 INFO:tasks.workunit.client.0.smithi059.stdout:3/928: creat d0/db/d132/f144 x:0 0 0 2024-04-25T16:26:39.604 INFO:tasks.workunit.client.0.smithi059.stdout:5/921: unlink d1/d1e/lb7 0 2024-04-25T16:26:39.613 INFO:tasks.workunit.client.0.smithi059.stdout:8/842: rename d7/dd/d17/db4/d7e/l105 to d7/d2f/d76/l115 0 2024-04-25T16:26:39.756 INFO:tasks.workunit.client.0.smithi059.stdout:7/831: symlink d0/de5/dfc/l10d 0 2024-04-25T16:26:39.775 INFO:tasks.workunit.client.0.smithi059.stdout:7/832: chown d0/d7/d51/da9/db3/d33/d4c/d4e 6888141 1 2024-04-25T16:26:39.948 INFO:tasks.workunit.client.0.smithi059.stdout:6/937: getdents d9/d16/d53/d55/d71/d7e/d9e/d111 0 2024-04-25T16:26:40.084 INFO:tasks.workunit.client.0.smithi059.stdout:0/856: mkdir dc/df/d24/d119 0 2024-04-25T16:26:40.439 INFO:tasks.workunit.client.0.smithi059.stdout:6/938: dread d9/f21 [0,4194304] 0 2024-04-25T16:26:40.460 INFO:tasks.workunit.client.0.smithi059.stdout:3/929: creat d0/d1e/d57/da8/d13d/f145 x:0 0 0 2024-04-25T16:26:40.474 INFO:tasks.workunit.client.0.smithi059.stdout:0/857: truncate dc/f2a 4394560 0 2024-04-25T16:26:40.602 INFO:tasks.workunit.client.0.smithi059.stdout:8/843: mkdir d7/d16/de0/d101/d37/d116 0 2024-04-25T16:26:40.826 INFO:tasks.workunit.client.0.smithi059.stdout:8/844: creat d7/d2f/d43/f117 x:0 0 0 2024-04-25T16:26:41.051 INFO:tasks.workunit.client.0.smithi059.stdout:3/930: dread d0/db/d3f/d89/f105 [0,4194304] 0 2024-04-25T16:26:41.054 INFO:tasks.workunit.client.0.smithi059.stdout:1/913: write d7/d21/fc4 [394382,116710] 0 2024-04-25T16:26:41.067 INFO:tasks.workunit.client.0.smithi059.stdout:0/858: dread dc/d37/d47/d71/f8d [0,4194304] 0 2024-04-25T16:26:41.211 INFO:tasks.workunit.client.0.smithi059.stdout:8/845: rmdir d7/dd/d17/db4/d7e/da5 39 2024-04-25T16:26:41.224 INFO:tasks.workunit.client.0.smithi059.stdout:7/833: link d0/d7/d51/da9/db3/d33/d79/d5d/f74 d0/d7/d16/d20/dab/dd5/f10e 0 2024-04-25T16:26:41.225 INFO:tasks.workunit.client.0.smithi059.stdout:0/859: dread - dc/d37/d47/df7/fe9 zero size 2024-04-25T16:26:41.301 INFO:tasks.workunit.client.0.smithi059.stdout:2/863: dwrite de/d16/f1a [0,4194304] 0 2024-04-25T16:26:41.362 INFO:tasks.workunit.client.0.smithi059.stdout:8/846: dread - d7/f8e zero size 2024-04-25T16:26:41.365 INFO:tasks.workunit.client.0.smithi059.stdout:4/843: dwrite d0/d4/df/d48/d5f/fbf [0,4194304] 0 2024-04-25T16:26:41.469 INFO:tasks.workunit.client.0.smithi059.stdout:8/847: stat d7/dd/d17/c2c 0 2024-04-25T16:26:41.579 INFO:tasks.workunit.client.0.smithi059.stdout:1/914: mkdir d7/d2a/d62/d130 0 2024-04-25T16:26:41.646 INFO:tasks.workunit.client.0.smithi059.stdout:0/860: mknod dc/d37/d47/d81/dd2/c11a 0 2024-04-25T16:26:41.660 INFO:tasks.workunit.client.0.smithi059.stdout:0/861: chown dc/d37/d47/d71/dd0/fd8 165652492 1 2024-04-25T16:26:41.734 INFO:tasks.workunit.client.0.smithi059.stdout:2/864: creat de/d16/d9d/f13a x:0 0 0 2024-04-25T16:26:41.779 INFO:tasks.workunit.client.0.smithi059.stdout:3/931: symlink d0/db/d3f/d49/d129/l146 0 2024-04-25T16:26:42.004 INFO:tasks.workunit.client.0.smithi059.stdout:4/844: rename d0/d4/df/d1c/d45/d54/d75/fe9 to d0/d4/df/d48/da3/de2/ffb 0 2024-04-25T16:26:42.061 INFO:tasks.workunit.client.0.smithi059.stdout:8/848: creat d7/d16/de0/d101/d37/d5c/d87/d94/d7f/dcb/f118 x:0 0 0 2024-04-25T16:26:42.065 INFO:tasks.workunit.client.0.smithi059.stdout:1/915: rmdir d7/d2a/d85/db7/dbb/dc2 39 2024-04-25T16:26:42.112 INFO:tasks.workunit.client.0.smithi059.stdout:0/862: symlink dc/dd/d3b/d66/d9b/l11b 0 2024-04-25T16:26:42.164 INFO:tasks.workunit.client.0.smithi059.stdout:5/922: dwrite d1/f11a [0,4194304] 0 2024-04-25T16:26:42.203 INFO:tasks.workunit.client.0.smithi059.stdout:8/849: sync 2024-04-25T16:26:42.257 INFO:tasks.workunit.client.0.smithi059.stdout:2/865: mknod de/d2a/d2e/de1/c13b 0 2024-04-25T16:26:42.295 INFO:tasks.workunit.client.0.smithi059.stdout:3/932: mkdir d0/db/d47/d7e/ded/d147 0 2024-04-25T16:26:42.448 INFO:tasks.workunit.client.0.smithi059.stdout:9/912: dread d6/d4e/dba/fbe [0,4194304] 0 2024-04-25T16:26:42.485 INFO:tasks.workunit.client.0.smithi059.stdout:0/863: dread dc/dd/f58 [0,4194304] 0 2024-04-25T16:26:42.601 INFO:tasks.workunit.client.0.smithi059.stdout:6/939: dwrite d9/d27/d39/ff1 [0,4194304] 0 2024-04-25T16:26:42.668 INFO:tasks.workunit.client.0.smithi059.stdout:6/940: readlink d9/d16/d24/l67 0 2024-04-25T16:26:42.693 INFO:tasks.workunit.client.0.smithi059.stdout:8/850: chown d7/d2f/l39 870468924 1 2024-04-25T16:26:42.762 INFO:tasks.workunit.client.0.smithi059.stdout:8/851: sync 2024-04-25T16:26:42.856 INFO:tasks.workunit.client.0.smithi059.stdout:9/913: read d6/dae/dc3/fed [3756010,32559] 0 2024-04-25T16:26:42.919 INFO:tasks.workunit.client.0.smithi059.stdout:0/864: dread dc/f4e [4194304,4194304] 0 2024-04-25T16:26:43.030 INFO:tasks.workunit.client.0.smithi059.stdout:3/933: rename d0/db/d2d/d7a/dfa/l111 to d0/db/d2d/d7a/dfa/l148 0 2024-04-25T16:26:43.093 INFO:tasks.workunit.client.0.smithi059.stdout:3/934: readlink d0/db/d3f/d49/d129/l146 0 2024-04-25T16:26:43.112 INFO:tasks.workunit.client.0.smithi059.stdout:6/941: mkdir d9/d16/d53/d6c/da6/d11d 0 2024-04-25T16:26:43.154 INFO:tasks.workunit.client.0.smithi059.stdout:7/834: dwrite d0/d7/d16/d20/ff4 [0,4194304] 0 2024-04-25T16:26:43.462 INFO:tasks.workunit.client.0.smithi059.stdout:5/923: mkdir d1/dcd/d44/d79/dda/dfe/d12b/d138 0 2024-04-25T16:26:43.939 INFO:tasks.workunit.client.0.smithi059.stdout:6/942: fsync d9/d1b/d58/d49/db0/f103 0 2024-04-25T16:26:44.157 INFO:tasks.workunit.client.0.smithi059.stdout:4/845: link d0/d4/df/d1c/l25 d0/d4/lfc 0 2024-04-25T16:26:44.201 INFO:tasks.workunit.client.0.smithi059.stdout:5/924: rmdir d1/d1e/dca/d113 39 2024-04-25T16:26:44.367 INFO:tasks.workunit.client.0.smithi059.stdout:1/916: write d7/d93/f4f [873557,115223] 0 2024-04-25T16:26:44.450 INFO:tasks.workunit.client.0.smithi059.stdout:2/866: dwrite de/d16/d7f/ff6 [0,4194304] 0 2024-04-25T16:26:44.523 INFO:tasks.workunit.client.0.smithi059.stdout:4/846: creat d0/d4/df/d48/da3/da4/ffd x:0 0 0 2024-04-25T16:26:44.536 INFO:tasks.workunit.client.0.smithi059.stdout:5/925: symlink d1/dcd/d44/d79/d92/l139 0 2024-04-25T16:26:44.812 INFO:tasks.workunit.client.0.smithi059.stdout:8/852: dwrite d7/d16/de0/d101/d37/d5c/d87/d94/dcd/f10f [0,4194304] 0 2024-04-25T16:26:45.013 INFO:tasks.workunit.client.0.smithi059.stdout:2/867: mknod de/d2a/d2e/d6a/c13c 0 2024-04-25T16:26:45.019 INFO:tasks.workunit.client.0.smithi059.stdout:9/914: write d6/d35/d26/ff3 [3948202,126307] 0 2024-04-25T16:26:45.065 INFO:tasks.workunit.client.0.smithi059.stdout:0/865: write dc/f2d [2007127,23339] 0 2024-04-25T16:26:45.175 INFO:tasks.workunit.client.0.smithi059.stdout:9/915: dread d6/dae/dc3/fed [0,4194304] 0 2024-04-25T16:26:45.181 INFO:tasks.workunit.client.0.smithi059.stdout:8/853: truncate d7/d16/d3a/fc5 3342495 0 2024-04-25T16:26:45.219 INFO:tasks.workunit.client.0.smithi059.stdout:3/935: write d0/d1e/f56 [172503,40175] 0 2024-04-25T16:26:45.246 INFO:tasks.workunit.client.0.smithi059.stdout:8/854: dread d7/d2f/fa8 [0,4194304] 0 2024-04-25T16:26:45.269 INFO:tasks.workunit.client.0.smithi059.stdout:8/855: stat d7/d16/de0/d101/f71 0 2024-04-25T16:26:45.318 INFO:tasks.workunit.client.0.smithi059.stdout:2/868: fsync de/d2a/d33/d65/dcf/fd1 0 2024-04-25T16:26:45.405 INFO:tasks.workunit.client.0.smithi059.stdout:5/926: mknod d1/d48/c13a 0 2024-04-25T16:26:45.475 INFO:tasks.workunit.client.0.smithi059.stdout:9/916: symlink d6/dae/dc3/dc5/l110 0 2024-04-25T16:26:45.489 INFO:tasks.workunit.client.0.smithi059.stdout:9/917: chown d6/d4e/d54/d5d/d48/d49/c65 846 1 2024-04-25T16:26:45.641 INFO:tasks.workunit.client.0.smithi059.stdout:7/835: dwrite d0/d7/dae/de2/ff8 [0,4194304] 0 2024-04-25T16:26:45.704 INFO:tasks.workunit.client.0.smithi059.stdout:8/856: rename d7/dd/d33/l62 to d7/d16/d8c/l119 0 2024-04-25T16:26:45.767 INFO:tasks.workunit.client.0.smithi059.stdout:2/869: read de/d16/d3e/d101/f103 [2856836,59607] 0 2024-04-25T16:26:46.079 INFO:tasks.workunit.client.0.smithi059.stdout:9/918: truncate d6/d4e/d54/d5d/d48/d6e/fa4 4757680 0 2024-04-25T16:26:46.081 INFO:tasks.workunit.client.0.smithi059.stdout:0/866: fsync dc/d84/f9a 0 2024-04-25T16:26:46.107 INFO:tasks.workunit.client.0.smithi059.stdout:8/857: creat d7/dd/d33/f11a x:0 0 0 2024-04-25T16:26:46.108 INFO:tasks.workunit.client.0.smithi059.stdout:7/836: mknod d0/d7/d51/da9/db3/d33/d79/d5d/dcb/c10f 0 2024-04-25T16:26:46.223 INFO:tasks.workunit.client.0.smithi059.stdout:3/936: link d0/db/d47/d5b/f88 d0/db/d3f/d89/dd5/f149 0 2024-04-25T16:26:46.264 INFO:tasks.workunit.client.0.smithi059.stdout:6/943: dwrite d9/d1b/d58/fe4 [0,4194304] 0 2024-04-25T16:26:46.370 INFO:tasks.workunit.client.0.smithi059.stdout:6/944: sync 2024-04-25T16:26:46.432 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:26:46.435 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:26:46.462 INFO:tasks.workunit.client.0.smithi059.stdout:8/858: creat d7/d16/da3/f11b x:0 0 0 2024-04-25T16:26:46.463 INFO:tasks.workunit.client.0.smithi059.stdout:2/870: creat de/d2a/d33/d12e/f13d x:0 0 0 2024-04-25T16:26:46.591 INFO:tasks.workunit.client.0.smithi059.stdout:9/919: unlink d6/d4e/d54/d5d/d48/d49/f5c 0 2024-04-25T16:26:46.704 INFO:tasks.workunit.client.0.smithi059.stdout:7/837: mknod d0/d7/d51/da9/db3/d33/d79/d5d/dcb/c110 0 2024-04-25T16:26:46.722 INFO:tasks.workunit.client.0.smithi059.stdout:1/917: dwrite d7/d2a/d85/db7/d16/d5c/d74/f100 [0,4194304] 0 2024-04-25T16:26:46.912 INFO:tasks.workunit.client.0.smithi059.stdout:4/847: dwrite d0/d4/df/d1c/fe0 [0,4194304] 0 2024-04-25T16:26:47.051 INFO:tasks.workunit.client.0.smithi059.stdout:2/871: fdatasync de/fc9 0 2024-04-25T16:26:47.196 INFO:tasks.workunit.client.0.smithi059.stdout:9/920: mknod d6/d35/d26/d6b/d105/c111 0 2024-04-25T16:26:47.288 INFO:tasks.workunit.client.0.smithi059.stdout:3/937: truncate d0/f6 1489135 0 2024-04-25T16:26:47.368 INFO:tasks.workunit.client.0.smithi059.stdout:7/838: mkdir d0/d7/dae/de2/d111 0 2024-04-25T16:26:47.442 INFO:tasks.workunit.client.0.smithi059.stdout:1/918: creat d7/d2a/d85/db7/d16/d7f/f131 x:0 0 0 2024-04-25T16:26:47.605 INFO:tasks.workunit.client.0.smithi059.stdout:2/872: readlink de/d2a/d2e/d36/d59/l115 0 2024-04-25T16:26:47.615 INFO:tasks.workunit.client.0.smithi059.stdout:2/873: chown de/d16/d3e/f102 382148 1 2024-04-25T16:26:47.623 INFO:tasks.workunit.client.0.smithi059.stdout:2/874: chown de/d2a/d2e/d36 15830 1 2024-04-25T16:26:47.764 INFO:tasks.workunit.client.0.smithi059.stdout:9/921: rename d6/d35/d28/f8c to d6/d35/d26/d6b/dc9/f112 0 2024-04-25T16:26:47.769 INFO:tasks.workunit.client.0.smithi059.stdout:3/938: fdatasync d0/db/d2d/d7a/d86/ff5 0 2024-04-25T16:26:47.809 INFO:tasks.workunit.client.0.smithi059.stdout:5/927: write d1/dcd/f57 [3725484,81040] 0 2024-04-25T16:26:48.127 INFO:tasks.workunit.client.0.smithi059.stdout:1/919: truncate d7/d2a/d85/db7/d16/d5c/d74/f10a 367176 0 2024-04-25T16:26:48.364 INFO:tasks.workunit.client.0.smithi059.stdout:3/939: mknod d0/d1e/d95/d11e/c14a 0 2024-04-25T16:26:48.377 INFO:tasks.workunit.client.0.smithi059.stdout:7/839: symlink d0/d7/d51/da9/db3/d33/dc6/de8/l112 0 2024-04-25T16:26:48.417 INFO:tasks.workunit.client.0.smithi059.stdout:2/875: mknod de/d2a/da7/d119/c13e 0 2024-04-25T16:26:48.458 INFO:tasks.workunit.client.0.smithi059.stdout:1/920: truncate d7/d2a/d85/db7/f87 1115867 0 2024-04-25T16:26:48.543 INFO:tasks.workunit.client.0.smithi059.stdout:0/867: dwrite dc/f95 [0,4194304] 0 2024-04-25T16:26:48.618 INFO:tasks.workunit.client.0.smithi059.stdout:4/848: getdents d0/d79 0 2024-04-25T16:26:49.028 INFO:tasks.workunit.client.0.smithi059.stdout:0/868: dread dc/f3a [0,4194304] 0 2024-04-25T16:26:49.079 INFO:tasks.workunit.client.0.smithi059.stdout:4/849: truncate d0/d4/df/d1c/d45/d54/d75/f80 661774 0 2024-04-25T16:26:49.091 INFO:tasks.workunit.client.0.smithi059.stdout:4/850: dread - d0/d4/df/d44/fbe zero size 2024-04-25T16:26:49.286 INFO:tasks.workunit.client.0.smithi059.stdout:8/859: write d7/d16/da3/fbe [3028390,99423] 0 2024-04-25T16:26:49.312 INFO:tasks.workunit.client.0.smithi059.stdout:0/869: dread - dc/d37/d47/d71/d77/dce/d10b/f10e zero size 2024-04-25T16:26:49.360 INFO:tasks.workunit.client.0.smithi059.stdout:4/851: rename d0/d4/df/d44/dcf to d0/d4/df/d1c/d45/d54/d75/d7e/dfe 0 2024-04-25T16:26:49.537 INFO:tasks.workunit.client.0.smithi059.stdout:3/940: link d0/db/d3f/d49/d10f/l127 d0/db/d3f/d49/d129/l14b 0 2024-04-25T16:26:49.812 INFO:tasks.workunit.client.0.smithi059.stdout:4/852: fsync d0/d4/f1b 0 2024-04-25T16:26:49.873 INFO:tasks.workunit.client.0.smithi059.stdout:6/945: truncate d9/d27/d39/ff1 1257359 0 2024-04-25T16:26:49.975 INFO:tasks.workunit.client.0.smithi059.stdout:8/860: creat d7/d16/de0/d101/d37/d5c/d87/d94/d66/daa/d103/f11c x:0 0 0 2024-04-25T16:26:50.172 INFO:tasks.workunit.client.0.smithi059.stdout:9/922: write d6/d35/d6c/f79 [1952068,89023] 0 2024-04-25T16:26:50.174 INFO:tasks.workunit.client.0.smithi059.stdout:4/853: fsync d0/d4/df/d48/d5f/f6a 0 2024-04-25T16:26:50.266 INFO:tasks.workunit.client.0.smithi059.stdout:6/946: rename d9/d16/dc0/d10c/ff7 to d9/d16/d53/d55/f11e 0 2024-04-25T16:26:50.270 INFO:tasks.workunit.client.0.smithi059.stdout:5/928: write d1/dcd/d44/d79/f90 [2005497,126614] 0 2024-04-25T16:26:50.343 INFO:tasks.workunit.client.0.smithi059.stdout:8/861: symlink d7/dd/d33/l11d 0 2024-04-25T16:26:50.541 INFO:tasks.workunit.client.0.smithi059.stdout:4/854: creat d0/d4/df/d1c/d45/d54/dd4/fff x:0 0 0 2024-04-25T16:26:50.613 INFO:tasks.workunit.client.0.smithi059.stdout:6/947: fdatasync d9/f4b 0 2024-04-25T16:26:50.640 INFO:tasks.workunit.client.0.smithi059.stdout:6/948: chown d9/d16/d53/d55/d71/d7e/d9e/c11c 278633 1 2024-04-25T16:26:50.885 INFO:tasks.workunit.client.0.smithi059.stdout:7/840: write d0/d7/d51/da9/db3/d33/d79/d5d/fc2 [80160,63417] 0 2024-04-25T16:26:50.887 INFO:tasks.workunit.client.0.smithi059.stdout:2/876: write de/d5a/d9a/de9/fb9 [1355571,16301] 0 2024-04-25T16:26:51.032 INFO:tasks.workunit.client.0.smithi059.stdout:1/921: dwrite d7/d2a/d85/db7/d16/d7f/dbe/fd5 [0,4194304] 0 2024-04-25T16:26:51.271 INFO:tasks.workunit.client.0.smithi059.stdout:6/949: symlink d9/d16/d24/d97/dc3/l11f 0 2024-04-25T16:26:51.518 INFO:tasks.workunit.client.0.smithi059.stdout:2/877: mknod de/d2a/d33/d12e/c13f 0 2024-04-25T16:26:51.526 INFO:tasks.workunit.client.0.smithi059.stdout:7/841: creat d0/d7/d51/da9/db3/f113 x:0 0 0 2024-04-25T16:26:51.546 INFO:tasks.workunit.client.0.smithi059.stdout:0/870: write dc/dd/d3b/fd3 [102450,58635] 0 2024-04-25T16:26:51.654 INFO:tasks.workunit.client.0.smithi059.stdout:0/871: sync 2024-04-25T16:26:51.661 INFO:tasks.workunit.client.0.smithi059.stdout:0/872: stat dc/df/d5e/fba 0 2024-04-25T16:26:51.877 INFO:tasks.workunit.client.0.smithi059.stdout:4/855: rename d0/d4/df/d1c/d45/d54/d75/d82/f8e to d0/d4/df/d1c/d45/d54/f100 0 2024-04-25T16:26:51.982 INFO:tasks.workunit.client.0.smithi059.stdout:7/842: fdatasync d0/d7/d51/da9/db3/d33/d79/fc4 0 2024-04-25T16:26:52.000 INFO:tasks.workunit.client.0.smithi059.stdout:7/843: chown d0/d7/d51/da9/db3/d33/d79/d5d 12663473 1 2024-04-25T16:26:52.210 INFO:tasks.workunit.client.0.smithi059.stdout:4/856: mkdir d0/d4/df/d48/dde/d101 0 2024-04-25T16:26:52.353 INFO:tasks.workunit.client.0.smithi059.stdout:4/857: mknod d0/d4/df/d1c/d45/d6f/c102 0 2024-04-25T16:26:52.411 INFO:tasks.workunit.client.0.smithi059.stdout:4/858: sync 2024-04-25T16:26:52.697 INFO:tasks.workunit.client.0.smithi059.stdout:3/941: write d0/db/d2d/de1/df2/f12e [1451324,128539] 0 2024-04-25T16:26:52.707 INFO:tasks.workunit.client.0.smithi059.stdout:5/929: write d1/d48/da3/f96 [4877123,92563] 0 2024-04-25T16:26:52.874 INFO:tasks.workunit.client.0.smithi059.stdout:9/923: dwrite d6/dae/fcc [0,4194304] 0 2024-04-25T16:26:52.969 INFO:tasks.workunit.client.0.smithi059.stdout:4/859: truncate d0/d4/df/d44/fbe 838229 0 2024-04-25T16:26:53.004 INFO:tasks.workunit.client.0.smithi059.stdout:8/862: dwrite d7/d16/de0/d101/d37/d5c/d87/d94/d66/daa/fcc [4194304,4194304] 0 2024-04-25T16:26:53.079 INFO:tasks.workunit.client.0.smithi059.stdout:3/942: mkdir d0/db/d47/d7e/d14c 0 2024-04-25T16:26:53.083 INFO:tasks.workunit.client.0.smithi059.stdout:1/922: write d7/de5/d8f/f5e [1872932,99436] 0 2024-04-25T16:26:53.154 INFO:tasks.workunit.client.0.smithi059.stdout:5/930: dread d1/d1e/f41 [0,4194304] 0 2024-04-25T16:26:53.278 INFO:tasks.workunit.client.0.smithi059.stdout:4/860: creat d0/d4/df/d48/d5f/f103 x:0 0 0 2024-04-25T16:26:53.304 INFO:tasks.workunit.client.0.smithi059.stdout:6/950: dwrite d9/f23 [0,4194304] 0 2024-04-25T16:26:53.562 INFO:tasks.workunit.client.0.smithi059.stdout:8/863: mknod d7/d16/de0/d101/d37/d5c/d87/d94/dcd/c11e 0 2024-04-25T16:26:53.623 INFO:tasks.workunit.client.0.smithi059.stdout:3/943: truncate d0/db/d47/d98/ff1 928549 0 2024-04-25T16:26:53.709 INFO:tasks.workunit.client.0.smithi059.stdout:1/923: truncate d7/d21/d51/da6/f84 164459 0 2024-04-25T16:26:53.744 INFO:tasks.workunit.client.0.smithi059.stdout:0/873: dwrite dc/df/d5e/fea [0,4194304] 0 2024-04-25T16:26:53.747 INFO:tasks.workunit.client.0.smithi059.stdout:2/878: dwrite de/d16/f79 [0,4194304] 0 2024-04-25T16:26:53.905 INFO:tasks.workunit.client.0.smithi059.stdout:7/844: dwrite d0/d7/fac [0,4194304] 0 2024-04-25T16:26:53.970 INFO:tasks.workunit.client.0.smithi059.stdout:2/879: chown de/d67/f12f 199678620 1 2024-04-25T16:26:53.997 INFO:tasks.workunit.client.0.smithi059.stdout:7/845: chown d0/d7/dae/fd3 5787 1 2024-04-25T16:26:54.231 INFO:tasks.workunit.client.0.smithi059.stdout:5/931: dwrite d1/dd/fa5 [0,4194304] 0 2024-04-25T16:26:54.558 INFO:tasks.workunit.client.0.smithi059.stdout:9/924: getdents d6/d35/d28/dc0 0 2024-04-25T16:26:54.776 INFO:tasks.workunit.client.0.smithi059.stdout:0/874: dread - dc/df/d5e/dc6/fef zero size 2024-04-25T16:26:54.822 INFO:tasks.workunit.client.0.smithi059.stdout:6/951: dwrite d9/d16/d24/d97/f100 [0,4194304] 0 2024-04-25T16:26:54.901 INFO:tasks.workunit.client.0.smithi059.stdout:2/880: stat de/d2a/d33/d65/dcf/c116 0 2024-04-25T16:26:54.911 INFO:tasks.workunit.client.0.smithi059.stdout:7/846: mknod d0/d7/d51/da9/db3/d33/d79/d5d/d94/c114 0 2024-04-25T16:26:55.621 INFO:tasks.workunit.client.0.smithi059.stdout:4/861: creat d0/d4/df/f104 x:0 0 0 2024-04-25T16:26:55.627 INFO:tasks.workunit.client.0.smithi059.stdout:0/875: creat dc/d37/d47/d71/d77/dce/d10b/f11c x:0 0 0 2024-04-25T16:26:55.769 INFO:tasks.workunit.client.0.smithi059.stdout:7/847: symlink d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/l115 0 2024-04-25T16:26:55.863 INFO:tasks.workunit.client.0.smithi059.stdout:5/932: creat d1/d1e/d27/d66/d121/f13b x:0 0 0 2024-04-25T16:26:55.921 INFO:tasks.workunit.client.0.smithi059.stdout:9/925: fsync d6/d35/d26/d6b/dc9/f112 0 2024-04-25T16:26:56.012 INFO:tasks.workunit.client.0.smithi059.stdout:8/864: rename d7/d2f/fa8 to d7/dd/d17/db4/d7e/f11f 0 2024-04-25T16:26:56.030 INFO:tasks.workunit.client.0.smithi059.stdout:3/944: write d0/db/d3f/d6c/fac [986849,94507] 0 2024-04-25T16:26:56.158 INFO:tasks.workunit.client.0.smithi059.stdout:8/865: dread d7/dd/d33/f73 [0,4194304] 0 2024-04-25T16:26:56.278 INFO:tasks.workunit.client.0.smithi059.stdout:4/862: creat d0/d4/df/d48/d5f/f105 x:0 0 0 2024-04-25T16:26:56.330 INFO:tasks.workunit.client.0.smithi059.stdout:7/848: rmdir d0 39 2024-04-25T16:26:56.563 INFO:tasks.workunit.client.0.smithi059.stdout:3/945: truncate d0/db/d47/d5b/fc8 192993 0 2024-04-25T16:26:56.571 INFO:tasks.workunit.client.0.smithi059.stdout:3/946: chown d0/db/l4f 38 1 2024-04-25T16:26:57.062 INFO:tasks.workunit.client.0.smithi059.stdout:9/926: symlink d6/d35/d26/d6b/de3/l113 0 2024-04-25T16:26:57.068 INFO:tasks.workunit.client.0.smithi059.stdout:9/927: readlink d6/l42 0 2024-04-25T16:26:57.167 INFO:tasks.workunit.client.0.smithi059.stdout:3/947: rename d0/d1e/d57/da8/dba to d0/d1e/d57/dc9/d14d 0 2024-04-25T16:26:57.174 INFO:tasks.workunit.client.0.smithi059.stdout:1/924: write d7/d2a/d85/db7/d16/d5c/d74/da7/fc6 [947090,104267] 0 2024-04-25T16:26:57.352 INFO:tasks.workunit.client.0.smithi059.stdout:7/849: symlink d0/d7/dae/de2/l116 0 2024-04-25T16:26:57.441 INFO:tasks.workunit.client.0.smithi059.stdout:6/952: write d9/d16/d53/d55/d71/f109 [317762,122440] 0 2024-04-25T16:26:57.510 INFO:tasks.workunit.client.0.smithi059.stdout:2/881: dwrite de/d5a/f77 [0,4194304] 0 2024-04-25T16:26:57.526 INFO:tasks.workunit.client.0.smithi059.stdout:1/925: creat d7/d2a/d85/db7/d16/d5c/d74/f132 x:0 0 0 2024-04-25T16:26:57.599 INFO:tasks.workunit.client.0.smithi059.stdout:4/863: link d0/d4/df/d44/f5e d0/d4/df/d44/f106 0 2024-04-25T16:26:57.644 INFO:tasks.workunit.client.0.smithi059.stdout:1/926: sync 2024-04-25T16:26:57.733 INFO:tasks.workunit.client.0.smithi059.stdout:3/948: dread d0/db/d2d/d7a/f108 [0,4194304] 0 2024-04-25T16:26:57.955 INFO:tasks.workunit.client.0.smithi059.stdout:1/927: rmdir d7/d2a/d85/db7 39 2024-04-25T16:26:57.957 INFO:tasks.workunit.client.0.smithi059.stdout:4/864: creat d0/d4/df/d44/f107 x:0 0 0 2024-04-25T16:26:58.086 INFO:tasks.workunit.client.0.smithi059.stdout:0/876: dwrite dc/f2d [4194304,4194304] 0 2024-04-25T16:26:58.178 INFO:tasks.workunit.client.0.smithi059.stdout:3/949: dread - d0/db/d3f/d89/dd5/f121 zero size 2024-04-25T16:26:58.273 INFO:tasks.workunit.client.0.smithi059.stdout:5/933: dwrite d1/d48/d85/dbe/dde/f82 [0,4194304] 0 2024-04-25T16:26:58.362 INFO:tasks.workunit.client.0.smithi059.stdout:8/866: write d7/d16/d36/dca/f104 [80235,31787] 0 2024-04-25T16:26:58.474 INFO:tasks.workunit.client.0.smithi059.stdout:4/865: truncate d0/d4/df/d1c/d45/d54/d75/f90 520407 0 2024-04-25T16:26:58.488 INFO:tasks.workunit.client.0.smithi059.stdout:4/866: chown d0/d4/df/d48/d5f/fc9 11 1 2024-04-25T16:26:58.628 INFO:tasks.workunit.client.0.smithi059.stdout:7/850: rename d0/c9b to d0/d7/d51/da9/db3/d33/d4c/d4e/c117 0 2024-04-25T16:26:58.632 INFO:tasks.workunit.client.0.smithi059.stdout:9/928: write d6/d35/d6c/f6d [161114,108551] 0 2024-04-25T16:26:58.669 INFO:tasks.workunit.client.0.smithi059.stdout:3/950: unlink d0/d1e/d57/c63 0 2024-04-25T16:26:58.675 INFO:tasks.workunit.client.0.smithi059.stdout:4/867: dread d0/d4/fe [0,4194304] 0 2024-04-25T16:26:58.776 INFO:tasks.workunit.client.0.smithi059.stdout:5/934: creat d1/d48/d85/f13c x:0 0 0 2024-04-25T16:26:58.881 INFO:tasks.workunit.client.0.smithi059.stdout:4/868: dread d0/d4/df/d1c/d45/d54/fb7 [0,4194304] 0 2024-04-25T16:26:58.981 INFO:tasks.workunit.client.0.smithi059.stdout:6/953: dwrite d9/d16/f26 [4194304,4194304] 0 2024-04-25T16:26:59.044 INFO:tasks.workunit.client.0.smithi059.stdout:6/954: chown d9/d1b/ffd 455328 1 2024-04-25T16:26:59.293 INFO:tasks.workunit.client.0.smithi059.stdout:0/877: write dc/d44/ff9 [4776801,69945] 0 2024-04-25T16:27:00.130 INFO:tasks.workunit.client.0.smithi059.stdout:9/929: symlink d6/d4e/d54/d5d/d48/d49/dfb/l114 0 2024-04-25T16:27:00.137 INFO:tasks.workunit.client.0.smithi059.stdout:9/930: readlink d6/dae/l106 0 2024-04-25T16:27:00.284 INFO:tasks.workunit.client.0.smithi059.stdout:4/869: mknod d0/d4/df/c108 0 2024-04-25T16:27:00.507 INFO:tasks.workunit.client.0.smithi059.stdout:4/870: creat d0/d4/df/d48/dde/f109 x:0 0 0 2024-04-25T16:27:00.931 INFO:tasks.workunit.client.0.smithi059.stdout:5/935: write d1/d1e/d27/d66/d70/d75/f7d [592666,62925] 0 2024-04-25T16:27:00.932 INFO:tasks.workunit.client.0.smithi059.stdout:8/867: write d7/d16/d3a/fc5 [2270461,94145] 0 2024-04-25T16:27:00.997 INFO:tasks.workunit.client.0.smithi059.stdout:0/878: getdents dc/dd/d3b 0 2024-04-25T16:27:01.026 INFO:tasks.workunit.client.0.smithi059.stdout:8/868: readlink d7/l10e 0 2024-04-25T16:27:01.117 INFO:tasks.workunit.client.0.smithi059.stdout:8/869: read d7/dd/d33/f41 [1773081,118868] 0 2024-04-25T16:27:01.121 INFO:tasks.workunit.client.0.smithi059.stdout:6/955: dwrite d9/d16/f22 [4194304,4194304] 0 2024-04-25T16:27:01.313 INFO:tasks.workunit.client.0.smithi059.stdout:6/956: dread d9/d27/d39/da5/fd5 [0,4194304] 0 2024-04-25T16:27:01.451 INFO:tasks.workunit.client.0.smithi059.stdout:2/882: rename de/l137 to de/da1/l140 0 2024-04-25T16:27:01.564 INFO:tasks.workunit.client.0.smithi059.stdout:6/957: creat d9/d16/dc0/d10c/f120 x:0 0 0 2024-04-25T16:27:01.676 INFO:tasks.workunit.client.0.smithi059.stdout:4/871: dwrite d0/d4/df/d48/da3/da4/ffa [0,4194304] 0 2024-04-25T16:27:01.873 INFO:tasks.workunit.client.0.smithi059.stdout:5/936: write d1/dcd/d50/db8/f10d [1278,19203] 0 2024-04-25T16:27:01.890 INFO:tasks.workunit.client.0.smithi059.stdout:3/951: rename d0/db/d3f/d49/f7b to d0/db/d2d/d7a/d86/f14e 0 2024-04-25T16:27:02.082 INFO:tasks.workunit.client.0.smithi059.stdout:4/872: mknod d0/d4/df/d1c/d45/d6f/dc4/c10a 0 2024-04-25T16:27:02.204 INFO:tasks.workunit.client.0.smithi059.stdout:9/931: link d6/d4e/d7a/ff2 d6/d4e/d54/d5d/d48/d6e/f115 0 2024-04-25T16:27:02.323 INFO:tasks.workunit.client.0.smithi059.stdout:1/928: rename d7/d21/fc4 to d7/d2a/d85/db7/dbb/de9/f133 0 2024-04-25T16:27:02.520 INFO:tasks.workunit.client.0.smithi059.stdout:5/937: unlink d1/d1e/d27/d66/d70/d75/ffb 0 2024-04-25T16:27:02.526 INFO:tasks.workunit.client.0.smithi059.stdout:2/883: mknod de/d5a/c141 0 2024-04-25T16:27:02.588 INFO:tasks.workunit.client.0.smithi059.stdout:0/879: getdents dc/dd/d3b 0 2024-04-25T16:27:02.846 INFO:tasks.workunit.client.0.smithi059.stdout:6/958: dwrite d9/d1b/d58/d49/db0/f103 [0,4194304] 0 2024-04-25T16:27:02.941 INFO:tasks.workunit.client.0.smithi059.stdout:9/932: write d6/d4e/d54/d5d/f45 [4654327,28232] 0 2024-04-25T16:27:02.948 INFO:tasks.workunit.client.0.smithi059.stdout:4/873: dread d0/d4/f56 [0,4194304] 0 2024-04-25T16:27:03.029 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:41:15.634 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:27:03.112 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:41:15.675 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:27:03.113 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:41:15.717 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:27:03.116 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:41:15.680 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:27:03.141 INFO:tasks.workunit.client.0.smithi059.stdout:2/884: write de/d5a/f12d [349858,88647] 0 2024-04-25T16:27:03.148 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:41:15.752 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:27:03.163 INFO:tasks.workunit.client.0.smithi059.stdout:7/851: rename d0/d3f/f4d to d0/d7/d51/da9/db3/d33/d79/d5d/d94/d106/f118 0 2024-04-25T16:27:03.164 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:41:15.728 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:27:03.165 INFO:tasks.workunit.client.0.smithi059.stdout:5/938: read d1/d1e/d27/d66/d70/d24/f4b [1811063,42741] 0 2024-04-25T16:27:03.193 INFO:tasks.workunit.client.0.smithi059.stdout:3/952: dwrite d0/d1e/f56 [0,4194304] 0 2024-04-25T16:27:03.213 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:41:15.776 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:27:03.216 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:41:15.780 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:27:03.247 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:41:15.810 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:27:03.261 INFO:tasks.workunit.client.0.smithi059.stdout:4/874: chown d0/d4/df/d1c/ceb 115 1 2024-04-25T16:27:03.277 INFO:tasks.workunit.client.0.smithi059.stdout:0/880: truncate dc/fc5 736069 0 2024-04-25T16:27:03.317 INFO:tasks.workunit.client.0.smithi059.stdout:1/929: dread d7/d2a/d85/db7/f5a [0,4194304] 0 2024-04-25T16:27:03.711 INFO:tasks.workunit.client.0.smithi059.stdout:8/870: rename d7/d16/d3a/fed to d7/d2f/d43/f120 0 2024-04-25T16:27:03.731 INFO:tasks.workunit.client.0.smithi059.stdout:5/939: mknod d1/dcd/d50/d8a/c13d 0 2024-04-25T16:27:03.750 INFO:tasks.workunit.client.0.smithi059.stdout:9/933: mkdir d6/d4e/d54/d5d/d48/d116 0 2024-04-25T16:27:03.754 INFO:tasks.workunit.client.0.smithi059.stdout:4/875: rmdir d0/d4/df/d48/da3 39 2024-04-25T16:27:04.071 INFO:tasks.workunit.client.0.smithi059.stdout:0/881: mkdir dc/df/d5e/dc6/d11d 0 2024-04-25T16:27:04.077 INFO:tasks.workunit.client.0.smithi059.stdout:7/852: symlink d0/l119 0 2024-04-25T16:27:04.083 INFO:tasks.workunit.client.0.smithi059.stdout:3/953: rename d0/d1e/d57/c8a to d0/db/d2d/de4/c14f 0 2024-04-25T16:27:04.141 INFO:tasks.workunit.client.0.smithi059.stdout:0/882: chown dc/d37/d47/d71/d77/dce/f10f 2075447 1 2024-04-25T16:27:04.522 INFO:tasks.workunit.client.0.smithi059.stdout:6/959: dwrite d9/d16/d53/d6c/fb3 [0,4194304] 0 2024-04-25T16:27:04.685 INFO:tasks.workunit.client.0.smithi059.stdout:2/885: truncate de/d2a/d2e/d36/d2c/fbf 6579 0 2024-04-25T16:27:04.692 INFO:tasks.workunit.client.0.smithi059.stdout:5/940: chown d1/d48/d85/dbe/dde/c7a 259 1 2024-04-25T16:27:04.706 INFO:tasks.workunit.client.0.smithi059.stdout:2/886: chown de/d2a/d2e/de1/c122 106066 1 2024-04-25T16:27:04.813 INFO:tasks.workunit.client.0.smithi059.stdout:3/954: mkdir d0/db/d3f/d49/d129/d150 0 2024-04-25T16:27:04.895 INFO:tasks.workunit.client.0.smithi059.stdout:7/853: fdatasync d0/d7/d51/da9/db3/d33/d79/d5d/d85/ff7 0 2024-04-25T16:27:04.944 INFO:tasks.workunit.client.0.smithi059.stdout:3/955: sync 2024-04-25T16:27:05.036 INFO:tasks.workunit.client.0.smithi059.stdout:8/871: dwrite d7/dd/d33/d57/fa0 [0,4194304] 0 2024-04-25T16:27:05.104 INFO:tasks.workunit.client.0.smithi059.stdout:9/934: symlink d6/d4e/d54/d5d/d48/l117 0 2024-04-25T16:27:05.206 INFO:tasks.workunit.client.0.smithi059.stdout:8/872: dwrite d7/d16/de0/d101/f2a [0,4194304] 0 2024-04-25T16:27:05.528 INFO:tasks.workunit.client.0.smithi059.stdout:2/887: fsync de/d5a/d7d/fc3 0 2024-04-25T16:27:05.650 INFO:tasks.workunit.client.0.smithi059.stdout:2/888: read - de/d5a/d7d/d80/ddb/de3/ff1 zero size 2024-04-25T16:27:05.656 INFO:tasks.workunit.client.0.smithi059.stdout:4/876: dwrite d0/d79/fcd [0,4194304] 0 2024-04-25T16:27:05.844 INFO:tasks.workunit.client.0.smithi059.stdout:9/935: mknod d6/d35/d26/df0/c118 0 2024-04-25T16:27:05.944 INFO:tasks.workunit.client.0.smithi059.stdout:5/941: getdents d1/d1e/d12d 0 2024-04-25T16:27:06.015 INFO:tasks.workunit.client.0.smithi059.stdout:0/883: write dc/df/d24/fb5 [1007231,115885] 0 2024-04-25T16:27:06.376 INFO:tasks.workunit.client.0.smithi059.stdout:5/942: fdatasync d1/d1e/d27/d66/d70/fdf 0 2024-04-25T16:27:06.465 INFO:tasks.workunit.client.0.smithi059.stdout:1/930: creat d7/d2a/d85/db7/f134 x:0 0 0 2024-04-25T16:27:06.503 INFO:tasks.workunit.client.0.smithi059.stdout:4/877: truncate d0/d4/df/d1c/f6b 1264952 0 2024-04-25T16:27:06.597 INFO:tasks.workunit.client.0.smithi059.stdout:2/889: mkdir de/d2a/d2e/d36/d2c/d131/d142 0 2024-04-25T16:27:06.635 INFO:tasks.workunit.client.0.smithi059.stdout:9/936: fsync d6/d4e/d54/d5d/d48/d49/dfb/f10b 0 2024-04-25T16:27:06.651 INFO:tasks.workunit.client.0.smithi059.stdout:9/937: chown d6/d35/d26/d6b/d105/le9 1274381 1 2024-04-25T16:27:06.868 INFO:tasks.workunit.client.0.smithi059.stdout:6/960: dwrite d9/d16/d53/f82 [0,4194304] 0 2024-04-25T16:27:06.941 INFO:tasks.workunit.client.0.smithi059.stdout:2/890: mknod de/d2a/d33/d65/dca/c143 0 2024-04-25T16:27:06.945 INFO:tasks.workunit.client.0.smithi059.stdout:4/878: creat d0/d4/df/d1c/d45/d54/d75/d7e/f10b x:0 0 0 2024-04-25T16:27:06.974 INFO:tasks.workunit.client.0.smithi059.stdout:6/961: dread - d9/d27/d39/f92 zero size 2024-04-25T16:27:07.155 INFO:tasks.workunit.client.0.smithi059.stdout:1/931: truncate d7/d2a/d85/db7/d16/d72/def/f112 1216838 0 2024-04-25T16:27:07.217 INFO:tasks.workunit.client.0.smithi059.stdout:7/854: dwrite d0/d7/dae/fb5 [0,4194304] 0 2024-04-25T16:27:07.284 INFO:tasks.workunit.client.0.smithi059.stdout:9/938: dread d6/dae/dc3/ff4 [0,4194304] 0 2024-04-25T16:27:07.350 INFO:tasks.workunit.client.0.smithi059.stdout:3/956: dwrite d0/db/d3f/d6c/fac [0,4194304] 0 2024-04-25T16:27:07.429 INFO:tasks.workunit.client.0.smithi059.stdout:4/879: chown d0/d4/df/d1c/l25 2052439 1 2024-04-25T16:27:07.472 INFO:tasks.workunit.client.0.smithi059.stdout:5/943: getdents d1/d1e/d27/d66/d70/d75 0 2024-04-25T16:27:07.579 INFO:tasks.workunit.client.0.smithi059.stdout:8/873: dwrite d7/d16/d36/fa6 [0,4194304] 0 2024-04-25T16:27:07.778 INFO:tasks.workunit.client.0.smithi059.stdout:2/891: getdents de/d2a/d33/d65 0 2024-04-25T16:27:07.941 INFO:tasks.workunit.client.0.smithi059.stdout:0/884: dwrite dc/d37/d47/f64 [4194304,4194304] 0 2024-04-25T16:27:08.006 INFO:tasks.workunit.client.0.smithi059.stdout:6/962: dwrite d9/f23 [0,4194304] 0 2024-04-25T16:27:08.044 INFO:tasks.workunit.client.0.smithi059.stdout:0/885: sync 2024-04-25T16:27:08.088 INFO:tasks.workunit.client.0.smithi059.stdout:7/855: creat d0/d7/d51/da9/db3/d33/d4c/d5c/f11a x:0 0 0 2024-04-25T16:27:08.092 INFO:tasks.workunit.client.0.smithi059.stdout:9/939: truncate d6/d35/d26/d6b/fe4 547305 0 2024-04-25T16:27:08.101 INFO:tasks.workunit.client.0.smithi059.stdout:1/932: truncate d7/d2a/d85/db7/d16/d7f/f131 633049 0 2024-04-25T16:27:08.148 INFO:tasks.workunit.client.0.smithi059.stdout:9/940: chown d6/d35/d26/d6b/de3 3200 1 2024-04-25T16:27:08.458 INFO:tasks.workunit.client.0.smithi059.stdout:0/886: creat dc/d84/f11e x:0 0 0 2024-04-25T16:27:08.462 INFO:tasks.workunit.client.0.smithi059.stdout:6/963: mkdir d9/d16/d53/d6c/da6/dc6/de3/d121 0 2024-04-25T16:27:08.527 INFO:tasks.workunit.client.0.smithi059.stdout:0/887: sync 2024-04-25T16:27:08.543 INFO:tasks.workunit.client.0.smithi059.stdout:5/944: rename d1/d1e/d27/d66/d70/f39 to d1/d1e/d27/d66/f13e 0 2024-04-25T16:27:08.681 INFO:tasks.workunit.client.0.smithi059.stdout:9/941: mknod d6/d4e/c119 0 2024-04-25T16:27:08.691 INFO:tasks.workunit.client.0.smithi059.stdout:3/957: write d0/d1e/d11f/f125 [188343,29456] 0 2024-04-25T16:27:08.809 INFO:tasks.workunit.client.0.smithi059.stdout:8/874: write d7/dd/d33/f73 [2112849,86169] 0 2024-04-25T16:27:09.090 INFO:tasks.workunit.client.0.smithi059.stdout:2/892: rename de/d2a/d2e/fb2 to de/d2a/d33/f144 0 2024-04-25T16:27:09.112 INFO:tasks.workunit.client.0.smithi059.stdout:2/893: chown de/d67/l9f 517078940 1 2024-04-25T16:27:09.337 INFO:tasks.workunit.client.0.smithi059.stdout:6/964: mkdir d9/d27/d122 0 2024-04-25T16:27:09.348 INFO:tasks.workunit.client.0.smithi059.stdout:9/942: mknod d6/d35/d26/d6b/dc9/c11a 0 2024-04-25T16:27:09.390 INFO:tasks.workunit.client.0.smithi059.stdout:0/888: fdatasync dc/d37/d47/d71/f94 0 2024-04-25T16:27:09.801 INFO:tasks.workunit.client.0.smithi059.stdout:5/945: symlink d1/d1e/dca/l13f 0 2024-04-25T16:27:09.807 INFO:tasks.workunit.client.0.smithi059.stdout:2/894: truncate f7 2077381 0 2024-04-25T16:27:09.817 INFO:tasks.workunit.client.0.smithi059.stdout:4/880: link d0/d4/df/d48/da3/la6 d0/d4/df/d1c/d45/d54/d75/l10c 0 2024-04-25T16:27:09.821 INFO:tasks.workunit.client.0.smithi059.stdout:7/856: link d0/f27 d0/d7/d51/da9/db3/d33/d79/d5d/db7/f11b 0 2024-04-25T16:27:09.853 INFO:tasks.workunit.client.0.smithi059.stdout:5/946: stat d1/dcd/d44/fa4 0 2024-04-25T16:27:09.880 INFO:tasks.workunit.client.0.smithi059.stdout:5/947: chown d1/d1e/d27/d66/d70/f47 6317230 1 2024-04-25T16:27:09.978 INFO:tasks.workunit.client.0.smithi059.stdout:6/965: truncate d9/d16/d54/f94 3543468 0 2024-04-25T16:27:10.002 INFO:tasks.workunit.client.0.smithi059.stdout:6/966: chown d9/d16/d53/d55/d71/d7e/d9e/d111 202950 1 2024-04-25T16:27:10.411 INFO:tasks.workunit.client.0.smithi059.stdout:4/881: stat d0/d4/df/d44/f106 0 2024-04-25T16:27:10.578 INFO:tasks.workunit.client.0.smithi059.stdout:7/857: symlink d0/d7/d51/da9/db3/d33/dc6/l11c 0 2024-04-25T16:27:10.706 INFO:tasks.workunit.client.0.smithi059.stdout:5/948: creat d1/dcd/d50/d8a/dd8/f140 x:0 0 0 2024-04-25T16:27:10.729 INFO:tasks.workunit.client.0.smithi059.stdout:5/949: chown d1/d1e/d27/d66/d70/f114 5179951 1 2024-04-25T16:27:11.003 INFO:tasks.workunit.client.0.smithi059.stdout:1/933: rename d7/d2a/d85/db7/d16/d5c/d74/f100 to d7/f135 0 2024-04-25T16:27:11.079 INFO:tasks.workunit.client.0.smithi059.stdout:4/882: truncate d0/d4/df/d1c/f85 5136852 0 2024-04-25T16:27:11.162 INFO:tasks.workunit.client.0.smithi059.stdout:2/895: dread de/d2a/d2e/fb7 [0,4194304] 0 2024-04-25T16:27:11.262 INFO:tasks.workunit.client.0.smithi059.stdout:3/958: link d0/db/c4a d0/db/d47/d7e/c151 0 2024-04-25T16:27:11.277 INFO:tasks.workunit.client.0.smithi059.stdout:9/943: write d6/d4e/d54/f84 [72779,94080] 0 2024-04-25T16:27:11.361 INFO:tasks.workunit.client.0.smithi059.stdout:3/959: readlink d0/db/d2d/de4/de6/lfc 0 2024-04-25T16:27:11.375 INFO:tasks.workunit.client.0.smithi059.stdout:8/875: dwrite d7/dd/faf [0,4194304] 0 2024-04-25T16:27:11.452 INFO:tasks.workunit.client.0.smithi059.stdout:0/889: write dc/f4e [6012785,87639] 0 2024-04-25T16:27:11.627 INFO:tasks.workunit.client.0.smithi059.stdout:4/883: rename d0/d4/df/d74/f78 to d0/d4/df/d1c/d45/d6f/dc4/f10d 0 2024-04-25T16:27:11.789 INFO:tasks.workunit.client.0.smithi059.stdout:9/944: mknod d6/d35/d26/d6b/dc9/dd6/c11b 0 2024-04-25T16:27:11.802 INFO:tasks.workunit.client.0.smithi059.stdout:9/945: readlink d6/d35/d2f/d39/d85/lca 0 2024-04-25T16:27:11.856 INFO:tasks.workunit.client.0.smithi059.stdout:8/876: readlink d7/d16/d8c/ldb 0 2024-04-25T16:27:11.864 INFO:tasks.workunit.client.0.smithi059.stdout:8/877: chown d7/dd/faf 5431 1 2024-04-25T16:27:12.008 INFO:tasks.workunit.client.0.smithi059.stdout:1/934: truncate d7/d2a/d85/db7/d2d/fca 793833 0 2024-04-25T16:27:12.009 INFO:tasks.workunit.client.0.smithi059.stdout:0/890: stat dc/d37/d47/d71/d77/l92 0 2024-04-25T16:27:12.119 INFO:tasks.workunit.client.0.smithi059.stdout:0/891: sync 2024-04-25T16:27:12.194 INFO:tasks.workunit.client.0.smithi059.stdout:0/892: sync 2024-04-25T16:27:12.306 INFO:tasks.workunit.client.0.smithi059.stdout:9/946: symlink d6/d35/d26/d6b/dc9/dd6/l11c 0 2024-04-25T16:27:12.443 INFO:tasks.workunit.client.0.smithi059.stdout:1/935: mknod d7/d93/d8e/c136 0 2024-04-25T16:27:12.651 INFO:tasks.workunit.client.0.smithi059.stdout:0/893: creat dc/d44/f11f x:0 0 0 2024-04-25T16:27:12.762 INFO:tasks.workunit.client.0.smithi059.stdout:2/896: getdents de/d2a/d33/d65/dcf 0 2024-04-25T16:27:13.118 INFO:tasks.workunit.client.0.smithi059.stdout:4/884: getdents d0/d4/df/d1c/d45/d6f 0 2024-04-25T16:27:13.169 INFO:tasks.workunit.client.0.smithi059.stdout:5/950: dwrite d1/dcd/d44/d79/f7e [0,4194304] 0 2024-04-25T16:27:13.252 INFO:tasks.workunit.client.0.smithi059.stdout:0/894: mkdir dc/d37/d47/d109/d120 0 2024-04-25T16:27:13.261 INFO:tasks.workunit.client.0.smithi059.stdout:5/951: sync 2024-04-25T16:27:13.313 INFO:tasks.workunit.client.0.smithi059.stdout:6/967: dwrite d9/d16/d53/d6c/da6/fe7 [0,4194304] 0 2024-04-25T16:27:13.406 INFO:tasks.workunit.client.0.smithi059.stdout:2/897: mkdir de/d16/d9d/df7/d145 0 2024-04-25T16:27:13.429 INFO:tasks.workunit.client.0.smithi059.stdout:9/947: getdents d6/d35/d6c 0 2024-04-25T16:27:13.439 INFO:tasks.workunit.client.0.smithi059.stdout:4/885: chown d0/d4/df/d48/d5f/fb8 1913107391 1 2024-04-25T16:27:13.443 INFO:tasks.workunit.client.0.smithi059.stdout:5/952: chown d1/dcd/d50/fa2 12706 1 2024-04-25T16:27:13.500 INFO:tasks.workunit.client.0.smithi059.stdout:7/858: dwrite d0/d7/d51/da9/db3/d33/f41 [8388608,4194304] 0 2024-04-25T16:27:13.593 INFO:tasks.workunit.client.0.smithi059.stdout:5/953: read d1/dcd/d50/f8d [1148235,104211] 0 2024-04-25T16:27:13.867 INFO:tasks.workunit.client.0.smithi059.stdout:1/936: write d7/d2a/d85/db7/d16/d5c/d74/f132 [400773,6524] 0 2024-04-25T16:27:13.887 INFO:tasks.workunit.client.0.smithi059.stdout:3/960: dwrite d0/d1e/d57/dc9/f128 [0,4194304] 0 2024-04-25T16:27:13.972 INFO:tasks.workunit.client.0.smithi059.stdout:6/968: fsync d9/d16/d53/d74/fac 0 2024-04-25T16:27:13.984 INFO:tasks.workunit.client.0.smithi059.stdout:0/895: rename dc/d37/d47/d71/d77/dce to dc/df0/d121 0 2024-04-25T16:27:14.002 INFO:tasks.workunit.client.0.smithi059.stdout:9/948: mkdir d6/d4e/d54/d5d/d48/d49/d11d 0 2024-04-25T16:27:14.084 INFO:tasks.workunit.client.0.smithi059.stdout:6/969: readlink d9/d27/d39/d7b/lfe 0 2024-04-25T16:27:14.120 INFO:tasks.workunit.client.0.smithi059.stdout:5/954: symlink d1/d1e/d27/d66/d121/l141 0 2024-04-25T16:27:14.138 INFO:tasks.workunit.client.0.smithi059.stdout:8/878: dwrite d7/dd/f108 [0,4194304] 0 2024-04-25T16:27:14.204 INFO:tasks.workunit.client.0.smithi059.stdout:7/859: chown d0/d7/d51/da9/db3/d33/d79/d5d/f75 223 1 2024-04-25T16:27:14.239 INFO:tasks.workunit.client.0.smithi059.stdout:6/970: read d9/d27/f5f [3611341,111075] 0 2024-04-25T16:27:14.507 INFO:tasks.workunit.client.0.smithi059.stdout:3/961: mknod d0/db/d3f/d89/d101/c152 0 2024-04-25T16:27:15.061 INFO:tasks.workunit.client.0.smithi059.stdout:6/971: truncate d9/f72 1760414 0 2024-04-25T16:27:15.064 INFO:tasks.workunit.client.0.smithi059.stdout:8/879: dread d7/f1f [0,4194304] 0 2024-04-25T16:27:15.341 INFO:tasks.workunit.client.0.smithi059.stdout:3/962: readlink d0/db/d3f/d49/d10f/l127 0 2024-04-25T16:27:15.395 INFO:tasks.workunit.client.0.smithi059.stdout:3/963: stat d0/db/d47/c62 0 2024-04-25T16:27:15.441 INFO:tasks.workunit.client.0.smithi059.stdout:4/886: dwrite d0/d4/df/d1c/d45/d6f/dc4/f10d [0,4194304] 0 2024-04-25T16:27:15.581 INFO:tasks.workunit.client.0.smithi059.stdout:6/972: unlink d9/d16/d53/d55/fca 0 2024-04-25T16:27:15.795 INFO:tasks.workunit.client.0.smithi059.stdout:2/898: link de/d16/fcc de/f146 0 2024-04-25T16:27:15.805 INFO:tasks.workunit.client.0.smithi059.stdout:2/899: chown de/d5a/d7d/fc3 116 1 2024-04-25T16:27:15.848 INFO:tasks.workunit.client.0.smithi059.stdout:0/896: write dc/df/d24/f2e [2037958,122441] 0 2024-04-25T16:27:15.864 INFO:tasks.workunit.client.0.smithi059.stdout:0/897: chown dc/dd/f20 511803 1 2024-04-25T16:27:15.964 INFO:tasks.workunit.client.0.smithi059.stdout:1/937: rename d7/d2a/d85/db7/d16/d5c/d74/fb4 to d7/d2a/d85/db7/d16/f137 0 2024-04-25T16:27:16.087 INFO:tasks.workunit.client.0.smithi059.stdout:4/887: mknod d0/d4/df/d1c/d45/d54/d75/d82/d8f/c10e 0 2024-04-25T16:27:16.117 INFO:tasks.workunit.client.0.smithi059.stdout:4/888: dread - d0/d4/df/d1c/d45/d6f/dc4/fcb zero size 2024-04-25T16:27:16.166 INFO:tasks.workunit.client.0.smithi059.stdout:5/955: link d1/d1e/d27/d66/d70/d75/deb/lec d1/dcd/d50/d8a/dd8/l142 0 2024-04-25T16:27:16.460 INFO:tasks.workunit.client.0.smithi059.stdout:7/860: rename d0/d7/d16/d20/cec to d0/d7/dae/c11d 0 2024-04-25T16:27:16.508 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:27:16.510 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:27:16.602 INFO:tasks.workunit.client.0.smithi059.stdout:7/861: dread d0/d7/d51/da9/db3/d33/f41 [4194304,4194304] 0 2024-04-25T16:27:16.681 INFO:tasks.workunit.client.0.smithi059.stdout:8/880: rmdir d7/d16/de0/d101/d37/d116 0 2024-04-25T16:27:16.812 INFO:tasks.workunit.client.0.smithi059.stdout:9/949: write d6/d35/d2f/d39/f4f [4167578,87254] 0 2024-04-25T16:27:16.854 INFO:tasks.workunit.client.0.smithi059.stdout:8/881: dread d7/d16/fa7 [4194304,4194304] 0 2024-04-25T16:27:16.865 INFO:tasks.workunit.client.0.smithi059.stdout:0/898: symlink dc/d37/d47/d109/d120/l122 0 2024-04-25T16:27:17.072 INFO:tasks.workunit.client.0.smithi059.stdout:7/862: fdatasync d0/d7/d51/da9/db3/d33/d79/d5d/d94/fa2 0 2024-04-25T16:27:17.216 INFO:tasks.workunit.client.0.smithi059.stdout:5/956: getdents d1/d1e/d12d 0 2024-04-25T16:27:17.322 INFO:tasks.workunit.client.0.smithi059.stdout:0/899: symlink dc/d37/d47/d60/l123 0 2024-04-25T16:27:17.448 INFO:tasks.workunit.client.0.smithi059.stdout:0/900: sync 2024-04-25T16:27:17.613 INFO:tasks.workunit.client.0.smithi059.stdout:8/882: unlink d7/d16/de0/d101/d37/d5c/d87/d94/lb7 0 2024-04-25T16:27:17.725 INFO:tasks.workunit.client.0.smithi059.stdout:2/900: write de/d16/d3e/f4f [4546058,87821] 0 2024-04-25T16:27:17.772 INFO:tasks.workunit.client.0.smithi059.stdout:0/901: mknod dc/dd/d3b/d66/c124 0 2024-04-25T16:27:17.787 INFO:tasks.workunit.client.0.smithi059.stdout:2/901: sync 2024-04-25T16:27:17.853 INFO:tasks.workunit.client.0.smithi059.stdout:2/902: sync 2024-04-25T16:27:17.892 INFO:tasks.workunit.client.0.smithi059.stdout:1/938: write d7/d2a/d85/fc9 [177020,68757] 0 2024-04-25T16:27:17.918 INFO:tasks.workunit.client.0.smithi059.stdout:3/964: dwrite d0/d1e/f53 [0,4194304] 0 2024-04-25T16:27:17.986 INFO:tasks.workunit.client.0.smithi059.stdout:5/957: creat d1/d48/d85/dbe/f143 x:0 0 0 2024-04-25T16:27:18.035 INFO:tasks.workunit.client.0.smithi059.stdout:0/902: rename dc/d37/d47/d71/d9e to dc/df/d24/d119/d125 0 2024-04-25T16:27:18.088 INFO:tasks.workunit.client.0.smithi059.stdout:6/973: write d9/d16/d54/fcc [4614529,32642] 0 2024-04-25T16:27:18.171 INFO:tasks.workunit.client.0.smithi059.stdout:2/903: rmdir de/d2a/da7 39 2024-04-25T16:27:18.296 INFO:tasks.workunit.client.0.smithi059.stdout:4/889: write d0/d4/df/d44/f46 [2386190,63479] 0 2024-04-25T16:27:18.339 INFO:tasks.workunit.client.0.smithi059.stdout:5/958: readlink d1/d1e/dca/d113/dcc/l132 0 2024-04-25T16:27:18.379 INFO:tasks.workunit.client.0.smithi059.stdout:1/939: dread d7/d93/fb2 [0,4194304] 0 2024-04-25T16:27:18.410 INFO:tasks.workunit.client.0.smithi059.stdout:6/974: fdatasync d9/d16/fb6 0 2024-04-25T16:27:18.455 INFO:tasks.workunit.client.0.smithi059.stdout:0/903: dread dc/dd/d3b/d66/d9b/fb3 [0,4194304] 0 2024-04-25T16:27:18.762 INFO:tasks.workunit.client.0.smithi059.stdout:2/904: symlink de/d16/d3e/d101/l147 0 2024-04-25T16:27:18.764 INFO:tasks.workunit.client.0.smithi059.stdout:3/965: unlink d0/l10 0 2024-04-25T16:27:18.788 INFO:tasks.workunit.client.0.smithi059.stdout:4/890: chown d0/d4/df/d1c/d45/d54/cce 736 1 2024-04-25T16:27:18.822 INFO:tasks.workunit.client.0.smithi059.stdout:7/863: write d0/d7/d16/d20/f67 [1069810,3336] 0 2024-04-25T16:27:18.845 INFO:tasks.workunit.client.0.smithi059.stdout:9/950: write d6/d4e/d7a/fc2 [375112,40589] 0 2024-04-25T16:27:18.872 INFO:tasks.workunit.client.0.smithi059.stdout:4/891: sync 2024-04-25T16:27:18.900 INFO:tasks.workunit.client.0.smithi059.stdout:9/951: chown d6/d35/d28/dc0/df9 1 1 2024-04-25T16:27:19.034 INFO:tasks.workunit.client.0.smithi059.stdout:5/959: dread d1/dcd/d50/d8a/f99 [0,4194304] 0 2024-04-25T16:27:19.041 INFO:tasks.workunit.client.0.smithi059.stdout:1/940: truncate d7/d93/f4f 142966 0 2024-04-25T16:27:19.047 INFO:tasks.workunit.client.0.smithi059.stdout:0/904: truncate dc/df0/d121/f10f 445243 0 2024-04-25T16:27:19.068 INFO:tasks.workunit.client.0.smithi059.stdout:3/966: creat d0/db/d3f/d89/f153 x:0 0 0 2024-04-25T16:27:19.092 INFO:tasks.workunit.client.0.smithi059.stdout:2/905: mkdir de/d2a/d33/d65/dcf/d148 0 2024-04-25T16:27:19.122 INFO:tasks.workunit.client.0.smithi059.stdout:6/975: dread d9/d27/d39/f86 [0,4194304] 0 2024-04-25T16:27:19.178 INFO:tasks.workunit.client.0.smithi059.stdout:6/976: chown d9/d16/d53/d55/d71/d7e/la9 819 1 2024-04-25T16:27:19.314 INFO:tasks.workunit.client.0.smithi059.stdout:9/952: symlink d6/dae/dc3/l11e 0 2024-04-25T16:27:19.383 INFO:tasks.workunit.client.0.smithi059.stdout:8/883: getdents d7/d16/de0/d101/d37/d5c/d87/d94/d66/daa/dbd 0 2024-04-25T16:27:19.385 INFO:tasks.workunit.client.0.smithi059.stdout:4/892: fsync d0/d4/df/d1c/d45/d54/d75/d7e/f10b 0 2024-04-25T16:27:19.387 INFO:tasks.workunit.client.0.smithi059.stdout:9/953: sync 2024-04-25T16:27:19.534 INFO:tasks.workunit.client.0.smithi059.stdout:3/967: symlink d0/d1e/d11f/l154 0 2024-04-25T16:27:19.569 INFO:tasks.workunit.client.0.smithi059.stdout:2/906: creat de/d2a/d33/d12e/f149 x:0 0 0 2024-04-25T16:27:19.975 INFO:tasks.workunit.client.0.smithi059.stdout:1/941: truncate d7/d2a/d85/d8d/f95 3248575 0 2024-04-25T16:27:20.043 INFO:tasks.workunit.client.0.smithi059.stdout:6/977: mkdir d9/d16/d53/d74/d123 0 2024-04-25T16:27:20.316 INFO:tasks.workunit.client.0.smithi059.stdout:5/960: write d1/d1e/f20 [8098032,79391] 0 2024-04-25T16:27:20.722 INFO:tasks.workunit.client.0.smithi059.stdout:6/978: fsync d9/f59 0 2024-04-25T16:27:20.737 INFO:tasks.workunit.client.0.smithi059.stdout:6/979: chown d9/d16/d24/d5d/c69 17 1 2024-04-25T16:27:20.813 INFO:tasks.workunit.client.0.smithi059.stdout:6/980: sync 2024-04-25T16:27:20.905 INFO:tasks.workunit.client.0.smithi059.stdout:4/893: symlink d0/d4/df/d48/dde/d101/l10f 0 2024-04-25T16:27:21.157 INFO:tasks.workunit.client.0.smithi059.stdout:3/968: creat d0/db/d47/d7e/ded/d147/f155 x:0 0 0 2024-04-25T16:27:21.221 INFO:tasks.workunit.client.0.smithi059.stdout:3/969: sync 2024-04-25T16:27:21.240 INFO:tasks.workunit.client.0.smithi059.stdout:7/864: write d0/f30 [1215760,48904] 0 2024-04-25T16:27:21.576 INFO:tasks.workunit.client.0.smithi059.stdout:4/894: dread d0/d4/df/f8b [0,4194304] 0 2024-04-25T16:27:21.590 INFO:tasks.workunit.client.0.smithi059.stdout:4/895: read d0/d4/fe [2208874,119050] 0 2024-04-25T16:27:21.615 INFO:tasks.workunit.client.0.smithi059.stdout:3/970: mkdir d0/db/d2d/de4/de6/d156 0 2024-04-25T16:27:21.785 INFO:tasks.workunit.client.0.smithi059.stdout:0/905: rename dc/d37/l43 to dc/dd/d3b/d66/dbb/l126 0 2024-04-25T16:27:21.802 INFO:tasks.workunit.client.0.smithi059.stdout:5/961: creat d1/d48/d85/dbe/f144 x:0 0 0 2024-04-25T16:27:21.818 INFO:tasks.workunit.client.0.smithi059.stdout:7/865: read d0/d7/d51/da9/db3/d33/d79/d5d/d94/d106/f118 [430117,89600] 0 2024-04-25T16:27:21.901 INFO:tasks.workunit.client.0.smithi059.stdout:5/962: dread d1/d48/da3/f52 [0,4194304] 0 2024-04-25T16:27:21.910 INFO:tasks.workunit.client.0.smithi059.stdout:4/896: chown d0/d4/df/d44/fbe 1143696 1 2024-04-25T16:27:21.964 INFO:tasks.workunit.client.0.smithi059.stdout:2/907: getdents de/d2a/d2e/d36/d123 0 2024-04-25T16:27:21.980 INFO:tasks.workunit.client.0.smithi059.stdout:2/908: dread - de/d5a/d7d/d80/ddb/de3/f104 zero size 2024-04-25T16:27:22.108 INFO:tasks.workunit.client.0.smithi059.stdout:0/906: rename dc/d37/d47/d71/dd0/c108 to dc/d37/d47/d81/dd2/c127 0 2024-04-25T16:27:22.110 INFO:tasks.workunit.client.0.smithi059.stdout:1/942: dwrite d7/d21/f7c [0,4194304] 0 2024-04-25T16:27:22.252 INFO:tasks.workunit.client.0.smithi059.stdout:7/866: chown d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/f6e 1518113796 1 2024-04-25T16:27:22.301 INFO:tasks.workunit.client.0.smithi059.stdout:9/954: dwrite d6/d4e/d54/d5d/d95/fab [0,4194304] 0 2024-04-25T16:27:22.390 INFO:tasks.workunit.client.0.smithi059.stdout:7/867: write d0/d7/d51/da9/db3/d33/d79/d5d/d94/d106/f84 [1072443,520] 0 2024-04-25T16:27:22.405 INFO:tasks.workunit.client.0.smithi059.stdout:4/897: rmdir d0/d4/df/d1c 39 2024-04-25T16:27:22.509 INFO:tasks.workunit.client.0.smithi059.stdout:7/868: chown d0/d7/d51/da9/db3/d33/dc6/de8 58202 1 2024-04-25T16:27:22.547 INFO:tasks.workunit.client.0.smithi059.stdout:2/909: rename de/d5a/d7d to de/d2a/d2e/d36/d2c/d40/d57/d112/d14a 0 2024-04-25T16:27:22.588 INFO:tasks.workunit.client.0.smithi059.stdout:8/884: dwrite d7/d16/de0/d101/d37/d5c/d87/d94/d7f/dcb/fe1 [0,4194304] 0 2024-04-25T16:27:22.657 INFO:tasks.workunit.client.0.smithi059.stdout:1/943: dread - d7/d2a/d85/db7/f134 zero size 2024-04-25T16:27:22.678 INFO:tasks.workunit.client.0.smithi059.stdout:9/955: truncate d6/d4e/dba/fbe 1340011 0 2024-04-25T16:27:22.776 INFO:tasks.workunit.client.0.smithi059.stdout:4/898: dread d0/d4/f1b [0,4194304] 0 2024-04-25T16:27:23.051 INFO:tasks.workunit.client.0.smithi059.stdout:6/981: unlink d9/d16/c2d 0 2024-04-25T16:27:23.052 INFO:tasks.workunit.client.0.smithi059.stdout:0/907: rename dc/dd/d3b to dc/dd/d3b/d66/d128 22 2024-04-25T16:27:23.182 INFO:tasks.workunit.client.0.smithi059.stdout:3/971: write d0/db/d3f/d6c/fac [4422102,86778] 0 2024-04-25T16:27:23.204 INFO:tasks.workunit.client.0.smithi059.stdout:9/956: creat d6/d35/d6c/f11f x:0 0 0 2024-04-25T16:27:23.273 INFO:tasks.workunit.client.0.smithi059.stdout:3/972: write d0/d1e/f53 [81682,62965] 0 2024-04-25T16:27:23.351 INFO:tasks.workunit.client.0.smithi059.stdout:5/963: dwrite d1/dcd/f55 [4194304,4194304] 0 2024-04-25T16:27:23.410 INFO:tasks.workunit.client.0.smithi059.stdout:3/973: chown d0/d1e/d57/da8/ff8 517472323 1 2024-04-25T16:27:23.422 INFO:tasks.workunit.client.0.smithi059.stdout:1/944: mknod d7/d2a/d85/db7/d16/d7f/c138 0 2024-04-25T16:27:23.742 INFO:tasks.workunit.client.0.smithi059.stdout:8/885: dwrite d7/d16/de0/d101/f2a [0,4194304] 0 2024-04-25T16:27:23.977 INFO:tasks.workunit.client.0.smithi059.stdout:3/974: stat d0/f27 0 2024-04-25T16:27:23.981 INFO:tasks.workunit.client.0.smithi059.stdout:2/910: dwrite de/d5a/d9a/de9/dea/f118 [0,4194304] 0 2024-04-25T16:27:24.055 INFO:tasks.workunit.client.0.smithi059.stdout:5/964: mknod d1/d1e/d27/d66/d70/d75/deb/c145 0 2024-04-25T16:27:24.080 INFO:tasks.workunit.client.0.smithi059.stdout:2/911: sync 2024-04-25T16:27:24.173 INFO:tasks.workunit.client.0.smithi059.stdout:4/899: rmdir d0/d4/df/d1c/d45/d54/d75/d82/d8f 39 2024-04-25T16:27:24.192 INFO:tasks.workunit.client.0.smithi059.stdout:5/965: read - d1/dcd/d50/d8a/fd3 zero size 2024-04-25T16:27:24.196 INFO:tasks.workunit.client.0.smithi059.stdout:0/908: creat dc/dd/d5c/d104/f129 x:0 0 0 2024-04-25T16:27:24.230 INFO:tasks.workunit.client.0.smithi059.stdout:7/869: dwrite d0/d7/d51/da9/db3/d33/dc6/de8/ff9 [4194304,4194304] 0 2024-04-25T16:27:24.302 INFO:tasks.workunit.client.0.smithi059.stdout:6/982: dwrite d9/d16/d53/d6c/fbb [0,4194304] 0 2024-04-25T16:27:24.384 INFO:tasks.workunit.client.0.smithi059.stdout:9/957: write d6/d4e/d54/f62 [4169908,53994] 0 2024-04-25T16:27:24.576 INFO:tasks.workunit.client.0.smithi059.stdout:1/945: dwrite d7/d2a/d85/db7/d16/f46 [0,4194304] 0 2024-04-25T16:27:24.729 INFO:tasks.workunit.client.0.smithi059.stdout:0/909: creat dc/dd/d5c/f12a x:0 0 0 2024-04-25T16:27:25.077 INFO:tasks.workunit.client.0.smithi059.stdout:6/983: unlink d9/d1b/d58/d49/db0/dd7/l112 0 2024-04-25T16:27:25.323 INFO:tasks.workunit.client.0.smithi059.stdout:5/966: rename d1/d1e/d27/d66/d70/f22 to d1/d1e/d27/d66/d70/f146 0 2024-04-25T16:27:25.448 INFO:tasks.workunit.client.0.smithi059.stdout:2/912: truncate de/d2a/d2e/d36/d2c/d40/d57/d112/d14a/fc3 23941 0 2024-04-25T16:27:25.588 INFO:tasks.workunit.client.0.smithi059.stdout:9/958: write d6/d35/d2f/f4d [4658601,40260] 0 2024-04-25T16:27:25.590 INFO:tasks.workunit.client.0.smithi059.stdout:4/900: write d0/d4/df/d44/f4d [174347,129866] 0 2024-04-25T16:27:25.645 INFO:tasks.workunit.client.0.smithi059.stdout:8/886: dwrite d7/d16/de0/d101/d37/d5c/d87/d94/fe9 [0,4194304] 0 2024-04-25T16:27:25.950 INFO:tasks.workunit.client.0.smithi059.stdout:1/946: getdents d7/d21/d51/da6/d11d/d11e 0 2024-04-25T16:27:26.139 INFO:tasks.workunit.client.0.smithi059.stdout:9/959: mknod d6/d35/d26/d6b/dc9/dd6/c120 0 2024-04-25T16:27:26.198 INFO:tasks.workunit.client.0.smithi059.stdout:8/887: mknod d7/d2f/d43/c121 0 2024-04-25T16:27:26.311 INFO:tasks.workunit.client.0.smithi059.stdout:4/901: creat d0/d4/df/d1c/d45/d6f/dc4/f110 x:0 0 0 2024-04-25T16:27:26.427 INFO:tasks.workunit.client.0.smithi059.stdout:6/984: symlink d9/d16/dc0/l124 0 2024-04-25T16:27:26.435 INFO:tasks.workunit.client.0.smithi059.stdout:6/985: chown d9/c11 4439 1 2024-04-25T16:27:26.441 INFO:tasks.workunit.client.0.smithi059.stdout:7/870: write d0/d7/d51/da9/db3/d33/d79/d5d/d85/fce [783678,124810] 0 2024-04-25T16:27:26.645 INFO:tasks.workunit.client.0.smithi059.stdout:8/888: chown d7/c5a 5 1 2024-04-25T16:27:26.831 INFO:tasks.workunit.client.0.smithi059.stdout:6/986: symlink d9/d16/dc0/d10c/l125 0 2024-04-25T16:27:27.140 INFO:tasks.workunit.client.0.smithi059.stdout:5/967: write d1/dd/f6e [202611,57460] 0 2024-04-25T16:27:27.242 INFO:tasks.workunit.client.0.smithi059.stdout:0/910: dwrite dc/dd/d3b/fd3 [0,4194304] 0 2024-04-25T16:27:27.392 INFO:tasks.workunit.client.0.smithi059.stdout:6/987: creat d9/d16/d53/d6c/da6/dc6/de3/d121/f126 x:0 0 0 2024-04-25T16:27:27.515 INFO:tasks.workunit.client.0.smithi059.stdout:5/968: mkdir d1/dcd/d44/dd1/d147 0 2024-04-25T16:27:27.671 INFO:tasks.workunit.client.0.smithi059.stdout:3/975: rename d0/l10b to d0/d1e/d31/l157 0 2024-04-25T16:27:27.675 INFO:tasks.workunit.client.0.smithi059.stdout:4/902: truncate d0/d4/df/d1c/d45/d54/d75/d82/d8f/fc1 296959 0 2024-04-25T16:27:27.680 INFO:tasks.workunit.client.0.smithi059.stdout:0/911: rmdir dc/d37/d47/df7 39 2024-04-25T16:27:27.734 INFO:tasks.workunit.client.0.smithi059.stdout:5/969: symlink d1/dcd/d44/l148 0 2024-04-25T16:27:28.095 INFO:tasks.workunit.client.0.smithi059.stdout:2/913: write de/d2a/d2e/d36/ff2 [476116,54561] 0 2024-04-25T16:27:28.104 INFO:tasks.workunit.client.0.smithi059.stdout:7/871: write d0/d7/d16/d20/f67 [1716184,41663] 0 2024-04-25T16:27:28.221 INFO:tasks.workunit.client.0.smithi059.stdout:7/872: chown d0/d7/dae/le1 1 1 2024-04-25T16:27:28.256 INFO:tasks.workunit.client.0.smithi059.stdout:9/960: rename d6/d35/d2f/d39/cb0 to d6/d35/d26/d6b/d105/c121 0 2024-04-25T16:27:28.341 INFO:tasks.workunit.client.0.smithi059.stdout:1/947: dwrite d7/d2a/d85/db7/d2d/d4a/f4b [0,4194304] 0 2024-04-25T16:27:28.407 INFO:tasks.workunit.client.0.smithi059.stdout:8/889: dwrite d7/d16/de0/d101/fda [0,4194304] 0 2024-04-25T16:27:28.486 INFO:tasks.workunit.client.0.smithi059.stdout:6/988: symlink d9/d16/d24/d5d/l127 0 2024-04-25T16:27:28.504 INFO:tasks.workunit.client.0.smithi059.stdout:1/948: readlink d7/d2a/d85/l127 0 2024-04-25T16:27:28.903 INFO:tasks.workunit.client.0.smithi059.stdout:2/914: mknod de/d2a/d33/d65/dca/c14b 0 2024-04-25T16:27:29.071 INFO:tasks.workunit.client.0.smithi059.stdout:0/912: symlink dc/dd/l12b 0 2024-04-25T16:27:29.118 INFO:tasks.workunit.client.0.smithi059.stdout:7/873: rmdir d0/d7/d16/d20 39 2024-04-25T16:27:29.142 INFO:tasks.workunit.client.0.smithi059.stdout:4/903: dwrite d0/d79/fd9 [0,4194304] 0 2024-04-25T16:27:29.214 INFO:tasks.workunit.client.0.smithi059.stdout:5/970: write d1/d1e/d27/d66/d70/d24/f4b [870200,14600] 0 2024-04-25T16:27:29.262 INFO:tasks.workunit.client.0.smithi059.stdout:9/961: fdatasync d6/d4e/d54/d5d/f38 0 2024-04-25T16:27:29.320 INFO:tasks.workunit.client.0.smithi059.stdout:3/976: dwrite d0/db/d3f/d6c/dea/de9/f11c [0,4194304] 0 2024-04-25T16:27:29.427 INFO:tasks.workunit.client.0.smithi059.stdout:9/962: chown d6/d35/d2f/d39/f9a 13492 1 2024-04-25T16:27:29.483 INFO:tasks.workunit.client.0.smithi059.stdout:9/963: dread d6/d35/d26/d6b/dc9/dd6/fd9 [0,4194304] 0 2024-04-25T16:27:29.564 INFO:tasks.workunit.client.0.smithi059.stdout:1/949: dread d7/d2a/d85/db7/d16/d5c/d74/f132 [0,4194304] 0 2024-04-25T16:27:29.911 INFO:tasks.workunit.client.0.smithi059.stdout:6/989: dwrite d9/d27/f5f [0,4194304] 0 2024-04-25T16:27:29.973 INFO:tasks.workunit.client.0.smithi059.stdout:6/990: chown d9/f23 1296477486 1 2024-04-25T16:27:30.020 INFO:tasks.workunit.client.0.smithi059.stdout:7/874: dread - d0/fd8 zero size 2024-04-25T16:27:30.148 INFO:tasks.workunit.client.0.smithi059.stdout:5/971: truncate d1/dcd/f104 726061 0 2024-04-25T16:27:30.255 INFO:tasks.workunit.client.0.smithi059.stdout:5/972: sync 2024-04-25T16:27:30.365 INFO:tasks.workunit.client.0.smithi059.stdout:3/977: creat d0/db/d47/d7e/ded/d147/f158 x:0 0 0 2024-04-25T16:27:30.428 INFO:tasks.workunit.client.0.smithi059.stdout:9/964: mknod d6/d35/d26/c122 0 2024-04-25T16:27:30.438 INFO:tasks.workunit.client.0.smithi059.stdout:9/965: chown d6/d4e/d54 22228 1 2024-04-25T16:27:30.546 INFO:tasks.workunit.client.0.smithi059.stdout:8/890: dread - d7/dd/d17/db4/d7e/da5/fff zero size 2024-04-25T16:27:30.622 INFO:tasks.workunit.client.0.smithi059.stdout:1/950: fdatasync d7/d2a/d85/db7/d16/d7f/dbe/fd5 0 2024-04-25T16:27:30.668 INFO:tasks.workunit.client.0.smithi059.stdout:6/991: read d9/d1b/d58/d49/db0/fe1 [505809,102578] 0 2024-04-25T16:27:31.036 INFO:tasks.workunit.client.0.smithi059.stdout:7/875: chown d0/f88 1404869 1 2024-04-25T16:27:31.270 INFO:tasks.workunit.client.0.smithi059.stdout:4/904: creat d0/d4/df/d1c/d45/d54/d75/d7e/df5/f111 x:0 0 0 2024-04-25T16:27:31.316 INFO:tasks.workunit.client.0.smithi059.stdout:3/978: chown d0/d1e/lb1 157291009 1 2024-04-25T16:27:31.413 INFO:tasks.workunit.client.0.smithi059.stdout:8/891: chown d7/dd/d17/db4/d7e/f113 259 1 2024-04-25T16:27:31.502 INFO:tasks.workunit.client.0.smithi059.stdout:1/951: rmdir d7/d2a/d85/db7/dbb 39 2024-04-25T16:27:31.566 INFO:tasks.workunit.client.0.smithi059.stdout:6/992: creat d9/d16/d53/d6c/da6/dc6/de3/d121/f128 x:0 0 0 2024-04-25T16:27:31.581 INFO:tasks.workunit.client.0.smithi059.stdout:6/993: chown d9/d16/dc0/d10c/dd2/l105 3855797 1 2024-04-25T16:27:31.772 INFO:tasks.workunit.client.0.smithi059.stdout:7/876: fsync d0/d7/d51/da9/db3/d33/d79/d5d/f95 0 2024-04-25T16:27:31.812 INFO:tasks.workunit.client.0.smithi059.stdout:0/913: link dc/dd/d3b/d66/ld7 dc/df/d5e/dc6/l12c 0 2024-04-25T16:27:31.819 INFO:tasks.workunit.client.0.smithi059.stdout:0/914: readlink dc/d44/l38 0 2024-04-25T16:27:31.847 INFO:tasks.workunit.client.0.smithi059.stdout:5/973: mknod d1/dcd/df9/c149 0 2024-04-25T16:27:31.893 INFO:tasks.workunit.client.0.smithi059.stdout:4/905: dread - d0/d4/df/d1c/d45/d54/dd4/fff zero size 2024-04-25T16:27:31.934 INFO:tasks.workunit.client.0.smithi059.stdout:9/966: mknod d6/d35/dde/c123 0 2024-04-25T16:27:32.004 INFO:tasks.workunit.client.0.smithi059.stdout:2/915: getdents de/d2a/d2e/d36/d11d 0 2024-04-25T16:27:32.048 INFO:tasks.workunit.client.0.smithi059.stdout:8/892: creat d7/dd/d33/f122 x:0 0 0 2024-04-25T16:27:32.116 INFO:tasks.workunit.client.0.smithi059.stdout:1/952: dread d7/d93/f4f [0,4194304] 0 2024-04-25T16:27:32.125 INFO:tasks.workunit.client.0.smithi059.stdout:1/953: chown d7/d2a/d85 3 1 2024-04-25T16:27:32.139 INFO:tasks.workunit.client.0.smithi059.stdout:6/994: truncate d9/fb2 1385963 0 2024-04-25T16:27:32.231 INFO:tasks.workunit.client.0.smithi059.stdout:0/915: truncate f9 1316270 0 2024-04-25T16:27:32.348 INFO:tasks.workunit.client.0.smithi059.stdout:9/967: mknod d6/d35/d26/d6b/c124 0 2024-04-25T16:27:32.364 INFO:tasks.workunit.client.0.smithi059.stdout:9/968: dread - d6/d4e/d54/d5d/d48/d6e/f115 zero size 2024-04-25T16:27:32.408 INFO:tasks.workunit.client.0.smithi059.stdout:2/916: fsync de/d16/d9d/f12a 0 2024-04-25T16:27:32.559 INFO:tasks.workunit.client.0.smithi059.stdout:1/954: rmdir d7/d2a/d85/db7 39 2024-04-25T16:27:32.571 INFO:tasks.workunit.client.0.smithi059.stdout:1/955: chown d7/d2a/d62/l106 62920109 1 2024-04-25T16:27:32.612 INFO:tasks.workunit.client.0.smithi059.stdout:6/995: creat d9/d16/dc0/d10c/df6/f129 x:0 0 0 2024-04-25T16:27:33.107 INFO:tasks.workunit.client.0.smithi059.stdout:4/906: rename d0/d4/df/d1c/d45/d54/d75/cdc to d0/d4/df/d1c/d45/d54/d75/d82/c112 0 2024-04-25T16:27:33.178 INFO:tasks.workunit.client.0.smithi059.stdout:6/996: fsync d9/d16/d53/fec 0 2024-04-25T16:27:33.282 INFO:tasks.workunit.client.0.smithi059.stdout:3/979: dwrite d0/db/d2d/f4e [0,4194304] 0 2024-04-25T16:27:33.363 INFO:tasks.workunit.client.0.smithi059.stdout:3/980: sync 2024-04-25T16:27:33.383 INFO:tasks.workunit.client.0.smithi059.stdout:0/916: symlink dc/d37/d47/df7/d10c/l12d 0 2024-04-25T16:27:33.432 INFO:tasks.workunit.client.0.smithi059.stdout:3/981: dread - d0/db/d47/d98/fc0 zero size 2024-04-25T16:27:33.452 INFO:tasks.workunit.client.0.smithi059.stdout:7/877: dwrite d0/d7/fa [12582912,4194304] 0 2024-04-25T16:27:33.610 INFO:tasks.workunit.client.0.smithi059.stdout:8/893: rename d7/dd/d17/db4/d7e/fc1 to d7/d16/d8f/dc0/f123 0 2024-04-25T16:27:33.632 INFO:tasks.workunit.client.0.smithi059.stdout:1/956: mknod d7/d2a/d85/db7/d16/d5c/d74/dd0/c139 0 2024-04-25T16:27:33.713 INFO:tasks.workunit.client.0.smithi059.stdout:5/974: dwrite d1/f5b [0,4194304] 0 2024-04-25T16:27:33.938 INFO:tasks.workunit.client.0.smithi059.stdout:4/907: truncate d0/d4/df/d1c/d45/d6f/dc4/f110 935769 0 2024-04-25T16:27:34.228 INFO:tasks.workunit.client.0.smithi059.stdout:3/982: symlink d0/db/d2d/d7a/d114/l159 0 2024-04-25T16:27:34.237 INFO:tasks.workunit.client.0.smithi059.stdout:9/969: write d6/f47 [8670620,19067] 0 2024-04-25T16:27:34.239 INFO:tasks.workunit.client.0.smithi059.stdout:2/917: write de/d2a/d2e/d36/d2c/d40/fe4 [3598454,129011] 0 2024-04-25T16:27:34.314 INFO:tasks.workunit.client.0.smithi059.stdout:9/970: dread d6/d35/d26/d6b/dc9/dd6/fd9 [0,4194304] 0 2024-04-25T16:27:34.396 INFO:tasks.workunit.client.0.smithi059.stdout:1/957: rename d7/de5/d102/c103 to d7/d2a/db8/c13a 0 2024-04-25T16:27:34.463 INFO:tasks.workunit.client.0.smithi059.stdout:5/975: mknod d1/dcd/d44/d79/dda/dfe/dea/c14a 0 2024-04-25T16:27:34.645 INFO:tasks.workunit.client.0.smithi059.stdout:6/997: write d9/d1b/d58/d49/db0/f103 [3906912,46516] 0 2024-04-25T16:27:34.647 INFO:tasks.workunit.client.0.smithi059.stdout:4/908: symlink d0/d79/l113 0 2024-04-25T16:27:34.787 INFO:tasks.workunit.client.0.smithi059.stdout:3/983: mkdir d0/d1e/d57/dc9/d14d/d10a/d15a 0 2024-04-25T16:27:35.674 INFO:tasks.workunit.client.0.smithi059.stdout:6/998: symlink d9/d16/dc0/d10c/l12a 0 2024-04-25T16:27:35.935 INFO:tasks.workunit.client.0.smithi059.stdout:3/984: dread d0/db/d2d/d7a/d86/f14e [0,4194304] 0 2024-04-25T16:27:36.141 INFO:tasks.workunit.client.0.smithi059.stdout:8/894: creat d7/d16/f124 x:0 0 0 2024-04-25T16:27:36.395 INFO:tasks.workunit.client.0.smithi059.stdout:5/976: mknod d1/dcd/d110/c14b 0 2024-04-25T16:27:36.413 INFO:tasks.workunit.client.0.smithi059.stdout:0/917: getdents dc/dd/d3b/d66/dbb/de4 0 2024-04-25T16:27:36.511 INFO:tasks.workunit.client.0.smithi059.stdout:3/985: creat d0/db/d132/f15b x:0 0 0 2024-04-25T16:27:36.620 INFO:tasks.workunit.client.0.smithi059.stdout:8/895: unlink d7/l1d 0 2024-04-25T16:27:36.837 INFO:tasks.workunit.client.0.smithi059.stdout:7/878: rename d0/d7/dae/de2/c101 to d0/d7/d16/d20/c11e 0 2024-04-25T16:27:36.843 INFO:tasks.workunit.client.0.smithi059.stdout:6/999: mkdir d9/d16/d53/d55/d71/d7e/dc4/deb/d12b 0 2024-04-25T16:27:36.857 INFO:tasks.workunit.client.0.smithi059.stdout:7/879: stat d0/d7/d51/da9/db3/d33/d4c/laa 0 2024-04-25T16:27:37.285 INFO:tasks.workunit.client.0.smithi059.stdout:7/880: mkdir d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/d108/d11f 0 2024-04-25T16:27:38.055 INFO:tasks.workunit.client.0.smithi059.stdout:5/977: getdents d1/d48/d85 0 2024-04-25T16:27:38.086 INFO:tasks.workunit.client.0.smithi059.stdout:4/909: write d0/d4/df/d1c/d45/f2d [685069,114915] 0 2024-04-25T16:27:38.090 INFO:tasks.workunit.client.0.smithi059.stdout:2/918: write de/d2a/d2e/d36/d2c/d40/de5/f109 [285107,71657] 0 2024-04-25T16:27:38.137 INFO:tasks.workunit.client.0.smithi059.stdout:0/918: write dc/dd/d3b/f80 [5062392,10247] 0 2024-04-25T16:27:38.313 INFO:tasks.workunit.client.0.smithi059.stdout:1/958: dwrite d7/d2a/d85/db7/d16/d72/def/f112 [0,4194304] 0 2024-04-25T16:27:38.402 INFO:tasks.workunit.client.0.smithi059.stdout:9/971: mkdir d6/d125 0 2024-04-25T16:27:38.405 INFO:tasks.workunit.client.0.smithi059.stdout:7/881: write d0/d7/d51/da9/db3/d33/d79/d5d/db7/fef [628962,121249] 0 2024-04-25T16:27:38.413 INFO:tasks.workunit.client.0.smithi059.stdout:5/978: mknod d1/dcd/d50/db8/c14c 0 2024-04-25T16:27:38.441 INFO:tasks.workunit.client.0.smithi059.stdout:2/919: symlink de/d16/d7f/l14c 0 2024-04-25T16:27:38.451 INFO:tasks.workunit.client.0.smithi059.stdout:3/986: dwrite d0/d1e/d31/df0/f12a [0,4194304] 0 2024-04-25T16:27:38.566 INFO:tasks.workunit.client.0.smithi059.stdout:0/919: mknod dc/df/d5e/dc6/c12e 0 2024-04-25T16:27:38.713 INFO:tasks.workunit.client.0.smithi059.stdout:8/896: dwrite d7/dd/d17/db4/d7e/da5/fc9 [0,4194304] 0 2024-04-25T16:27:38.904 INFO:tasks.workunit.client.0.smithi059.stdout:9/972: dread d6/d4e/d54/d5d/f59 [0,4194304] 0 2024-04-25T16:27:39.059 INFO:tasks.workunit.client.0.smithi059.stdout:4/910: creat d0/d4/df/d1c/d45/d6f/dc4/dd0/f114 x:0 0 0 2024-04-25T16:27:39.194 INFO:tasks.workunit.client.0.smithi059.stdout:1/959: dwrite d7/d2a/d85/f126 [0,4194304] 0 2024-04-25T16:27:39.261 INFO:tasks.workunit.client.0.smithi059.stdout:3/987: unlink d0/db/d2d/fab 0 2024-04-25T16:27:39.283 INFO:tasks.workunit.client.0.smithi059.stdout:7/882: truncate d0/d7/d51/da9/db3/d33/d79/f7b 3927300 0 2024-04-25T16:27:39.407 INFO:tasks.workunit.client.0.smithi059.stdout:2/920: write de/d2a/d2e/d36/d2c/d40/fcb [5060385,84484] 0 2024-04-25T16:27:39.579 INFO:tasks.workunit.client.0.smithi059.stdout:5/979: dwrite d1/d1e/d27/d66/d70/d75/daa/fbf [0,4194304] 0 2024-04-25T16:27:39.580 INFO:tasks.workunit.client.0.smithi059.stdout:4/911: creat d0/d4/df/d1c/d45/d6f/dc4/f115 x:0 0 0 2024-04-25T16:27:39.656 INFO:tasks.workunit.client.0.smithi059.stdout:8/897: mkdir d7/d16/d36/d125 0 2024-04-25T16:27:39.680 INFO:tasks.workunit.client.0.smithi059.stdout:0/920: dwrite dc/dd/f4c [4194304,4194304] 0 2024-04-25T16:27:39.768 INFO:tasks.workunit.client.0.smithi059.stdout:1/960: mkdir d7/d2a/d85/d8d/dff/d13b 0 2024-04-25T16:27:39.778 INFO:tasks.workunit.client.0.smithi059.stdout:7/883: mkdir d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/d108/d120 0 2024-04-25T16:27:39.779 INFO:tasks.workunit.client.0.smithi059.stdout:5/980: readlink d1/d1e/l28 0 2024-04-25T16:27:40.230 INFO:tasks.workunit.client.0.smithi059.stdout:3/988: unlink d0/d1e/l59 0 2024-04-25T16:27:40.267 INFO:tasks.workunit.client.0.smithi059.stdout:8/898: fdatasync d7/f1f 0 2024-04-25T16:27:40.527 INFO:tasks.workunit.client.0.smithi059.stdout:9/973: creat d6/d4e/d7a/f126 x:0 0 0 2024-04-25T16:27:40.621 INFO:tasks.workunit.client.0.smithi059.stdout:5/981: mknod d1/dcd/d110/c14d 0 2024-04-25T16:27:40.643 INFO:tasks.workunit.client.0.smithi059.stdout:7/884: mknod d0/d7/d51/da9/db3/d33/d79/d5d/db7/c121 0 2024-04-25T16:27:40.697 INFO:tasks.workunit.client.0.smithi059.stdout:1/961: truncate d7/d2a/d85/db7/d16/d5c/d74/da7/fc6 1214420 0 2024-04-25T16:27:40.801 INFO:tasks.workunit.client.0.smithi059.stdout:2/921: mkdir de/d5a/d9a/de9/dea/d12b/d14d 0 2024-04-25T16:27:41.333 INFO:tasks.workunit.client.0.smithi059.stdout:9/974: truncate d6/d4e/d54/fa9 289710 0 2024-04-25T16:27:41.399 INFO:tasks.workunit.client.0.smithi059.stdout:7/885: truncate d0/d7/d51/da9/db3/d33/d4c/f10c 59587 0 2024-04-25T16:27:41.499 INFO:tasks.workunit.client.0.smithi059.stdout:2/922: mkdir de/d2a/d2e/d36/d59/d14e 0 2024-04-25T16:27:41.890 INFO:tasks.workunit.client.0.smithi059.stdout:7/886: rename d0/de5/dfc/l10d to d0/d7/d51/da9/db3/d33/d79/d5d/dcb/l122 0 2024-04-25T16:27:41.980 INFO:tasks.workunit.client.0.smithi059.stdout:4/912: dwrite d0/d4/df/d48/d5f/fb8 [0,4194304] 0 2024-04-25T16:27:42.247 INFO:tasks.workunit.client.0.smithi059.stdout:0/921: dwrite dc/d37/d47/d81/fc0 [0,4194304] 0 2024-04-25T16:27:42.307 INFO:tasks.workunit.client.0.smithi059.stdout:4/913: rmdir d0/d4/df/d48/da3 39 2024-04-25T16:27:42.318 INFO:tasks.workunit.client.0.smithi059.stdout:5/982: getdents d1/d1e/dca 0 2024-04-25T16:27:42.403 INFO:tasks.workunit.client.0.smithi059.stdout:5/983: read d1/d1e/f41 [19901,28570] 0 2024-04-25T16:27:42.451 INFO:tasks.workunit.client.0.smithi059.stdout:3/989: dwrite d0/db/d47/d7e/ded/d147/f158 [0,4194304] 0 2024-04-25T16:27:42.638 INFO:tasks.workunit.client.0.smithi059.stdout:4/914: unlink d0/ff4 0 2024-04-25T16:27:42.652 INFO:tasks.workunit.client.0.smithi059.stdout:8/899: write d7/d16/da3/fdf [215666,64807] 0 2024-04-25T16:27:42.721 INFO:tasks.workunit.client.0.smithi059.stdout:0/922: symlink dc/d37/d47/df7/l12f 0 2024-04-25T16:27:42.858 INFO:tasks.workunit.client.0.smithi059.stdout:1/962: dwrite d7/d2a/d85/f9d [0,4194304] 0 2024-04-25T16:27:42.995 INFO:tasks.workunit.client.0.smithi059.stdout:9/975: dwrite d6/d4e/fb4 [0,4194304] 0 2024-04-25T16:27:43.076 INFO:tasks.workunit.client.0.smithi059.stdout:4/915: rename d0/d4/df/c6e to d0/d4/df/d48/dde/c116 0 2024-04-25T16:27:43.081 INFO:tasks.workunit.client.0.smithi059.stdout:0/923: creat dc/dd/d5c/d104/f130 x:0 0 0 2024-04-25T16:27:43.168 INFO:tasks.workunit.client.0.smithi059.stdout:9/976: dread - d6/d4e/d54/d5d/d95/fe2 zero size 2024-04-25T16:27:43.175 INFO:tasks.workunit.client.0.smithi059.stdout:2/923: dwrite de/d2a/d2e/d36/d2c/d40/de5/ff4 [0,4194304] 0 2024-04-25T16:27:43.473 INFO:tasks.workunit.client.0.smithi059.stdout:7/887: dwrite d0/d7/d51/da9/db3/fb2 [0,4194304] 0 2024-04-25T16:27:43.547 INFO:tasks.workunit.client.0.smithi059.stdout:0/924: creat dc/dd/d5c/d104/f131 x:0 0 0 2024-04-25T16:27:43.572 INFO:tasks.workunit.client.0.smithi059.stdout:8/900: dwrite d7/dd/d33/f41 [4194304,4194304] 0 2024-04-25T16:27:43.657 INFO:tasks.workunit.client.0.smithi059.stdout:5/984: creat d1/f14e x:0 0 0 2024-04-25T16:27:43.668 INFO:tasks.workunit.client.0.smithi059.stdout:3/990: creat d0/db/d47/f15c x:0 0 0 2024-04-25T16:27:43.680 INFO:tasks.workunit.client.0.smithi059.stdout:4/916: chown d0/d4/df/d1c/d45/d54/d75/f90 127162 1 2024-04-25T16:27:43.703 INFO:tasks.workunit.client.0.smithi059.stdout:2/924: rmdir de/d5a/d9a/de9/dea/d12b 39 2024-04-25T16:27:43.786 INFO:tasks.workunit.client.0.smithi059.stdout:0/925: dread dc/d37/d47/d71/d9c/fc8 [0,4194304] 0 2024-04-25T16:27:43.788 INFO:tasks.workunit.client.0.smithi059.stdout:7/888: chown d0/d7/d51/da9/db3/d33/d79/d5d/d94/c114 471665 1 2024-04-25T16:27:44.170 INFO:tasks.workunit.client.0.smithi059.stdout:1/963: write d7/f53 [292584,70948] 0 2024-04-25T16:27:44.193 INFO:tasks.workunit.client.0.smithi059.stdout:5/985: mknod d1/dcd/d44/d79/dda/dfe/c14f 0 2024-04-25T16:27:44.320 INFO:tasks.workunit.client.0.smithi059.stdout:5/986: stat d1/dcd/d44/d79/ffa 0 2024-04-25T16:27:44.486 INFO:tasks.workunit.client.0.smithi059.stdout:4/917: dread d0/d79/fcd [0,4194304] 0 2024-04-25T16:27:44.509 INFO:tasks.workunit.client.0.smithi059.stdout:8/901: dread d7/d16/de0/d101/f63 [0,4194304] 0 2024-04-25T16:27:44.716 INFO:tasks.workunit.client.0.smithi059.stdout:9/977: link d6/d35/d6c/lff d6/d35/d26/d6b/de3/l127 0 2024-04-25T16:27:44.728 INFO:tasks.workunit.client.0.smithi059.stdout:3/991: rename d0/d1e/d57/dc9/d14d/d10a/l113 to d0/d1e/d57/dc9/d14d/d10a/d15a/l15d 0 2024-04-25T16:27:44.758 INFO:tasks.workunit.client.0.smithi059.stdout:9/978: chown d6/d4e/d54/l77 1378 1 2024-04-25T16:27:44.782 INFO:tasks.workunit.client.0.smithi059.stdout:5/987: creat d1/dcd/d50/d8a/f150 x:0 0 0 2024-04-25T16:27:45.164 INFO:tasks.workunit.client.0.smithi059.stdout:7/889: dwrite d0/d7/d51/da9/db3/d33/f93 [0,4194304] 0 2024-04-25T16:27:45.281 INFO:tasks.workunit.client.0.smithi059.stdout:1/964: dwrite d7/d93/fb3 [0,4194304] 0 2024-04-25T16:27:45.416 INFO:tasks.workunit.client.0.smithi059.stdout:1/965: chown d7/d2a/d85/db7/d16/d7f/dbe/d121/dbc/fc1 27 1 2024-04-25T16:27:45.446 INFO:tasks.workunit.client.0.smithi059.stdout:4/918: fsync d0/d4/df/f19 0 2024-04-25T16:27:45.454 INFO:tasks.workunit.client.0.smithi059.stdout:7/890: dwrite d0/d7/d51/da9/db3/d33/f93 [0,4194304] 0 2024-04-25T16:27:45.466 INFO:tasks.workunit.client.0.smithi059.stdout:8/902: symlink d7/d16/d3a/l126 0 2024-04-25T16:27:45.541 INFO:tasks.workunit.client.0.smithi059.stdout:2/925: link de/d16/d3e/d101/f103 de/d2a/d33/d88/f14f 0 2024-04-25T16:27:45.544 INFO:tasks.workunit.client.0.smithi059.stdout:0/926: creat dc/dd/f132 x:0 0 0 2024-04-25T16:27:45.561 INFO:tasks.workunit.client.0.smithi059.stdout:3/992: creat d0/d1e/d57/d116/f15e x:0 0 0 2024-04-25T16:27:45.561 INFO:tasks.workunit.client.0.smithi059.stdout:9/979: fdatasync d6/d35/d26/ff3 0 2024-04-25T16:27:45.589 INFO:tasks.workunit.client.0.smithi059.stdout:5/988: dread - d1/d1e/d27/d66/d70/f103 zero size 2024-04-25T16:27:46.201 INFO:tasks.workunit.client.0.smithi059.stdout:7/891: fsync d0/d7/d16/d20/fc5 0 2024-04-25T16:27:46.313 INFO:tasks.workunit.client.0.smithi059.stdout:4/919: rmdir d0/d4/df/d1c/d45/d54/d75 39 2024-04-25T16:27:46.414 INFO:tasks.workunit.client.0.smithi059.stdout:5/989: mknod d1/dcd/d50/c151 0 2024-04-25T16:27:46.415 INFO:tasks.workunit.client.0.smithi059.stdout:0/927: fdatasync dc/d37/d47/d81/dd2/fe1 0 2024-04-25T16:27:46.433 INFO:tasks.workunit.client.0.smithi059.stdout:9/980: read - d6/d35/d6c/f11f zero size 2024-04-25T16:27:46.554 INFO:tasks.workunit.client.0.smithi059.stdout:3/993: creat d0/db/d3f/d6c/dea/de9/f15f x:0 0 0 2024-04-25T16:27:46.564 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:27:46.567 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:27:46.571 INFO:tasks.workunit.client.0.smithi059.stdout:3/994: chown d0/d1e/d57/dc9/d14d 427946 1 2024-04-25T16:27:46.677 INFO:tasks.workunit.client.0.smithi059.stdout:8/903: unlink d7/dd/d33/d57/c9b 0 2024-04-25T16:27:46.845 INFO:tasks.workunit.client.0.smithi059.stdout:7/892: dread d0/d7/d51/da9/db3/d33/d4c/d5c/f89 [0,4194304] 0 2024-04-25T16:27:46.925 INFO:tasks.workunit.client.0.smithi059.stdout:0/928: read - dc/df/d5e/dc6/f116 zero size 2024-04-25T16:27:47.017 INFO:tasks.workunit.client.0.smithi059.stdout:5/990: dread d1/dcd/d44/d79/f7e [0,4194304] 0 2024-04-25T16:27:47.039 INFO:tasks.workunit.client.0.smithi059.stdout:5/991: chown d1/d48/d85/dbe/dde/f73 6499 1 2024-04-25T16:27:47.067 INFO:tasks.workunit.client.0.smithi059.stdout:9/981: truncate d6/d35/d6c/f79 383231 0 2024-04-25T16:27:47.075 INFO:tasks.workunit.client.0.smithi059.stdout:2/926: fsync de/d2a/d2e/d36/d2c/d40/d57/d112/d14a/fc3 0 2024-04-25T16:27:47.112 INFO:tasks.workunit.client.0.smithi059.stdout:3/995: truncate d0/db/d3f/d49/d65/fc3 4694859 0 2024-04-25T16:27:47.210 INFO:tasks.workunit.client.0.smithi059.stdout:4/920: mknod d0/d4/df/d1c/d45/d54/df0/c117 0 2024-04-25T16:27:47.352 INFO:tasks.workunit.client.0.smithi059.stdout:0/929: rename dc/df/d24/d119 to dc/d37/d47/d109/d133 0 2024-04-25T16:27:47.464 INFO:tasks.workunit.client.0.smithi059.stdout:5/992: unlink d1/d1e/d27/d66/d121/f13b 0 2024-04-25T16:27:47.511 INFO:tasks.workunit.client.0.smithi059.stdout:9/982: fdatasync d6/dae/ffe 0 2024-04-25T16:27:47.545 INFO:tasks.workunit.client.0.smithi059.stdout:9/983: stat d6/d35/fd4 0 2024-04-25T16:27:47.559 INFO:tasks.workunit.client.0.smithi059.stdout:1/966: dwrite d7/d2a/d85/db7/d16/d7f/dbe/fd5 [0,4194304] 0 2024-04-25T16:27:47.646 INFO:tasks.workunit.client.0.smithi059.stdout:4/921: dread - d0/d4/df/f104 zero size 2024-04-25T16:27:47.980 INFO:tasks.workunit.client.0.smithi059.stdout:5/993: dread d1/f3 [0,4194304] 0 2024-04-25T16:27:48.054 INFO:tasks.workunit.client.0.smithi059.stdout:4/922: symlink d0/d4/df/d1c/d45/d54/dd4/l118 0 2024-04-25T16:27:48.215 INFO:tasks.workunit.client.0.smithi059.stdout:9/984: fdatasync d6/d4e/d54/d5d/fbb 0 2024-04-25T16:27:48.306 INFO:tasks.workunit.client.0.smithi059.stdout:8/904: write d7/d2f/d76/fe5 [31193,3452] 0 2024-04-25T16:27:48.430 INFO:tasks.workunit.client.0.smithi059.stdout:0/930: write dc/df/d24/f39 [11831129,1393] 0 2024-04-25T16:27:48.437 INFO:tasks.workunit.client.0.smithi059.stdout:2/927: write de/d2a/d2e/d36/d2c/d40/d57/d112/d14a/d80/f129 [925357,82782] 0 2024-04-25T16:27:48.480 INFO:tasks.workunit.client.0.smithi059.stdout:5/994: read - d1/dcd/d50/d8a/dd8/f140 zero size 2024-04-25T16:27:48.566 INFO:tasks.workunit.client.0.smithi059.stdout:0/931: chown dc/dd/d3b/f110 44996663 1 2024-04-25T16:27:48.631 INFO:tasks.workunit.client.0.smithi059.stdout:7/893: dwrite d0/f9a [0,4194304] 0 2024-04-25T16:27:48.695 INFO:tasks.workunit.client.0.smithi059.stdout:3/996: dwrite d0/db/d3f/d49/d65/f85 [0,4194304] 0 2024-04-25T16:27:48.796 INFO:tasks.workunit.client.0.smithi059.stdout:3/997: chown d0/db/d47/d5b/fd2 22589821 1 2024-04-25T16:27:48.821 INFO:tasks.workunit.client.0.smithi059.stdout:3/998: read - d0/db/d2d/d7a/d86/ff5 zero size 2024-04-25T16:27:48.843 INFO:tasks.workunit.client.0.smithi059.stdout:1/967: truncate d7/d2a/d85/db7/d77/da3/f101 1060222 0 2024-04-25T16:27:48.847 INFO:tasks.workunit.client.0.smithi059.stdout:9/985: truncate d6/d35/d28/f40 3085119 0 2024-04-25T16:27:48.853 INFO:tasks.workunit.client.0.smithi059.stdout:8/905: symlink d7/dd/l127 0 2024-04-25T16:27:48.908 INFO:tasks.workunit.client.0.smithi059.stdout:8/906: dread - d7/d16/de0/d101/d37/d5c/d87/d94/d66/daa/dbd/fee zero size 2024-04-25T16:27:49.146 INFO:tasks.workunit.client.0.smithi059.stdout:2/928: truncate de/d2a/d33/d65/dcf/fd1 1458007 0 2024-04-25T16:27:49.158 INFO:tasks.workunit.client.0.smithi059.stdout:4/923: mknod d0/d4/df/d1c/d45/d54/c119 0 2024-04-25T16:27:49.174 INFO:tasks.workunit.client.0.smithi059.stdout:8/907: fsync d7/dd/faf 0 2024-04-25T16:27:49.334 INFO:tasks.workunit.client.0.smithi059.stdout:9/986: creat d6/d4e/d54/d5d/d48/d116/f128 x:0 0 0 2024-04-25T16:27:49.438 INFO:tasks.workunit.client.0.smithi059.stdout:1/968: getdents d7/d21/d51/da6/d11d/d120 0 2024-04-25T16:27:49.598 INFO:tasks.workunit.client.0.smithi059.stdout:7/894: rename d0/d7/d51/lff to d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/d108/d120/l123 0 2024-04-25T16:27:49.663 INFO:tasks.workunit.client.0.smithi059.stdout:2/929: truncate f1 3926915 0 2024-04-25T16:27:49.833 INFO:tasks.workunit.client.0.smithi059.stdout:5/995: write d1/d48/d85/fb0 [1023901,69132] 0 2024-04-25T16:27:49.846 INFO:tasks.workunit.client.0.smithi059.stdout:8/908: chown d7/d16/de0/d101/d37/d5c/d87/d94/d7f/cae 873 1 2024-04-25T16:27:50.116 INFO:tasks.workunit.client.0.smithi059.stdout:9/987: mknod d6/d35/d26/d6b/dc9/dd6/c129 0 2024-04-25T16:27:50.364 INFO:tasks.workunit.client.0.smithi059.stdout:0/932: write dc/df0/d121/ff8 [4991105,130544] 0 2024-04-25T16:27:50.541 INFO:tasks.workunit.client.0.smithi059.stdout:1/969: symlink d7/d2a/d85/db7/d16/d72/l13c 0 2024-04-25T16:27:50.637 INFO:tasks.workunit.client.0.smithi059.stdout:7/895: read d0/f56 [3181969,3605] 0 2024-04-25T16:27:50.726 INFO:tasks.workunit.client.0.smithi059.stdout:4/924: rename d0/d4/f56 to d0/d4/df/d48/da3/f11a 0 2024-04-25T16:27:50.813 INFO:tasks.workunit.client.0.smithi059.stdout:2/930: dread de/d16/f79 [0,4194304] 0 2024-04-25T16:27:50.917 INFO:tasks.workunit.client.0.smithi059.stdout:9/988: fdatasync d6/d4e/f8a 0 2024-04-25T16:27:51.140 INFO:tasks.workunit.client.0.smithi059.stdout:3/999: getdents d0/db/d3f/d89/d101 0 2024-04-25T16:27:51.468 INFO:tasks.workunit.client.0.smithi059.stdout:8/909: mknod d7/d16/de0/d101/d37/d8b/c128 0 2024-04-25T16:27:51.538 INFO:tasks.workunit.client.0.smithi059.stdout:4/925: creat d0/d4/df/d1c/d45/d6f/f11b x:0 0 0 2024-04-25T16:27:51.657 INFO:tasks.workunit.client.0.smithi059.stdout:9/989: creat d6/d4e/dba/f12a x:0 0 0 2024-04-25T16:27:51.676 INFO:tasks.workunit.client.0.smithi059.stdout:9/990: chown d6/d35/d26/d6b/dc9/dd6/l11c 115582600 1 2024-04-25T16:27:51.730 INFO:tasks.workunit.client.0.smithi059.stdout:9/991: dread d6/d4e/d54/d5d/f59 [0,4194304] 0 2024-04-25T16:27:52.080 INFO:tasks.workunit.client.0.smithi059.stdout:2/931: fsync de/d2a/d2e/d36/d2c/fcd 0 2024-04-25T16:27:52.080 INFO:tasks.workunit.client.0.smithi059.stdout:4/926: creat d0/d4/df/d1c/d45/d6f/dc4/f11c x:0 0 0 2024-04-25T16:27:52.316 INFO:tasks.workunit.client.0.smithi059.stdout:9/992: symlink d6/d4e/l12b 0 2024-04-25T16:27:52.392 INFO:tasks.workunit.client.0.smithi059.stdout:8/910: unlink d7/d16/de0/d101/d37/d5c/d87/d94/dcd/c11e 0 2024-04-25T16:27:52.446 INFO:tasks.workunit.client.0.smithi059.stdout:4/927: rmdir d0/d4/df/d48/da3/de2 39 2024-04-25T16:27:52.519 INFO:tasks.workunit.client.0.smithi059.stdout:2/932: truncate de/d2a/d2e/d36/d2c/d40/d57/d112/d14a/d80/fe6 4628406 0 2024-04-25T16:27:52.659 INFO:tasks.workunit.client.0.smithi059.stdout:7/896: getdents d0/d7/d51/da9/db3/d33/d79/d5d/d94 0 2024-04-25T16:27:52.679 INFO:tasks.workunit.client.0.smithi059.stdout:0/933: write dc/df/d5e/fdb [568512,122131] 0 2024-04-25T16:27:52.874 INFO:tasks.workunit.client.0.smithi059.stdout:4/928: mkdir d0/d4/df/d48/da9/d11d 0 2024-04-25T16:27:52.912 INFO:tasks.workunit.client.0.smithi059.stdout:2/933: truncate de/d16/f43 664114 0 2024-04-25T16:27:52.996 INFO:tasks.workunit.client.0.smithi059.stdout:1/970: dwrite d7/d2a/d85/db7/f134 [0,4194304] 0 2024-04-25T16:27:53.062 INFO:tasks.workunit.client.0.smithi059.stdout:0/934: mkdir dc/dd/d3b/d86/d134 0 2024-04-25T16:27:53.318 INFO:tasks.workunit.client.0.smithi059.stdout:1/971: symlink d7/de5/l13d 0 2024-04-25T16:27:53.448 INFO:tasks.workunit.client.0.smithi059.stdout:5/996: rename d1/d1e/d27/d66/d70/lc4 to d1/dcd/l152 0 2024-04-25T16:27:53.565 INFO:tasks.workunit.client.0.smithi059.stdout:7/897: getdents d0/d3f 0 2024-04-25T16:27:53.692 INFO:tasks.workunit.client.0.smithi059.stdout:1/972: symlink d7/d2a/d62/d130/l13e 0 2024-04-25T16:27:53.766 INFO:tasks.workunit.client.0.smithi059.stdout:5/997: rename d1/d48/d85/c11b to d1/dcd/d44/d79/dda/dfe/d12b/c153 0 2024-04-25T16:27:53.813 INFO:tasks.workunit.client.0.smithi059.stdout:4/929: link d0/d4/df/d1c/d45/d54/d75/d7e/d9e/cdd d0/d4/df/d48/d5f/c11e 0 2024-04-25T16:27:53.951 INFO:tasks.workunit.client.0.smithi059.stdout:7/898: symlink d0/d7/d51/da9/db3/d33/d79/d5d/d94/d106/l124 0 2024-04-25T16:27:54.014 INFO:tasks.workunit.client.0.smithi059.stdout:1/973: fsync d7/d2a/d85/db7/d77/da3/f115 0 2024-04-25T16:27:54.080 INFO:tasks.workunit.client.0.smithi059.stdout:5/998: dread d1/dcd/f55 [4194304,4194304] 0 2024-04-25T16:27:54.124 INFO:tasks.workunit.client.0.smithi059.stdout:7/899: fdatasync d0/f88 0 2024-04-25T16:27:54.253 INFO:tasks.workunit.client.0.smithi059.stdout:1/974: fdatasync d7/de5/f5d 0 2024-04-25T16:27:54.261 INFO:tasks.workunit.client.0.smithi059.stdout:4/930: dread - d0/d4/df/d48/da3/de2/ffb zero size 2024-04-25T16:27:54.328 INFO:tasks.workunit.client.0.smithi059.stdout:5/999: dread d1/d1e/d27/d66/d70/f10b [0,4194304] 0 2024-04-25T16:27:54.397 INFO:tasks.workunit.client.0.smithi059.stdout:7/900: mknod d0/d7/dae/c125 0 2024-04-25T16:27:54.404 INFO:tasks.workunit.client.0.smithi059.stdout:9/993: write d6/d4e/d54/f84 [1529617,46619] 0 2024-04-25T16:27:54.429 INFO:tasks.workunit.client.0.smithi059.stdout:7/901: readlink d0/d7/d51/da9/lbc 0 2024-04-25T16:27:54.450 INFO:tasks.workunit.client.0.smithi059.stdout:7/902: stat d0/d7/d51/da9/db3/d33/d4c/d5c/f11a 0 2024-04-25T16:27:54.468 INFO:tasks.workunit.client.0.smithi059.stdout:7/903: chown d0/d7/d51/da9/db3/d33/d79/d5d/dcb/dd4 112015420 1 2024-04-25T16:27:54.475 INFO:tasks.workunit.client.0.smithi059.stdout:4/931: fsync d0/d4/df/d44/f59 0 2024-04-25T16:27:54.530 INFO:tasks.workunit.client.0.smithi059.stdout:8/911: write d7/d16/de0/d101/d37/f44 [2296631,118016] 0 2024-04-25T16:27:55.111 INFO:tasks.workunit.client.0.smithi059.stdout:2/934: dwrite de/d2a/d33/d65/ffd [0,4194304] 0 2024-04-25T16:27:55.231 INFO:tasks.workunit.client.0.smithi059.stdout:9/994: getdents d6/d4e/d54/d5d/d95/d107 0 2024-04-25T16:27:55.258 INFO:tasks.workunit.client.0.smithi059.stdout:0/935: dwrite dc/d44/d5f/dc2/fee [0,4194304] 0 2024-04-25T16:27:55.395 INFO:tasks.workunit.client.0.smithi059.stdout:9/995: sync 2024-04-25T16:27:55.529 INFO:tasks.workunit.client.0.smithi059.stdout:9/996: sync 2024-04-25T16:27:55.575 INFO:tasks.workunit.client.0.smithi059.stdout:4/932: dread d0/d4/df/d1c/d45/f9b [4194304,4194304] 0 2024-04-25T16:27:55.589 INFO:tasks.workunit.client.0.smithi059.stdout:8/912: dread d7/d16/d8f/dc0/f123 [0,4194304] 0 2024-04-25T16:27:55.613 INFO:tasks.workunit.client.0.smithi059.stdout:8/913: chown d7/d16/de0/d101/d37/d8b 442324411 1 2024-04-25T16:27:55.868 INFO:tasks.workunit.client.0.smithi059.stdout:9/997: mkdir d6/d35/dde/d12c 0 2024-04-25T16:27:56.002 INFO:tasks.workunit.client.0.smithi059.stdout:2/935: rename de/d2a/d2e/d36/d2c/d40/d57/d112/d14a/d80/f129 to de/d2a/d2e/de1/f150 0 2024-04-25T16:27:56.088 INFO:tasks.workunit.client.0.smithi059.stdout:0/936: creat dc/d37/d47/d71/d9c/dd6/f135 x:0 0 0 2024-04-25T16:27:56.633 INFO:tasks.workunit.client.0.smithi059.stdout:4/933: creat d0/d4/df/d1c/d45/d54/d75/d82/f11f x:0 0 0 2024-04-25T16:27:56.663 INFO:tasks.workunit.client.0.smithi059.stdout:4/934: dread d0/d4/df/d44/fbe [0,4194304] 0 2024-04-25T16:27:56.791 INFO:tasks.workunit.client.0.smithi059.stdout:2/936: mkdir de/d5a/d9a/de9/dea/d12b/d151 0 2024-04-25T16:27:56.795 INFO:tasks.workunit.client.0.smithi059.stdout:1/975: write d7/d2a/d85/db7/d16/d5c/d74/f10a [760862,78977] 0 2024-04-25T16:27:56.899 INFO:tasks.workunit.client.0.smithi059.stdout:8/914: getdents d7/d2f/d76/d85 0 2024-04-25T16:27:57.265 INFO:tasks.workunit.client.0.smithi059.stdout:4/935: symlink d0/d4/df/d1c/d45/d54/d75/l120 0 2024-04-25T16:27:57.362 INFO:tasks.workunit.client.0.smithi059.stdout:8/915: symlink d7/dd/d33/df4/l129 0 2024-04-25T16:27:57.625 INFO:tasks.workunit.client.0.smithi059.stdout:4/936: creat d0/d4/f121 x:0 0 0 2024-04-25T16:27:57.633 INFO:tasks.workunit.client.0.smithi059.stdout:0/937: write dc/df/d5e/dc6/f116 [155744,109851] 0 2024-04-25T16:27:57.783 INFO:tasks.workunit.client.0.smithi059.stdout:9/998: write d6/f4a [990434,97473] 0 2024-04-25T16:27:58.167 INFO:tasks.workunit.client.0.smithi059.stdout:0/938: creat dc/d37/d47/d71/d9c/dd6/f136 x:0 0 0 2024-04-25T16:27:58.170 INFO:tasks.workunit.client.0.smithi059.stdout:4/937: fsync d0/d4/df/d1c/d45/d54/d75/d82/faf 0 2024-04-25T16:27:58.442 INFO:tasks.workunit.client.0.smithi059.stdout:1/976: link d7/d2a/d85/db7/d16/d7f/dbe/l10d d7/d2a/d62/l13f 0 2024-04-25T16:27:58.519 INFO:tasks.workunit.client.0.smithi059.stdout:1/977: readlink d7/d2a/d85/db7/d16/d72/l13c 0 2024-04-25T16:27:58.546 INFO:tasks.workunit.client.0.smithi059.stdout:7/904: creat d0/f126 x:0 0 0 2024-04-25T16:27:58.570 INFO:tasks.workunit.client.0.smithi059.stdout:2/937: dwrite de/d16/d9d/f10e [0,4194304] 0 2024-04-25T16:27:58.675 INFO:tasks.workunit.client.0.smithi059.stdout:4/938: creat d0/d4/df/d48/da9/f122 x:0 0 0 2024-04-25T16:27:58.801 INFO:tasks.workunit.client.0.smithi059.stdout:9/999: rename d6/d4e/d54/d5d/f59 to d6/f12d 0 2024-04-25T16:27:58.832 INFO:tasks.workunit.client.0.smithi059.stdout:0/939: dread dc/f95 [0,4194304] 0 2024-04-25T16:27:58.928 INFO:tasks.workunit.client.0.smithi059.stdout:1/978: unlink d7/d2a/d85/db7/d16/d72/l13c 0 2024-04-25T16:27:59.151 INFO:tasks.workunit.client.0.smithi059.stdout:4/939: rename d0/d4/df/d1c/cb6 to d0/d4/df/d74/ddb/c123 0 2024-04-25T16:27:59.155 INFO:tasks.workunit.client.0.smithi059.stdout:0/940: unlink dc/d44/f50 0 2024-04-25T16:27:59.166 INFO:tasks.workunit.client.0.smithi059.stdout:8/916: write d7/d2f/d43/f120 [610874,106926] 0 2024-04-25T16:27:59.319 INFO:tasks.workunit.client.0.smithi059.stdout:1/979: unlink d7/d2a/f3d 0 2024-04-25T16:27:59.328 INFO:tasks.workunit.client.0.smithi059.stdout:7/905: creat d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/d108/d11f/f127 x:0 0 0 2024-04-25T16:27:59.453 INFO:tasks.workunit.client.0.smithi059.stdout:2/938: rename de/d2a/d2e/d36/d2c/d40/f52 to de/d2a/d2e/d36/d2c/d40/de5/f152 0 2024-04-25T16:27:59.459 INFO:tasks.workunit.client.0.smithi059.stdout:0/941: mknod dc/dd/dbd/c137 0 2024-04-25T16:27:59.562 INFO:tasks.workunit.client.0.smithi059.stdout:8/917: truncate d7/d2f/d43/f117 283319 0 2024-04-25T16:27:59.562 INFO:tasks.workunit.client.0.smithi059.stdout:4/940: creat d0/d4/df/d1c/d45/d6f/f124 x:0 0 0 2024-04-25T16:27:59.585 INFO:tasks.workunit.client.0.smithi059.stdout:4/941: chown d0/d4/df/d48/da3/da4/ld6 936 1 2024-04-25T16:27:59.700 INFO:tasks.workunit.client.0.smithi059.stdout:7/906: dread d0/d7/d16/d20/f67 [0,4194304] 0 2024-04-25T16:27:59.718 INFO:tasks.workunit.client.0.smithi059.stdout:7/907: stat d0/d7/d51/da9/db3/d33/d79/d5d/d85 0 2024-04-25T16:28:00.002 INFO:tasks.workunit.client.0.smithi059.stdout:2/939: dread de/d2a/d2e/d36/d2c/d40/d57/f8a [0,4194304] 0 2024-04-25T16:28:00.093 INFO:tasks.workunit.client.0.smithi059.stdout:4/942: truncate d0/d4/df/d1c/d45/d54/dd4/fff 727424 0 2024-04-25T16:28:00.119 INFO:tasks.workunit.client.0.smithi059.stdout:7/908: read - d0/de5/f10a zero size 2024-04-25T16:28:00.247 INFO:tasks.workunit.client.0.smithi059.stdout:0/942: dwrite dc/dd/d3b/d66/f87 [0,4194304] 0 2024-04-25T16:28:00.321 INFO:tasks.workunit.client.0.smithi059.stdout:8/918: mkdir d7/d16/d12a 0 2024-04-25T16:28:00.333 INFO:tasks.workunit.client.0.smithi059.stdout:8/919: chown d7/d16/de0/d101/d37 982022 1 2024-04-25T16:28:00.443 INFO:tasks.workunit.client.0.smithi059.stdout:2/940: creat de/d16/d7f/f153 x:0 0 0 2024-04-25T16:28:00.876 INFO:tasks.workunit.client.0.smithi059.stdout:0/943: unlink dc/d37/d47/d81/f83 0 2024-04-25T16:28:01.030 INFO:tasks.workunit.client.0.smithi059.stdout:1/980: write d7/d2a/d85/db7/dbb/db6/f11a [488483,101590] 0 2024-04-25T16:28:01.047 INFO:tasks.workunit.client.0.smithi059.stdout:1/981: stat d7/d21/d51/f125 0 2024-04-25T16:28:01.202 INFO:tasks.workunit.client.0.smithi059.stdout:2/941: creat de/d2a/d2e/d36/d123/f154 x:0 0 0 2024-04-25T16:28:01.414 INFO:tasks.workunit.client.0.smithi059.stdout:0/944: symlink dc/df0/l138 0 2024-04-25T16:28:01.457 INFO:tasks.workunit.client.0.smithi059.stdout:1/982: truncate d7/f53 4525681 0 2024-04-25T16:28:01.796 INFO:tasks.workunit.client.0.smithi059.stdout:4/943: write d0/d4/f2e [2227407,116620] 0 2024-04-25T16:28:01.818 INFO:tasks.workunit.client.0.smithi059.stdout:7/909: link d0/d7/d51/da9/lbc d0/d7/d51/da9/db3/d33/d79/l128 0 2024-04-25T16:28:01.883 INFO:tasks.workunit.client.0.smithi059.stdout:0/945: read dc/dd/d5c/fb9 [339841,50407] 0 2024-04-25T16:28:01.909 INFO:tasks.workunit.client.0.smithi059.stdout:8/920: dwrite d7/dd/d33/d57/fa0 [0,4194304] 0 2024-04-25T16:28:01.974 INFO:tasks.workunit.client.0.smithi059.stdout:8/921: readlink d7/l10 0 2024-04-25T16:28:01.999 INFO:tasks.workunit.client.0.smithi059.stdout:1/983: creat d7/d2a/d85/db7/dbb/db6/f140 x:0 0 0 2024-04-25T16:28:02.014 INFO:tasks.workunit.client.0.smithi059.stdout:1/984: stat d7/d2a/d85/db7/fa4 0 2024-04-25T16:28:02.157 INFO:tasks.workunit.client.0.smithi059.stdout:4/944: mkdir d0/d4/df/d1c/d45/d54/d75/d7e/df5/d125 0 2024-04-25T16:28:02.179 INFO:tasks.workunit.client.0.smithi059.stdout:7/910: dread d0/f27 [0,4194304] 0 2024-04-25T16:28:02.446 INFO:tasks.workunit.client.0.smithi059.stdout:8/922: mknod d7/d16/d36/dca/c12b 0 2024-04-25T16:28:02.551 INFO:tasks.workunit.client.0.smithi059.stdout:2/942: dwrite de/d2a/d2e/d36/d2c/d40/f47 [0,4194304] 0 2024-04-25T16:28:02.841 INFO:tasks.workunit.client.0.smithi059.stdout:4/945: symlink d0/d4/l126 0 2024-04-25T16:28:02.858 INFO:tasks.workunit.client.0.smithi059.stdout:0/946: write dc/dd/d5c/d104/f131 [316345,49653] 0 2024-04-25T16:28:02.862 INFO:tasks.workunit.client.0.smithi059.stdout:1/985: getdents d7/d2a/d11c 0 2024-04-25T16:28:02.866 INFO:tasks.workunit.client.0.smithi059.stdout:7/911: creat d0/d7/d51/da9/db3/d33/d79/d5d/d94/d106/f129 x:0 0 0 2024-04-25T16:28:02.902 INFO:tasks.workunit.client.0.smithi059.stdout:7/912: stat d0/d7/dae/lf0 0 2024-04-25T16:28:02.924 INFO:tasks.workunit.client.0.smithi059.stdout:4/946: read d0/d4/df/d44/f59 [3255713,14862] 0 2024-04-25T16:28:02.925 INFO:tasks.workunit.client.0.smithi059.stdout:8/923: read - d7/d16/d3a/ffe zero size 2024-04-25T16:28:02.925 INFO:tasks.workunit.client.0.smithi059.stdout:2/943: creat de/d5a/d9a/f155 x:0 0 0 2024-04-25T16:28:03.013 INFO:tasks.workunit.client.0.smithi059.stdout:1/986: dread d7/d2a/d85/fc9 [0,4194304] 0 2024-04-25T16:28:03.061 INFO:tasks.workunit.client.0.smithi059.stdout:2/944: sync 2024-04-25T16:28:03.184 INFO:tasks.workunit.client.0.smithi059.stdout:7/913: readlink d0/d7/d51/da9/db3/d33/d79/d5d/lea 0 2024-04-25T16:28:03.253 INFO:tasks.workunit.client.0.smithi059.stdout:8/924: mknod d7/d16/d36/c12c 0 2024-04-25T16:28:03.396 INFO:tasks.workunit.client.0.smithi059.stdout:0/947: dwrite dc/df/f59 [0,4194304] 0 2024-04-25T16:28:03.470 INFO:tasks.workunit.client.0.smithi059.stdout:7/914: truncate d0/d7/d51/da9/db3/d33/d4c/d4e/fde 527501 0 2024-04-25T16:28:03.484 INFO:tasks.workunit.client.0.smithi059.stdout:7/915: dread - d0/f126 zero size 2024-04-25T16:28:03.525 INFO:tasks.workunit.client.0.smithi059.stdout:7/916: chown d0/d7/d51/da9/db3/d33/d79/d5d/fc2 589618922 1 2024-04-25T16:28:03.553 INFO:tasks.workunit.client.0.smithi059.stdout:1/987: mkdir d7/d21/d141 0 2024-04-25T16:28:03.555 INFO:tasks.workunit.client.0.smithi059.stdout:7/917: readlink d0/d7/d51/da9/db3/d33/d79/l63 0 2024-04-25T16:28:03.641 INFO:tasks.workunit.client.0.smithi059.stdout:4/947: dwrite d0/d4/df/d48/da3/fed [0,4194304] 0 2024-04-25T16:28:03.822 INFO:tasks.workunit.client.0.smithi059.stdout:0/948: symlink dc/dd/d3b/d86/l139 0 2024-04-25T16:28:03.908 INFO:tasks.workunit.client.0.smithi059.stdout:8/925: dwrite d7/d16/da3/fbe [0,4194304] 0 2024-04-25T16:28:03.989 INFO:tasks.workunit.client.0.smithi059.stdout:2/945: dwrite de/d2a/d2e/d36/d2c/d40/d57/d112/d14a/d80/ddb/de3/f104 [0,4194304] 0 2024-04-25T16:28:04.057 INFO:tasks.workunit.client.0.smithi059.stdout:0/949: chown dc/df/d24/f39 2139021284 1 2024-04-25T16:28:04.195 INFO:tasks.workunit.client.0.smithi059.stdout:7/918: write d0/d7/d51/da9/f107 [2239077,118989] 0 2024-04-25T16:28:04.304 INFO:tasks.workunit.client.0.smithi059.stdout:4/948: truncate d0/d4/df/d1c/d45/d54/dd4/fe1 1009898 0 2024-04-25T16:28:04.317 INFO:tasks.workunit.client.0.smithi059.stdout:1/988: dwrite d7/d2a/d85/db7/dbb/dc2/f128 [0,4194304] 0 2024-04-25T16:28:04.493 INFO:tasks.workunit.client.0.smithi059.stdout:8/926: symlink d7/dd/d17/l12d 0 2024-04-25T16:28:04.571 INFO:tasks.workunit.client.0.smithi059.stdout:7/919: write d0/d7/d51/da9/db3/d33/d79/d5d/fc2 [89189,50912] 0 2024-04-25T16:28:04.602 INFO:tasks.workunit.client.0.smithi059.stdout:2/946: dread de/d2a/d2e/d36/d2c/d40/d57/d112/d14a/d80/fe6 [0,4194304] 0 2024-04-25T16:28:04.620 INFO:tasks.workunit.client.0.smithi059.stdout:7/920: chown d0/de5/f10a 939037149 1 2024-04-25T16:28:04.658 INFO:tasks.workunit.client.0.smithi059.stdout:7/921: dread d0/d7/f7c [0,4194304] 0 2024-04-25T16:28:04.666 INFO:tasks.workunit.client.0.smithi059.stdout:7/922: chown d0/d7/d16 1 1 2024-04-25T16:28:04.721 INFO:tasks.workunit.client.0.smithi059.stdout:4/949: rename d0/c86 to d0/d4/df/d48/da3/de2/c127 0 2024-04-25T16:28:04.723 INFO:tasks.workunit.client.0.smithi059.stdout:0/950: link dc/d44/d5f/d72/fd5 dc/d37/d47/d60/f13a 0 2024-04-25T16:28:05.005 INFO:tasks.workunit.client.0.smithi059.stdout:7/923: creat d0/de5/dfc/f12a x:0 0 0 2024-04-25T16:28:05.159 INFO:tasks.workunit.client.0.smithi059.stdout:2/947: symlink de/d16/d9d/df7/d145/l156 0 2024-04-25T16:28:05.362 INFO:tasks.workunit.client.0.smithi059.stdout:1/989: dwrite d7/d2a/d85/db7/d16/d7f/dbe/d121/dbc/fc1 [0,4194304] 0 2024-04-25T16:28:05.371 INFO:tasks.workunit.client.0.smithi059.stdout:8/927: dwrite d7/dd/d17/db4/d7e/da5/ff2 [0,4194304] 0 2024-04-25T16:28:05.462 INFO:tasks.workunit.client.0.smithi059.stdout:4/950: dread d0/d4/df/d1c/d45/d6f/dc4/f110 [0,4194304] 0 2024-04-25T16:28:05.541 INFO:tasks.workunit.client.0.smithi059.stdout:0/951: dwrite dc/d37/d47/f7c [0,4194304] 0 2024-04-25T16:28:05.612 INFO:tasks.workunit.client.0.smithi059.stdout:1/990: read d7/de5/f73 [2748527,114824] 0 2024-04-25T16:28:05.804 INFO:tasks.workunit.client.0.smithi059.stdout:7/924: rename d0/d7/d51/da9/db3/d33/d79/d5d/d94/d106/f84 to d0/d7/d51/da9/db3/d33/d79/d5d/dcb/dd4/f12b 0 2024-04-25T16:28:06.104 INFO:tasks.workunit.client.0.smithi059.stdout:8/928: mknod d7/d16/de0/d101/d37/d5c/d87/d94/d66/c12e 0 2024-04-25T16:28:06.112 INFO:tasks.workunit.client.0.smithi059.stdout:0/952: mknod dc/d44/d5f/d72/c13b 0 2024-04-25T16:28:06.410 INFO:tasks.workunit.client.0.smithi059.stdout:0/953: rename dc/d37/d47/d71/d9c/dca/l10d to dc/dd/dbd/l13c 0 2024-04-25T16:28:06.458 INFO:tasks.workunit.client.0.smithi059.stdout:0/954: stat dc/dd/f23 0 2024-04-25T16:28:06.474 INFO:tasks.workunit.client.0.smithi059.stdout:7/925: dread d0/d7/dae/de2/ff8 [0,4194304] 0 2024-04-25T16:28:06.744 INFO:tasks.workunit.client.0.smithi059.stdout:1/991: mknod d7/d2a/d85/c142 0 2024-04-25T16:28:06.753 INFO:tasks.workunit.client.0.smithi059.stdout:2/948: write de/d2a/d2e/d36/d2c/d40/d57/f128 [523962,12465] 0 2024-04-25T16:28:06.821 INFO:tasks.workunit.client.0.smithi059.stdout:4/951: getdents d0/d4/df/d48/da9 0 2024-04-25T16:28:06.941 INFO:tasks.workunit.client.0.smithi059.stdout:7/926: chown d0/d7/d51/da9/db3/d33/c36 27 1 2024-04-25T16:28:07.128 INFO:tasks.workunit.client.0.smithi059.stdout:2/949: creat de/d2a/d2e/d36/d11d/f157 x:0 0 0 2024-04-25T16:28:07.199 INFO:tasks.workunit.client.0.smithi059.stdout:4/952: mknod d0/d4/df/d1c/d45/d54/d75/d82/dd2/c128 0 2024-04-25T16:28:07.211 INFO:tasks.workunit.client.0.smithi059.stdout:4/953: readlink d0/d4/df/d1c/d45/l1d 0 2024-04-25T16:28:07.273 INFO:tasks.workunit.client.0.smithi059.stdout:7/927: fdatasync d0/d7/fac 0 2024-04-25T16:28:07.294 INFO:tasks.workunit.client.0.smithi059.stdout:7/928: readlink d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/l68 0 2024-04-25T16:28:07.466 INFO:tasks.workunit.client.0.smithi059.stdout:8/929: write d7/dd/d17/db4/d7e/f11f [17777,3708] 0 2024-04-25T16:28:07.547 INFO:tasks.workunit.client.0.smithi059.stdout:2/950: unlink de/d2a/da7/d119/c13e 0 2024-04-25T16:28:07.588 INFO:tasks.workunit.client.0.smithi059.stdout:4/954: truncate d0/d4/df/d1c/d45/d54/dd4/fff 549123 0 2024-04-25T16:28:07.600 INFO:tasks.workunit.client.0.smithi059.stdout:4/955: chown d0/d4/df/d44/f4d 109861 1 2024-04-25T16:28:08.060 INFO:tasks.workunit.client.0.smithi059.stdout:8/930: dread - d7/d16/d8f/dc8/ffc zero size 2024-04-25T16:28:08.060 INFO:tasks.workunit.client.0.smithi059.stdout:0/955: dwrite dc/dd/d3b/d66/f87 [4194304,4194304] 0 2024-04-25T16:28:08.060 INFO:tasks.workunit.client.0.smithi059.stdout:2/951: creat de/da1/d124/f158 x:0 0 0 2024-04-25T16:28:08.060 INFO:tasks.workunit.client.0.smithi059.stdout:1/992: dwrite d7/d93/f76 [0,4194304] 0 2024-04-25T16:28:08.060 INFO:tasks.workunit.client.0.smithi059.stdout:4/956: symlink d0/d4/df/d1c/d45/d54/d75/d7e/l129 0 2024-04-25T16:28:08.060 INFO:tasks.workunit.client.0.smithi059.stdout:8/931: rename d7/d16/de0/d101/d37/d5c/c8d to d7/dd/d17/db4/d7e/da5/c12f 0 2024-04-25T16:28:08.275 INFO:tasks.workunit.client.0.smithi059.stdout:2/952: mkdir de/d2a/d33/d65/dcf/d159 0 2024-04-25T16:28:08.309 INFO:tasks.workunit.client.0.smithi059.stdout:7/929: getdents d0/d7/d51/da9/db3/d33/d4c/d5c 0 2024-04-25T16:28:08.402 INFO:tasks.workunit.client.0.smithi059.stdout:4/957: mkdir d0/d4/df/d48/dde/d12a 0 2024-04-25T16:28:08.482 INFO:tasks.workunit.client.0.smithi059.stdout:1/993: truncate d7/d21/d51/da6/f71 1851233 0 2024-04-25T16:28:08.553 INFO:tasks.workunit.client.0.smithi059.stdout:8/932: dread d7/d16/d36/dca/fe4 [0,4194304] 0 2024-04-25T16:28:08.560 INFO:tasks.workunit.client.0.smithi059.stdout:1/994: chown d7/d2a/d85/db7/f92 14 1 2024-04-25T16:28:08.919 INFO:tasks.workunit.client.0.smithi059.stdout:0/956: dwrite dc/f2d [0,4194304] 0 2024-04-25T16:28:08.920 INFO:tasks.workunit.client.0.smithi059.stdout:7/930: dread d0/d7/d16/f2a [4194304,4194304] 0 2024-04-25T16:28:09.041 INFO:tasks.workunit.client.0.smithi059.stdout:8/933: fdatasync d7/dd/fe7 0 2024-04-25T16:28:09.225 INFO:tasks.workunit.client.0.smithi059.stdout:1/995: creat d7/d2a/d85/db7/dbb/de6/f143 x:0 0 0 2024-04-25T16:28:09.332 INFO:tasks.workunit.client.0.smithi059.stdout:0/957: symlink dc/df/d5e/dc6/d11d/l13d 0 2024-04-25T16:28:09.343 INFO:tasks.workunit.client.0.smithi059.stdout:0/958: chown dc/df0/d121/d10b/l115 78 1 2024-04-25T16:28:09.393 INFO:tasks.workunit.client.0.smithi059.stdout:7/931: fdatasync d0/d7/d16/d20/dab/fda 0 2024-04-25T16:28:09.396 INFO:tasks.workunit.client.0.smithi059.stdout:4/958: getdents d0/d4/df/d1c/d45/d54/df0 0 2024-04-25T16:28:09.427 INFO:tasks.workunit.client.0.smithi059.stdout:1/996: chown d7/d2a/ff2 31 1 2024-04-25T16:28:09.468 INFO:tasks.workunit.client.0.smithi059.stdout:0/959: rmdir dc/df0/d121 39 2024-04-25T16:28:09.564 INFO:tasks.workunit.client.0.smithi059.stdout:4/959: mknod d0/d4/df/d48/da9/c12b 0 2024-04-25T16:28:09.725 INFO:tasks.workunit.client.0.smithi059.stdout:1/997: read d7/d2a/d85/db7/f87 [548392,95585] 0 2024-04-25T16:28:09.797 INFO:tasks.workunit.client.0.smithi059.stdout:0/960: mkdir dc/d44/df4/d13e 0 2024-04-25T16:28:09.803 INFO:tasks.workunit.client.0.smithi059.stdout:0/961: chown dc/cd1 7890 1 2024-04-25T16:28:09.941 INFO:tasks.workunit.client.0.smithi059.stdout:2/953: write de/d2a/d33/f144 [3982759,20676] 0 2024-04-25T16:28:10.234 INFO:tasks.workunit.client.0.smithi059.stdout:8/934: dwrite d7/dd/d33/d57/f98 [0,4194304] 0 2024-04-25T16:28:10.369 INFO:tasks.workunit.client.0.smithi059.stdout:8/935: sync 2024-04-25T16:28:10.488 INFO:tasks.workunit.client.0.smithi059.stdout:7/932: dwrite d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/d108/d11f/f127 [0,4194304] 0 2024-04-25T16:28:10.810 INFO:tasks.workunit.client.0.smithi059.stdout:4/960: link d0/d4/df/d48/dde/cee d0/d4/df/d48/dde/d101/c12c 0 2024-04-25T16:28:11.078 INFO:tasks.workunit.client.0.smithi059.stdout:7/933: rmdir d0/d7/d51/da9/db3/d33/d79/d5d/dcb 39 2024-04-25T16:28:11.128 INFO:tasks.workunit.client.0.smithi059.stdout:0/962: write dc/df/d5e/dc6/fef [98304,96904] 0 2024-04-25T16:28:11.189 INFO:tasks.workunit.client.0.smithi059.stdout:1/998: dwrite d7/d2a/d85/db7/d16/d5c/f70 [0,4194304] 0 2024-04-25T16:28:11.293 INFO:tasks.workunit.client.0.smithi059.stdout:1/999: stat d7/d21/d51/d10e/c10f 0 2024-04-25T16:28:11.364 INFO:tasks.workunit.client.0.smithi059.stdout:0/963: dread dc/f2d [4194304,4194304] 0 2024-04-25T16:28:11.535 INFO:tasks.workunit.client.0.smithi059.stdout:0/964: mknod dc/d37/d47/df7/d10c/c13f 0 2024-04-25T16:28:12.018 INFO:tasks.workunit.client.0.smithi059.stdout:7/934: write d0/d3f/fa3 [419420,51838] 0 2024-04-25T16:28:12.158 INFO:tasks.workunit.client.0.smithi059.stdout:4/961: rename d0/d4/f9f to d0/d4/df/d1c/d45/d6f/f12d 0 2024-04-25T16:28:12.190 INFO:tasks.workunit.client.0.smithi059.stdout:8/936: dwrite d7/f91 [0,4194304] 0 2024-04-25T16:28:12.248 INFO:tasks.workunit.client.0.smithi059.stdout:2/954: dwrite de/d2a/f35 [4194304,4194304] 0 2024-04-25T16:28:12.278 INFO:tasks.workunit.client.0.smithi059.stdout:8/937: sync 2024-04-25T16:28:12.382 INFO:tasks.workunit.client.0.smithi059.stdout:7/935: symlink d0/d7/d51/da9/db3/d33/d79/d5d/l12c 0 2024-04-25T16:28:12.434 INFO:tasks.workunit.client.0.smithi059.stdout:8/938: stat d7/d16/d36/dca/c12b 0 2024-04-25T16:28:12.465 INFO:tasks.workunit.client.0.smithi059.stdout:0/965: dwrite dc/d44/df4/f103 [0,4194304] 0 2024-04-25T16:28:12.468 INFO:tasks.workunit.client.0.smithi059.stdout:4/962: read d0/d4/df/d44/f46 [729219,44307] 0 2024-04-25T16:28:12.528 INFO:tasks.workunit.client.0.smithi059.stdout:0/966: sync 2024-04-25T16:28:12.568 INFO:tasks.workunit.client.0.smithi059.stdout:8/939: read d7/d16/fa7 [848046,122469] 0 2024-04-25T16:28:12.586 INFO:tasks.workunit.client.0.smithi059.stdout:0/967: sync 2024-04-25T16:28:12.594 INFO:tasks.workunit.client.0.smithi059.stdout:7/936: truncate d0/d7/fa7 318805 0 2024-04-25T16:28:12.667 INFO:tasks.workunit.client.0.smithi059.stdout:2/955: truncate de/d2a/d2e/d36/d2c/f8c 1972605 0 2024-04-25T16:28:12.695 INFO:tasks.workunit.client.0.smithi059.stdout:0/968: dread dc/d44/df4/f103 [0,4194304] 0 2024-04-25T16:28:12.781 INFO:tasks.workunit.client.0.smithi059.stdout:8/940: rmdir d7/d16/d36/dca 39 2024-04-25T16:28:12.847 INFO:tasks.workunit.client.0.smithi059.stdout:4/963: mkdir d0/d4/df/d1c/d45/d54/d12e 0 2024-04-25T16:28:12.961 INFO:tasks.workunit.client.0.smithi059.stdout:2/956: fdatasync de/d2a/d33/d12e/f13d 0 2024-04-25T16:28:13.047 INFO:tasks.workunit.client.0.smithi059.stdout:8/941: mknod d7/dd/d33/df4/c130 0 2024-04-25T16:28:13.321 INFO:tasks.workunit.client.0.smithi059.stdout:4/964: mknod d0/d4/df/d1c/d45/d54/df0/c12f 0 2024-04-25T16:28:13.327 INFO:tasks.workunit.client.0.smithi059.stdout:0/969: mkdir dc/d44/df4/d13e/d140 0 2024-04-25T16:28:13.353 INFO:tasks.workunit.client.0.smithi059.stdout:8/942: fsync d7/d2f/d43/f6f 0 2024-04-25T16:28:13.364 INFO:tasks.workunit.client.0.smithi059.stdout:0/970: chown dc/dd/d3b/f110 9 1 2024-04-25T16:28:13.404 INFO:tasks.workunit.client.0.smithi059.stdout:4/965: sync 2024-04-25T16:28:13.425 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:42:26.030 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:28:13.495 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:42:26.100 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:28:13.519 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:42:26.083 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:28:13.524 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:42:26.088 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:28:13.528 INFO:tasks.workunit.client.0.smithi059.stdout:2/957: symlink de/d2a/d2e/d36/d2c/l15a 0 2024-04-25T16:28:13.531 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:42:26.136 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:28:13.558 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:42:26.122 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:28:13.580 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:42:26.144 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:28:13.582 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:42:26.146 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:28:13.602 INFO:tasks.workunit.client.0.smithi059.stdout:2/958: stat de/d2a/d33/d65 0 2024-04-25T16:28:13.638 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:42:26.202 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:28:13.719 INFO:tasks.workunit.client.0.smithi059.stdout:0/971: fsync dc/df0/d121/ff8 0 2024-04-25T16:28:13.729 INFO:tasks.workunit.client.0.smithi059.stdout:4/966: dread d0/d4/df/d1c/d45/f2d [0,4194304] 0 2024-04-25T16:28:13.733 INFO:tasks.workunit.client.0.smithi059.stdout:7/937: dwrite d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/f52 [0,4194304] 0 2024-04-25T16:28:13.803 INFO:tasks.workunit.client.0.smithi059.stdout:7/938: sync 2024-04-25T16:28:13.898 INFO:tasks.workunit.client.0.smithi059.stdout:8/943: creat d7/d16/de0/d101/d37/f131 x:0 0 0 2024-04-25T16:28:13.911 INFO:tasks.workunit.client.0.smithi059.stdout:2/959: dread - de/d16/d9d/f13a zero size 2024-04-25T16:28:13.978 INFO:tasks.workunit.client.0.smithi059.stdout:0/972: rmdir dc/d44/d5f/d72 39 2024-04-25T16:28:14.242 INFO:tasks.workunit.client.0.smithi059.stdout:4/967: creat d0/d4/df/d1c/d45/d6f/dc4/f130 x:0 0 0 2024-04-25T16:28:14.244 INFO:tasks.workunit.client.0.smithi059.stdout:8/944: creat d7/d2f/d76/d85/f132 x:0 0 0 2024-04-25T16:28:14.254 INFO:tasks.workunit.client.0.smithi059.stdout:0/973: symlink dc/df/d5e/dc6/d11d/l141 0 2024-04-25T16:28:14.287 INFO:tasks.workunit.client.0.smithi059.stdout:2/960: mknod de/d2a/d2e/d36/d2c/d131/d142/c15b 0 2024-04-25T16:28:14.471 INFO:tasks.workunit.client.0.smithi059.stdout:0/974: fdatasync dc/d37/d47/d71/dd0/fd8 0 2024-04-25T16:28:14.471 INFO:tasks.workunit.client.0.smithi059.stdout:2/961: creat de/d16/d3e/f15c x:0 0 0 2024-04-25T16:28:14.710 INFO:tasks.workunit.client.0.smithi059.stdout:4/968: mknod d0/c131 0 2024-04-25T16:28:14.713 INFO:tasks.workunit.client.0.smithi059.stdout:2/962: unlink de/d2a/d33/c106 0 2024-04-25T16:28:14.718 INFO:tasks.workunit.client.0.smithi059.stdout:0/975: symlink dc/df/d5e/dc6/d11d/l142 0 2024-04-25T16:28:14.812 INFO:tasks.workunit.client.0.smithi059.stdout:7/939: link d0/d7/d51/da9/db3/d33/dc6/de8/l112 d0/d7/d51/da9/db3/d33/d4c/d4e/l12d 0 2024-04-25T16:28:15.000 INFO:tasks.workunit.client.0.smithi059.stdout:0/976: truncate dc/f1f 2770951 0 2024-04-25T16:28:15.120 INFO:tasks.workunit.client.0.smithi059.stdout:4/969: truncate d0/d4/df/d48/da3/fed 612463 0 2024-04-25T16:28:15.124 INFO:tasks.workunit.client.0.smithi059.stdout:7/940: mknod d0/d7/d51/da9/db3/d33/d4c/c12e 0 2024-04-25T16:28:15.159 INFO:tasks.workunit.client.0.smithi059.stdout:4/970: chown d0/d4/df/d1c/d45/d6f/dc4/f130 820474 1 2024-04-25T16:28:15.327 INFO:tasks.workunit.client.0.smithi059.stdout:8/945: write d7/f1f [3604895,125865] 0 2024-04-25T16:28:15.339 INFO:tasks.workunit.client.0.smithi059.stdout:0/977: chown dc/d37/cb4 128 1 2024-04-25T16:28:15.346 INFO:tasks.workunit.client.0.smithi059.stdout:8/946: readlink d7/dd/l127 0 2024-04-25T16:28:15.367 INFO:tasks.workunit.client.0.smithi059.stdout:2/963: write de/d16/d9d/f13a [794259,92313] 0 2024-04-25T16:28:15.388 INFO:tasks.workunit.client.0.smithi059.stdout:0/978: chown dc/d44/d5f/dc2/fee 16023069 1 2024-04-25T16:28:15.406 INFO:tasks.workunit.client.0.smithi059.stdout:4/971: dread - d0/d4/df/d1c/d45/d6f/dc4/f11c zero size 2024-04-25T16:28:15.714 INFO:tasks.workunit.client.0.smithi059.stdout:8/947: creat d7/d16/d8c/f133 x:0 0 0 2024-04-25T16:28:15.757 INFO:tasks.workunit.client.0.smithi059.stdout:7/941: truncate d0/d7/d51/da9/db3/d33/d4c/d4e/fde 26320 0 2024-04-25T16:28:15.894 INFO:tasks.workunit.client.0.smithi059.stdout:4/972: truncate d0/d4/df/d48/f4e 10508557 0 2024-04-25T16:28:15.898 INFO:tasks.workunit.client.0.smithi059.stdout:2/964: unlink de/d2a/d2e/l23 0 2024-04-25T16:28:16.113 INFO:tasks.workunit.client.0.smithi059.stdout:8/948: read - d7/dd/d33/f122 zero size 2024-04-25T16:28:16.334 INFO:tasks.workunit.client.0.smithi059.stdout:8/949: fdatasync d7/dd/d33/f11a 0 2024-04-25T16:28:16.413 INFO:tasks.workunit.client.0.smithi059.stdout:2/965: symlink de/d2a/d2e/d36/d123/da6/l15d 0 2024-04-25T16:28:16.504 INFO:tasks.workunit.client.0.smithi059.stdout:8/950: fdatasync d7/dd/d33/f73 0 2024-04-25T16:28:16.629 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:28:16.632 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:28:17.063 INFO:tasks.workunit.client.0.smithi059.stdout:0/979: dwrite dc/fc7 [0,4194304] 0 2024-04-25T16:28:17.484 INFO:tasks.workunit.client.0.smithi059.stdout:7/942: dwrite d0/de5/dfc/f12a [0,4194304] 0 2024-04-25T16:28:17.556 INFO:tasks.workunit.client.0.smithi059.stdout:4/973: dwrite d0/d4/df/d48/d5f/f105 [0,4194304] 0 2024-04-25T16:28:17.812 INFO:tasks.workunit.client.0.smithi059.stdout:8/951: dwrite d7/d16/d3a/f9a [0,4194304] 0 2024-04-25T16:28:17.819 INFO:tasks.workunit.client.0.smithi059.stdout:2/966: dwrite de/d2a/d2e/f98 [0,4194304] 0 2024-04-25T16:28:17.933 INFO:tasks.workunit.client.0.smithi059.stdout:0/980: symlink dc/dd/d3b/d66/l143 0 2024-04-25T16:28:17.946 INFO:tasks.workunit.client.0.smithi059.stdout:7/943: symlink d0/d7/d16/l12f 0 2024-04-25T16:28:17.980 INFO:tasks.workunit.client.0.smithi059.stdout:2/967: sync 2024-04-25T16:28:18.009 INFO:tasks.workunit.client.0.smithi059.stdout:4/974: mknod d0/d4/df/d1c/d45/d54/d75/d7e/df5/d125/c132 0 2024-04-25T16:28:18.145 INFO:tasks.workunit.client.0.smithi059.stdout:7/944: mkdir d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/d108/d130 0 2024-04-25T16:28:18.149 INFO:tasks.workunit.client.0.smithi059.stdout:8/952: mkdir d7/d16/de0/d101/d37/d5c/d87/d94/d134 0 2024-04-25T16:28:18.173 INFO:tasks.workunit.client.0.smithi059.stdout:0/981: dread dc/d37/d47/df7/f8a [0,4194304] 0 2024-04-25T16:28:18.309 INFO:tasks.workunit.client.0.smithi059.stdout:2/968: mkdir de/d2a/d2e/d36/d2c/d40/d57/d112/d15e 0 2024-04-25T16:28:18.314 INFO:tasks.workunit.client.0.smithi059.stdout:4/975: symlink d0/d4/df/d1c/d45/d54/d75/d7e/df5/l133 0 2024-04-25T16:28:18.329 INFO:tasks.workunit.client.0.smithi059.stdout:7/945: mkdir d0/d7/dae/de2/d131 0 2024-04-25T16:28:18.422 INFO:tasks.workunit.client.0.smithi059.stdout:8/953: dread d7/d16/d36/dca/fe4 [0,4194304] 0 2024-04-25T16:28:18.427 INFO:tasks.workunit.client.0.smithi059.stdout:7/946: chown d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/f6e 681600321 1 2024-04-25T16:28:18.455 INFO:tasks.workunit.client.0.smithi059.stdout:2/969: unlink de/da1/d124/f134 0 2024-04-25T16:28:18.457 INFO:tasks.workunit.client.0.smithi059.stdout:0/982: fsync dc/df0/d121/f10f 0 2024-04-25T16:28:18.480 INFO:tasks.workunit.client.0.smithi059.stdout:0/983: chown dc/d37/d47/d71/ce7 254955 1 2024-04-25T16:28:18.489 INFO:tasks.workunit.client.0.smithi059.stdout:0/984: chown dc/df/f16 4 1 2024-04-25T16:28:18.865 INFO:tasks.workunit.client.0.smithi059.stdout:0/985: fsync dc/dd/f20 0 2024-04-25T16:28:18.879 INFO:tasks.workunit.client.0.smithi059.stdout:2/970: chown de/d2a/d2e/l5c 278469535 1 2024-04-25T16:28:19.032 INFO:tasks.workunit.client.0.smithi059.stdout:8/954: dwrite d7/dd/d17/db4/d7e/da5/fec [0,4194304] 0 2024-04-25T16:28:19.098 INFO:tasks.workunit.client.0.smithi059.stdout:4/976: creat d0/d4/df/d48/dde/d12a/f134 x:0 0 0 2024-04-25T16:28:19.111 INFO:tasks.workunit.client.0.smithi059.stdout:0/986: mkdir dc/dd/dbd/d144 0 2024-04-25T16:28:19.134 INFO:tasks.workunit.client.0.smithi059.stdout:2/971: truncate de/d2a/d2e/d36/d2c/d40/d57/d112/d14a/d80/ddb/de3/ff1 1041406 0 2024-04-25T16:28:19.149 INFO:tasks.workunit.client.0.smithi059.stdout:8/955: chown d7/dd/d33/d57/lb9 582109 1 2024-04-25T16:28:19.160 INFO:tasks.workunit.client.0.smithi059.stdout:0/987: dread - dc/d37/d47/d71/dd0/fd8 zero size 2024-04-25T16:28:19.386 INFO:tasks.workunit.client.0.smithi059.stdout:4/977: symlink d0/d4/df/d48/da3/de2/l135 0 2024-04-25T16:28:19.388 INFO:tasks.workunit.client.0.smithi059.stdout:7/947: creat d0/d7/d16/d20/f132 x:0 0 0 2024-04-25T16:28:19.400 INFO:tasks.workunit.client.0.smithi059.stdout:0/988: rename dc/d37/d47/d71/c97 to dc/d37/d47/df7/d10c/c145 0 2024-04-25T16:28:19.436 INFO:tasks.workunit.client.0.smithi059.stdout:8/956: truncate d7/d16/de0/d101/d37/f44 921153 0 2024-04-25T16:28:19.451 INFO:tasks.workunit.client.0.smithi059.stdout:4/978: chown d0/d4/df/d48/da3/da4/lf2 1844700 1 2024-04-25T16:28:19.744 INFO:tasks.workunit.client.0.smithi059.stdout:0/989: mkdir dc/dd/d3b/d86/d146 0 2024-04-25T16:28:19.759 INFO:tasks.workunit.client.0.smithi059.stdout:4/979: rmdir d0/d4/df/d44 39 2024-04-25T16:28:19.834 INFO:tasks.workunit.client.0.smithi059.stdout:2/972: dwrite de/d2a/d2e/d36/d2c/d40/fe4 [0,4194304] 0 2024-04-25T16:28:19.906 INFO:tasks.workunit.client.0.smithi059.stdout:2/973: sync 2024-04-25T16:28:20.077 INFO:tasks.workunit.client.0.smithi059.stdout:7/948: mkdir d0/d7/dae/de2/d111/d133 0 2024-04-25T16:28:20.245 INFO:tasks.workunit.client.0.smithi059.stdout:2/974: readlink de/d2a/d2e/d36/d2c/l44 0 2024-04-25T16:28:20.353 INFO:tasks.workunit.client.0.smithi059.stdout:0/990: unlink dc/d84/l89 0 2024-04-25T16:28:20.502 INFO:tasks.workunit.client.0.smithi059.stdout:8/957: write d7/d2f/d43/f117 [24262,282] 0 2024-04-25T16:28:20.508 INFO:tasks.workunit.client.0.smithi059.stdout:4/980: truncate d0/f2a 1595120 0 2024-04-25T16:28:20.605 INFO:tasks.workunit.client.0.smithi059.stdout:2/975: dread de/d2a/d2e/d36/d59/ff9 [0,4194304] 0 2024-04-25T16:28:20.936 INFO:tasks.workunit.client.0.smithi059.stdout:0/991: mknod dc/d37/d47/d71/d77/c147 0 2024-04-25T16:28:21.027 INFO:tasks.workunit.client.0.smithi059.stdout:7/949: dwrite d0/d7/f1f [0,4194304] 0 2024-04-25T16:28:21.380 INFO:tasks.workunit.client.0.smithi059.stdout:2/976: getdents de/d2a/d2e/d36/d123/da6/d100 0 2024-04-25T16:28:21.394 INFO:tasks.workunit.client.0.smithi059.stdout:2/977: chown de/d2a/d33/d65/dca/c14b 11047 1 2024-04-25T16:28:21.448 INFO:tasks.workunit.client.0.smithi059.stdout:7/950: mkdir d0/d7/d51/da9/db3/d33/d79/d134 0 2024-04-25T16:28:21.593 INFO:tasks.workunit.client.0.smithi059.stdout:8/958: creat d7/d16/f135 x:0 0 0 2024-04-25T16:28:21.724 INFO:tasks.workunit.client.0.smithi059.stdout:0/992: mkdir dc/df/d148 0 2024-04-25T16:28:21.792 INFO:tasks.workunit.client.0.smithi059.stdout:7/951: creat d0/d7/d51/f135 x:0 0 0 2024-04-25T16:28:21.952 INFO:tasks.workunit.client.0.smithi059.stdout:8/959: dread d7/d16/d36/fa6 [0,4194304] 0 2024-04-25T16:28:21.970 INFO:tasks.workunit.client.0.smithi059.stdout:8/960: chown d7/d16/de0/d101/d37/d5c/d87/f89 4 1 2024-04-25T16:28:22.062 INFO:tasks.workunit.client.0.smithi059.stdout:2/978: mkdir de/d2a/d2e/d36/d2c/d15f 0 2024-04-25T16:28:22.318 INFO:tasks.workunit.client.0.smithi059.stdout:4/981: dwrite d0/d4/df/d1c/d45/d54/dd4/fff [0,4194304] 0 2024-04-25T16:28:22.404 INFO:tasks.workunit.client.0.smithi059.stdout:8/961: creat d7/d16/de0/d101/d38/f136 x:0 0 0 2024-04-25T16:28:22.508 INFO:tasks.workunit.client.0.smithi059.stdout:2/979: rename de/d2a/d2e/d36/d2c/l44 to de/d2a/d2e/d36/d59/l160 0 2024-04-25T16:28:22.516 INFO:tasks.workunit.client.0.smithi059.stdout:2/980: readlink de/d16/d7f/l14c 0 2024-04-25T16:28:22.601 INFO:tasks.workunit.client.0.smithi059.stdout:4/982: mknod d0/d4/df/d48/da9/c136 0 2024-04-25T16:28:22.639 INFO:tasks.workunit.client.0.smithi059.stdout:8/962: mknod d7/d16/d3a/c137 0 2024-04-25T16:28:22.739 INFO:tasks.workunit.client.0.smithi059.stdout:0/993: getdents dc/d37/d47 0 2024-04-25T16:28:22.788 INFO:tasks.workunit.client.0.smithi059.stdout:4/983: mknod d0/d4/df/d1c/d45/d54/d75/d7e/df5/d125/c137 0 2024-04-25T16:28:22.810 INFO:tasks.workunit.client.0.smithi059.stdout:7/952: dwrite d0/d7/d51/da9/db3/f113 [0,4194304] 0 2024-04-25T16:28:22.869 INFO:tasks.workunit.client.0.smithi059.stdout:8/963: rmdir d7/d16/de0/d101/d37/d5c 39 2024-04-25T16:28:23.227 INFO:tasks.workunit.client.0.smithi059.stdout:8/964: creat d7/dd/f138 x:0 0 0 2024-04-25T16:28:23.235 INFO:tasks.workunit.client.0.smithi059.stdout:0/994: truncate dc/d37/d47/d81/fc0 3043230 0 2024-04-25T16:28:23.498 INFO:tasks.workunit.client.0.smithi059.stdout:2/981: write de/d16/f8e [1073237,74026] 0 2024-04-25T16:28:23.524 INFO:tasks.workunit.client.0.smithi059.stdout:7/953: unlink d0/d7/d51/da9/db3/d33/dc6/de8/l112 0 2024-04-25T16:28:23.530 INFO:tasks.workunit.client.0.smithi059.stdout:4/984: write d0/d4/df/f3a [3715366,74426] 0 2024-04-25T16:28:23.557 INFO:tasks.workunit.client.0.smithi059.stdout:2/982: chown de/d2a/d33/d65/dcf/fd1 8456340 1 2024-04-25T16:28:23.583 INFO:tasks.workunit.client.0.smithi059.stdout:4/985: chown d0/d4/df/d1c/d45/d54/d75/d7e/l129 51572 1 2024-04-25T16:28:23.620 INFO:tasks.workunit.client.0.smithi059.stdout:8/965: rmdir d7/d16/d8c 39 2024-04-25T16:28:23.634 INFO:tasks.workunit.client.0.smithi059.stdout:0/995: fdatasync dc/d37/d47/d71/f94 0 2024-04-25T16:28:23.676 INFO:tasks.workunit.client.0.smithi059.stdout:7/954: mknod d0/d7/d51/da9/db3/d33/d79/c136 0 2024-04-25T16:28:23.930 INFO:tasks.workunit.client.0.smithi059.stdout:4/986: dread d0/d4/df/d48/da3/f11a [0,4194304] 0 2024-04-25T16:28:24.115 INFO:tasks.workunit.client.0.smithi059.stdout:0/996: truncate dc/f4e 873765 0 2024-04-25T16:28:24.118 INFO:tasks.workunit.client.0.smithi059.stdout:7/955: mkdir d0/de5/d137 0 2024-04-25T16:28:24.374 INFO:tasks.workunit.client.0.smithi059.stdout:4/987: getdents d0/d4/df/d44 0 2024-04-25T16:28:24.382 INFO:tasks.workunit.client.0.smithi059.stdout:2/983: dwrite de/d2a/d2e/d36/d2c/d40/d57/d112/d14a/d80/ddb/de3/f104 [0,4194304] 0 2024-04-25T16:28:24.466 INFO:tasks.workunit.client.0.smithi059.stdout:7/956: creat d0/d7/d51/da9/db3/d33/d79/d5d/db7/f138 x:0 0 0 2024-04-25T16:28:24.472 INFO:tasks.workunit.client.0.smithi059.stdout:8/966: dread d7/d2f/d43/f96 [0,4194304] 0 2024-04-25T16:28:24.475 INFO:tasks.workunit.client.0.smithi059.stdout:0/997: creat dc/dd/d3b/d86/f149 x:0 0 0 2024-04-25T16:28:24.566 INFO:tasks.workunit.client.0.smithi059.stdout:2/984: mkdir de/d2a/d33/d161 0 2024-04-25T16:28:24.770 INFO:tasks.workunit.client.0.smithi059.stdout:7/957: truncate d0/d7/f23 2741459 0 2024-04-25T16:28:24.776 INFO:tasks.workunit.client.0.smithi059.stdout:0/998: fdatasync dc/dd/d5c/fb9 0 2024-04-25T16:28:25.285 INFO:tasks.workunit.client.0.smithi059.stdout:4/988: write d0/d4/df/d1c/d45/d6f/dc4/f11c [150094,9983] 0 2024-04-25T16:28:25.292 INFO:tasks.workunit.client.0.smithi059.stdout:0/999: creat dc/d37/d47/d71/dd0/f14a x:0 0 0 2024-04-25T16:28:25.331 INFO:tasks.workunit.client.0.smithi059.stdout:7/958: dread d0/d7/d16/d20/dab/dd5/ff5 [0,4194304] 0 2024-04-25T16:28:25.481 INFO:tasks.workunit.client.0.smithi059.stdout:4/989: rmdir d0/d4/df/d44 39 2024-04-25T16:28:25.600 INFO:tasks.workunit.client.0.smithi059.stdout:2/985: dwrite de/f146 [4194304,4194304] 0 2024-04-25T16:28:25.903 INFO:tasks.workunit.client.0.smithi059.stdout:7/959: creat d0/d7/dae/de2/f139 x:0 0 0 2024-04-25T16:28:25.925 INFO:tasks.workunit.client.0.smithi059.stdout:7/960: stat d0/d7/d51/da9/db3/d33/d79/d5d/d94/d106/fcf 0 2024-04-25T16:28:25.983 INFO:tasks.workunit.client.0.smithi059.stdout:8/967: link d7/d16/de0/d101/d37/d5c/cb2 d7/d16/de0/d101/d37/d5c/d87/d94/dcd/c139 0 2024-04-25T16:28:26.295 INFO:tasks.workunit.client.0.smithi059.stdout:2/986: dread de/d2a/f35 [0,4194304] 0 2024-04-25T16:28:26.309 INFO:tasks.workunit.client.0.smithi059.stdout:2/987: chown de/d5a/d9a/de9/l107 60 1 2024-04-25T16:28:26.319 INFO:tasks.workunit.client.0.smithi059.stdout:4/990: truncate d0/d4/df/d1c/d45/d54/d75/d82/d8f/fa7 2774932 0 2024-04-25T16:28:26.458 INFO:tasks.workunit.client.0.smithi059.stdout:8/968: mknod d7/d16/d8f/c13a 0 2024-04-25T16:28:26.601 INFO:tasks.workunit.client.0.smithi059.stdout:2/988: truncate de/d16/f31 1117668 0 2024-04-25T16:28:26.621 INFO:tasks.workunit.client.0.smithi059.stdout:4/991: dread d0/d4/df/d44/f83 [0,4194304] 0 2024-04-25T16:28:26.810 INFO:tasks.workunit.client.0.smithi059.stdout:8/969: symlink d7/d16/de0/d101/d37/d5c/l13b 0 2024-04-25T16:28:26.902 INFO:tasks.workunit.client.0.smithi059.stdout:4/992: mknod d0/d4/df/d48/da3/c138 0 2024-04-25T16:28:27.096 INFO:tasks.workunit.client.0.smithi059.stdout:2/989: creat de/d2a/d2e/d36/d2c/f162 x:0 0 0 2024-04-25T16:28:27.831 INFO:tasks.workunit.client.0.smithi059.stdout:2/990: write de/d2a/d2e/d36/ff2 [507729,70284] 0 2024-04-25T16:28:27.858 INFO:tasks.workunit.client.0.smithi059.stdout:8/970: getdents d7/dd/d17 0 2024-04-25T16:28:27.939 INFO:tasks.workunit.client.0.smithi059.stdout:8/971: chown d7/l88 49241 1 2024-04-25T16:28:28.010 INFO:tasks.workunit.client.0.smithi059.stdout:7/961: dwrite d0/d7/d51/da9/db3/d33/d79/f7b [0,4194304] 0 2024-04-25T16:28:28.093 INFO:tasks.workunit.client.0.smithi059.stdout:4/993: dwrite d0/d4/df/f12 [8388608,4194304] 0 2024-04-25T16:28:28.100 INFO:tasks.workunit.client.0.smithi059.stdout:2/991: chown de/d2a/d2e/f3f 39682 1 2024-04-25T16:28:28.198 INFO:tasks.workunit.client.0.smithi059.stdout:8/972: write d7/d16/d3a/f9a [2049956,17732] 0 2024-04-25T16:28:28.228 INFO:tasks.workunit.client.0.smithi059.stdout:8/973: stat d7/d16/de0/df3 0 2024-04-25T16:28:28.250 INFO:tasks.workunit.client.0.smithi059.stdout:4/994: chown d0/d4/df/d1c/d45/d54/d75/d7e/f10b 4831 1 2024-04-25T16:28:28.260 INFO:tasks.workunit.client.0.smithi059.stdout:8/974: chown d7/d16/d3a/f109 1114 1 2024-04-25T16:28:28.438 INFO:tasks.workunit.client.0.smithi059.stdout:4/995: unlink d0/d4/df/d1c/d45/cd8 0 2024-04-25T16:28:28.439 INFO:tasks.workunit.client.0.smithi059.stdout:7/962: creat d0/d7/d51/da9/db3/d33/d79/d5d/dcb/f13a x:0 0 0 2024-04-25T16:28:28.571 INFO:tasks.workunit.client.0.smithi059.stdout:2/992: dwrite de/d2a/d2e/d36/d2c/d40/de5/f109 [0,4194304] 0 2024-04-25T16:28:28.672 INFO:tasks.workunit.client.0.smithi059.stdout:4/996: rmdir d0 39 2024-04-25T16:28:28.692 INFO:tasks.workunit.client.0.smithi059.stdout:8/975: write d7/d16/de0/d101/f81 [4120125,21499] 0 2024-04-25T16:28:28.783 INFO:tasks.workunit.client.0.smithi059.stdout:2/993: rmdir de/d5a 39 2024-04-25T16:28:28.878 INFO:tasks.workunit.client.0.smithi059.stdout:7/963: creat d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/f13b x:0 0 0 2024-04-25T16:28:29.016 INFO:tasks.workunit.client.0.smithi059.stdout:8/976: creat d7/d16/f13c x:0 0 0 2024-04-25T16:28:29.154 INFO:tasks.workunit.client.0.smithi059.stdout:8/977: sync 2024-04-25T16:28:29.209 INFO:tasks.workunit.client.0.smithi059.stdout:2/994: rename de/d2a/d2e/d36/d2c/l70 to de/d2a/d33/d65/dca/l163 0 2024-04-25T16:28:29.220 INFO:tasks.workunit.client.0.smithi059.stdout:4/997: write d0/d4/f1b [4865447,100851] 0 2024-04-25T16:28:29.220 INFO:tasks.workunit.client.0.smithi059.stdout:7/964: getdents d0/d7/d51/da9/db3/d33/d79/d134 0 2024-04-25T16:28:29.259 INFO:tasks.workunit.client.0.smithi059.stdout:8/978: mkdir d7/d2f/d43/d13d 0 2024-04-25T16:28:29.567 INFO:tasks.workunit.client.0.smithi059.stdout:2/995: truncate de/d2a/d2e/d36/d11d/f157 165556 0 2024-04-25T16:28:29.568 INFO:tasks.workunit.client.0.smithi059.stdout:7/965: write d0/f9a [4020450,48772] 0 2024-04-25T16:28:29.578 INFO:tasks.workunit.client.0.smithi059.stdout:8/979: mknod d7/d16/de0/d101/d37/d5c/d87/d94/d66/c13e 0 2024-04-25T16:28:29.604 INFO:tasks.workunit.client.0.smithi059.stdout:4/998: read d0/d4/df/d44/f4d [253832,117359] 0 2024-04-25T16:28:29.647 INFO:tasks.workunit.client.0.smithi059.stdout:7/966: rmdir d0/d7/dae 39 2024-04-25T16:28:29.759 INFO:tasks.workunit.client.0.smithi059.stdout:8/980: symlink d7/d2f/d76/l13f 0 2024-04-25T16:28:29.769 INFO:tasks.workunit.client.0.smithi059.stdout:2/996: rename de/d5a/f77 to de/d16/d3e/d101/f164 0 2024-04-25T16:28:29.812 INFO:tasks.workunit.client.0.smithi059.stdout:8/981: sync 2024-04-25T16:28:29.963 INFO:tasks.workunit.client.0.smithi059.stdout:4/999: write d0/d4/df/d1c/fdf [1025353,53331] 0 2024-04-25T16:28:30.286 INFO:tasks.workunit.client.0.smithi059.stdout:2/997: unlink de/d2a/d2e/d6a/c78 0 2024-04-25T16:28:30.291 INFO:tasks.workunit.client.0.smithi059.stdout:8/982: rename d7/d16/de0/d101/d37/d8b/cdc to d7/d16/d8f/dc0/c140 0 2024-04-25T16:28:30.532 INFO:tasks.workunit.client.0.smithi059.stdout:2/998: creat de/d2a/d2e/d6a/f165 x:0 0 0 2024-04-25T16:28:30.574 INFO:tasks.workunit.client.0.smithi059.stdout:7/967: dwrite d0/d7/d51/da9/db3/d33/d4c/d5c/f11a [0,4194304] 0 2024-04-25T16:28:30.667 INFO:tasks.workunit.client.0.smithi059.stdout:8/983: dread d7/d16/de0/d101/d37/f44 [0,4194304] 0 2024-04-25T16:28:30.896 INFO:tasks.workunit.client.0.smithi059.stdout:8/984: creat d7/d16/da3/f141 x:0 0 0 2024-04-25T16:28:30.905 INFO:tasks.workunit.client.0.smithi059.stdout:2/999: chown f1 736 1 2024-04-25T16:28:31.000 INFO:tasks.workunit.client.0.smithi059.stdout:7/968: symlink d0/d7/d51/da9/db3/d33/d79/d5d/l13c 0 2024-04-25T16:28:31.003 INFO:tasks.workunit.client.0.smithi059.stdout:8/985: creat d7/dd/d33/df4/f142 x:0 0 0 2024-04-25T16:28:31.026 INFO:tasks.workunit.client.0.smithi059.stdout:8/986: write d7/d16/f13c [270035,40603] 0 2024-04-25T16:28:31.310 INFO:tasks.workunit.client.0.smithi059.stdout:8/987: read d7/d2f/d43/f6f [1953653,25660] 0 2024-04-25T16:28:31.824 INFO:tasks.workunit.client.0.smithi059.stdout:7/969: dwrite d0/f88 [4194304,4194304] 0 2024-04-25T16:28:32.010 INFO:tasks.workunit.client.0.smithi059.stdout:8/988: dwrite d7/d16/de0/d101/d37/d5c/d87/d94/d66/daa/d103/f11c [0,4194304] 0 2024-04-25T16:28:32.093 INFO:tasks.workunit.client.0.smithi059.stdout:8/989: dread d7/f91 [0,4194304] 0 2024-04-25T16:28:32.190 INFO:tasks.workunit.client.0.smithi059.stdout:8/990: creat d7/dd/d17/f143 x:0 0 0 2024-04-25T16:28:32.214 INFO:tasks.workunit.client.0.smithi059.stdout:7/970: dwrite d0/d7/d51/da9/db3/d33/d79/d5d/d94/d106/f129 [0,4194304] 0 2024-04-25T16:28:32.343 INFO:tasks.workunit.client.0.smithi059.stdout:8/991: creat d7/d16/d8f/dc8/f144 x:0 0 0 2024-04-25T16:28:32.375 INFO:tasks.workunit.client.0.smithi059.stdout:7/971: creat d0/d7/d51/da9/db3/d33/dc6/f13d x:0 0 0 2024-04-25T16:28:32.383 INFO:tasks.workunit.client.0.smithi059.stdout:8/992: dread d7/f1c [0,4194304] 0 2024-04-25T16:28:32.463 INFO:tasks.workunit.client.0.smithi059.stdout:7/972: sync 2024-04-25T16:28:32.585 INFO:tasks.workunit.client.0.smithi059.stdout:7/973: mknod d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/d108/d120/c13e 0 2024-04-25T16:28:32.692 INFO:tasks.workunit.client.0.smithi059.stdout:8/993: dwrite d7/d2f/d76/fd0 [0,4194304] 0 2024-04-25T16:28:32.773 INFO:tasks.workunit.client.0.smithi059.stdout:7/974: fdatasync d0/f30 0 2024-04-25T16:28:32.918 INFO:tasks.workunit.client.0.smithi059.stdout:7/975: creat d0/d7/d51/f13f x:0 0 0 2024-04-25T16:28:32.926 INFO:tasks.workunit.client.0.smithi059.stdout:8/994: rename d7/dd/d33/lf5 to d7/d16/d36/dca/l145 0 2024-04-25T16:28:33.096 INFO:tasks.workunit.client.0.smithi059.stdout:8/995: creat d7/d16/de0/d101/d37/d5c/d87/d94/d7f/f146 x:0 0 0 2024-04-25T16:28:33.171 INFO:tasks.workunit.client.0.smithi059.stdout:7/976: truncate d0/d7/f40 4845070 0 2024-04-25T16:28:33.397 INFO:tasks.workunit.client.0.smithi059.stdout:7/977: creat d0/d7/d51/da9/db3/d33/dc6/f140 x:0 0 0 2024-04-25T16:28:33.405 INFO:tasks.workunit.client.0.smithi059.stdout:8/996: write d7/d16/de0/d101/f71 [387583,7769] 0 2024-04-25T16:28:33.537 INFO:tasks.workunit.client.0.smithi059.stdout:8/997: mknod d7/d16/d8f/dc0/c147 0 2024-04-25T16:28:33.543 INFO:tasks.workunit.client.0.smithi059.stdout:7/978: creat d0/d7/d51/da9/db3/d33/d79/d5d/dcb/f141 x:0 0 0 2024-04-25T16:28:33.733 INFO:tasks.workunit.client.0.smithi059.stdout:7/979: mknod d0/d7/d51/da9/db3/d33/c142 0 2024-04-25T16:28:33.738 INFO:tasks.workunit.client.0.smithi059.stdout:8/998: write d7/dd/fe7 [363616,32896] 0 2024-04-25T16:28:33.878 INFO:tasks.workunit.client.0.smithi059.stdout:8/999: rmdir d7/d16/de0/df3 39 2024-04-25T16:28:33.882 INFO:tasks.workunit.client.0.smithi059.stdout:7/980: fdatasync d0/f56 0 2024-04-25T16:28:34.196 INFO:tasks.workunit.client.0.smithi059.stdout:7/981: rename d0/d7/c11 to d0/d7/d51/da9/db3/d33/d79/c143 0 2024-04-25T16:28:34.275 INFO:tasks.workunit.client.0.smithi059.stdout:7/982: unlink d0/d7/d51/da9/db3/d33/d79/d5d/db7/lcc 0 2024-04-25T16:28:34.329 INFO:tasks.workunit.client.0.smithi059.stdout:7/983: mkdir d0/d7/d144 0 2024-04-25T16:28:34.368 INFO:tasks.workunit.client.0.smithi059.stdout:7/984: chown d0/d7/dae/c125 568417850 1 2024-04-25T16:28:34.377 INFO:tasks.workunit.client.0.smithi059.stdout:7/985: chown d0/de5/f10a 14005566 1 2024-04-25T16:28:34.454 INFO:tasks.workunit.client.0.smithi059.stdout:7/986: mknod d0/d7/d51/da9/db3/d33/d79/d5d/d94/dfe/c145 0 2024-04-25T16:28:34.470 INFO:tasks.workunit.client.0.smithi059.stdout:7/987: chown d0/d7/d51/da9/db3/d33/d79/f9c 161453 1 2024-04-25T16:28:34.523 INFO:tasks.workunit.client.0.smithi059.stdout:7/988: creat d0/d7/d144/f146 x:0 0 0 2024-04-25T16:28:34.602 INFO:tasks.workunit.client.0.smithi059.stdout:7/989: fdatasync d0/d7/d16/d5a/fd1 0 2024-04-25T16:28:34.620 INFO:tasks.workunit.client.0.smithi059.stdout:7/990: chown d0/d7/d51/da9/db3/d33/d4c/d4e 1446052 1 2024-04-25T16:28:34.888 INFO:tasks.workunit.client.0.smithi059.stdout:7/991: creat d0/d7/d51/da9/db3/f147 x:0 0 0 2024-04-25T16:28:34.944 INFO:tasks.workunit.client.0.smithi059.stdout:7/992: dread d0/d7/d51/da9/db3/d33/d79/d5d/fc2 [0,4194304] 0 2024-04-25T16:28:35.023 INFO:tasks.workunit.client.0.smithi059.stdout:7/993: truncate d0/f30 1470146 0 2024-04-25T16:28:35.075 INFO:tasks.workunit.client.0.smithi059.stdout:7/994: fsync d0/d7/d51/da9/db3/d33/d79/d5d/f75 0 2024-04-25T16:28:35.258 INFO:tasks.workunit.client.0.smithi059.stdout:7/995: symlink d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/d108/d120/l148 0 2024-04-25T16:28:35.277 INFO:tasks.workunit.client.0.smithi059.stdout:7/996: chown d0/d7/d51/da9/db3/d33/d79/c136 0 1 2024-04-25T16:28:35.390 INFO:tasks.workunit.client.0.smithi059.stdout:7/997: rename d0/d7/d51/da9/db3/d33/d79/d5d/d94/d106 to d0/d7/dae/de2/d149 0 2024-04-25T16:28:35.461 INFO:tasks.workunit.client.0.smithi059.stdout:7/998: mkdir d0/d7/dae/de2/d111/d133/d14a 0 2024-04-25T16:28:35.521 INFO:tasks.workunit.client.0.smithi059.stdout:7/999: symlink d0/d7/d51/da9/db3/d33/d4c/d4e/d4f/d108/d11f/l14b 0 2024-04-25T16:28:35.538 INFO:tasks.workunit.client.0.smithi059.stderr:+ rm -rf -- ./tmp.Q8bC7cbqvS 2024-04-25T16:28:46.692 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:28:46.695 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:29:16.754 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:29:16.756 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:29:46.804 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:29:46.807 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:30:16.886 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:30:16.889 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:30:30.393 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:44:42.999 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:30:30.400 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:44:43.006 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:30:30.411 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:44:42.976 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:30:30.413 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:44:42.977 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:30:30.414 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:44:42.979 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:30:30.416 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:44:42.981 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:30:30.470 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:44:43.076 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:30:30.486 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:44:43.050 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:30:30.495 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:44:43.059 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:30:46.967 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:30:46.969 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:31:17.031 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:31:17.035 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:31:47.101 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:31:47.104 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:32:17.157 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:32:17.160 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:32:47.216 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:32:47.218 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:33:17.299 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:33:17.303 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:33:47.355 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:33:47.359 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:34:17.410 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:34:17.414 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:34:39.678 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:48:52.284 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:34:39.681 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:48:52.287 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:34:39.692 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:48:52.258 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:34:39.693 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:48:52.258 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:34:39.695 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:48:52.261 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:34:39.696 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:48:52.261 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:34:39.794 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:48:52.400 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:34:39.834 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:48:52.400 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:34:39.836 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:48:52.401 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:34:47.471 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:34:47.473 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:34:54.005 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T16:34:54.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T16:35:17.561 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:35:17.564 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:35:47.623 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:35:47.626 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:36:17.830 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:36:17.833 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:36:36.128 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:50:48.735 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:36:36.131 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:50:48.737 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:36:36.185 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:50:48.792 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:36:36.217 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:50:48.783 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:36:36.219 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:50:48.785 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:36:36.229 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:50:48.795 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:36:36.234 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:50:48.800 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:36:36.270 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:50:48.836 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:36:36.286 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:50:48.852 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:36:47.911 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:36:47.914 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:37:17.966 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:37:17.969 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:37:48.032 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:37:48.035 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:38:18.090 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:38:18.093 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:38:46.861 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:52:59.468 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:38:46.864 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:52:59.471 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:38:46.875 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:52:59.441 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:38:46.877 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:52:59.443 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:38:46.878 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:52:59.444 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:38:46.881 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:52:59.448 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:38:46.936 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:52:59.543 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:38:46.946 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:52:59.513 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:38:46.977 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:52:59.543 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:38:48.154 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:38:48.157 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:39:18.228 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:39:18.232 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:39:48.283 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:39:48.286 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:40:18.339 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:40:18.342 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:40:48.396 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:40:48.399 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:41:18.451 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:41:18.454 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:41:48.515 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:41:48.518 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:42:18.579 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:42:18.582 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:42:48.637 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:42:48.639 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:42:54.353 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:57:06.960 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:42:54.360 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:57:06.967 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:42:54.372 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:57:06.939 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:42:54.373 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:57:06.939 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:42:54.375 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:57:06.942 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:42:54.376 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:57:06.943 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:42:54.465 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:57:07.072 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:42:54.501 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:57:07.067 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:42:54.502 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:57:07.069 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:43:18.701 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:43:18.704 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:43:47.636 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:58:00.243 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:43:47.644 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:58:00.251 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:43:47.680 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:58:00.287 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:43:47.726 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:58:00.293 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:43:47.728 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:58:00.295 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:43:47.740 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:58:00.307 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:43:47.743 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:58:00.309 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:43:47.766 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:58:00.333 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:43:47.790 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:58:00.357 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:43:48.757 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:43:48.760 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:44:18.829 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:44:18.831 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:44:48.886 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:44:48.889 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:44:58.024 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:59:10.632 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:44:58.029 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:59:10.636 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:44:58.060 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:00:59:10.668 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:44:58.107 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:59:10.674 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:44:58.110 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:59:10.676 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:44:58.112 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:59:10.679 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:44:58.115 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:59:10.681 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:44:58.148 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:00:59:10.715 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:44:58.156 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:00:59:10.723 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:45:18.949 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:45:18.953 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:45:49.022 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:45:49.025 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:46:19.087 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:46:19.091 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:46:49.202 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:46:49.205 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:47:01.690 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:01:14.297 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:47:01.693 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:01:14.301 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:47:01.706 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:01:14.273 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:47:01.707 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:01:14.274 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:47:01.709 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:01:14.276 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:47:01.710 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:01:14.277 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:47:01.755 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:01:14.363 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:47:01.775 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:01:14.341 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:47:01.791 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:01:14.358 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:47:19.267 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:47:19.271 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:47:49.373 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:47:49.377 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:48:19.429 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:48:19.432 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:48:49.510 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:48:49.512 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:49:19.566 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:49:19.570 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:49:49.623 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:49:49.626 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:50:19.756 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:50:19.760 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:50:49.821 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:50:49.824 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:51:10.481 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:05:23.089 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:51:10.486 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:05:23.094 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:51:10.500 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:05:23.067 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:51:10.501 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:05:23.068 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:51:10.502 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:05:23.069 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:51:10.504 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:05:23.071 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:51:10.590 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:05:23.198 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:51:10.608 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:05:23.175 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:51:10.614 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:05:23.181 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:51:19.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:51:19.888 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:51:49.962 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:51:49.966 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:52:09.640 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:06:22.247 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:52:09.640 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:06:22.249 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:52:09.679 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:06:22.287 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:52:09.717 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:06:22.284 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:52:09.723 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:06:22.290 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:52:09.740 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:06:22.307 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:52:09.742 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:06:22.309 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:52:09.769 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:06:22.336 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:52:09.780 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:06:22.347 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:52:20.040 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:52:20.043 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:52:50.104 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:52:50.107 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:53:20.176 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:53:20.179 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:53:20.282 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:07:32.890 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:53:20.286 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:07:32.894 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:53:20.319 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:07:32.927 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:53:20.367 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:07:32.934 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:53:20.369 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:07:32.936 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:53:20.372 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:07:32.940 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:53:20.375 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:07:32.943 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:53:20.406 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:07:32.973 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:53:20.425 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:07:32.992 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:53:50.241 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:53:50.244 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:54:20.414 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:54:20.417 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:54:50.505 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:54:50.508 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:55:16.899 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:09:29.507 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:55:16.905 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:09:29.513 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:55:16.914 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:09:29.481 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:55:16.916 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:09:29.484 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:55:16.917 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:09:29.485 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:55:16.918 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:09:29.486 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:55:16.965 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:09:29.573 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:55:16.981 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:09:29.548 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:55:16.983 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:09:29.550 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:55:20.563 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:55:20.567 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:55:50.627 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:55:50.630 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:56:20.698 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:56:20.701 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:56:50.757 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:56:50.760 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:57:20.819 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:57:20.822 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:57:50.877 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:57:50.881 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:58:20.942 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:58:20.944 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:58:51.003 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:58:51.005 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:59:21.067 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:59:21.070 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:59:26.030 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:13:38.638 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:59:26.035 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:13:38.643 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:59:26.041 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:13:38.609 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:59:26.044 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:13:38.612 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:59:26.047 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:13:38.614 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:59:26.049 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:13:38.617 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:59:26.142 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:13:38.751 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T16:59:26.154 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:13:38.721 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T16:59:26.156 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:13:38.724 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T16:59:51.141 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T16:59:51.144 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:00:21.215 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:00:21.218 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:00:32.387 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:14:44.994 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T17:00:32.388 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:14:44.996 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T17:00:32.426 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:14:45.034 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T17:00:32.463 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:14:45.030 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T17:00:32.470 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:14:45.037 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T17:00:32.472 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:14:45.039 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T17:00:32.472 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:14:45.039 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T17:00:32.512 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:14:45.079 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T17:00:32.517 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:14:45.084 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T17:00:51.272 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:00:51.275 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:01:21.330 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:01:21.333 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:01:30.714 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-25T17:01:30.714 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T17:01:31.011 DEBUG:teuthology.parallel:result is None 2024-04-25T17:01:31.011 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T17:01:31.311 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T17:01:31.311 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T17:01:31.322 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T17:01:31.322 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T17:01:31.322 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T17:01:31.338 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T17:01:31.338 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T17:01:31.394 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T17:01:31.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.548+0000 7fbd78e20640 1 Processor -- start 2024-04-25T17:01:31.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.548+0000 7fbd78e20640 1 -- start start 2024-04-25T17:01:31.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.549+0000 7fbd78e20640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbd7406ce60 0x7fbd740ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:31.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.550+0000 7fbd78e20640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd7415a5d0 con 0x7fbd740ceb50 2024-04-25T17:01:31.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.550+0000 7fbd78e20640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd7415a8b0 con 0x7fbd7406fa50 2024-04-25T17:01:31.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.550+0000 7fbd78e20640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fbd740c9a00 con 0x7fbd7406ce60 2024-04-25T17:01:31.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.550+0000 7fbd71d9b640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbd7406ce60 0x7fbd740ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:31.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.551+0000 7fbd7259c640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fbd7406fa50 0x7fbd74154440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.59:58076/0 (socket says 172.21.15.59:58076) 2024-04-25T17:01:31.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.551+0000 7fbd7259c640 1 -- 172.21.15.59:0/522255690 learned_addr learned my addr 172.21.15.59:0/522255690 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T17:01:31.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.553+0000 7fbd7159a640 1 -- 172.21.15.59:0/522255690 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 733318345 0 0) 0x7fbd7415a8b0 con 0x7fbd7406fa50 2024-04-25T17:01:31.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.553+0000 7fbd7159a640 1 -- 172.21.15.59:0/522255690 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd60003520 con 0x7fbd7406fa50 2024-04-25T17:01:31.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.554+0000 7fbd71d9b640 1 -- 172.21.15.59:0/522255690 >> v1:172.21.15.64:6789/0 conn(0x7fbd7406fa50 legacy=0x7fbd74154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:31.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.554+0000 7fbd71d9b640 1 -- 172.21.15.59:0/522255690 >> v1:172.21.15.59:6789/0 conn(0x7fbd740ceb50 legacy=0x7fbd740c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:31.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.554+0000 7fbd71d9b640 1 -- 172.21.15.59:0/522255690 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7415ab90 con 0x7fbd7406ce60 2024-04-25T17:01:31.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.557+0000 7fbd71d9b640 1 --2- 172.21.15.59:0/522255690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd7406ce60 0x7fbd740ce610 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0097a0 tx=0x7fbd5c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff10d5fad8612353 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:31.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.564+0000 7fbd7159a640 1 -- 172.21.15.59:0/522255690 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c037070 con 0x7fbd7406ce60 2024-04-25T17:01:31.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.564+0000 7fbd7159a640 1 -- 172.21.15.59:0/522255690 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd5c032640 con 0x7fbd7406ce60 2024-04-25T17:01:31.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.564+0000 7fbd7159a640 1 -- 172.21.15.59:0/522255690 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c032a10 con 0x7fbd7406ce60 2024-04-25T17:01:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.565+0000 7fbd78e20640 1 -- 172.21.15.59:0/522255690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd7406ce60 msgr2=0x7fbd740ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.565+0000 7fbd78e20640 1 --2- 172.21.15.59:0/522255690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd7406ce60 0x7fbd740ce610 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0097a0 tx=0x7fbd5c02a2c0 comp rx=0 tx=0).stop 2024-04-25T17:01:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.565+0000 7fbd78e20640 1 -- 172.21.15.59:0/522255690 shutdown_connections 2024-04-25T17:01:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.565+0000 7fbd78e20640 1 --2- 172.21.15.59:0/522255690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd7406ce60 0x7fbd740ce610 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.565+0000 7fbd78e20640 1 -- 172.21.15.59:0/522255690 >> 172.21.15.59:0/522255690 conn(0x7fbd7406d690 msgr2=0x7fbd7406daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.565+0000 7fbd78e20640 1 -- 172.21.15.59:0/522255690 shutdown_connections 2024-04-25T17:01:31.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.565+0000 7fbd78e20640 1 -- 172.21.15.59:0/522255690 wait complete. 2024-04-25T17:01:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.567+0000 7fbd78e20640 1 Processor -- start 2024-04-25T17:01:31.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.567+0000 7fbd78e20640 1 -- start start 2024-04-25T17:01:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.568+0000 7fbd78e20640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd7406ce60 0x7fbd741e3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:31.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.568+0000 7fbd78e20640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbd7406fa50 0x7fbd740c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.568+0000 7fbd78e20640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd740ceb50 0x7fbd741e6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.568+0000 7fbd78e20640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbd74070a40 con 0x7fbd740ceb50 2024-04-25T17:01:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.568+0000 7fbd78e20640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7415a370 con 0x7fbd7406ce60 2024-04-25T17:01:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.568+0000 7fbd78e20640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fbd7415b150 con 0x7fbd7406fa50 2024-04-25T17:01:31.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.569+0000 7fbd71d9b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbd7406fa50 0x7fbd740c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.569+0000 7fbd72d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd740ceb50 0x7fbd741e6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.569+0000 7fbd7259c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd7406ce60 0x7fbd741e3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.569+0000 7fbd71d9b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbd7406fa50 0x7fbd740c4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:33190/0 (socket says 172.21.15.59:33190) 2024-04-25T17:01:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.569+0000 7fbd71d9b640 1 -- 172.21.15.59:0/761468014 learned_addr learned my addr 172.21.15.59:0/761468014 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:31.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.569+0000 7fbd72d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd740ceb50 0x7fbd741e6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41282/0 (socket says 172.21.15.59:41282) 2024-04-25T17:01:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.573+0000 7fbd7259c640 1 -- 172.21.15.59:0/761468014 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbd7406fa50 msgr2=0x7fbd740c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.573+0000 7fbd7259c640 1 --2- 172.21.15.59:0/761468014 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbd7406fa50 0x7fbd740c4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.573+0000 7fbd7259c640 1 -- 172.21.15.59:0/761468014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd740ceb50 msgr2=0x7fbd741e6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.573+0000 7fbd7259c640 1 --2- 172.21.15.59:0/761468014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd740ceb50 0x7fbd741e6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:31.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.573+0000 7fbd7259c640 1 -- 172.21.15.59:0/761468014 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd741e4160 con 0x7fbd7406ce60 2024-04-25T17:01:31.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.573+0000 7fbd72d9d640 1 --2- 172.21.15.59:0/761468014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd740ceb50 0x7fbd741e6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:01:31.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.576+0000 7fbd7259c640 1 --2- 172.21.15.59:0/761468014 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd7406ce60 0x7fbd741e3c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c00caa0 tx=0x7fbd6c00cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.580+0000 7fbd6affd640 1 -- 172.21.15.59:0/761468014 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c017070 con 0x7fbd7406ce60 2024-04-25T17:01:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.580+0000 7fbd6affd640 1 -- 172.21.15.59:0/761468014 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd6c00ac00 con 0x7fbd7406ce60 2024-04-25T17:01:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.581+0000 7fbd6affd640 1 -- 172.21.15.59:0/761468014 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c012400 con 0x7fbd7406ce60 2024-04-25T17:01:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.581+0000 7fbd78e20640 1 -- 172.21.15.59:0/761468014 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd74159ea0 con 0x7fbd7406ce60 2024-04-25T17:01:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.581+0000 7fbd78e20640 1 -- 172.21.15.59:0/761468014 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd74159800 con 0x7fbd7406ce60 2024-04-25T17:01:31.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.582+0000 7fbd78e20640 1 -- 172.21.15.59:0/761468014 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd740b3650 con 0x7fbd7406ce60 2024-04-25T17:01:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.605+0000 7fbd6affd640 1 -- 172.21.15.59:0/761468014 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbd6c01a070 con 0x7fbd7406ce60 2024-04-25T17:01:31.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.606+0000 7fbd6affd640 1 --2- 172.21.15.59:0/761468014 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbd54074500 0x7fbd54076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:31.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.606+0000 7fbd71d9b640 1 --2- 172.21.15.59:0/761468014 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbd54074500 0x7fbd54076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:31.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.606+0000 7fbd71d9b640 1 --2- 172.21.15.59:0/761468014 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbd54074500 0x7fbd54076a10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0097a0 tx=0x7fbd5c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:31.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.609+0000 7fbd6affd640 1 -- 172.21.15.59:0/761468014 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fbd6c05b7d0 con 0x7fbd7406ce60 2024-04-25T17:01:31.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:31.893+0000 7fbd6affd640 1 -- 172.21.15.59:0/761468014 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbd740b3650 con 0x7fbd7406ce60 2024-04-25T17:01:32.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.086+0000 7fbd78e20640 1 -- 172.21.15.59:0/761468014 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd740698a0 con 0x7fbd7406ce60 2024-04-25T17:01:32.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.133+0000 7fbd6affd640 1 -- 172.21.15.59:0/761468014 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16795 (secure 0 0 0) 0x7fbd6c05f540 con 0x7fbd7406ce60 2024-04-25T17:01:32.132 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T17:01:32.132 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"9bb5d7ca-5217-467b-882c-0a18cd57f08f","created":"2024-04-25T15:46:00.198001+0000","modified":"2024-04-25T15:47:08.715345+0000","last_up_change":"2024-04-25T15:46:15.850827+0000","last_in_change":"2024-04-25T15:46:06.311980+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:46:16.936340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:30.174141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:31.372481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34cee654-11dd-4f4b-99fe-093462f8abad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6803","nonce":1314235095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6805","nonce":1314235095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6809","nonce":1314235095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6807","nonce":1314235095}]},"public_addr":"172.21.15.59:6803/1314235095","cluster_addr":"172.21.15.59:6805/1314235095","heartbeat_back_addr":"172.21.15.59:6809/1314235095","heartbeat_front_addr":"172.21.15.59:6807/1314235095","state":["exists","up"]},{"osd":1,"uuid":"3c15505b-4abd-4a24-b30c-edc2732f8ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6827","nonce":3550810151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6829","nonce":3550810151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6833","nonce":3550810151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6831","nonce":3550810151}]},"public_addr":"172.21.15.59:6827/3550810151","cluster_addr":"172.21.15.59:6829/3550810151","heartbeat_back_addr":"172.21.15.59:6833/3550810151","heartbeat_front_addr":"172.21.15.59:6831/3550810151","state":["exists","up"]},{"osd":2,"uuid":"5884bf21-e6b4-4813-b8bc-6baa92443c87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6811","nonce":1651189093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6813","nonce":1651189093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6817","nonce":1651189093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6815","nonce":1651189093}]},"public_addr":"172.21.15.59:6811/1651189093","cluster_addr":"172.21.15.59:6813/1651189093","heartbeat_back_addr":"172.21.15.59:6817/1651189093","heartbeat_front_addr":"172.21.15.59:6815/1651189093","state":["exists","up"]},{"osd":3,"uuid":"6ff71700-3b00-4350-b3c9-f6c41ec46b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6819","nonce":1300858236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6821","nonce":1300858236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6825","nonce":1300858236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6823","nonce":1300858236}]},"public_addr":"172.21.15.59:6819/1300858236","cluster_addr":"172.21.15.59:6821/1300858236","heartbeat_back_addr":"172.21.15.59:6825/1300858236","heartbeat_front_addr":"172.21.15.59:6823/1300858236","state":["exists","up"]},{"osd":4,"uuid":"d0a72143-93fd-4712-aadb-f3fade303426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6817","nonce":2206186554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6819","nonce":2206186554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6823","nonce":2206186554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6821","nonce":2206186554}]},"public_addr":"172.21.15.64:6817/2206186554","cluster_addr":"172.21.15.64:6819/2206186554","heartbeat_back_addr":"172.21.15.64:6823/2206186554","heartbeat_front_addr":"172.21.15.64:6821/2206186554","state":["exists","up"]},{"osd":5,"uuid":"9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6825","nonce":639697697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6827","nonce":639697697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6831","nonce":639697697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6829","nonce":639697697}]},"public_addr":"172.21.15.64:6825/639697697","cluster_addr":"172.21.15.64:6827/639697697","heartbeat_back_addr":"172.21.15.64:6831/639697697","heartbeat_front_addr":"172.21.15.64:6829/639697697","state":["exists","up"]},{"osd":6,"uuid":"311d9a6b-8fbc-4809-8d33-b9248a3562f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6809","nonce":2335675289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6811","nonce":2335675289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6815","nonce":2335675289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6813","nonce":2335675289}]},"public_addr":"172.21.15.64:6809/2335675289","cluster_addr":"172.21.15.64:6811/2335675289","heartbeat_back_addr":"172.21.15.64:6815/2335675289","heartbeat_front_addr":"172.21.15.64:6813/2335675289","state":["exists","up"]},{"osd":7,"uuid":"d0f7436e-882f-4aa7-b2ae-684b9894b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6801","nonce":970439753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6803","nonce":970439753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6807","nonce":970439753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6805","nonce":970439753}]},"public_addr":"172.21.15.64:6801/970439753","cluster_addr":"172.21.15.64:6803/970439753","heartbeat_back_addr":"172.21.15.64:6807/970439753","heartbeat_front_addr":"172.21.15.64:6805/970439753","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.807777+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.945589+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.926832+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.943537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.925062+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.957550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.913559+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.839159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T17:01:32.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.136+0000 7fbd78e20640 1 -- 172.21.15.59:0/761468014 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbd54074500 msgr2=0x7fbd54076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:32.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.136+0000 7fbd78e20640 1 --2- 172.21.15.59:0/761468014 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbd54074500 0x7fbd54076a10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0097a0 tx=0x7fbd5c02e000 comp rx=0 tx=0).stop 2024-04-25T17:01:32.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.136+0000 7fbd78e20640 1 -- 172.21.15.59:0/761468014 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd7406ce60 msgr2=0x7fbd741e3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:32.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.136+0000 7fbd78e20640 1 --2- 172.21.15.59:0/761468014 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd7406ce60 0x7fbd741e3c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c00caa0 tx=0x7fbd6c00cf60 comp rx=0 tx=0).stop 2024-04-25T17:01:32.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.136+0000 7fbd78e20640 1 -- 172.21.15.59:0/761468014 shutdown_connections 2024-04-25T17:01:32.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.136+0000 7fbd78e20640 1 --2- 172.21.15.59:0/761468014 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fbd54074500 0x7fbd54076a10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:32.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.136+0000 7fbd78e20640 1 --2- 172.21.15.59:0/761468014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd740ceb50 0x7fbd741e6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:32.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.136+0000 7fbd78e20640 1 --2- 172.21.15.59:0/761468014 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbd7406fa50 0x7fbd740c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:32.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.136+0000 7fbd78e20640 1 --2- 172.21.15.59:0/761468014 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbd7406ce60 0x7fbd741e3c20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:32.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.136+0000 7fbd78e20640 1 -- 172.21.15.59:0/761468014 >> 172.21.15.59:0/761468014 conn(0x7fbd7406d690 msgr2=0x7fbd74154440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:32.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.136+0000 7fbd78e20640 1 -- 172.21.15.59:0/761468014 shutdown_connections 2024-04-25T17:01:32.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.136+0000 7fbd78e20640 1 -- 172.21.15.59:0/761468014 wait complete. 2024-04-25T17:01:32.147 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:46:16.936340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:46:30.174141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:46:31.372481+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T17:01:32.148 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T17:01:32.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.264+0000 7f2ebd4e0640 1 Processor -- start 2024-04-25T17:01:32.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.264+0000 7f2ebd4e0640 1 -- start start 2024-04-25T17:01:32.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.265+0000 7f2ebd4e0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2eb815c540 0x7f2eb80b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:32.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.265+0000 7f2ebd4e0640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2eb80cc580 0x7f2eb80cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:32.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.265+0000 7f2ebd4e0640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb80c7020 con 0x7f2eb80c7dc0 2024-04-25T17:01:32.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.265+0000 7f2ebd4e0640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb80b4af0 con 0x7f2eb80cc580 2024-04-25T17:01:32.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.265+0000 7f2ebd4e0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb80c7930 con 0x7f2eb815c540 2024-04-25T17:01:32.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.266+0000 7f2eb67fc640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2eb815c540 0x7f2eb80b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:32.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.266+0000 7f2eb77fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2eb80cc580 0x7f2eb80cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:32.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.267+0000 7f2eb67fc640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2eb815c540 0x7f2eb80b53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:33192/0 (socket says 172.21.15.59:33192) 2024-04-25T17:01:32.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.267+0000 7f2eb67fc640 1 -- 172.21.15.59:0/1674002204 learned_addr learned my addr 172.21.15.59:0/1674002204 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:32.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.270+0000 7f2eb67fc640 1 -- 172.21.15.59:0/1674002204 >> v2:172.21.15.64:3300/0 conn(0x7f2eb80cc580 msgr2=0x7f2eb80cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:32.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.270+0000 7f2eb67fc640 1 --2- 172.21.15.59:0/1674002204 >> v2:172.21.15.64:3300/0 conn(0x7f2eb80cc580 0x7f2eb80cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:32.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.270+0000 7f2eb67fc640 1 -- 172.21.15.59:0/1674002204 >> v1:172.21.15.64:6789/0 conn(0x7f2eb80c7dc0 legacy=0x7f2eb81564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:32.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.270+0000 7f2eb67fc640 1 -- 172.21.15.59:0/1674002204 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb81606a0 con 0x7f2eb815c540 2024-04-25T17:01:32.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.272+0000 7f2eb67fc640 1 --2- 172.21.15.59:0/1674002204 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2eb815c540 0x7f2eb80b53f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80c7ab0 tx=0x7f2eac02a2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d2a42164e0a66a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:32.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.277+0000 7f2eb5ffb640 1 -- 172.21.15.59:0/1674002204 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac037070 con 0x7f2eb815c540 2024-04-25T17:01:32.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.277+0000 7f2eb5ffb640 1 -- 172.21.15.59:0/1674002204 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac032640 con 0x7f2eb815c540 2024-04-25T17:01:32.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.277+0000 7f2eb5ffb640 1 -- 172.21.15.59:0/1674002204 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac032a10 con 0x7f2eb815c540 2024-04-25T17:01:32.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.278+0000 7f2ebd4e0640 1 -- 172.21.15.59:0/1674002204 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2eb815c540 msgr2=0x7f2eb80b53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:32.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.278+0000 7f2ebd4e0640 1 --2- 172.21.15.59:0/1674002204 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2eb815c540 0x7f2eb80b53f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80c7ab0 tx=0x7f2eac02a2e0 comp rx=0 tx=0).stop 2024-04-25T17:01:32.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.278+0000 7f2ebd4e0640 1 -- 172.21.15.59:0/1674002204 shutdown_connections 2024-04-25T17:01:32.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.278+0000 7f2ebd4e0640 1 --2- 172.21.15.59:0/1674002204 >> v2:172.21.15.64:3300/0 conn(0x7f2eb80cc580 0x7f2eb80cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:32.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.278+0000 7f2ebd4e0640 1 --2- 172.21.15.59:0/1674002204 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2eb815c540 0x7f2eb80b53f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:32.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.278+0000 7f2ebd4e0640 1 -- 172.21.15.59:0/1674002204 >> 172.21.15.59:0/1674002204 conn(0x7f2eb8074310 msgr2=0x7f2eb8068510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:32.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.278+0000 7f2ebd4e0640 1 -- 172.21.15.59:0/1674002204 shutdown_connections 2024-04-25T17:01:32.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.278+0000 7f2ebd4e0640 1 -- 172.21.15.59:0/1674002204 wait complete. 2024-04-25T17:01:32.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.280+0000 7f2ebd4e0640 1 Processor -- start 2024-04-25T17:01:32.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.280+0000 7f2ebd4e0640 1 -- start start 2024-04-25T17:01:32.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.281+0000 7f2ebd4e0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eb80cc580 0x7f2eb80d0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:32.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.281+0000 7f2ebd4e0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb815c540 0x7f2eb8159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:32.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.281+0000 7f2ebd4e0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2eb8158030 0x7f2eb814bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:32.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.281+0000 7f2ebd4e0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb80c75c0 con 0x7f2eb815c540 2024-04-25T17:01:32.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.281+0000 7f2ebd4e0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb80c72e0 con 0x7f2eb80cc580 2024-04-25T17:01:32.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.281+0000 7f2ebd4e0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb80b5930 con 0x7f2eb8158030 2024-04-25T17:01:32.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.282+0000 7f2eb67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb815c540 0x7f2eb8159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:32.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.282+0000 7f2eb6ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eb80cc580 0x7f2eb80d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:32.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.282+0000 7f2eb77fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2eb8158030 0x7f2eb814bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:32.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.282+0000 7f2eb67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb815c540 0x7f2eb8159070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41292/0 (socket says 172.21.15.59:41292) 2024-04-25T17:01:32.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.282+0000 7f2eb77fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2eb8158030 0x7f2eb814bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:33198/0 (socket says 172.21.15.59:33198) 2024-04-25T17:01:32.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.282+0000 7f2eb67fc640 1 -- 172.21.15.59:0/1902126240 learned_addr learned my addr 172.21.15.59:0/1902126240 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:32.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.286+0000 7f2eb67fc640 1 -- 172.21.15.59:0/1902126240 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2eb8158030 msgr2=0x7f2eb814bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:32.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.287+0000 7f2eb67fc640 1 --2- 172.21.15.59:0/1902126240 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2eb8158030 0x7f2eb814bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:32.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.287+0000 7f2eb67fc640 1 -- 172.21.15.59:0/1902126240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eb80cc580 msgr2=0x7f2eb80d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:32.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.287+0000 7f2eb67fc640 1 --2- 172.21.15.59:0/1902126240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eb80cc580 0x7f2eb80d0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:32.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.287+0000 7f2eb67fc640 1 -- 172.21.15.59:0/1902126240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb80d0950 con 0x7f2eb815c540 2024-04-25T17:01:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.289+0000 7f2eb67fc640 1 --2- 172.21.15.59:0/1902126240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb815c540 0x7f2eb8159070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2eac000c00 tx=0x7f2eac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:32.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.293+0000 7f2e9f7fe640 1 -- 172.21.15.59:0/1902126240 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac040020 con 0x7f2eb815c540 2024-04-25T17:01:32.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.293+0000 7f2e9f7fe640 1 -- 172.21.15.59:0/1902126240 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac038040 con 0x7f2eb815c540 2024-04-25T17:01:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.294+0000 7f2ebd4e0640 1 -- 172.21.15.59:0/1902126240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb81f22b0 con 0x7f2eb815c540 2024-04-25T17:01:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.294+0000 7f2e9f7fe640 1 -- 172.21.15.59:0/1902126240 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac037070 con 0x7f2eb815c540 2024-04-25T17:01:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.294+0000 7f2ebd4e0640 1 -- 172.21.15.59:0/1902126240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb81f2870 con 0x7f2eb815c540 2024-04-25T17:01:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.294+0000 7f2ebd4e0640 1 -- 172.21.15.59:0/1902126240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb8069910 con 0x7f2eb815c540 2024-04-25T17:01:32.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.598+0000 7f2e9f7fe640 1 -- 172.21.15.59:0/1902126240 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2eac043020 con 0x7f2eb815c540 2024-04-25T17:01:32.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.599+0000 7f2e9f7fe640 1 --2- 172.21.15.59:0/1902126240 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2ea4074530 0x7f2ea4076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:32.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.599+0000 7f2eb6ffd640 1 --2- 172.21.15.59:0/1902126240 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2ea4074530 0x7f2ea4076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:32.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.600+0000 7f2eb6ffd640 1 --2- 172.21.15.59:0/1902126240 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2ea4074530 0x7f2ea4076a40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80016e0 tx=0x7f2ea8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:32.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.616+0000 7f2e9f7fe640 1 -- 172.21.15.59:0/1902126240 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f2eac07bbd0 con 0x7f2eb815c540 2024-04-25T17:01:32.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.616+0000 7f2e9f7fe640 1 -- 172.21.15.59:0/1902126240 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2eac04a030 con 0x7f2eb815c540 2024-04-25T17:01:32.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.799+0000 7f2ebd4e0640 1 -- 172.21.15.59:0/1902126240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2eb80ce2d0 con 0x7f2eb815c540 2024-04-25T17:01:32.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.807+0000 7f2e9f7fe640 1 -- 172.21.15.59:0/1902126240 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f2eac07f940 con 0x7f2eb815c540 2024-04-25T17:01:32.805 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T17:01:32.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.809+0000 7f2ebd4e0640 1 -- 172.21.15.59:0/1902126240 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2ea4074530 msgr2=0x7f2ea4076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:32.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.809+0000 7f2ebd4e0640 1 --2- 172.21.15.59:0/1902126240 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2ea4074530 0x7f2ea4076a40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80016e0 tx=0x7f2ea8009040 comp rx=0 tx=0).stop 2024-04-25T17:01:32.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.809+0000 7f2ebd4e0640 1 -- 172.21.15.59:0/1902126240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb815c540 msgr2=0x7f2eb8159070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:32.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.809+0000 7f2ebd4e0640 1 --2- 172.21.15.59:0/1902126240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb815c540 0x7f2eb8159070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2eac000c00 tx=0x7f2eac0046c0 comp rx=0 tx=0).stop 2024-04-25T17:01:32.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.809+0000 7f2ebd4e0640 1 -- 172.21.15.59:0/1902126240 shutdown_connections 2024-04-25T17:01:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.809+0000 7f2ebd4e0640 1 --2- 172.21.15.59:0/1902126240 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2ea4074530 0x7f2ea4076a40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.809+0000 7f2ebd4e0640 1 --2- 172.21.15.59:0/1902126240 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2eb8158030 0x7f2eb814bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.809+0000 7f2ebd4e0640 1 --2- 172.21.15.59:0/1902126240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb815c540 0x7f2eb8159070 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.809+0000 7f2ebd4e0640 1 --2- 172.21.15.59:0/1902126240 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eb80cc580 0x7f2eb80d0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.809+0000 7f2ebd4e0640 1 -- 172.21.15.59:0/1902126240 >> 172.21.15.59:0/1902126240 conn(0x7f2eb8074310 msgr2=0x7f2eb80b6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.809+0000 7f2ebd4e0640 1 -- 172.21.15.59:0/1902126240 shutdown_connections 2024-04-25T17:01:32.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.809+0000 7f2ebd4e0640 1 -- 172.21.15.59:0/1902126240 wait complete. 2024-04-25T17:01:32.819 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T17:01:32.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.938+0000 7fc2be6bd640 1 Processor -- start 2024-04-25T17:01:32.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.938+0000 7fc2be6bd640 1 -- start start 2024-04-25T17:01:32.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.939+0000 7fc2be6bd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2b80b51b0 0x7fc2b8154780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:32.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.939+0000 7fc2be6bd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc2b815b820 0x7fc2b80cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:32.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.939+0000 7fc2be6bd640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2b80cb5d0 con 0x7fc2b80ccd60 2024-04-25T17:01:32.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.939+0000 7fc2be6bd640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fc2b80c9840 con 0x7fc2b80b51b0 2024-04-25T17:01:32.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.939+0000 7fc2be6bd640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fc2b80cc8d0 con 0x7fc2b815b820 2024-04-25T17:01:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.992+0000 7fc2b7fff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc2b80ccd60 0x7fc2b815e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49486/0 (socket says 172.21.15.59:49486) 2024-04-25T17:01:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.992+0000 7fc2b7fff640 1 -- 172.21.15.59:0/2158824706 learned_addr learned my addr 172.21.15.59:0/2158824706 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T17:01:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.992+0000 7fc2b77fe640 1 --2- 172.21.15.59:0/2158824706 >> v2:172.21.15.59:3300/0 conn(0x7fc2b80b51b0 0x7fc2b8154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.996+0000 7fc2bcc5a640 1 --2- 172.21.15.59:0/2158824706 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc2b815b820 0x7fc2b80cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.998+0000 7fc2b77fe640 1 -- 172.21.15.59:0/2158824706 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc2b815b820 msgr2=0x7fc2b80cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.998+0000 7fc2b77fe640 1 --2- 172.21.15.59:0/2158824706 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc2b815b820 0x7fc2b80cfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.998+0000 7fc2b77fe640 1 -- 172.21.15.59:0/2158824706 >> v1:172.21.15.59:6789/0 conn(0x7fc2b80ccd60 legacy=0x7fc2b815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:32.998+0000 7fc2b77fe640 1 -- 172.21.15.59:0/2158824706 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b80cac30 con 0x7fc2b80b51b0 2024-04-25T17:01:33.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.002+0000 7fc2b77fe640 1 --2- 172.21.15.59:0/2158824706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2b80b51b0 0x7fc2b8154780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0097a0 tx=0x7fc2ac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f0651afd3c6d12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:33.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.008+0000 7fc2b6ffd640 1 -- 172.21.15.59:0/2158824706 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac037070 con 0x7fc2b80b51b0 2024-04-25T17:01:33.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.008+0000 7fc2b6ffd640 1 -- 172.21.15.59:0/2158824706 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ac032440 con 0x7fc2b80b51b0 2024-04-25T17:01:33.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.008+0000 7fc2b6ffd640 1 -- 172.21.15.59:0/2158824706 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac032810 con 0x7fc2b80b51b0 2024-04-25T17:01:33.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.009+0000 7fc2be6bd640 1 -- 172.21.15.59:0/2158824706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2b80b51b0 msgr2=0x7fc2b8154780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:33.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.009+0000 7fc2be6bd640 1 --2- 172.21.15.59:0/2158824706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2b80b51b0 0x7fc2b8154780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0097a0 tx=0x7fc2ac02a180 comp rx=0 tx=0).stop 2024-04-25T17:01:33.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.009+0000 7fc2be6bd640 1 -- 172.21.15.59:0/2158824706 shutdown_connections 2024-04-25T17:01:33.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.009+0000 7fc2be6bd640 1 --2- 172.21.15.59:0/2158824706 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc2b815b820 0x7fc2b80cfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:33.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.009+0000 7fc2be6bd640 1 --2- 172.21.15.59:0/2158824706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2b80b51b0 0x7fc2b8154780 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:33.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.009+0000 7fc2be6bd640 1 -- 172.21.15.59:0/2158824706 >> 172.21.15.59:0/2158824706 conn(0x7fc2b806c760 msgr2=0x7fc2b806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:33.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.009+0000 7fc2be6bd640 1 -- 172.21.15.59:0/2158824706 shutdown_connections 2024-04-25T17:01:33.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.009+0000 7fc2be6bd640 1 -- 172.21.15.59:0/2158824706 wait complete. 2024-04-25T17:01:33.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.011+0000 7fc2be6bd640 1 Processor -- start 2024-04-25T17:01:33.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.011+0000 7fc2be6bd640 1 -- start start 2024-04-25T17:01:33.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.013+0000 7fc2be6bd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2b80b51b0 0x7fc2b80cef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:33.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.013+0000 7fc2be6bd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc2b815b820 0x7fc2b814ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:33.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.013+0000 7fc2be6bd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2b81f2c30 0x7fc2b814f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:33.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.013+0000 7fc2be6bd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b80cbfa0 con 0x7fc2b80b51b0 2024-04-25T17:01:33.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.013+0000 7fc2be6bd640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b80cb1d0 con 0x7fc2b81f2c30 2024-04-25T17:01:33.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.013+0000 7fc2be6bd640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fc2b80cc280 con 0x7fc2b815b820 2024-04-25T17:01:33.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.013+0000 7fc2b77fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc2b815b820 0x7fc2b814ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:33.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.014+0000 7fc2bcc5a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2b81f2c30 0x7fc2b814f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:33.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.014+0000 7fc2b77fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc2b815b820 0x7fc2b814ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:33218/0 (socket says 172.21.15.59:33218) 2024-04-25T17:01:33.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.014+0000 7fc2b77fe640 1 -- 172.21.15.59:0/2685408177 learned_addr learned my addr 172.21.15.59:0/2685408177 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.016+0000 7fc2b7fff640 1 --2- 172.21.15.59:0/2685408177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2b80b51b0 0x7fc2b80cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.018+0000 7fc2b77fe640 1 -- 172.21.15.59:0/2685408177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2b81f2c30 msgr2=0x7fc2b814f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.018+0000 7fc2b77fe640 1 --2- 172.21.15.59:0/2685408177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2b81f2c30 0x7fc2b814f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.018+0000 7fc2b77fe640 1 -- 172.21.15.59:0/2685408177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2b80b51b0 msgr2=0x7fc2b80cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.018+0000 7fc2b77fe640 1 --2- 172.21.15.59:0/2685408177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2b80b51b0 0x7fc2b80cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.018+0000 7fc2b77fe640 1 -- 172.21.15.59:0/2685408177 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b80c28b0 con 0x7fc2b815b820 2024-04-25T17:01:33.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.020+0000 7fc2b77fe640 1 --2- 172.21.15.59:0/2685408177 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc2b815b820 0x7fc2b814ecc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac035040 tx=0x7fc2ac0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:33.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.025+0000 7fc2b4ff9640 1 -- 172.21.15.59:0/2685408177 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac037040 con 0x7fc2b815b820 2024-04-25T17:01:33.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.025+0000 7fc2b4ff9640 1 -- 172.21.15.59:0/2685408177 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ac030770 con 0x7fc2b815b820 2024-04-25T17:01:33.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.025+0000 7fc2be6bd640 1 -- 172.21.15.59:0/2685408177 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b81526b0 con 0x7fc2b815b820 2024-04-25T17:01:33.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.025+0000 7fc2b4ff9640 1 -- 172.21.15.59:0/2685408177 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac030b80 con 0x7fc2b815b820 2024-04-25T17:01:33.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.025+0000 7fc2be6bd640 1 -- 172.21.15.59:0/2685408177 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b8146a80 con 0x7fc2b815b820 2024-04-25T17:01:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.026+0000 7fc2be6bd640 1 -- 172.21.15.59:0/2685408177 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2b815e0b0 con 0x7fc2b815b820 2024-04-25T17:01:33.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.052+0000 7fc2b4ff9640 1 -- 172.21.15.59:0/2685408177 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc2ac044020 con 0x7fc2b815b820 2024-04-25T17:01:33.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.052+0000 7fc2b4ff9640 1 --2- 172.21.15.59:0/2685408177 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc2a40744b0 0x7fc2a40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:33.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.052+0000 7fc2b7fff640 1 --2- 172.21.15.59:0/2685408177 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc2a40744b0 0x7fc2a40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:33.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.053+0000 7fc2b7fff640 1 --2- 172.21.15.59:0/2685408177 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc2a40744b0 0x7fc2a40769c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8007fd0 tx=0x7fc2a8007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:33.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.058+0000 7fc2b4ff9640 1 -- 172.21.15.59:0/2685408177 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fc2ac030d20 con 0x7fc2b815b820 2024-04-25T17:01:33.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.351+0000 7fc2b4ff9640 1 -- 172.21.15.59:0/2685408177 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc2b815e0b0 con 0x7fc2b815b820 2024-04-25T17:01:33.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.539+0000 7fc2be6bd640 1 -- 172.21.15.59:0/2685408177 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc2b8069fb0 con 0x7fc2b815b820 2024-04-25T17:01:33.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.547+0000 7fc2b4ff9640 1 -- 172.21.15.59:0/2685408177 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fc2ac032e20 con 0x7fc2b815b820 2024-04-25T17:01:33.544 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T17:01:33.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.548+0000 7fc2be6bd640 1 -- 172.21.15.59:0/2685408177 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc2a40744b0 msgr2=0x7fc2a40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.548+0000 7fc2be6bd640 1 --2- 172.21.15.59:0/2685408177 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc2a40744b0 0x7fc2a40769c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8007fd0 tx=0x7fc2a8007e80 comp rx=0 tx=0).stop 2024-04-25T17:01:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.548+0000 7fc2be6bd640 1 -- 172.21.15.59:0/2685408177 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc2b815b820 msgr2=0x7fc2b814ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.548+0000 7fc2be6bd640 1 --2- 172.21.15.59:0/2685408177 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc2b815b820 0x7fc2b814ecc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac035040 tx=0x7fc2ac0046c0 comp rx=0 tx=0).stop 2024-04-25T17:01:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.548+0000 7fc2be6bd640 1 -- 172.21.15.59:0/2685408177 shutdown_connections 2024-04-25T17:01:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.548+0000 7fc2be6bd640 1 --2- 172.21.15.59:0/2685408177 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc2a40744b0 0x7fc2a40769c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.548+0000 7fc2be6bd640 1 --2- 172.21.15.59:0/2685408177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2b81f2c30 0x7fc2b814f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.548+0000 7fc2be6bd640 1 --2- 172.21.15.59:0/2685408177 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc2b815b820 0x7fc2b814ecc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.548+0000 7fc2be6bd640 1 --2- 172.21.15.59:0/2685408177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2b80b51b0 0x7fc2b80cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.548+0000 7fc2be6bd640 1 -- 172.21.15.59:0/2685408177 >> 172.21.15.59:0/2685408177 conn(0x7fc2b806c760 msgr2=0x7fc2b815c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.548+0000 7fc2be6bd640 1 -- 172.21.15.59:0/2685408177 shutdown_connections 2024-04-25T17:01:33.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.548+0000 7fc2be6bd640 1 -- 172.21.15.59:0/2685408177 wait complete. 2024-04-25T17:01:33.558 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T17:01:33.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.676+0000 7f7d0b0b6640 1 Processor -- start 2024-04-25T17:01:33.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.676+0000 7f7d0b0b6640 1 -- start start 2024-04-25T17:01:33.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.677+0000 7f7d0b0b6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d041565d0 0x7f7d040b5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:33.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.677+0000 7f7d0b0b6640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d040cf080 con 0x7f7d040c70b0 2024-04-25T17:01:33.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.677+0000 7f7d0b0b6640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d0415d030 con 0x7f7d04160810 2024-04-25T17:01:33.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.677+0000 7f7d0b0b6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f7d040b58d0 con 0x7f7d041565d0 2024-04-25T17:01:33.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.678+0000 7f7d09653640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d041565d0 0x7f7d040b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:33.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.678+0000 7f7cfbfff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7d040c70b0 0x7f7d040ce350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:49490/0 (socket says 172.21.15.59:49490) 2024-04-25T17:01:33.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.678+0000 7f7cfbfff640 1 -- 172.21.15.59:0/2702594307 learned_addr learned my addr 172.21.15.59:0/2702594307 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T17:01:33.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.681+0000 7f7cfb7fe640 1 -- 172.21.15.59:0/2702594307 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1556156833 0 0) 0x7f7d040cf080 con 0x7f7d040c70b0 2024-04-25T17:01:33.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.681+0000 7f7cfb7fe640 1 -- 172.21.15.59:0/2702594307 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cec003520 con 0x7f7d040c70b0 2024-04-25T17:01:33.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.681+0000 7f7d09653640 1 -- 172.21.15.59:0/2702594307 >> v1:172.21.15.64:6789/0 conn(0x7f7d04160810 legacy=0x7f7d0415c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:33.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.681+0000 7f7d09653640 1 -- 172.21.15.59:0/2702594307 >> v1:172.21.15.59:6789/0 conn(0x7f7d040c70b0 legacy=0x7f7d040ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:33.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.681+0000 7f7d09653640 1 -- 172.21.15.59:0/2702594307 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0415d310 con 0x7f7d041565d0 2024-04-25T17:01:33.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.684+0000 7f7d09653640 1 --2- 172.21.15.59:0/2702594307 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d041565d0 0x7f7d040b5390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7d040b5a50 tx=0x7f7cfc02a750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8fb61bb3bb04fb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:33.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.688+0000 7f7cfb7fe640 1 -- 172.21.15.59:0/2702594307 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc007740 con 0x7f7d041565d0 2024-04-25T17:01:33.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.688+0000 7f7cfb7fe640 1 -- 172.21.15.59:0/2702594307 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cfc0078e0 con 0x7f7d041565d0 2024-04-25T17:01:33.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.688+0000 7f7cfb7fe640 1 -- 172.21.15.59:0/2702594307 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc007cb0 con 0x7f7d041565d0 2024-04-25T17:01:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.689+0000 7f7d0b0b6640 1 -- 172.21.15.59:0/2702594307 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d041565d0 msgr2=0x7f7d040b5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.689+0000 7f7d0b0b6640 1 --2- 172.21.15.59:0/2702594307 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d041565d0 0x7f7d040b5390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7d040b5a50 tx=0x7f7cfc02a750 comp rx=0 tx=0).stop 2024-04-25T17:01:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.689+0000 7f7d0b0b6640 1 -- 172.21.15.59:0/2702594307 shutdown_connections 2024-04-25T17:01:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.689+0000 7f7d0b0b6640 1 --2- 172.21.15.59:0/2702594307 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d041565d0 0x7f7d040b5390 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.689+0000 7f7d0b0b6640 1 -- 172.21.15.59:0/2702594307 >> 172.21.15.59:0/2702594307 conn(0x7f7d040684e0 msgr2=0x7f7d040688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.689+0000 7f7d0b0b6640 1 -- 172.21.15.59:0/2702594307 shutdown_connections 2024-04-25T17:01:33.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.689+0000 7f7d0b0b6640 1 -- 172.21.15.59:0/2702594307 wait complete. 2024-04-25T17:01:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.691+0000 7f7d0b0b6640 1 Processor -- start 2024-04-25T17:01:33.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.691+0000 7f7d0b0b6640 1 -- start start 2024-04-25T17:01:33.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.692+0000 7f7d0b0b6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d040c70b0 0x7f7d041e9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:33.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.692+0000 7f7d0b0b6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d041565d0 0x7f7d0414d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:33.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.692+0000 7f7d0b0b6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d04160810 0x7f7d0414d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:33.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.692+0000 7f7d0b0b6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7d041602f0 con 0x7f7d041565d0 2024-04-25T17:01:33.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.692+0000 7f7d0b0b6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f7d04160010 con 0x7f7d04160810 2024-04-25T17:01:33.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.692+0000 7f7d0b0b6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f7d041569e0 con 0x7f7d040c70b0 2024-04-25T17:01:33.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.693+0000 7f7d08e52640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d040c70b0 0x7f7d041e9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:33.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.693+0000 7f7cfbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d041565d0 0x7f7d0414d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:33.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.693+0000 7f7d09653640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d04160810 0x7f7d0414d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:33.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.693+0000 7f7d08e52640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d040c70b0 0x7f7d041e9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:33228/0 (socket says 172.21.15.59:33228) 2024-04-25T17:01:33.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.693+0000 7f7d08e52640 1 -- 172.21.15.59:0/3847300719 learned_addr learned my addr 172.21.15.59:0/3847300719 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:33.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.697+0000 7f7cfbfff640 1 -- 172.21.15.59:0/3847300719 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d040c70b0 msgr2=0x7f7d041e9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:33.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.697+0000 7f7cfbfff640 1 --2- 172.21.15.59:0/3847300719 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d040c70b0 0x7f7d041e9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:33.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.697+0000 7f7cfbfff640 1 -- 172.21.15.59:0/3847300719 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d04160810 msgr2=0x7f7d0414d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:33.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.697+0000 7f7cfbfff640 1 --2- 172.21.15.59:0/3847300719 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d04160810 0x7f7d0414d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:33.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.697+0000 7f7cfbfff640 1 -- 172.21.15.59:0/3847300719 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d041517f0 con 0x7f7d041565d0 2024-04-25T17:01:33.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.700+0000 7f7cfbfff640 1 --2- 172.21.15.59:0/3847300719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d041565d0 0x7f7d0414d210 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7d040cf840 tx=0x7f7cf4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:33.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.704+0000 7f7cf97fa640 1 -- 172.21.15.59:0/3847300719 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4017070 con 0x7f7d041565d0 2024-04-25T17:01:33.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.704+0000 7f7cf97fa640 1 -- 172.21.15.59:0/3847300719 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf4005ce0 con 0x7f7d041565d0 2024-04-25T17:01:33.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.704+0000 7f7cf97fa640 1 -- 172.21.15.59:0/3847300719 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf40072f0 con 0x7f7d041565d0 2024-04-25T17:01:33.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.704+0000 7f7d0b0b6640 1 -- 172.21.15.59:0/3847300719 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d041f3320 con 0x7f7d041565d0 2024-04-25T17:01:33.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.704+0000 7f7d0b0b6640 1 -- 172.21.15.59:0/3847300719 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d041f2840 con 0x7f7d041565d0 2024-04-25T17:01:33.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:33.705+0000 7f7d0b0b6640 1 -- 172.21.15.59:0/3847300719 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d04069910 con 0x7f7d041565d0 2024-04-25T17:01:34.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.005+0000 7f7cf97fa640 1 -- 172.21.15.59:0/3847300719 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7cf401a070 con 0x7f7d041565d0 2024-04-25T17:01:34.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.005+0000 7f7cf97fa640 1 --2- 172.21.15.59:0/3847300719 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f7cf0074530 0x7f7cf0076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:34.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.005+0000 7f7d08e52640 1 --2- 172.21.15.59:0/3847300719 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f7cf0074530 0x7f7cf0076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:34.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.006+0000 7f7d08e52640 1 --2- 172.21.15.59:0/3847300719 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f7cf0074530 0x7f7cf0076a40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7d00001800 tx=0x7f7d00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:34.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.022+0000 7f7cf97fa640 1 -- 172.21.15.59:0/3847300719 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f7cf405ac70 con 0x7f7d041565d0 2024-04-25T17:01:34.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.022+0000 7f7cf97fa640 1 -- 172.21.15.59:0/3847300719 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7cf4021020 con 0x7f7d041565d0 2024-04-25T17:01:34.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.217+0000 7f7d0b0b6640 1 -- 172.21.15.59:0/3847300719 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7d040cbda0 con 0x7f7d041565d0 2024-04-25T17:01:34.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.277+0000 7f7cf97fa640 1 -- 172.21.15.59:0/3847300719 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f7cf4007e20 con 0x7f7d041565d0 2024-04-25T17:01:34.275 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T17:01:34.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.279+0000 7f7d0b0b6640 1 -- 172.21.15.59:0/3847300719 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f7cf0074530 msgr2=0x7f7cf0076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:34.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.279+0000 7f7d0b0b6640 1 --2- 172.21.15.59:0/3847300719 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f7cf0074530 0x7f7cf0076a40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7d00001800 tx=0x7f7d00009040 comp rx=0 tx=0).stop 2024-04-25T17:01:34.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.279+0000 7f7d0b0b6640 1 -- 172.21.15.59:0/3847300719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d041565d0 msgr2=0x7f7d0414d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:34.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.279+0000 7f7d0b0b6640 1 --2- 172.21.15.59:0/3847300719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d041565d0 0x7f7d0414d210 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7d040cf840 tx=0x7f7cf4001e70 comp rx=0 tx=0).stop 2024-04-25T17:01:34.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.280+0000 7f7d0b0b6640 1 -- 172.21.15.59:0/3847300719 shutdown_connections 2024-04-25T17:01:34.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.280+0000 7f7d0b0b6640 1 --2- 172.21.15.59:0/3847300719 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f7cf0074530 0x7f7cf0076a40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:34.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.280+0000 7f7d0b0b6640 1 --2- 172.21.15.59:0/3847300719 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d04160810 0x7f7d0414d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:34.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.280+0000 7f7d0b0b6640 1 --2- 172.21.15.59:0/3847300719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d041565d0 0x7f7d0414d210 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:34.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.280+0000 7f7d0b0b6640 1 --2- 172.21.15.59:0/3847300719 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d040c70b0 0x7f7d041e9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:34.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.280+0000 7f7d0b0b6640 1 -- 172.21.15.59:0/3847300719 >> 172.21.15.59:0/3847300719 conn(0x7f7d040684e0 msgr2=0x7f7d040b5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:34.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.280+0000 7f7d0b0b6640 1 -- 172.21.15.59:0/3847300719 shutdown_connections 2024-04-25T17:01:34.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.280+0000 7f7d0b0b6640 1 -- 172.21.15.59:0/3847300719 wait complete. 2024-04-25T17:01:34.290 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T17:01:34.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.407+0000 7fd7c9e13640 1 Processor -- start 2024-04-25T17:01:34.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.407+0000 7fd7c9e13640 1 -- start start 2024-04-25T17:01:34.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.408+0000 7fd7c9e13640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd7c4156a70 0x7fd7c40c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:34.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.408+0000 7fd7c9e13640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd7c4164e70 0x7fd7c4167290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:34.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.408+0000 7fd7c9e13640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7c40ca290 con 0x7fd7c40ca500 2024-04-25T17:01:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.408+0000 7fd7c9e13640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fd7c408d7c0 con 0x7fd7c4156a70 2024-04-25T17:01:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.408+0000 7fd7c9e13640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c415d1c0 con 0x7fd7c4164e70 2024-04-25T17:01:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.409+0000 7fd7c2ffd640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd7c40ca500 0x7fd7c406e0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48092/0 (socket says 172.21.15.59:48092) 2024-04-25T17:01:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.409+0000 7fd7c2ffd640 1 -- 172.21.15.59:0/1222102718 learned_addr learned my addr 172.21.15.59:0/1222102718 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T17:01:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.409+0000 7fd7c3fff640 1 --2- 172.21.15.59:0/1222102718 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd7c4164e70 0x7fd7c4167290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:34.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.409+0000 7fd7c37fe640 1 --2- 172.21.15.59:0/1222102718 >> v2:172.21.15.64:3300/0 conn(0x7fd7c4156a70 0x7fd7c40c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:34.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.412+0000 7fd7c27fc640 1 -- 172.21.15.59:0/1222102718 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2920376541 0 0) 0x7fd7c40ca290 con 0x7fd7c40ca500 2024-04-25T17:01:34.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.412+0000 7fd7c27fc640 1 -- 172.21.15.59:0/1222102718 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7ac003520 con 0x7fd7c40ca500 2024-04-25T17:01:34.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.413+0000 7fd7c3fff640 1 -- 172.21.15.59:0/1222102718 >> v2:172.21.15.64:3300/0 conn(0x7fd7c4156a70 msgr2=0x7fd7c40c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:34.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.413+0000 7fd7c3fff640 1 --2- 172.21.15.59:0/1222102718 >> v2:172.21.15.64:3300/0 conn(0x7fd7c4156a70 0x7fd7c40c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:34.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.413+0000 7fd7c3fff640 1 -- 172.21.15.59:0/1222102718 >> v1:172.21.15.59:6789/0 conn(0x7fd7c40ca500 legacy=0x7fd7c406e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:34.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.413+0000 7fd7c3fff640 1 -- 172.21.15.59:0/1222102718 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c4070cf0 con 0x7fd7c4164e70 2024-04-25T17:01:34.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.417+0000 7fd7c3fff640 1 --2- 172.21.15.59:0/1222102718 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd7c4164e70 0x7fd7c4167290 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009d90 tx=0x7fd7bc02a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2720f2d32bfd25c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:34.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.421+0000 7fd7c27fc640 1 -- 172.21.15.59:0/1222102718 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc007740 con 0x7fd7c4164e70 2024-04-25T17:01:34.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.421+0000 7fd7c27fc640 1 -- 172.21.15.59:0/1222102718 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7bc0078e0 con 0x7fd7c4164e70 2024-04-25T17:01:34.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.421+0000 7fd7c27fc640 1 -- 172.21.15.59:0/1222102718 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc007cb0 con 0x7fd7c4164e70 2024-04-25T17:01:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.422+0000 7fd7c9e13640 1 -- 172.21.15.59:0/1222102718 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd7c4164e70 msgr2=0x7fd7c4167290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.422+0000 7fd7c9e13640 1 --2- 172.21.15.59:0/1222102718 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd7c4164e70 0x7fd7c4167290 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009d90 tx=0x7fd7bc02a6f0 comp rx=0 tx=0).stop 2024-04-25T17:01:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.422+0000 7fd7c9e13640 1 -- 172.21.15.59:0/1222102718 shutdown_connections 2024-04-25T17:01:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.422+0000 7fd7c9e13640 1 --2- 172.21.15.59:0/1222102718 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd7c4164e70 0x7fd7c4167290 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.422+0000 7fd7c9e13640 1 --2- 172.21.15.59:0/1222102718 >> v2:172.21.15.64:3300/0 conn(0x7fd7c4156a70 0x7fd7c40c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.422+0000 7fd7c9e13640 1 -- 172.21.15.59:0/1222102718 >> 172.21.15.59:0/1222102718 conn(0x7fd7c4068ed0 msgr2=0x7fd7c4073110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.422+0000 7fd7c9e13640 1 -- 172.21.15.59:0/1222102718 shutdown_connections 2024-04-25T17:01:34.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.422+0000 7fd7c9e13640 1 -- 172.21.15.59:0/1222102718 wait complete. 2024-04-25T17:01:34.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.423+0000 7fd7c9e13640 1 Processor -- start 2024-04-25T17:01:34.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.424+0000 7fd7c9e13640 1 -- start start 2024-04-25T17:01:34.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.425+0000 7fd7c9e13640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd7c40ca500 0x7fd7c41f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:34.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.425+0000 7fd7c9e13640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7c4156a70 0x7fd7c415a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:34.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.425+0000 7fd7c9e13640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7c4164e70 0x7fd7c414f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:34.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.425+0000 7fd7c9e13640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c4071590 con 0x7fd7c4156a70 2024-04-25T17:01:34.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.425+0000 7fd7c9e13640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c40712b0 con 0x7fd7c4164e70 2024-04-25T17:01:34.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.425+0000 7fd7c9e13640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c415d480 con 0x7fd7c40ca500 2024-04-25T17:01:34.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.426+0000 7fd7c2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7c4156a70 0x7fd7c415a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:34.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.426+0000 7fd7c37fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd7c40ca500 0x7fd7c41f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:34.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.426+0000 7fd7c3fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7c4164e70 0x7fd7c414f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:34.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.426+0000 7fd7c2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7c4156a70 0x7fd7c415a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43232/0 (socket says 172.21.15.59:43232) 2024-04-25T17:01:34.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.426+0000 7fd7c2ffd640 1 -- 172.21.15.59:0/1552630404 learned_addr learned my addr 172.21.15.59:0/1552630404 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:34.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.430+0000 7fd7c2ffd640 1 -- 172.21.15.59:0/1552630404 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd7c40ca500 msgr2=0x7fd7c41f3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:34.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.430+0000 7fd7c2ffd640 1 --2- 172.21.15.59:0/1552630404 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd7c40ca500 0x7fd7c41f3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:34.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.430+0000 7fd7c2ffd640 1 -- 172.21.15.59:0/1552630404 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7c4164e70 msgr2=0x7fd7c414f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:34.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.430+0000 7fd7c2ffd640 1 --2- 172.21.15.59:0/1552630404 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7c4164e70 0x7fd7c414f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:34.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.430+0000 7fd7c2ffd640 1 -- 172.21.15.59:0/1552630404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c415adb0 con 0x7fd7c4156a70 2024-04-25T17:01:34.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.433+0000 7fd7c2ffd640 1 --2- 172.21.15.59:0/1552630404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7c4156a70 0x7fd7c415a870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800c3c0 tx=0x7fd7b800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.437+0000 7fd7abfff640 1 -- 172.21.15.59:0/1552630404 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8017070 con 0x7fd7c4156a70 2024-04-25T17:01:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.437+0000 7fd7abfff640 1 -- 172.21.15.59:0/1552630404 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b8005ce0 con 0x7fd7c4156a70 2024-04-25T17:01:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.437+0000 7fd7c9e13640 1 -- 172.21.15.59:0/1552630404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c415be50 con 0x7fd7c4156a70 2024-04-25T17:01:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.437+0000 7fd7abfff640 1 -- 172.21.15.59:0/1552630404 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b80072f0 con 0x7fd7c4156a70 2024-04-25T17:01:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.437+0000 7fd7c9e13640 1 -- 172.21.15.59:0/1552630404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c415c410 con 0x7fd7c4156a70 2024-04-25T17:01:34.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.438+0000 7fd7c9e13640 1 -- 172.21.15.59:0/1552630404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c4069910 con 0x7fd7c4156a70 2024-04-25T17:01:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.462+0000 7fd7abfff640 1 -- 172.21.15.59:0/1552630404 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd7b801a070 con 0x7fd7c4156a70 2024-04-25T17:01:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.463+0000 7fd7abfff640 1 --2- 172.21.15.59:0/1552630404 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd7b00744e0 0x7fd7b00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:34.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.463+0000 7fd7c37fe640 1 --2- 172.21.15.59:0/1552630404 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd7b00744e0 0x7fd7b00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:34.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.463+0000 7fd7c37fe640 1 --2- 172.21.15.59:0/1552630404 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd7b00744e0 0x7fd7b00769f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009aa0 tx=0x7fd7b4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:34.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.750+0000 7fd7abfff640 1 -- 172.21.15.59:0/1552630404 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fd7b805ad60 con 0x7fd7c4156a70 2024-04-25T17:01:34.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.750+0000 7fd7abfff640 1 -- 172.21.15.59:0/1552630404 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd7b8021020 con 0x7fd7c4156a70 2024-04-25T17:01:34.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.951+0000 7fd7c9e13640 1 -- 172.21.15.59:0/1552630404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd7c40c4630 con 0x7fd7c4156a70 2024-04-25T17:01:34.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.957+0000 7fd7abfff640 1 -- 172.21.15.59:0/1552630404 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fd7b8067110 con 0x7fd7c4156a70 2024-04-25T17:01:34.955 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-04-25T17:01:34.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.959+0000 7fd7c9e13640 1 -- 172.21.15.59:0/1552630404 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd7b00744e0 msgr2=0x7fd7b00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:34.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.959+0000 7fd7c9e13640 1 --2- 172.21.15.59:0/1552630404 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd7b00744e0 0x7fd7b00769f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009aa0 tx=0x7fd7b4009190 comp rx=0 tx=0).stop 2024-04-25T17:01:34.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.959+0000 7fd7c9e13640 1 -- 172.21.15.59:0/1552630404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7c4156a70 msgr2=0x7fd7c415a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:34.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.959+0000 7fd7c9e13640 1 --2- 172.21.15.59:0/1552630404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7c4156a70 0x7fd7c415a870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800c3c0 tx=0x7fd7b800c880 comp rx=0 tx=0).stop 2024-04-25T17:01:34.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.959+0000 7fd7c9e13640 1 -- 172.21.15.59:0/1552630404 shutdown_connections 2024-04-25T17:01:34.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.959+0000 7fd7c9e13640 1 --2- 172.21.15.59:0/1552630404 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd7b00744e0 0x7fd7b00769f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:34.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.959+0000 7fd7c9e13640 1 --2- 172.21.15.59:0/1552630404 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7c4164e70 0x7fd7c414f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:34.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.959+0000 7fd7c9e13640 1 --2- 172.21.15.59:0/1552630404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7c4156a70 0x7fd7c415a870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:34.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.959+0000 7fd7c9e13640 1 --2- 172.21.15.59:0/1552630404 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd7c40ca500 0x7fd7c41f3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:34.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.959+0000 7fd7c9e13640 1 -- 172.21.15.59:0/1552630404 >> 172.21.15.59:0/1552630404 conn(0x7fd7c4068ed0 msgr2=0x7fd7c41557f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:34.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.959+0000 7fd7c9e13640 1 -- 172.21.15.59:0/1552630404 shutdown_connections 2024-04-25T17:01:34.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:34.959+0000 7fd7c9e13640 1 -- 172.21.15.59:0/1552630404 wait complete. 2024-04-25T17:01:34.969 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T17:01:34.969 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T17:01:34.985 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T17:01:35.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.139+0000 7f581c79d640 1 Processor -- start 2024-04-25T17:01:35.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.139+0000 7f581c79d640 1 -- start start 2024-04-25T17:01:35.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.141+0000 7f581c79d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f581415a1d0 0x7f58141542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:35.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.141+0000 7f581c79d640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581415a810 con 0x7f58140c4550 2024-04-25T17:01:35.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.141+0000 7f581c79d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581415aaf0 con 0x7f58140cfba0 2024-04-25T17:01:35.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.141+0000 7f581c79d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f581415a5e0 con 0x7f581415a1d0 2024-04-25T17:01:35.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.142+0000 7f5819d38640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f581415a1d0 0x7f58141542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:35.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.142+0000 7f581ad3a640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f58140cfba0 0x7f5814164b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.59:59256/0 (socket says 172.21.15.59:59256) 2024-04-25T17:01:35.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.142+0000 7f581ad3a640 1 -- 172.21.15.59:0/1812379664 learned_addr learned my addr 172.21.15.59:0/1812379664 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T17:01:35.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.145+0000 7f5819537640 1 -- 172.21.15.59:0/1812379664 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1369494481 0 0) 0x7f581415aaf0 con 0x7f58140cfba0 2024-04-25T17:01:35.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.145+0000 7f5819537640 1 -- 172.21.15.59:0/1812379664 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5800003520 con 0x7f58140cfba0 2024-04-25T17:01:35.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.145+0000 7f5819d38640 1 -- 172.21.15.59:0/1812379664 >> v1:172.21.15.64:6789/0 conn(0x7f58140cfba0 legacy=0x7f5814164b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:35.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.145+0000 7f5819d38640 1 -- 172.21.15.59:0/1812379664 >> v1:172.21.15.59:6789/0 conn(0x7f58140c4550 legacy=0x7f581415e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:35.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.145+0000 7f5819d38640 1 -- 172.21.15.59:0/1812379664 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581415add0 con 0x7f581415a1d0 2024-04-25T17:01:35.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.147+0000 7f5819d38640 1 --2- 172.21.15.59:0/1812379664 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f581415a1d0 0x7f58141542b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f58100097d0 tx=0x7f581002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad6814ab62ac7b23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:35.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.152+0000 7f5819537640 1 -- 172.21.15.59:0/1812379664 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5810037070 con 0x7f581415a1d0 2024-04-25T17:01:35.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.152+0000 7f5819537640 1 -- 172.21.15.59:0/1812379664 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5810032440 con 0x7f581415a1d0 2024-04-25T17:01:35.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.152+0000 7f5819537640 1 -- 172.21.15.59:0/1812379664 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58100327f0 con 0x7f581415a1d0 2024-04-25T17:01:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.153+0000 7f581c79d640 1 -- 172.21.15.59:0/1812379664 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f581415a1d0 msgr2=0x7f58141542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.153+0000 7f581c79d640 1 --2- 172.21.15.59:0/1812379664 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f581415a1d0 0x7f58141542b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f58100097d0 tx=0x7f581002a250 comp rx=0 tx=0).stop 2024-04-25T17:01:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.153+0000 7f581c79d640 1 -- 172.21.15.59:0/1812379664 shutdown_connections 2024-04-25T17:01:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.153+0000 7f581c79d640 1 --2- 172.21.15.59:0/1812379664 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f581415a1d0 0x7f58141542b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.153+0000 7f581c79d640 1 -- 172.21.15.59:0/1812379664 >> 172.21.15.59:0/1812379664 conn(0x7f581406c9a0 msgr2=0x7f581406cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.153+0000 7f581c79d640 1 -- 172.21.15.59:0/1812379664 shutdown_connections 2024-04-25T17:01:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.153+0000 7f581c79d640 1 -- 172.21.15.59:0/1812379664 wait complete. 2024-04-25T17:01:35.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.155+0000 7f581c79d640 1 Processor -- start 2024-04-25T17:01:35.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.155+0000 7f581c79d640 1 -- start start 2024-04-25T17:01:35.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.156+0000 7f581c79d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58140c4550 0x7f581406da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:35.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.156+0000 7f581c79d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f58140cfba0 0x7f58141e7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:35.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.156+0000 7f581c79d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f581415a1d0 0x7f581415cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:35.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.156+0000 7f581c79d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f58140b2490 con 0x7f581415a1d0 2024-04-25T17:01:35.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.156+0000 7f581c79d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f581415e770 con 0x7f58140c4550 2024-04-25T17:01:35.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.156+0000 7f581c79d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f581415d860 con 0x7f58140cfba0 2024-04-25T17:01:35.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.157+0000 7f5819d38640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f58140cfba0 0x7f58141e7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:35.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.157+0000 7f581a539640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58140c4550 0x7f581406da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:35.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.157+0000 7f5819d38640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f58140cfba0 0x7f58141e7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:59944/0 (socket says 172.21.15.59:59944) 2024-04-25T17:01:35.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.157+0000 7f5819d38640 1 -- 172.21.15.59:0/1432820005 learned_addr learned my addr 172.21.15.59:0/1432820005 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:35.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.161+0000 7f5819d38640 1 -- 172.21.15.59:0/1432820005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58140c4550 msgr2=0x7f581406da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:35.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.161+0000 7f5819d38640 1 --2- 172.21.15.59:0/1432820005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58140c4550 0x7f581406da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:35.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.161+0000 7f5819d38640 1 -- 172.21.15.59:0/1432820005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f581415a1d0 msgr2=0x7f581415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:35.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.161+0000 7f5819d38640 1 --2- 172.21.15.59:0/1432820005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f581415a1d0 0x7f581415cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:35.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.161+0000 7f5819d38640 1 -- 172.21.15.59:0/1432820005 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5814076860 con 0x7f58140cfba0 2024-04-25T17:01:35.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.164+0000 7f5819d38640 1 --2- 172.21.15.59:0/1432820005 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f58140cfba0 0x7f58141e7010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5810035040 tx=0x7f58100046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:35.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.169+0000 7f580affd640 1 -- 172.21.15.59:0/1432820005 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5810037050 con 0x7f58140cfba0 2024-04-25T17:01:35.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.169+0000 7f580affd640 1 -- 172.21.15.59:0/1432820005 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5810043070 con 0x7f58140cfba0 2024-04-25T17:01:35.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.169+0000 7f581c79d640 1 -- 172.21.15.59:0/1432820005 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f581406dfb0 con 0x7f58140cfba0 2024-04-25T17:01:35.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.169+0000 7f580affd640 1 -- 172.21.15.59:0/1432820005 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58100044e0 con 0x7f58140cfba0 2024-04-25T17:01:35.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.169+0000 7f581c79d640 1 -- 172.21.15.59:0/1432820005 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f581415bd00 con 0x7f58140cfba0 2024-04-25T17:01:35.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.170+0000 7f581c79d640 1 -- 172.21.15.59:0/1432820005 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f581415b770 con 0x7f58140cfba0 2024-04-25T17:01:35.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.475+0000 7f580affd640 1 -- 172.21.15.59:0/1432820005 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5810032a50 con 0x7f58140cfba0 2024-04-25T17:01:35.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.476+0000 7f580affd640 1 --2- 172.21.15.59:0/1432820005 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f57f8074500 0x7f57f8076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:35.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.476+0000 7f581a539640 1 --2- 172.21.15.59:0/1432820005 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f57f8074500 0x7f57f8076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:35.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.476+0000 7f581a539640 1 --2- 172.21.15.59:0/1432820005 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f57f8074500 0x7f57f8076a10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5804006fd0 tx=0x7f5804009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.481+0000 7f580affd640 1 -- 172.21.15.59:0/1432820005 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f581003fb80 con 0x7f58140cfba0 2024-04-25T17:01:35.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.492+0000 7f580affd640 1 -- 172.21.15.59:0/1432820005 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5814076860 con 0x7f58140cfba0 2024-04-25T17:01:35.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.698+0000 7f581c79d640 1 -- 172.21.15.59:0/1432820005 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5814069fb0 con 0x7f58140cfba0 2024-04-25T17:01:35.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.835+0000 7f580affd640 1 -- 172.21.15.59:0/1432820005 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16795 (secure 0 0 0) 0x7f5810081290 con 0x7f58140cfba0 2024-04-25T17:01:35.834 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T17:01:35.834 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"9bb5d7ca-5217-467b-882c-0a18cd57f08f","created":"2024-04-25T15:46:00.198001+0000","modified":"2024-04-25T15:47:08.715345+0000","last_up_change":"2024-04-25T15:46:15.850827+0000","last_in_change":"2024-04-25T15:46:06.311980+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:46:16.936340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:30.174141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:31.372481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34cee654-11dd-4f4b-99fe-093462f8abad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6803","nonce":1314235095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6805","nonce":1314235095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6809","nonce":1314235095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6807","nonce":1314235095}]},"public_addr":"172.21.15.59:6803/1314235095","cluster_addr":"172.21.15.59:6805/1314235095","heartbeat_back_addr":"172.21.15.59:6809/1314235095","heartbeat_front_addr":"172.21.15.59:6807/1314235095","state":["exists","up"]},{"osd":1,"uuid":"3c15505b-4abd-4a24-b30c-edc2732f8ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6827","nonce":3550810151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6829","nonce":3550810151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6833","nonce":3550810151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6831","nonce":3550810151}]},"public_addr":"172.21.15.59:6827/3550810151","cluster_addr":"172.21.15.59:6829/3550810151","heartbeat_back_addr":"172.21.15.59:6833/3550810151","heartbeat_front_addr":"172.21.15.59:6831/3550810151","state":["exists","up"]},{"osd":2,"uuid":"5884bf21-e6b4-4813-b8bc-6baa92443c87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6811","nonce":1651189093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6813","nonce":1651189093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6817","nonce":1651189093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6815","nonce":1651189093}]},"public_addr":"172.21.15.59:6811/1651189093","cluster_addr":"172.21.15.59:6813/1651189093","heartbeat_back_addr":"172.21.15.59:6817/1651189093","heartbeat_front_addr":"172.21.15.59:6815/1651189093","state":["exists","up"]},{"osd":3,"uuid":"6ff71700-3b00-4350-b3c9-f6c41ec46b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6819","nonce":1300858236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6821","nonce":1300858236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6825","nonce":1300858236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6823","nonce":1300858236}]},"public_addr":"172.21.15.59:6819/1300858236","cluster_addr":"172.21.15.59:6821/1300858236","heartbeat_back_addr":"172.21.15.59:6825/1300858236","heartbeat_front_addr":"172.21.15.59:6823/1300858236","state":["exists","up"]},{"osd":4,"uuid":"d0a72143-93fd-4712-aadb-f3fade303426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6817","nonce":2206186554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6819","nonce":2206186554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6823","nonce":2206186554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6821","nonce":2206186554}]},"public_addr":"172.21.15.64:6817/2206186554","cluster_addr":"172.21.15.64:6819/2206186554","heartbeat_back_addr":"172.21.15.64:6823/2206186554","heartbeat_front_addr":"172.21.15.64:6821/2206186554","state":["exists","up"]},{"osd":5,"uuid":"9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6825","nonce":639697697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6827","nonce":639697697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6831","nonce":639697697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6829","nonce":639697697}]},"public_addr":"172.21.15.64:6825/639697697","cluster_addr":"172.21.15.64:6827/639697697","heartbeat_back_addr":"172.21.15.64:6831/639697697","heartbeat_front_addr":"172.21.15.64:6829/639697697","state":["exists","up"]},{"osd":6,"uuid":"311d9a6b-8fbc-4809-8d33-b9248a3562f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6809","nonce":2335675289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6811","nonce":2335675289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6815","nonce":2335675289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6813","nonce":2335675289}]},"public_addr":"172.21.15.64:6809/2335675289","cluster_addr":"172.21.15.64:6811/2335675289","heartbeat_back_addr":"172.21.15.64:6815/2335675289","heartbeat_front_addr":"172.21.15.64:6813/2335675289","state":["exists","up"]},{"osd":7,"uuid":"d0f7436e-882f-4aa7-b2ae-684b9894b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6801","nonce":970439753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6803","nonce":970439753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6807","nonce":970439753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6805","nonce":970439753}]},"public_addr":"172.21.15.64:6801/970439753","cluster_addr":"172.21.15.64:6803/970439753","heartbeat_back_addr":"172.21.15.64:6807/970439753","heartbeat_front_addr":"172.21.15.64:6805/970439753","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.807777+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.945589+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.926832+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.943537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.925062+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.957550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.913559+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.839159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T17:01:35.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.837+0000 7f581c79d640 1 -- 172.21.15.59:0/1432820005 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f57f8074500 msgr2=0x7f57f8076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:35.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.837+0000 7f581c79d640 1 --2- 172.21.15.59:0/1432820005 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f57f8074500 0x7f57f8076a10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5804006fd0 tx=0x7f5804009060 comp rx=0 tx=0).stop 2024-04-25T17:01:35.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.837+0000 7f581c79d640 1 -- 172.21.15.59:0/1432820005 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f58140cfba0 msgr2=0x7f58141e7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:35.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.837+0000 7f581c79d640 1 --2- 172.21.15.59:0/1432820005 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f58140cfba0 0x7f58141e7010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5810035040 tx=0x7f58100046c0 comp rx=0 tx=0).stop 2024-04-25T17:01:35.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.837+0000 7f581c79d640 1 -- 172.21.15.59:0/1432820005 shutdown_connections 2024-04-25T17:01:35.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.837+0000 7f581c79d640 1 --2- 172.21.15.59:0/1432820005 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f57f8074500 0x7f57f8076a10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:35.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.837+0000 7f581c79d640 1 --2- 172.21.15.59:0/1432820005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f581415a1d0 0x7f581415cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:35.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.837+0000 7f581c79d640 1 --2- 172.21.15.59:0/1432820005 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f58140cfba0 0x7f58141e7010 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:35.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.837+0000 7f581c79d640 1 --2- 172.21.15.59:0/1432820005 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58140c4550 0x7f581406da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:35.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.837+0000 7f581c79d640 1 -- 172.21.15.59:0/1432820005 >> 172.21.15.59:0/1432820005 conn(0x7f581406c9a0 msgr2=0x7f58140c6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:35.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.838+0000 7f581c79d640 1 -- 172.21.15.59:0/1432820005 shutdown_connections 2024-04-25T17:01:35.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.838+0000 7f581c79d640 1 -- 172.21.15.59:0/1432820005 wait complete. 2024-04-25T17:01:35.848 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:46:16.936340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:46:30.174141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:46:31.372481+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T17:01:35.849 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T17:01:35.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.966+0000 7f9c4a0ee640 1 Processor -- start 2024-04-25T17:01:35.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.966+0000 7f9c4a0ee640 1 -- start start 2024-04-25T17:01:35.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.967+0000 7f9c4a0ee640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9c440ca500 0x7f9c4406e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:35.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.967+0000 7f9c4a0ee640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c440ca290 con 0x7f9c4406e5e0 2024-04-25T17:01:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.967+0000 7f9c4a0ee640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c4408d7c0 con 0x7f9c44156a70 2024-04-25T17:01:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.967+0000 7f9c4a0ee640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f9c440c5800 con 0x7f9c440ca500 2024-04-25T17:01:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.968+0000 7f9c43fff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9c4406e5e0 0x7f9c44166e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48108/0 (socket says 172.21.15.59:48108) 2024-04-25T17:01:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.968+0000 7f9c43fff640 1 -- 172.21.15.59:0/2589096253 learned_addr learned my addr 172.21.15.59:0/2589096253 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T17:01:35.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.968+0000 7f9c42ffd640 1 --2- 172.21.15.59:0/2589096253 >> v2:172.21.15.64:3300/0 conn(0x7f9c440ca500 0x7f9c4406e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:35.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.971+0000 7f9c427fc640 1 -- 172.21.15.59:0/2589096253 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 457921089 0 0) 0x7f9c440ca290 con 0x7f9c4406e5e0 2024-04-25T17:01:35.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.971+0000 7f9c427fc640 1 -- 172.21.15.59:0/2589096253 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c2c003520 con 0x7f9c4406e5e0 2024-04-25T17:01:35.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.973+0000 7f9c42ffd640 1 -- 172.21.15.59:0/2589096253 >> v1:172.21.15.64:6789/0 conn(0x7f9c44156a70 legacy=0x7f9c440c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:35.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.973+0000 7f9c42ffd640 1 -- 172.21.15.59:0/2589096253 >> v1:172.21.15.59:6789/0 conn(0x7f9c4406e5e0 legacy=0x7f9c44166e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:35.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.973+0000 7f9c42ffd640 1 -- 172.21.15.59:0/2589096253 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4415d1c0 con 0x7f9c440ca500 2024-04-25T17:01:35.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.976+0000 7f9c42ffd640 1 --2- 172.21.15.59:0/2589096253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c440ca500 0x7f9c4406e0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9c380097a0 tx=0x7f9c3802a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7494ff6171c27683 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:35.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.980+0000 7f9c427fc640 1 -- 172.21.15.59:0/2589096253 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c38037070 con 0x7f9c440ca500 2024-04-25T17:01:35.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.980+0000 7f9c427fc640 1 -- 172.21.15.59:0/2589096253 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c38032640 con 0x7f9c440ca500 2024-04-25T17:01:35.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.980+0000 7f9c427fc640 1 -- 172.21.15.59:0/2589096253 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c38032a10 con 0x7f9c440ca500 2024-04-25T17:01:35.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.981+0000 7f9c4a0ee640 1 -- 172.21.15.59:0/2589096253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c440ca500 msgr2=0x7f9c4406e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:35.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.981+0000 7f9c4a0ee640 1 --2- 172.21.15.59:0/2589096253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c440ca500 0x7f9c4406e0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9c380097a0 tx=0x7f9c3802a2c0 comp rx=0 tx=0).stop 2024-04-25T17:01:35.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.981+0000 7f9c4a0ee640 1 -- 172.21.15.59:0/2589096253 shutdown_connections 2024-04-25T17:01:35.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.981+0000 7f9c4a0ee640 1 --2- 172.21.15.59:0/2589096253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c440ca500 0x7f9c4406e0a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:35.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.981+0000 7f9c4a0ee640 1 -- 172.21.15.59:0/2589096253 >> 172.21.15.59:0/2589096253 conn(0x7f9c44068ed0 msgr2=0x7f9c44073110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:35.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.981+0000 7f9c4a0ee640 1 -- 172.21.15.59:0/2589096253 shutdown_connections 2024-04-25T17:01:35.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.981+0000 7f9c4a0ee640 1 -- 172.21.15.59:0/2589096253 wait complete. 2024-04-25T17:01:35.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.983+0000 7f9c4a0ee640 1 Processor -- start 2024-04-25T17:01:35.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.983+0000 7f9c4a0ee640 1 -- start start 2024-04-25T17:01:35.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.984+0000 7f9c4a0ee640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c4406e5e0 0x7f9c441f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:35.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.984+0000 7f9c4a0ee640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c440ca500 0x7f9c4414e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:35.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.984+0000 7f9c4a0ee640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9c44156a70 0x7f9c441e5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:35.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.984+0000 7f9c4a0ee640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c440712b0 con 0x7f9c4406e5e0 2024-04-25T17:01:35.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.984+0000 7f9c4a0ee640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f9c44070fd0 con 0x7f9c440ca500 2024-04-25T17:01:35.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.984+0000 7f9c4a0ee640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f9c44071590 con 0x7f9c44156a70 2024-04-25T17:01:35.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.985+0000 7f9c437fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c4406e5e0 0x7f9c441f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:35.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.985+0000 7f9c43fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9c44156a70 0x7f9c441e5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:35.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.985+0000 7f9c42ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c440ca500 0x7f9c4414e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:35.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.985+0000 7f9c437fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c4406e5e0 0x7f9c441f5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43246/0 (socket says 172.21.15.59:43246) 2024-04-25T17:01:35.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.985+0000 7f9c437fe640 1 -- 172.21.15.59:0/1950744804 learned_addr learned my addr 172.21.15.59:0/1950744804 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:35.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.989+0000 7f9c437fe640 1 -- 172.21.15.59:0/1950744804 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9c44156a70 msgr2=0x7f9c441e5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:35.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.989+0000 7f9c437fe640 1 --2- 172.21.15.59:0/1950744804 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9c44156a70 0x7f9c441e5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:35.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.989+0000 7f9c437fe640 1 -- 172.21.15.59:0/1950744804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c440ca500 msgr2=0x7f9c4414e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:35.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.989+0000 7f9c437fe640 1 --2- 172.21.15.59:0/1950744804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c440ca500 0x7f9c4414e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:35.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.989+0000 7f9c437fe640 1 -- 172.21.15.59:0/1950744804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c441e6e40 con 0x7f9c4406e5e0 2024-04-25T17:01:35.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.992+0000 7f9c437fe640 1 --2- 172.21.15.59:0/1950744804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c4406e5e0 0x7f9c441f5f30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c370 tx=0x7f9c3400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:35.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.996+0000 7f9c2bfff640 1 -- 172.21.15.59:0/1950744804 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c34017070 con 0x7f9c4406e5e0 2024-04-25T17:01:35.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.996+0000 7f9c2bfff640 1 -- 172.21.15.59:0/1950744804 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c340052d0 con 0x7f9c4406e5e0 2024-04-25T17:01:35.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.996+0000 7f9c2bfff640 1 -- 172.21.15.59:0/1950744804 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c34003850 con 0x7f9c4406e5e0 2024-04-25T17:01:35.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.996+0000 7f9c4a0ee640 1 -- 172.21.15.59:0/1950744804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c441f6470 con 0x7f9c4406e5e0 2024-04-25T17:01:35.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.996+0000 7f9c4a0ee640 1 -- 172.21.15.59:0/1950744804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c441e79c0 con 0x7f9c4406e5e0 2024-04-25T17:01:35.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:35.997+0000 7f9c4a0ee640 1 -- 172.21.15.59:0/1950744804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c44069910 con 0x7f9c4406e5e0 2024-04-25T17:01:36.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.021+0000 7f9c2bfff640 1 -- 172.21.15.59:0/1950744804 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9c3401a070 con 0x7f9c4406e5e0 2024-04-25T17:01:36.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.022+0000 7f9c2bfff640 1 --2- 172.21.15.59:0/1950744804 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f9c30074530 0x7f9c30076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:36.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.022+0000 7f9c42ffd640 1 --2- 172.21.15.59:0/1950744804 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f9c30074530 0x7f9c30076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:36.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.022+0000 7f9c42ffd640 1 --2- 172.21.15.59:0/1950744804 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f9c30074530 0x7f9c30076a40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9c38034000 tx=0x7f9c3802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:36.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.027+0000 7f9c2bfff640 1 -- 172.21.15.59:0/1950744804 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f9c3405ac60 con 0x7f9c4406e5e0 2024-04-25T17:01:36.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.311+0000 7f9c2bfff640 1 -- 172.21.15.59:0/1950744804 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9c34021020 con 0x7f9c4406e5e0 2024-04-25T17:01:36.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.500+0000 7f9c4a0ee640 1 -- 172.21.15.59:0/1950744804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9c440c4630 con 0x7f9c4406e5e0 2024-04-25T17:01:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.508+0000 7f9c2bfff640 1 -- 172.21.15.59:0/1950744804 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f9c441e6e40 con 0x7f9c4406e5e0 2024-04-25T17:01:36.506 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T17:01:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.510+0000 7f9c4a0ee640 1 -- 172.21.15.59:0/1950744804 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f9c30074530 msgr2=0x7f9c30076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.510+0000 7f9c4a0ee640 1 --2- 172.21.15.59:0/1950744804 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f9c30074530 0x7f9c30076a40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9c38034000 tx=0x7f9c3802e000 comp rx=0 tx=0).stop 2024-04-25T17:01:36.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.510+0000 7f9c4a0ee640 1 -- 172.21.15.59:0/1950744804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c4406e5e0 msgr2=0x7f9c441f5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:36.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.510+0000 7f9c4a0ee640 1 --2- 172.21.15.59:0/1950744804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c4406e5e0 0x7f9c441f5f30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c370 tx=0x7f9c3400c830 comp rx=0 tx=0).stop 2024-04-25T17:01:36.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.510+0000 7f9c4a0ee640 1 -- 172.21.15.59:0/1950744804 shutdown_connections 2024-04-25T17:01:36.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.510+0000 7f9c4a0ee640 1 --2- 172.21.15.59:0/1950744804 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f9c30074530 0x7f9c30076a40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:36.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.510+0000 7f9c4a0ee640 1 --2- 172.21.15.59:0/1950744804 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9c44156a70 0x7f9c441e5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:36.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.510+0000 7f9c4a0ee640 1 --2- 172.21.15.59:0/1950744804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c440ca500 0x7f9c4414e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:36.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.510+0000 7f9c4a0ee640 1 --2- 172.21.15.59:0/1950744804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c4406e5e0 0x7f9c441f5f30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:36.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.510+0000 7f9c4a0ee640 1 -- 172.21.15.59:0/1950744804 >> 172.21.15.59:0/1950744804 conn(0x7f9c44068ed0 msgr2=0x7f9c44072f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:36.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.510+0000 7f9c4a0ee640 1 -- 172.21.15.59:0/1950744804 shutdown_connections 2024-04-25T17:01:36.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.510+0000 7f9c4a0ee640 1 -- 172.21.15.59:0/1950744804 wait complete. 2024-04-25T17:01:36.520 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T17:01:36.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.637+0000 7f8d8c2d9640 1 Processor -- start 2024-04-25T17:01:36.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.637+0000 7f8d8c2d9640 1 -- start start 2024-04-25T17:01:36.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.639+0000 7f8d8c2d9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8d840b6a20 0x7f8d8408d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:36.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.639+0000 7f8d8c2d9640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d8408d950 0x7f8d840b5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:36.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.639+0000 7f8d8c2d9640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d8415c5b0 con 0x7f8d840b5ad0 2024-04-25T17:01:36.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.639+0000 7f8d8c2d9640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f8d840b6e30 con 0x7f8d8408d950 2024-04-25T17:01:36.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.639+0000 7f8d8c2d9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f8d8415d480 con 0x7f8d840b6a20 2024-04-25T17:01:36.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.639+0000 7f8d89874640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d8408d950 0x7f8d840b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:36.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.640+0000 7f8d89874640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d8408d950 0x7f8d840b5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43254/0 (socket says 172.21.15.59:43254) 2024-04-25T17:01:36.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.640+0000 7f8d89874640 1 -- 172.21.15.59:0/2150828400 learned_addr learned my addr 172.21.15.59:0/2150828400 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:36.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.642+0000 7f8d89874640 1 -- 172.21.15.59:0/2150828400 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8d840b6a20 msgr2=0x7f8d8408d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:36.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.642+0000 7f8d89874640 1 --2- 172.21.15.59:0/2150828400 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8d840b6a20 0x7f8d8408d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:36.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.642+0000 7f8d89874640 1 -- 172.21.15.59:0/2150828400 >> v1:172.21.15.64:6789/0 conn(0x7f8d840b5ad0 legacy=0x7f8d8415fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:36.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.642+0000 7f8d89874640 1 -- 172.21.15.59:0/2150828400 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8415c870 con 0x7f8d8408d950 2024-04-25T17:01:36.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.644+0000 7f8d89874640 1 --2- 172.21.15.59:0/2150828400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8408d950 0x7f8d840b5590 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8d74009870 tx=0x7f8d7402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e6f322b72fa8e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:36.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.648+0000 7f8d89073640 1 -- 172.21.15.59:0/2150828400 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74037070 con 0x7f8d8408d950 2024-04-25T17:01:36.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.649+0000 7f8d89073640 1 -- 172.21.15.59:0/2150828400 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d74032440 con 0x7f8d8408d950 2024-04-25T17:01:36.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.649+0000 7f8d89073640 1 -- 172.21.15.59:0/2150828400 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74032810 con 0x7f8d8408d950 2024-04-25T17:01:36.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.649+0000 7f8d8c2d9640 1 -- 172.21.15.59:0/2150828400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8408d950 msgr2=0x7f8d840b5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:36.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.649+0000 7f8d8c2d9640 1 --2- 172.21.15.59:0/2150828400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8408d950 0x7f8d840b5590 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8d74009870 tx=0x7f8d7402a2a0 comp rx=0 tx=0).stop 2024-04-25T17:01:36.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.649+0000 7f8d8c2d9640 1 -- 172.21.15.59:0/2150828400 shutdown_connections 2024-04-25T17:01:36.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.649+0000 7f8d8c2d9640 1 --2- 172.21.15.59:0/2150828400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8408d950 0x7f8d840b5590 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:36.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.649+0000 7f8d8c2d9640 1 --2- 172.21.15.59:0/2150828400 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8d840b6a20 0x7f8d8408d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:36.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.649+0000 7f8d8c2d9640 1 -- 172.21.15.59:0/2150828400 >> 172.21.15.59:0/2150828400 conn(0x7f8d840684e0 msgr2=0x7f8d840688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:36.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.649+0000 7f8d8c2d9640 1 -- 172.21.15.59:0/2150828400 shutdown_connections 2024-04-25T17:01:36.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.649+0000 7f8d8c2d9640 1 -- 172.21.15.59:0/2150828400 wait complete. 2024-04-25T17:01:36.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.651+0000 7f8d8c2d9640 1 Processor -- start 2024-04-25T17:01:36.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.651+0000 7f8d8c2d9640 1 -- start start 2024-04-25T17:01:36.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.653+0000 7f8d8c2d9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8408d950 0x7f8d84152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:36.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.653+0000 7f8d8c2d9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8d840b5ad0 0x7f8d840ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:36.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.653+0000 7f8d8c2d9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d840b6a20 0x7f8d840ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:36.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.653+0000 7f8d8c2d9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8415d110 con 0x7f8d8408d950 2024-04-25T17:01:36.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.653+0000 7f8d8c2d9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8415ce30 con 0x7f8d840b6a20 2024-04-25T17:01:36.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.653+0000 7f8d8c2d9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f8d840b5ee0 con 0x7f8d840b5ad0 2024-04-25T17:01:36.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.653+0000 7f8d8a075640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8408d950 0x7f8d84152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:36.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.654+0000 7f8d8a075640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8408d950 0x7f8d84152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43268/0 (socket says 172.21.15.59:43268) 2024-04-25T17:01:36.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.654+0000 7f8d8a075640 1 -- 172.21.15.59:0/3938802786 learned_addr learned my addr 172.21.15.59:0/3938802786 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:36.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.657+0000 7f8d8a075640 1 -- 172.21.15.59:0/3938802786 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8d840b5ad0 msgr2=0x7f8d840ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:36.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.658+0000 7f8d8a075640 1 --2- 172.21.15.59:0/3938802786 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8d840b5ad0 0x7f8d840ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:36.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.658+0000 7f8d8a075640 1 -- 172.21.15.59:0/3938802786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d840b6a20 msgr2=0x7f8d840ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:36.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.658+0000 7f8d8a075640 1 --2- 172.21.15.59:0/3938802786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d840b6a20 0x7f8d840ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:36.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.658+0000 7f8d8a075640 1 -- 172.21.15.59:0/3938802786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d841f5be0 con 0x7f8d8408d950 2024-04-25T17:01:36.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.660+0000 7f8d8a075640 1 --2- 172.21.15.59:0/3938802786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8408d950 0x7f8d84152680 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8d8000b440 tx=0x7f8d8000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:36.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.664+0000 7f8d7affd640 1 -- 172.21.15.59:0/3938802786 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d80015020 con 0x7f8d8408d950 2024-04-25T17:01:36.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.664+0000 7f8d7affd640 1 -- 172.21.15.59:0/3938802786 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d80011890 con 0x7f8d8408d950 2024-04-25T17:01:36.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.664+0000 7f8d7affd640 1 -- 172.21.15.59:0/3938802786 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d80011c80 con 0x7f8d8408d950 2024-04-25T17:01:36.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.664+0000 7f8d8c2d9640 1 -- 172.21.15.59:0/3938802786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d841551e0 con 0x7f8d8408d950 2024-04-25T17:01:36.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.664+0000 7f8d8c2d9640 1 -- 172.21.15.59:0/3938802786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d841557a0 con 0x7f8d8408d950 2024-04-25T17:01:36.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.665+0000 7f8d8c2d9640 1 -- 172.21.15.59:0/3938802786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d84154fd0 con 0x7f8d8408d950 2024-04-25T17:01:36.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.689+0000 7f8d7affd640 1 -- 172.21.15.59:0/3938802786 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8d80018020 con 0x7f8d8408d950 2024-04-25T17:01:36.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.690+0000 7f8d7affd640 1 --2- 172.21.15.59:0/3938802786 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f8d68074500 0x7f8d68076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:36.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.690+0000 7f8d89874640 1 --2- 172.21.15.59:0/3938802786 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f8d68074500 0x7f8d68076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:36.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.690+0000 7f8d89874640 1 --2- 172.21.15.59:0/3938802786 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f8d68074500 0x7f8d68076a10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8d74034000 tx=0x7f8d7402c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:36.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.980+0000 7f8d7affd640 1 -- 172.21.15.59:0/3938802786 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f8d8005bca0 con 0x7f8d8408d950 2024-04-25T17:01:36.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:36.980+0000 7f8d7affd640 1 -- 172.21.15.59:0/3938802786 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8d8001f020 con 0x7f8d8408d950 2024-04-25T17:01:37.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.170+0000 7f8d8c2d9640 1 -- 172.21.15.59:0/3938802786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8d84069910 con 0x7f8d8408d950 2024-04-25T17:01:37.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.183+0000 7f8d7affd640 1 -- 172.21.15.59:0/3938802786 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f8d8000d040 con 0x7f8d8408d950 2024-04-25T17:01:37.181 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T17:01:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.185+0000 7f8d8c2d9640 1 -- 172.21.15.59:0/3938802786 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f8d68074500 msgr2=0x7f8d68076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.185+0000 7f8d8c2d9640 1 --2- 172.21.15.59:0/3938802786 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f8d68074500 0x7f8d68076a10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8d74034000 tx=0x7f8d7402c000 comp rx=0 tx=0).stop 2024-04-25T17:01:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.185+0000 7f8d8c2d9640 1 -- 172.21.15.59:0/3938802786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8408d950 msgr2=0x7f8d84152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.185+0000 7f8d8c2d9640 1 --2- 172.21.15.59:0/3938802786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8408d950 0x7f8d84152680 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8d8000b440 tx=0x7f8d8000b900 comp rx=0 tx=0).stop 2024-04-25T17:01:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.185+0000 7f8d8c2d9640 1 -- 172.21.15.59:0/3938802786 shutdown_connections 2024-04-25T17:01:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.185+0000 7f8d8c2d9640 1 --2- 172.21.15.59:0/3938802786 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f8d68074500 0x7f8d68076a10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.185+0000 7f8d8c2d9640 1 --2- 172.21.15.59:0/3938802786 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d840b6a20 0x7f8d840ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.185+0000 7f8d8c2d9640 1 --2- 172.21.15.59:0/3938802786 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8d840b5ad0 0x7f8d840ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.185+0000 7f8d8c2d9640 1 --2- 172.21.15.59:0/3938802786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8408d950 0x7f8d84152680 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.185+0000 7f8d8c2d9640 1 -- 172.21.15.59:0/3938802786 >> 172.21.15.59:0/3938802786 conn(0x7f8d840684e0 msgr2=0x7f8d8415a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.185+0000 7f8d8c2d9640 1 -- 172.21.15.59:0/3938802786 shutdown_connections 2024-04-25T17:01:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.185+0000 7f8d8c2d9640 1 -- 172.21.15.59:0/3938802786 wait complete. 2024-04-25T17:01:37.195 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T17:01:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.312+0000 7fd8388e0640 1 Processor -- start 2024-04-25T17:01:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.312+0000 7fd8388e0640 1 -- start start 2024-04-25T17:01:37.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.314+0000 7fd8388e0640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd834160810 0x7fd8341565d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:37.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.314+0000 7fd8388e0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd8340c70b0 0x7fd8340b5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:37.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.314+0000 7fd8388e0640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8340cf080 con 0x7fd83415c5a0 2024-04-25T17:01:37.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.314+0000 7fd8388e0640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fd8340b58d0 con 0x7fd834160810 2024-04-25T17:01:37.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.314+0000 7fd8388e0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd83415d030 con 0x7fd8340c70b0 2024-04-25T17:01:37.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.315+0000 7fd83259c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd834160810 0x7fd8341565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:37.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.315+0000 7fd831d9b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd8340c70b0 0x7fd8340b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:37.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.315+0000 7fd831d9b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd8340c70b0 0x7fd8340b5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:59990/0 (socket says 172.21.15.59:59990) 2024-04-25T17:01:37.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.315+0000 7fd831d9b640 1 -- 172.21.15.59:0/609961664 learned_addr learned my addr 172.21.15.59:0/609961664 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:37.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.318+0000 7fd831d9b640 1 -- 172.21.15.59:0/609961664 >> v2:172.21.15.59:3300/0 conn(0x7fd834160810 msgr2=0x7fd8341565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:37.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.318+0000 7fd831d9b640 1 --2- 172.21.15.59:0/609961664 >> v2:172.21.15.59:3300/0 conn(0x7fd834160810 0x7fd8341565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:37.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.318+0000 7fd831d9b640 1 -- 172.21.15.59:0/609961664 >> v1:172.21.15.59:6789/0 conn(0x7fd83415c5a0 legacy=0x7fd8340ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:37.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.318+0000 7fd831d9b640 1 -- 172.21.15.59:0/609961664 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83415d310 con 0x7fd8340c70b0 2024-04-25T17:01:37.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.320+0000 7fd831d9b640 1 --2- 172.21.15.59:0/609961664 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd8340c70b0 0x7fd8340b5390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009870 tx=0x7fd81c02a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbb7a0895a3e25b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.324+0000 7fd83159a640 1 -- 172.21.15.59:0/609961664 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c037070 con 0x7fd8340c70b0 2024-04-25T17:01:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.324+0000 7fd83159a640 1 -- 172.21.15.59:0/609961664 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd81c02ae50 con 0x7fd8340c70b0 2024-04-25T17:01:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.324+0000 7fd83159a640 1 -- 172.21.15.59:0/609961664 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c032860 con 0x7fd8340c70b0 2024-04-25T17:01:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.325+0000 7fd8388e0640 1 -- 172.21.15.59:0/609961664 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd8340c70b0 msgr2=0x7fd8340b5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.325+0000 7fd8388e0640 1 --2- 172.21.15.59:0/609961664 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd8340c70b0 0x7fd8340b5390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009870 tx=0x7fd81c02a300 comp rx=0 tx=0).stop 2024-04-25T17:01:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.325+0000 7fd8388e0640 1 -- 172.21.15.59:0/609961664 shutdown_connections 2024-04-25T17:01:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.325+0000 7fd8388e0640 1 --2- 172.21.15.59:0/609961664 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd8340c70b0 0x7fd8340b5390 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.325+0000 7fd8388e0640 1 --2- 172.21.15.59:0/609961664 >> v2:172.21.15.59:3300/0 conn(0x7fd834160810 0x7fd8341565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.325+0000 7fd8388e0640 1 -- 172.21.15.59:0/609961664 >> 172.21.15.59:0/609961664 conn(0x7fd8340684e0 msgr2=0x7fd8340688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.325+0000 7fd8388e0640 1 -- 172.21.15.59:0/609961664 shutdown_connections 2024-04-25T17:01:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.325+0000 7fd8388e0640 1 -- 172.21.15.59:0/609961664 wait complete. 2024-04-25T17:01:37.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.327+0000 7fd8388e0640 1 Processor -- start 2024-04-25T17:01:37.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.327+0000 7fd8388e0640 1 -- start start 2024-04-25T17:01:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.328+0000 7fd8388e0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd8340c70b0 0x7fd8341f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.328+0000 7fd8388e0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83415c5a0 0x7fd8341e6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.328+0000 7fd8388e0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd834160810 0x7fd834154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.328+0000 7fd8388e0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd8341602f0 con 0x7fd834160810 2024-04-25T17:01:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.328+0000 7fd8388e0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fd834160010 con 0x7fd83415c5a0 2024-04-25T17:01:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.328+0000 7fd8388e0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fd8340cea60 con 0x7fd8340c70b0 2024-04-25T17:01:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.329+0000 7fd832d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd834160810 0x7fd834154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.329+0000 7fd83259c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd8340c70b0 0x7fd8341f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.329+0000 7fd832d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd834160810 0x7fd834154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43274/0 (socket says 172.21.15.59:43274) 2024-04-25T17:01:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.329+0000 7fd832d9d640 1 -- 172.21.15.59:0/2356402416 learned_addr learned my addr 172.21.15.59:0/2356402416 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.329+0000 7fd831d9b640 1 --2- 172.21.15.59:0/2356402416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83415c5a0 0x7fd8341e6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.333+0000 7fd832d9d640 1 -- 172.21.15.59:0/2356402416 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd8340c70b0 msgr2=0x7fd8341f63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.333+0000 7fd832d9d640 1 --2- 172.21.15.59:0/2356402416 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd8340c70b0 0x7fd8341f63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.333+0000 7fd832d9d640 1 -- 172.21.15.59:0/2356402416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83415c5a0 msgr2=0x7fd8341e6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.333+0000 7fd832d9d640 1 --2- 172.21.15.59:0/2356402416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83415c5a0 0x7fd8341e6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.333+0000 7fd832d9d640 1 -- 172.21.15.59:0/2356402416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8341e7360 con 0x7fd834160810 2024-04-25T17:01:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.336+0000 7fd832d9d640 1 --2- 172.21.15.59:0/2356402416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd834160810 0x7fd834154540 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd82400c6b0 tx=0x7fd82400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:37.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.340+0000 7fd82affd640 1 -- 172.21.15.59:0/2356402416 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824003b70 con 0x7fd834160810 2024-04-25T17:01:37.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.340+0000 7fd82affd640 1 -- 172.21.15.59:0/2356402416 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd824003d30 con 0x7fd834160810 2024-04-25T17:01:37.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.340+0000 7fd8388e0640 1 -- 172.21.15.59:0/2356402416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd834155220 con 0x7fd834160810 2024-04-25T17:01:37.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.340+0000 7fd82affd640 1 -- 172.21.15.59:0/2356402416 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824005310 con 0x7fd834160810 2024-04-25T17:01:37.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.340+0000 7fd8388e0640 1 -- 172.21.15.59:0/2356402416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8340c96a0 con 0x7fd834160810 2024-04-25T17:01:37.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.341+0000 7fd8388e0640 1 -- 172.21.15.59:0/2356402416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd834069910 con 0x7fd834160810 2024-04-25T17:01:37.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.363+0000 7fd82affd640 1 -- 172.21.15.59:0/2356402416 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd8240054b0 con 0x7fd834160810 2024-04-25T17:01:37.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.364+0000 7fd82affd640 1 --2- 172.21.15.59:0/2356402416 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd814074500 0x7fd814076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:37.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.364+0000 7fd83259c640 1 --2- 172.21.15.59:0/2356402416 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd814074500 0x7fd814076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:37.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.364+0000 7fd83259c640 1 --2- 172.21.15.59:0/2356402416 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd814074500 0x7fd814076a10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd8340745a0 tx=0x7fd82c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:37.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.368+0000 7fd82affd640 1 -- 172.21.15.59:0/2356402416 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fd8240057a0 con 0x7fd834160810 2024-04-25T17:01:37.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.670+0000 7fd82affd640 1 -- 172.21.15.59:0/2356402416 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd82405fb80 con 0x7fd834160810 2024-04-25T17:01:37.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.855+0000 7fd8388e0640 1 -- 172.21.15.59:0/2356402416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd8340cbda0 con 0x7fd834160810 2024-04-25T17:01:37.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.862+0000 7fd82affd640 1 -- 172.21.15.59:0/2356402416 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7fd824063e80 con 0x7fd834160810 2024-04-25T17:01:37.860 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T17:01:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.864+0000 7fd8388e0640 1 -- 172.21.15.59:0/2356402416 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd814074500 msgr2=0x7fd814076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.864+0000 7fd8388e0640 1 --2- 172.21.15.59:0/2356402416 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd814074500 0x7fd814076a10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd8340745a0 tx=0x7fd82c009190 comp rx=0 tx=0).stop 2024-04-25T17:01:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.864+0000 7fd8388e0640 1 -- 172.21.15.59:0/2356402416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd834160810 msgr2=0x7fd834154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.864+0000 7fd8388e0640 1 --2- 172.21.15.59:0/2356402416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd834160810 0x7fd834154540 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd82400c6b0 tx=0x7fd82400cb70 comp rx=0 tx=0).stop 2024-04-25T17:01:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.864+0000 7fd8388e0640 1 -- 172.21.15.59:0/2356402416 shutdown_connections 2024-04-25T17:01:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.864+0000 7fd8388e0640 1 --2- 172.21.15.59:0/2356402416 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fd814074500 0x7fd814076a10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.864+0000 7fd8388e0640 1 --2- 172.21.15.59:0/2356402416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd834160810 0x7fd834154540 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.864+0000 7fd8388e0640 1 --2- 172.21.15.59:0/2356402416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd83415c5a0 0x7fd8341e6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.864+0000 7fd8388e0640 1 --2- 172.21.15.59:0/2356402416 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd8340c70b0 0x7fd8341f63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.864+0000 7fd8388e0640 1 -- 172.21.15.59:0/2356402416 >> 172.21.15.59:0/2356402416 conn(0x7fd8340684e0 msgr2=0x7fd8340ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.864+0000 7fd8388e0640 1 -- 172.21.15.59:0/2356402416 shutdown_connections 2024-04-25T17:01:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.864+0000 7fd8388e0640 1 -- 172.21.15.59:0/2356402416 wait complete. 2024-04-25T17:01:37.873 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T17:01:37.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.989+0000 7fc30edc7640 1 Processor -- start 2024-04-25T17:01:37.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.989+0000 7fc30edc7640 1 -- start start 2024-04-25T17:01:37.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.991+0000 7fc30edc7640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc308156930 0x7fc3080cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:37.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.991+0000 7fc30edc7640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc3080cfee0 0x7fc30815c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:37.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.991+0000 7fc30edc7640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3080cb3d0 con 0x7fc30806f420 2024-04-25T17:01:37.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.991+0000 7fc30edc7640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fc3080cb690 con 0x7fc308156930 2024-04-25T17:01:37.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.991+0000 7fc30edc7640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fc308156d40 con 0x7fc3080cfee0 2024-04-25T17:01:37.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.991+0000 7fc30d364640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc3080cfee0 0x7fc30815c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:37.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.992+0000 7fc30d364640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc3080cfee0 0x7fc30815c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:60010/0 (socket says 172.21.15.59:60010) 2024-04-25T17:01:37.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.992+0000 7fc30d364640 1 -- 172.21.15.59:0/4134027424 learned_addr learned my addr 172.21.15.59:0/4134027424 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:37.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.992+0000 7fc307fff640 1 --2- 172.21.15.59:0/4134027424 >> v2:172.21.15.59:3300/0 conn(0x7fc308156930 0x7fc3080cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:37.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.995+0000 7fc30d364640 1 -- 172.21.15.59:0/4134027424 >> v2:172.21.15.59:3300/0 conn(0x7fc308156930 msgr2=0x7fc3080cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:37.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.995+0000 7fc30d364640 1 --2- 172.21.15.59:0/4134027424 >> v2:172.21.15.59:3300/0 conn(0x7fc308156930 0x7fc3080cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:37.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.995+0000 7fc30d364640 1 -- 172.21.15.59:0/4134027424 >> v1:172.21.15.59:6789/0 conn(0x7fc30806f420 legacy=0x7fc3080cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:37.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.995+0000 7fc30d364640 1 -- 172.21.15.59:0/4134027424 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3080cc260 con 0x7fc3080cfee0 2024-04-25T17:01:37.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:37.997+0000 7fc30d364640 1 --2- 172.21.15.59:0/4134027424 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc3080cfee0 0x7fc30815c810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009870 tx=0x7fc2f802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77e41386dded7d3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:38.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.005+0000 7fc3077fe640 1 -- 172.21.15.59:0/4134027424 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8037070 con 0x7fc3080cfee0 2024-04-25T17:01:38.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.005+0000 7fc3077fe640 1 -- 172.21.15.59:0/4134027424 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f8032440 con 0x7fc3080cfee0 2024-04-25T17:01:38.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.005+0000 7fc3077fe640 1 -- 172.21.15.59:0/4134027424 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8032810 con 0x7fc3080cfee0 2024-04-25T17:01:38.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.006+0000 7fc30edc7640 1 -- 172.21.15.59:0/4134027424 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc3080cfee0 msgr2=0x7fc30815c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:38.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.006+0000 7fc30edc7640 1 --2- 172.21.15.59:0/4134027424 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc3080cfee0 0x7fc30815c810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009870 tx=0x7fc2f802a180 comp rx=0 tx=0).stop 2024-04-25T17:01:38.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.006+0000 7fc30edc7640 1 -- 172.21.15.59:0/4134027424 shutdown_connections 2024-04-25T17:01:38.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.006+0000 7fc30edc7640 1 --2- 172.21.15.59:0/4134027424 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc3080cfee0 0x7fc30815c810 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:38.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.006+0000 7fc30edc7640 1 --2- 172.21.15.59:0/4134027424 >> v2:172.21.15.59:3300/0 conn(0x7fc308156930 0x7fc3080cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:38.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.006+0000 7fc30edc7640 1 -- 172.21.15.59:0/4134027424 >> 172.21.15.59:0/4134027424 conn(0x7fc3080732d0 msgr2=0x7fc3080736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:38.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.006+0000 7fc30edc7640 1 -- 172.21.15.59:0/4134027424 shutdown_connections 2024-04-25T17:01:38.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.006+0000 7fc30edc7640 1 -- 172.21.15.59:0/4134027424 wait complete. 2024-04-25T17:01:38.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.009+0000 7fc30edc7640 1 Processor -- start 2024-04-25T17:01:38.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.009+0000 7fc30edc7640 1 -- start start 2024-04-25T17:01:38.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.010+0000 7fc30edc7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc30806f420 0x7fc3081f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:38.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.010+0000 7fc30edc7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3080cfee0 0x7fc3080b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:38.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.010+0000 7fc30edc7640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc308156930 0x7fc3081e90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:38.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.010+0000 7fc30edc7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc3080ccb00 con 0x7fc30806f420 2024-04-25T17:01:38.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.010+0000 7fc30edc7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc3080cc820 con 0x7fc3080cfee0 2024-04-25T17:01:38.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.010+0000 7fc30edc7640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fc3080ccde0 con 0x7fc308156930 2024-04-25T17:01:38.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.011+0000 7fc30d364640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc308156930 0x7fc3081e90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:38.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.011+0000 7fc30d364640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc308156930 0x7fc3081e90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:60012/0 (socket says 172.21.15.59:60012) 2024-04-25T17:01:38.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.011+0000 7fc30d364640 1 -- 172.21.15.59:0/3548076670 learned_addr learned my addr 172.21.15.59:0/3548076670 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:38.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.015+0000 7fc30d364640 1 -- 172.21.15.59:0/3548076670 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3080cfee0 msgr2=0x7fc3080b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:38.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.015+0000 7fc30d364640 1 --2- 172.21.15.59:0/3548076670 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3080cfee0 0x7fc3080b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:38.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.015+0000 7fc30d364640 1 -- 172.21.15.59:0/3548076670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc30806f420 msgr2=0x7fc3081f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:38.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.015+0000 7fc30d364640 1 --2- 172.21.15.59:0/3548076670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc30806f420 0x7fc3081f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:38.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.015+0000 7fc30d364640 1 -- 172.21.15.59:0/3548076670 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3081f6500 con 0x7fc308156930 2024-04-25T17:01:38.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.018+0000 7fc30d364640 1 --2- 172.21.15.59:0/3548076670 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc308156930 0x7fc3081e90c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009870 tx=0x7fc2f80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:38.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.022+0000 7fc3057fa640 1 -- 172.21.15.59:0/3548076670 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8041070 con 0x7fc308156930 2024-04-25T17:01:38.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.022+0000 7fc3057fa640 1 -- 172.21.15.59:0/3548076670 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f803c870 con 0x7fc308156930 2024-04-25T17:01:38.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.022+0000 7fc3057fa640 1 -- 172.21.15.59:0/3548076670 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8037040 con 0x7fc308156930 2024-04-25T17:01:38.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.022+0000 7fc30edc7640 1 -- 172.21.15.59:0/3548076670 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3081f2570 con 0x7fc308156930 2024-04-25T17:01:38.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.023+0000 7fc30edc7640 1 -- 172.21.15.59:0/3548076670 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3081f2b10 con 0x7fc308156930 2024-04-25T17:01:38.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.023+0000 7fc30edc7640 1 -- 172.21.15.59:0/3548076670 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc308071030 con 0x7fc308156930 2024-04-25T17:01:38.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.331+0000 7fc3057fa640 1 -- 172.21.15.59:0/3548076670 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc2f8044070 con 0x7fc308156930 2024-04-25T17:01:38.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.331+0000 7fc3057fa640 1 --2- 172.21.15.59:0/3548076670 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc2f4074500 0x7fc2f4076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:38.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.331+0000 7fc30cb63640 1 --2- 172.21.15.59:0/3548076670 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc2f4074500 0x7fc2f4076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:38.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.332+0000 7fc30cb63640 1 --2- 172.21.15.59:0/3548076670 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc2f4074500 0x7fc2f4076a10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc300001bb0 tx=0x7fc300007d10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:38.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.337+0000 7fc3057fa640 1 -- 172.21.15.59:0/3548076670 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fc2f807c510 con 0x7fc308156930 2024-04-25T17:01:38.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.348+0000 7fc3057fa640 1 -- 172.21.15.59:0/3548076670 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc308071030 con 0x7fc308156930 2024-04-25T17:01:38.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.558+0000 7fc30edc7640 1 -- 172.21.15.59:0/3548076670 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc308152650 con 0x7fc308156930 2024-04-25T17:01:38.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.567+0000 7fc3057fa640 1 -- 172.21.15.59:0/3548076670 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fc308152650 con 0x7fc308156930 2024-04-25T17:01:38.564 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-04-25T17:01:38.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.569+0000 7fc30edc7640 1 -- 172.21.15.59:0/3548076670 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc2f4074500 msgr2=0x7fc2f4076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:38.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.569+0000 7fc30edc7640 1 --2- 172.21.15.59:0/3548076670 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc2f4074500 0x7fc2f4076a10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc300001bb0 tx=0x7fc300007d10 comp rx=0 tx=0).stop 2024-04-25T17:01:38.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.569+0000 7fc30edc7640 1 -- 172.21.15.59:0/3548076670 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc308156930 msgr2=0x7fc3081e90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:38.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.569+0000 7fc30edc7640 1 --2- 172.21.15.59:0/3548076670 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc308156930 0x7fc3081e90c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009870 tx=0x7fc2f80046c0 comp rx=0 tx=0).stop 2024-04-25T17:01:38.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.569+0000 7fc30edc7640 1 -- 172.21.15.59:0/3548076670 shutdown_connections 2024-04-25T17:01:38.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.569+0000 7fc30edc7640 1 --2- 172.21.15.59:0/3548076670 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc2f4074500 0x7fc2f4076a10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:38.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.569+0000 7fc30edc7640 1 --2- 172.21.15.59:0/3548076670 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc308156930 0x7fc3081e90c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:38.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.569+0000 7fc30edc7640 1 --2- 172.21.15.59:0/3548076670 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3080cfee0 0x7fc3080b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:38.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.569+0000 7fc30edc7640 1 --2- 172.21.15.59:0/3548076670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc30806f420 0x7fc3081f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:38.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.569+0000 7fc30edc7640 1 -- 172.21.15.59:0/3548076670 >> 172.21.15.59:0/3548076670 conn(0x7fc3080732d0 msgr2=0x7fc3080c87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:38.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.569+0000 7fc30edc7640 1 -- 172.21.15.59:0/3548076670 shutdown_connections 2024-04-25T17:01:38.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:38.569+0000 7fc30edc7640 1 -- 172.21.15.59:0/3548076670 wait complete. 2024-04-25T17:01:38.579 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi059.front.sepia.ceph.com... 2024-04-25T17:01:38.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:01:38.579 DEBUG:teuthology.orchestra.run.smithi059:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T17:01:38.603 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:01:38.644 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[43254]: fuse finished with error 0 and tester_r 0 2024-04-25T17:01:39.535 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:==00:01:14:20.952 43254== 2024-04-25T17:01:39.535 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:==00:01:14:20.952 43254== Exit program on first error (--exit-on-first-error=yes) 2024-04-25T17:01:39.698 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:daemon-helper: command failed with exit status 42 2024-04-25T17:01:42.921 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:15:55.528 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T17:01:42.925 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:15:55.532 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T17:01:42.962 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:15:55.569 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T17:01:43.010 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:15:55.577 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T17:01:43.011 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:15:55.578 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T17:01:43.042 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:15:55.608 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T17:01:43.043 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:15:55.610 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T17:01:43.048 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:15:55.614 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T17:01:43.078 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:15:55.645 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T17:01:44.704 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-25T17:01:44.705 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T17:01:44.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:01:44.705 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T17:01:44.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:01:44.739 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T17:01:44.797 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T17:01:44.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:01:44.798 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T17:01:44.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:01:44.867 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2024-04-25T17:01:44.985 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T17:01:44.994 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T17:01:44.994 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T17:01:45.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.116+0000 7fb3651c7640 1 Processor -- start 2024-04-25T17:01:45.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.116+0000 7fb3651c7640 1 -- start start 2024-04-25T17:01:45.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.117+0000 7fb3651c7640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb3600c8170 0x7fb360154580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:45.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.117+0000 7fb3651c7640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3600ce3c0 con 0x7fb3600c6ff0 2024-04-25T17:01:45.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.117+0000 7fb3651c7640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3600c9f40 con 0x7fb3600c6be0 2024-04-25T17:01:45.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.117+0000 7fb3651c7640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb3600cdbb0 con 0x7fb3600c8170 2024-04-25T17:01:45.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.118+0000 7fb35ed9d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb3600c8170 0x7fb360154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:45.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.119+0000 7fb35ed9d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb3600c8170 0x7fb360154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51102/0 (socket says 172.21.15.59:51102) 2024-04-25T17:01:45.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.119+0000 7fb35ed9d640 1 -- 172.21.15.59:0/1358229319 learned_addr learned my addr 172.21.15.59:0/1358229319 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:45.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.122+0000 7fb35ed9d640 1 -- 172.21.15.59:0/1358229319 >> v1:172.21.15.64:6789/0 conn(0x7fb3600c6be0 legacy=0x7fb36015dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:45.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.122+0000 7fb35ed9d640 1 -- 172.21.15.59:0/1358229319 >> v1:172.21.15.59:6789/0 conn(0x7fb3600c6ff0 legacy=0x7fb360164c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:45.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.122+0000 7fb35ed9d640 1 -- 172.21.15.59:0/1358229319 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3600c97e0 con 0x7fb3600c8170 2024-04-25T17:01:45.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.126+0000 7fb35ed9d640 1 --2- 172.21.15.59:0/1358229319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3600c8170 0x7fb360154580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb350009870 tx=0x7fb35002a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57940f7e14e24f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:45.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.130+0000 7fb35e59c640 1 -- 172.21.15.59:0/1358229319 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350037070 con 0x7fb3600c8170 2024-04-25T17:01:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.132+0000 7fb35e59c640 1 -- 172.21.15.59:0/1358229319 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb350032640 con 0x7fb3600c8170 2024-04-25T17:01:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.132+0000 7fb35e59c640 1 -- 172.21.15.59:0/1358229319 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350032a10 con 0x7fb3600c8170 2024-04-25T17:01:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.133+0000 7fb3651c7640 1 -- 172.21.15.59:0/1358229319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3600c8170 msgr2=0x7fb360154580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.133+0000 7fb3651c7640 1 --2- 172.21.15.59:0/1358229319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3600c8170 0x7fb360154580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb350009870 tx=0x7fb35002a330 comp rx=0 tx=0).stop 2024-04-25T17:01:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.133+0000 7fb3651c7640 1 -- 172.21.15.59:0/1358229319 shutdown_connections 2024-04-25T17:01:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.133+0000 7fb3651c7640 1 --2- 172.21.15.59:0/1358229319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3600c8170 0x7fb360154580 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.133+0000 7fb3651c7640 1 -- 172.21.15.59:0/1358229319 >> 172.21.15.59:0/1358229319 conn(0x7fb360068900 msgr2=0x7fb36006f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.133+0000 7fb3651c7640 1 -- 172.21.15.59:0/1358229319 shutdown_connections 2024-04-25T17:01:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.133+0000 7fb3651c7640 1 -- 172.21.15.59:0/1358229319 wait complete. 2024-04-25T17:01:45.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.135+0000 7fb3651c7640 1 Processor -- start 2024-04-25T17:01:45.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.135+0000 7fb3651c7640 1 -- start start 2024-04-25T17:01:45.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.136+0000 7fb3651c7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3600c6be0 0x7fb360154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:45.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.136+0000 7fb3651c7640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb3600c6ff0 0x7fb36015b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:45.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.136+0000 7fb3651c7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3600c8170 0x7fb3601e7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:45.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.136+0000 7fb3651c7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb36015d980 con 0x7fb3600c8170 2024-04-25T17:01:45.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.136+0000 7fb3651c7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb3600ce0e0 con 0x7fb3600c6be0 2024-04-25T17:01:45.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.136+0000 7fb3651c7640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fb3600c7400 con 0x7fb3600c6ff0 2024-04-25T17:01:45.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.137+0000 7fb35f59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3600c8170 0x7fb3601e7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:45.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.137+0000 7fb357fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb3600c6ff0 0x7fb36015b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:45.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.137+0000 7fb35f59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3600c8170 0x7fb3601e7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51112/0 (socket says 172.21.15.59:51112) 2024-04-25T17:01:45.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.137+0000 7fb35f59e640 1 -- 172.21.15.59:0/419623278 learned_addr learned my addr 172.21.15.59:0/419623278 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:45.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.140+0000 7fb35ed9d640 1 --2- 172.21.15.59:0/419623278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3600c6be0 0x7fb360154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:45.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.141+0000 7fb35f59e640 1 -- 172.21.15.59:0/419623278 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb3600c6ff0 msgr2=0x7fb36015b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:45.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.141+0000 7fb35f59e640 1 --2- 172.21.15.59:0/419623278 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb3600c6ff0 0x7fb36015b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:45.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.141+0000 7fb35f59e640 1 -- 172.21.15.59:0/419623278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3600c6be0 msgr2=0x7fb360154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:45.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.141+0000 7fb35f59e640 1 --2- 172.21.15.59:0/419623278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3600c6be0 0x7fb360154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:45.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.141+0000 7fb35f59e640 1 -- 172.21.15.59:0/419623278 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb36015ba10 con 0x7fb3600c8170 2024-04-25T17:01:45.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.163+0000 7fb35f59e640 1 --2- 172.21.15.59:0/419623278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3600c8170 0x7fb3601e7280 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb35800c680 tx=0x7fb35800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:45.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.189+0000 7fb3577fe640 1 -- 172.21.15.59:0/419623278 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358003b70 con 0x7fb3600c8170 2024-04-25T17:01:45.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.189+0000 7fb3577fe640 1 -- 172.21.15.59:0/419623278 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb358003d10 con 0x7fb3600c8170 2024-04-25T17:01:45.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.189+0000 7fb3577fe640 1 -- 172.21.15.59:0/419623278 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358005310 con 0x7fb3600c8170 2024-04-25T17:01:45.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.189+0000 7fb3651c7640 1 -- 172.21.15.59:0/419623278 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb360156010 con 0x7fb3600c8170 2024-04-25T17:01:45.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.189+0000 7fb3651c7640 1 -- 172.21.15.59:0/419623278 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3601565d0 con 0x7fb3600c8170 2024-04-25T17:01:45.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.190+0000 7fb3651c7640 1 -- 172.21.15.59:0/419623278 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3600698a0 con 0x7fb3600c8170 2024-04-25T17:01:45.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.218+0000 7fb3577fe640 1 -- 172.21.15.59:0/419623278 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb3580054b0 con 0x7fb3600c8170 2024-04-25T17:01:45.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.218+0000 7fb3577fe640 1 --2- 172.21.15.59:0/419623278 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb340074530 0x7fb340076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:45.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.219+0000 7fb35ed9d640 1 --2- 172.21.15.59:0/419623278 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb340074530 0x7fb340076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:45.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.219+0000 7fb35ed9d640 1 --2- 172.21.15.59:0/419623278 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb340074530 0x7fb340076a40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb350034000 tx=0x7fb35002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.505+0000 7fb3577fe640 1 -- 172.21.15.59:0/419623278 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fb3580057a0 con 0x7fb3600c8170 2024-04-25T17:01:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.505+0000 7fb3577fe640 1 -- 172.21.15.59:0/419623278 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb358060270 con 0x7fb3600c8170 2024-04-25T17:01:45.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.685+0000 7fb3651c7640 1 -- 172.21.15.59:0/419623278 --> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb360157ca0 con 0x7fb340074530 2024-04-25T17:01:45.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.692+0000 7fb3577fe640 1 -- 172.21.15.59:0/419623278 <== mgr.4102 v2:172.21.15.59:6800/2368090706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253925 (secure 0 0 0) 0x7fb360157ca0 con 0x7fb340074530 2024-04-25T17:01:45.693 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T17:01:45.694 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T17:01:45.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.695+0000 7fb3651c7640 1 -- 172.21.15.59:0/419623278 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb340074530 msgr2=0x7fb340076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:45.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.695+0000 7fb3651c7640 1 --2- 172.21.15.59:0/419623278 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb340074530 0x7fb340076a40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb350034000 tx=0x7fb35002e000 comp rx=0 tx=0).stop 2024-04-25T17:01:45.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.695+0000 7fb3651c7640 1 -- 172.21.15.59:0/419623278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3600c8170 msgr2=0x7fb3601e7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:45.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.695+0000 7fb3651c7640 1 --2- 172.21.15.59:0/419623278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3600c8170 0x7fb3601e7280 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb35800c680 tx=0x7fb35800cb40 comp rx=0 tx=0).stop 2024-04-25T17:01:45.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.695+0000 7fb3651c7640 1 -- 172.21.15.59:0/419623278 shutdown_connections 2024-04-25T17:01:45.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.695+0000 7fb3651c7640 1 --2- 172.21.15.59:0/419623278 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb340074530 0x7fb340076a40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:45.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.695+0000 7fb3651c7640 1 --2- 172.21.15.59:0/419623278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3600c8170 0x7fb3601e7280 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:45.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.695+0000 7fb3651c7640 1 --2- 172.21.15.59:0/419623278 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb3600c6ff0 0x7fb36015b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:45.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.695+0000 7fb3651c7640 1 --2- 172.21.15.59:0/419623278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3600c6be0 0x7fb360154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:45.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.695+0000 7fb3651c7640 1 -- 172.21.15.59:0/419623278 >> 172.21.15.59:0/419623278 conn(0x7fb360068900 msgr2=0x7fb36006f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:45.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.695+0000 7fb3651c7640 1 -- 172.21.15.59:0/419623278 shutdown_connections 2024-04-25T17:01:45.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.695+0000 7fb3651c7640 1 -- 172.21.15.59:0/419623278 wait complete. 2024-04-25T17:01:45.705 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":2283,"stamp":"2024-04-25T17:01:45.417294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":184908490,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":5898,"num_read_kb":1451856,"num_write":56443,"num_write_kb":4563428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53229,"ondisk_log_size":53229,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":934688,"kb_used_data":363232,"kb_used_omap":12,"kb_used_meta":571379,"kb_avail":754040032,"statfs":{"total":773094113280,"available":772136992768,"internally_reserved":0,"allocated":371949568,"data_stored":370527476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":585092658},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2165,"num_objects":-4,"num_object_clones":0,"num_object_copies":-8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":26,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003026"},"pg_stats":[{"pgid":"3.3f","version":"24'430","reported_seq":557,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.999197+0000","last_change":"2024-04-25T15:47:08.942552+0000","last_active":"2024-04-25T17:01:38.999197+0000","last_peered":"2024-04-25T17:01:38.999197+0000","last_clean":"2024-04-25T17:01:38.999197+0000","last_became_active":"2024-04-25T15:47:08.942222+0000","last_became_peered":"2024-04-25T15:47:08.942222+0000","last_unstale":"2024-04-25T17:01:38.999197+0000","last_undegraded":"2024-04-25T17:01:38.999197+0000","last_fullsized":"2024-04-25T17:01:38.999197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":51437,"num_write":399,"num_write_kb":108426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"24'420","reported_seq":504,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.002197+0000","last_change":"2024-04-25T15:46:33.022420+0000","last_active":"2024-04-25T17:01:39.002197+0000","last_peered":"2024-04-25T17:01:39.002197+0000","last_clean":"2024-04-25T17:01:39.002197+0000","last_became_active":"2024-04-25T15:46:33.022095+0000","last_became_peered":"2024-04-25T15:46:33.022095+0000","last_unstale":"2024-04-25T17:01:39.002197+0000","last_undegraded":"2024-04-25T17:01:39.002197+0000","last_fullsized":"2024-04-25T17:01:39.002197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15735,"num_write":392,"num_write_kb":67130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"24'384","reported_seq":464,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.997245+0000","last_change":"2024-04-25T15:46:33.063451+0000","last_active":"2024-04-25T17:01:38.997245+0000","last_peered":"2024-04-25T17:01:38.997245+0000","last_clean":"2024-04-25T17:01:38.997245+0000","last_became_active":"2024-04-25T15:46:33.063038+0000","last_became_peered":"2024-04-25T15:46:33.063038+0000","last_unstale":"2024-04-25T17:01:38.997245+0000","last_undegraded":"2024-04-25T17:01:38.997245+0000","last_fullsized":"2024-04-25T17:01:38.997245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:49:29.792442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13830,"num_write":355,"num_write_kb":38647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"24'395","reported_seq":469,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.079625+0000","last_change":"2024-04-25T15:47:09.046881+0000","last_active":"2024-04-25T17:01:39.079625+0000","last_peered":"2024-04-25T17:01:39.079625+0000","last_clean":"2024-04-25T17:01:39.079625+0000","last_became_active":"2024-04-25T15:47:09.046576+0000","last_became_peered":"2024-04-25T15:47:09.046576+0000","last_unstale":"2024-04-25T17:01:39.079625+0000","last_undegraded":"2024-04-25T17:01:39.079625+0000","last_fullsized":"2024-04-25T17:01:39.079625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":6992,"num_write":371,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"24'432","reported_seq":558,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.951575+0000","last_change":"2024-04-25T15:46:33.063350+0000","last_active":"2024-04-25T17:01:38.951575+0000","last_peered":"2024-04-25T17:01:38.951575+0000","last_clean":"2024-04-25T17:01:38.951575+0000","last_became_active":"2024-04-25T15:46:33.063110+0000","last_became_peered":"2024-04-25T15:46:33.063110+0000","last_unstale":"2024-04-25T17:01:38.951575+0000","last_undegraded":"2024-04-25T17:01:38.951575+0000","last_fullsized":"2024-04-25T17:01:38.951575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":46382,"num_write":409,"num_write_kb":84827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"24'371","reported_seq":423,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.967663+0000","last_change":"2024-04-25T15:46:33.040765+0000","last_active":"2024-04-25T17:01:38.967663+0000","last_peered":"2024-04-25T17:01:38.967663+0000","last_clean":"2024-04-25T17:01:38.967663+0000","last_became_active":"2024-04-25T15:46:33.040272+0000","last_became_peered":"2024-04-25T15:46:33.040272+0000","last_unstale":"2024-04-25T17:01:38.967663+0000","last_undegraded":"2024-04-25T17:01:38.967663+0000","last_fullsized":"2024-04-25T17:01:38.967663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:20.677976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":345,"num_write_kb":38164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"24'405","reported_seq":505,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.942762+0000","last_change":"2024-04-25T15:46:33.037395+0000","last_active":"2024-04-25T17:01:38.942762+0000","last_peered":"2024-04-25T17:01:38.942762+0000","last_clean":"2024-04-25T17:01:38.942762+0000","last_became_active":"2024-04-25T15:46:33.036613+0000","last_became_peered":"2024-04-25T15:46:33.036613+0000","last_unstale":"2024-04-25T17:01:38.942762+0000","last_undegraded":"2024-04-25T17:01:38.942762+0000","last_fullsized":"2024-04-25T17:01:38.942762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29371,"num_write":377,"num_write_kb":63589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"24'387","reported_seq":479,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.079573+0000","last_change":"2024-04-25T15:47:09.047263+0000","last_active":"2024-04-25T17:01:39.079573+0000","last_peered":"2024-04-25T17:01:39.079573+0000","last_clean":"2024-04-25T17:01:39.079573+0000","last_became_active":"2024-04-25T15:47:09.046942+0000","last_became_peered":"2024-04-25T15:47:09.046942+0000","last_unstale":"2024-04-25T17:01:39.079573+0000","last_undegraded":"2024-04-25T17:01:39.079573+0000","last_fullsized":"2024-04-25T17:01:39.079573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37992,"num_write":353,"num_write_kb":79970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"24'414","reported_seq":514,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.962775+0000","last_change":"2024-04-25T15:46:33.043405+0000","last_active":"2024-04-25T17:01:38.962775+0000","last_peered":"2024-04-25T17:01:38.962775+0000","last_clean":"2024-04-25T17:01:38.962775+0000","last_became_active":"2024-04-25T15:46:33.043094+0000","last_became_peered":"2024-04-25T15:46:33.043094+0000","last_unstale":"2024-04-25T17:01:38.962775+0000","last_undegraded":"2024-04-25T17:01:38.962775+0000","last_fullsized":"2024-04-25T17:01:38.962775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:49.811317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25428,"num_write":377,"num_write_kb":51351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"24'395","reported_seq":472,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.004887+0000","last_change":"2024-04-25T15:46:33.037180+0000","last_active":"2024-04-25T17:01:39.004887+0000","last_peered":"2024-04-25T17:01:39.004887+0000","last_clean":"2024-04-25T17:01:39.004887+0000","last_became_active":"2024-04-25T15:46:33.036822+0000","last_became_peered":"2024-04-25T15:46:33.036822+0000","last_unstale":"2024-04-25T17:01:39.004887+0000","last_undegraded":"2024-04-25T17:01:39.004887+0000","last_fullsized":"2024-04-25T17:01:39.004887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:45.123026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15654,"num_write":362,"num_write_kb":47082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"24'382","reported_seq":452,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.993868+0000","last_change":"2024-04-25T15:46:33.040594+0000","last_active":"2024-04-25T17:01:38.993868+0000","last_peered":"2024-04-25T17:01:38.993868+0000","last_clean":"2024-04-25T17:01:38.993868+0000","last_became_active":"2024-04-25T15:46:33.040296+0000","last_became_peered":"2024-04-25T15:46:33.040296+0000","last_unstale":"2024-04-25T17:01:38.993868+0000","last_undegraded":"2024-04-25T17:01:38.993868+0000","last_fullsized":"2024-04-25T17:01:38.993868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:47.844325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9049,"num_write":364,"num_write_kb":58665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"24'374","reported_seq":475,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.990927+0000","last_change":"2024-04-25T15:46:33.011129+0000","last_active":"2024-04-25T17:01:38.990927+0000","last_peered":"2024-04-25T17:01:38.990927+0000","last_clean":"2024-04-25T17:01:38.990927+0000","last_became_active":"2024-04-25T15:46:33.010754+0000","last_became_peered":"2024-04-25T15:46:33.010754+0000","last_unstale":"2024-04-25T17:01:38.990927+0000","last_undegraded":"2024-04-25T17:01:38.990927+0000","last_fullsized":"2024-04-25T17:01:38.990927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:31.093111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27496,"num_write":346,"num_write_kb":71109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"24'401","reported_seq":495,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.923244+0000","last_change":"2024-04-25T15:46:33.011388+0000","last_active":"2024-04-25T17:01:38.923244+0000","last_peered":"2024-04-25T17:01:38.923244+0000","last_clean":"2024-04-25T17:01:38.923244+0000","last_became_active":"2024-04-25T15:46:33.011083+0000","last_became_peered":"2024-04-25T15:46:33.011083+0000","last_unstale":"2024-04-25T17:01:38.923244+0000","last_undegraded":"2024-04-25T17:01:38.923244+0000","last_fullsized":"2024-04-25T17:01:38.923244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:22.959149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":17390,"num_write":371,"num_write_kb":87698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"24'409","reported_seq":485,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.997095+0000","last_change":"2024-04-25T15:46:33.022531+0000","last_active":"2024-04-25T17:01:38.997095+0000","last_peered":"2024-04-25T17:01:38.997095+0000","last_clean":"2024-04-25T17:01:38.997095+0000","last_became_active":"2024-04-25T15:46:33.022214+0000","last_became_peered":"2024-04-25T15:46:33.022214+0000","last_unstale":"2024-04-25T17:01:38.997095+0000","last_undegraded":"2024-04-25T17:01:38.997095+0000","last_fullsized":"2024-04-25T17:01:38.997095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:19.052124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17435,"num_write":384,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"24'435","reported_seq":563,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.085228+0000","last_change":"2024-04-25T15:46:32.929715+0000","last_active":"2024-04-25T17:01:39.085228+0000","last_peered":"2024-04-25T17:01:39.085228+0000","last_clean":"2024-04-25T17:01:39.085228+0000","last_became_active":"2024-04-25T15:46:32.929386+0000","last_became_peered":"2024-04-25T15:46:32.929386+0000","last_unstale":"2024-04-25T17:01:39.085228+0000","last_undegraded":"2024-04-25T17:01:39.085228+0000","last_fullsized":"2024-04-25T17:01:39.085228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:47.844325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41362,"num_write":401,"num_write_kb":92598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"24'426","reported_seq":499,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.966357+0000","last_change":"2024-04-25T15:46:33.041583+0000","last_active":"2024-04-25T17:01:38.966357+0000","last_peered":"2024-04-25T17:01:38.966357+0000","last_clean":"2024-04-25T17:01:38.966357+0000","last_became_active":"2024-04-25T15:46:33.040240+0000","last_became_peered":"2024-04-25T15:46:33.040240+0000","last_unstale":"2024-04-25T17:01:38.966357+0000","last_undegraded":"2024-04-25T17:01:38.966357+0000","last_fullsized":"2024-04-25T17:01:38.966357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16384,"num_write":396,"num_write_kb":62713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"24'404","reported_seq":490,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.972544+0000","last_change":"2024-04-25T15:46:33.044561+0000","last_active":"2024-04-25T17:01:38.972544+0000","last_peered":"2024-04-25T17:01:38.972544+0000","last_clean":"2024-04-25T17:01:38.972544+0000","last_became_active":"2024-04-25T15:46:33.044065+0000","last_became_peered":"2024-04-25T15:46:33.044065+0000","last_unstale":"2024-04-25T17:01:38.972544+0000","last_undegraded":"2024-04-25T17:01:38.972544+0000","last_fullsized":"2024-04-25T17:01:38.972544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:33.557001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":15331,"num_write":377,"num_write_kb":71706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"24'418","reported_seq":517,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.079842+0000","last_change":"2024-04-25T15:46:33.061929+0000","last_active":"2024-04-25T17:01:39.079842+0000","last_peered":"2024-04-25T17:01:39.079842+0000","last_clean":"2024-04-25T17:01:39.079842+0000","last_became_active":"2024-04-25T15:46:33.061623+0000","last_became_peered":"2024-04-25T15:46:33.061623+0000","last_unstale":"2024-04-25T17:01:39.079842+0000","last_undegraded":"2024-04-25T17:01:39.079842+0000","last_fullsized":"2024-04-25T17:01:39.079842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:28.844626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29942,"num_write":388,"num_write_kb":91861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"24'442","reported_seq":554,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.948818+0000","last_change":"2024-04-25T15:46:33.063451+0000","last_active":"2024-04-25T17:01:38.948818+0000","last_peered":"2024-04-25T17:01:38.948818+0000","last_clean":"2024-04-25T17:01:38.948818+0000","last_became_active":"2024-04-25T15:46:33.063126+0000","last_became_peered":"2024-04-25T15:46:33.063126+0000","last_unstale":"2024-04-25T17:01:38.948818+0000","last_undegraded":"2024-04-25T17:01:38.948818+0000","last_fullsized":"2024-04-25T17:01:38.948818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:49.144595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":28728,"num_write":405,"num_write_kb":157712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"24'446","reported_seq":529,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996562+0000","last_change":"2024-04-25T15:46:33.014377+0000","last_active":"2024-04-25T17:01:38.996562+0000","last_peered":"2024-04-25T17:01:38.996562+0000","last_clean":"2024-04-25T17:01:38.996562+0000","last_became_active":"2024-04-25T15:46:33.014056+0000","last_became_peered":"2024-04-25T15:46:33.014056+0000","last_unstale":"2024-04-25T17:01:38.996562+0000","last_undegraded":"2024-04-25T17:01:38.996562+0000","last_fullsized":"2024-04-25T17:01:38.996562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:49.025646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19430,"num_write":422,"num_write_kb":59069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"24'420","reported_seq":529,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996828+0000","last_change":"2024-04-25T15:46:33.032744+0000","last_active":"2024-04-25T17:01:38.996828+0000","last_peered":"2024-04-25T17:01:38.996828+0000","last_clean":"2024-04-25T17:01:38.996828+0000","last_became_active":"2024-04-25T15:46:33.032498+0000","last_became_peered":"2024-04-25T15:46:33.032498+0000","last_unstale":"2024-04-25T17:01:38.996828+0000","last_undegraded":"2024-04-25T17:01:38.996828+0000","last_fullsized":"2024-04-25T17:01:38.996828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:04.861299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38942,"num_write":394,"num_write_kb":67464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"24'418","reported_seq":501,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.974586+0000","last_change":"2024-04-25T15:46:33.043548+0000","last_active":"2024-04-25T17:01:38.974586+0000","last_peered":"2024-04-25T17:01:38.974586+0000","last_clean":"2024-04-25T17:01:38.974586+0000","last_became_active":"2024-04-25T15:46:33.043251+0000","last_became_peered":"2024-04-25T15:46:33.043251+0000","last_unstale":"2024-04-25T17:01:38.974586+0000","last_undegraded":"2024-04-25T17:01:38.974586+0000","last_fullsized":"2024-04-25T17:01:38.974586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:04.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15275,"num_write":389,"num_write_kb":50799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"24'423","reported_seq":528,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.919948+0000","last_change":"2024-04-25T15:46:32.927532+0000","last_active":"2024-04-25T17:01:38.919948+0000","last_peered":"2024-04-25T17:01:38.919948+0000","last_clean":"2024-04-25T17:01:38.919948+0000","last_became_active":"2024-04-25T15:46:32.926836+0000","last_became_peered":"2024-04-25T15:46:32.926836+0000","last_unstale":"2024-04-25T17:01:38.919948+0000","last_undegraded":"2024-04-25T17:01:38.919948+0000","last_fullsized":"2024-04-25T17:01:38.919948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:21.339594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":23691,"num_write":392,"num_write_kb":92779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"24'428","reported_seq":517,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.972089+0000","last_change":"2024-04-25T15:46:33.041900+0000","last_active":"2024-04-25T17:01:38.972089+0000","last_peered":"2024-04-25T17:01:38.972089+0000","last_clean":"2024-04-25T17:01:38.972089+0000","last_became_active":"2024-04-25T15:46:33.040821+0000","last_became_peered":"2024-04-25T15:46:33.040821+0000","last_unstale":"2024-04-25T17:01:38.972089+0000","last_undegraded":"2024-04-25T17:01:38.972089+0000","last_fullsized":"2024-04-25T17:01:38.972089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18443,"num_write":400,"num_write_kb":50986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"24'394","reported_seq":477,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.907774+0000","last_change":"2024-04-25T15:46:32.926772+0000","last_active":"2024-04-25T17:01:38.907774+0000","last_peered":"2024-04-25T17:01:38.907774+0000","last_clean":"2024-04-25T17:01:38.907774+0000","last_became_active":"2024-04-25T15:46:32.926468+0000","last_became_peered":"2024-04-25T15:46:32.926468+0000","last_unstale":"2024-04-25T17:01:38.907774+0000","last_undegraded":"2024-04-25T17:01:38.907774+0000","last_fullsized":"2024-04-25T17:01:38.907774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:21:35.665923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16804,"num_write":379,"num_write_kb":50499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"24'462","reported_seq":583,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.005049+0000","last_change":"2024-04-25T15:46:33.031482+0000","last_active":"2024-04-25T17:01:39.005049+0000","last_peered":"2024-04-25T17:01:39.005049+0000","last_clean":"2024-04-25T17:01:39.005049+0000","last_became_active":"2024-04-25T15:46:33.031182+0000","last_became_peered":"2024-04-25T15:46:33.031182+0000","last_unstale":"2024-04-25T17:01:39.005049+0000","last_undegraded":"2024-04-25T17:01:39.005049+0000","last_fullsized":"2024-04-25T17:01:39.005049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":42888,"num_write":421,"num_write_kb":44012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"24'399","reported_seq":499,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.162134+0000","last_change":"2024-04-25T15:46:32.931992+0000","last_active":"2024-04-25T17:01:39.162134+0000","last_peered":"2024-04-25T17:01:39.162134+0000","last_clean":"2024-04-25T17:01:39.162134+0000","last_became_active":"2024-04-25T15:46:32.931684+0000","last_became_peered":"2024-04-25T15:46:32.931684+0000","last_unstale":"2024-04-25T17:01:39.162134+0000","last_undegraded":"2024-04-25T17:01:39.162134+0000","last_fullsized":"2024-04-25T17:01:39.162134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:12.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25944,"num_write":373,"num_write_kb":59184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"24'397","reported_seq":465,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.923787+0000","last_change":"2024-04-25T15:46:32.926461+0000","last_active":"2024-04-25T17:01:38.923787+0000","last_peered":"2024-04-25T17:01:38.923787+0000","last_clean":"2024-04-25T17:01:38.923787+0000","last_became_active":"2024-04-25T15:46:32.926136+0000","last_became_peered":"2024-04-25T15:46:32.926136+0000","last_unstale":"2024-04-25T17:01:38.923787+0000","last_undegraded":"2024-04-25T17:01:38.923787+0000","last_fullsized":"2024-04-25T17:01:38.923787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:29.896062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5076,"num_write":375,"num_write_kb":141478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"24'412","reported_seq":512,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.994782+0000","last_change":"2024-04-25T15:46:33.022460+0000","last_active":"2024-04-25T17:01:38.994782+0000","last_peered":"2024-04-25T17:01:38.994782+0000","last_clean":"2024-04-25T17:01:38.994782+0000","last_became_active":"2024-04-25T15:46:33.022116+0000","last_became_peered":"2024-04-25T15:46:33.022116+0000","last_unstale":"2024-04-25T17:01:38.994782+0000","last_undegraded":"2024-04-25T17:01:38.994782+0000","last_fullsized":"2024-04-25T17:01:38.994782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:22.980615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":30085,"num_write":382,"num_write_kb":75269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"24'493","reported_seq":633,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.972507+0000","last_change":"2024-04-25T15:46:33.040668+0000","last_active":"2024-04-25T17:01:38.972507+0000","last_peered":"2024-04-25T17:01:38.972507+0000","last_clean":"2024-04-25T17:01:38.972507+0000","last_became_active":"2024-04-25T15:46:33.040134+0000","last_became_peered":"2024-04-25T15:46:33.040134+0000","last_unstale":"2024-04-25T17:01:38.972507+0000","last_undegraded":"2024-04-25T17:01:38.972507+0000","last_fullsized":"2024-04-25T17:01:38.972507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:16.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44575,"num_write":459,"num_write_kb":113331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"24'453","reported_seq":584,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.078848+0000","last_change":"2024-04-25T15:47:08.950730+0000","last_active":"2024-04-25T17:01:39.078848+0000","last_peered":"2024-04-25T17:01:39.078848+0000","last_clean":"2024-04-25T17:01:39.078848+0000","last_became_active":"2024-04-25T15:47:08.950453+0000","last_became_peered":"2024-04-25T15:47:08.950453+0000","last_unstale":"2024-04-25T17:01:39.078848+0000","last_undegraded":"2024-04-25T17:01:39.078848+0000","last_fullsized":"2024-04-25T17:01:39.078848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:12.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":42323,"num_write":423,"num_write_kb":72432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"24'432","reported_seq":513,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996532+0000","last_change":"2024-04-25T15:46:33.022223+0000","last_active":"2024-04-25T17:01:38.996532+0000","last_peered":"2024-04-25T17:01:38.996532+0000","last_clean":"2024-04-25T17:01:38.996532+0000","last_became_active":"2024-04-25T15:46:33.021888+0000","last_became_peered":"2024-04-25T15:46:33.021888+0000","last_unstale":"2024-04-25T17:01:38.996532+0000","last_undegraded":"2024-04-25T17:01:38.996532+0000","last_fullsized":"2024-04-25T17:01:38.996532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:23.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16763,"num_write":405,"num_write_kb":80030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"24'382","reported_seq":443,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.984126+0000","last_change":"2024-04-25T15:46:32.929281+0000","last_active":"2024-04-25T17:01:38.984126+0000","last_peered":"2024-04-25T17:01:38.984126+0000","last_clean":"2024-04-25T17:01:38.984126+0000","last_became_active":"2024-04-25T15:46:32.929019+0000","last_became_peered":"2024-04-25T15:46:32.929019+0000","last_unstale":"2024-04-25T17:01:38.984126+0000","last_undegraded":"2024-04-25T17:01:38.984126+0000","last_fullsized":"2024-04-25T17:01:38.984126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:55.692126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5031,"num_write":350,"num_write_kb":37997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'222","reported_seq":270,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:35.310167+0000","last_change":"2024-04-25T15:46:31.685950+0000","last_active":"2024-04-25T17:01:35.310167+0000","last_peered":"2024-04-25T17:01:35.310167+0000","last_clean":"2024-04-25T17:01:35.310167+0000","last_became_active":"2024-04-25T15:46:31.685602+0000","last_became_peered":"2024-04-25T15:46:31.685602+0000","last_unstale":"2024-04-25T17:01:35.310167+0000","last_undegraded":"2024-04-25T17:01:35.310167+0000","last_fullsized":"2024-04-25T17:01:35.310167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:29.676427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"24'361","reported_seq":424,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.998822+0000","last_change":"2024-04-25T15:46:33.023655+0000","last_active":"2024-04-25T17:01:38.998822+0000","last_peered":"2024-04-25T17:01:38.998822+0000","last_clean":"2024-04-25T17:01:38.998822+0000","last_became_active":"2024-04-25T15:46:33.023432+0000","last_became_peered":"2024-04-25T15:46:33.023432+0000","last_unstale":"2024-04-25T17:01:38.998822+0000","last_undegraded":"2024-04-25T17:01:38.998822+0000","last_fullsized":"2024-04-25T17:01:38.998822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:21.339594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5878,"num_write":338,"num_write_kb":30071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1233","reported_seq":1281,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:35.017131+0000","last_change":"2024-04-25T15:46:31.659079+0000","last_active":"2024-04-25T17:00:35.017131+0000","last_peered":"2024-04-25T17:00:35.017131+0000","last_clean":"2024-04-25T17:00:35.017131+0000","last_became_active":"2024-04-25T15:46:31.658681+0000","last_became_peered":"2024-04-25T15:46:31.658681+0000","last_unstale":"2024-04-25T17:00:35.017131+0000","last_undegraded":"2024-04-25T17:00:35.017131+0000","last_fullsized":"2024-04-25T17:00:35.017131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1233,"log_dups_size":0,"ondisk_log_size":1233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":12901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"24'720","reported_seq":768,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:21.336832+0000","last_change":"2024-04-25T15:46:31.684220+0000","last_active":"2024-04-25T17:00:21.336832+0000","last_peered":"2024-04-25T17:00:21.336832+0000","last_clean":"2024-04-25T17:00:21.336832+0000","last_became_active":"2024-04-25T15:46:31.682936+0000","last_became_peered":"2024-04-25T15:46:31.682936+0000","last_unstale":"2024-04-25T17:00:21.336832+0000","last_undegraded":"2024-04-25T17:00:21.336832+0000","last_fullsized":"2024-04-25T17:00:21.336832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:53.729696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"24'432","reported_seq":504,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.919915+0000","last_change":"2024-04-25T15:46:33.019843+0000","last_active":"2024-04-25T17:01:38.919915+0000","last_peered":"2024-04-25T17:01:38.919915+0000","last_clean":"2024-04-25T17:01:38.919915+0000","last_became_active":"2024-04-25T15:46:33.019526+0000","last_became_peered":"2024-04-25T15:46:33.019526+0000","last_unstale":"2024-04-25T17:01:38.919915+0000","last_undegraded":"2024-04-25T17:01:38.919915+0000","last_fullsized":"2024-04-25T17:01:38.919915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:22.980615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10652,"num_write":400,"num_write_kb":42963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"24'1278","reported_seq":1327,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:27.319190+0000","last_change":"2024-04-25T15:46:31.689444+0000","last_active":"2024-04-25T17:01:27.319190+0000","last_peered":"2024-04-25T17:01:27.319190+0000","last_clean":"2024-04-25T17:01:27.319190+0000","last_became_active":"2024-04-25T15:46:31.689130+0000","last_became_peered":"2024-04-25T15:46:31.689130+0000","last_unstale":"2024-04-25T17:01:27.319190+0000","last_undegraded":"2024-04-25T17:01:27.319190+0000","last_fullsized":"2024-04-25T17:01:27.319190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1278,"log_dups_size":0,"ondisk_log_size":1278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":12905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"24'413","reported_seq":475,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.181021+0000","last_change":"2024-04-25T15:46:32.931979+0000","last_active":"2024-04-25T17:01:39.181021+0000","last_peered":"2024-04-25T17:01:39.181021+0000","last_clean":"2024-04-25T17:01:39.181021+0000","last_became_active":"2024-04-25T15:46:32.931648+0000","last_became_peered":"2024-04-25T15:46:32.931648+0000","last_unstale":"2024-04-25T17:01:39.181021+0000","last_undegraded":"2024-04-25T17:01:39.181021+0000","last_fullsized":"2024-04-25T17:01:39.181021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:23.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9624,"num_write":380,"num_write_kb":46532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"24'54","reported_seq":103,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:27.332734+0000","last_change":"2024-04-25T15:46:31.685721+0000","last_active":"2024-04-25T17:01:27.332734+0000","last_peered":"2024-04-25T17:01:27.332734+0000","last_clean":"2024-04-25T17:01:27.332734+0000","last_became_active":"2024-04-25T15:46:31.685244+0000","last_became_peered":"2024-04-25T15:46:31.685244+0000","last_unstale":"2024-04-25T17:01:27.332734+0000","last_undegraded":"2024-04-25T17:01:27.332734+0000","last_fullsized":"2024-04-25T17:01:27.332734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"24'416","reported_seq":506,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.973069+0000","last_change":"2024-04-25T15:46:33.043533+0000","last_active":"2024-04-25T17:01:38.973069+0000","last_peered":"2024-04-25T17:01:38.973069+0000","last_clean":"2024-04-25T17:01:38.973069+0000","last_became_active":"2024-04-25T15:46:33.043228+0000","last_became_peered":"2024-04-25T15:46:33.043228+0000","last_unstale":"2024-04-25T17:01:38.973069+0000","last_undegraded":"2024-04-25T17:01:38.973069+0000","last_fullsized":"2024-04-25T17:01:38.973069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26593,"num_write":386,"num_write_kb":54872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"24'373","reported_seq":422,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:15.484935+0000","last_change":"2024-04-25T15:46:31.692399+0000","last_active":"2024-04-25T17:01:15.484935+0000","last_peered":"2024-04-25T17:01:15.484935+0000","last_clean":"2024-04-25T17:01:15.484935+0000","last_became_active":"2024-04-25T15:46:31.692063+0000","last_became_peered":"2024-04-25T15:46:31.692063+0000","last_unstale":"2024-04-25T17:01:15.484935+0000","last_undegraded":"2024-04-25T17:01:15.484935+0000","last_fullsized":"2024-04-25T17:01:15.484935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'409","reported_seq":513,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.991611+0000","last_change":"2024-04-25T15:46:33.043275+0000","last_active":"2024-04-25T17:01:38.991611+0000","last_peered":"2024-04-25T17:01:38.991611+0000","last_clean":"2024-04-25T17:01:38.991611+0000","last_became_active":"2024-04-25T15:46:33.042941+0000","last_became_peered":"2024-04-25T15:46:33.042941+0000","last_unstale":"2024-04-25T17:01:38.991611+0000","last_undegraded":"2024-04-25T17:01:38.991611+0000","last_fullsized":"2024-04-25T17:01:38.991611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:22.959149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53704,"num_write":377,"num_write_kb":101029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'2113","reported_seq":2162,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:34.052959+0000","last_change":"2024-04-25T15:46:31.686299+0000","last_active":"2024-04-25T17:01:34.052959+0000","last_peered":"2024-04-25T17:01:34.052959+0000","last_clean":"2024-04-25T17:01:34.052959+0000","last_became_active":"2024-04-25T15:46:31.685993+0000","last_became_peered":"2024-04-25T15:46:31.685993+0000","last_unstale":"2024-04-25T17:01:34.052959+0000","last_undegraded":"2024-04-25T17:01:34.052959+0000","last_fullsized":"2024-04-25T17:01:34.052959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2113,"log_dups_size":0,"ondisk_log_size":2113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2065,"num_write_kb":6028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'405","reported_seq":535,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.989646+0000","last_change":"2024-04-25T15:46:33.035207+0000","last_active":"2024-04-25T17:01:38.989646+0000","last_peered":"2024-04-25T17:01:38.989646+0000","last_clean":"2024-04-25T17:01:38.989646+0000","last_became_active":"2024-04-25T15:46:33.034926+0000","last_became_peered":"2024-04-25T15:46:33.034926+0000","last_unstale":"2024-04-25T17:01:38.989646+0000","last_undegraded":"2024-04-25T17:01:38.989646+0000","last_fullsized":"2024-04-25T17:01:38.989646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:28.844626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":46433,"num_write":373,"num_write_kb":80369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'1505","reported_seq":1555,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:27.332697+0000","last_change":"2024-04-25T15:46:31.683086+0000","last_active":"2024-04-25T17:01:27.332697+0000","last_peered":"2024-04-25T17:01:27.332697+0000","last_clean":"2024-04-25T17:01:27.332697+0000","last_became_active":"2024-04-25T15:46:31.682661+0000","last_became_peered":"2024-04-25T15:46:31.682661+0000","last_unstale":"2024-04-25T17:01:27.332697+0000","last_undegraded":"2024-04-25T17:01:27.332697+0000","last_fullsized":"2024-04-25T17:01:27.332697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1505,"log_dups_size":0,"ondisk_log_size":1505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1466,"num_write_kb":13174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"24'389","reported_seq":486,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.951163+0000","last_change":"2024-04-25T15:46:33.034800+0000","last_active":"2024-04-25T17:01:38.951163+0000","last_peered":"2024-04-25T17:01:38.951163+0000","last_clean":"2024-04-25T17:01:38.951163+0000","last_became_active":"2024-04-25T15:46:33.034493+0000","last_became_peered":"2024-04-25T15:46:33.034493+0000","last_unstale":"2024-04-25T17:01:38.951163+0000","last_undegraded":"2024-04-25T17:01:38.951163+0000","last_fullsized":"2024-04-25T17:01:38.951163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:16.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":29846,"num_write":355,"num_write_kb":66952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"24'423","reported_seq":473,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:35.016607+0000","last_change":"2024-04-25T15:46:31.688398+0000","last_active":"2024-04-25T17:00:35.016607+0000","last_peered":"2024-04-25T17:00:35.016607+0000","last_clean":"2024-04-25T17:00:35.016607+0000","last_became_active":"2024-04-25T15:46:31.688096+0000","last_became_peered":"2024-04-25T15:46:31.688096+0000","last_unstale":"2024-04-25T17:00:35.016607+0000","last_undegraded":"2024-04-25T17:00:35.016607+0000","last_fullsized":"2024-04-25T17:00:35.016607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:53.729696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"24'423","reported_seq":498,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996679+0000","last_change":"2024-04-25T15:46:33.031520+0000","last_active":"2024-04-25T17:01:38.996679+0000","last_peered":"2024-04-25T17:01:38.996679+0000","last_clean":"2024-04-25T17:01:38.996679+0000","last_became_active":"2024-04-25T15:46:33.031282+0000","last_became_peered":"2024-04-25T15:46:33.031282+0000","last_unstale":"2024-04-25T17:01:38.996679+0000","last_undegraded":"2024-04-25T17:01:38.996679+0000","last_fullsized":"2024-04-25T17:01:38.996679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:41.663796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11364,"num_write":392,"num_write_kb":80312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"24'62","reported_seq":112,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:12.317879+0000","last_change":"2024-04-25T15:46:31.691191+0000","last_active":"2024-04-25T17:01:12.317879+0000","last_peered":"2024-04-25T17:01:12.317879+0000","last_clean":"2024-04-25T17:01:12.317879+0000","last_became_active":"2024-04-25T15:46:31.690848+0000","last_became_peered":"2024-04-25T15:46:31.690848+0000","last_unstale":"2024-04-25T17:01:12.317879+0000","last_undegraded":"2024-04-25T17:01:12.317879+0000","last_fullsized":"2024-04-25T17:01:12.317879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'391","reported_seq":450,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.964984+0000","last_change":"2024-04-25T15:46:33.040890+0000","last_active":"2024-04-25T17:01:38.964984+0000","last_peered":"2024-04-25T17:01:38.964984+0000","last_clean":"2024-04-25T17:01:38.964984+0000","last_became_active":"2024-04-25T15:46:33.040568+0000","last_became_peered":"2024-04-25T15:46:33.040568+0000","last_unstale":"2024-04-25T17:01:38.964984+0000","last_undegraded":"2024-04-25T17:01:38.964984+0000","last_fullsized":"2024-04-25T17:01:38.964984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:04.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":1556,"num_write":356,"num_write_kb":55877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"24'58","reported_seq":108,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T16:59:56.238276+0000","last_change":"2024-04-25T15:46:31.659031+0000","last_active":"2024-04-25T16:59:56.238276+0000","last_peered":"2024-04-25T16:59:56.238276+0000","last_clean":"2024-04-25T16:59:56.238276+0000","last_became_active":"2024-04-25T15:46:31.658670+0000","last_became_peered":"2024-04-25T15:46:31.658670+0000","last_unstale":"2024-04-25T16:59:56.238276+0000","last_undegraded":"2024-04-25T16:59:56.238276+0000","last_fullsized":"2024-04-25T16:59:56.238276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"24'439","reported_seq":516,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.993735+0000","last_change":"2024-04-25T15:46:33.021142+0000","last_active":"2024-04-25T17:01:38.993735+0000","last_peered":"2024-04-25T17:01:38.993735+0000","last_clean":"2024-04-25T17:01:38.993735+0000","last_became_active":"2024-04-25T15:46:33.020753+0000","last_became_peered":"2024-04-25T15:46:33.020753+0000","last_unstale":"2024-04-25T17:01:38.993735+0000","last_undegraded":"2024-04-25T17:01:38.993735+0000","last_fullsized":"2024-04-25T17:01:38.993735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17823,"num_write":412,"num_write_kb":54819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'566","reported_seq":616,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:31.049237+0000","last_change":"2024-04-25T15:46:31.703454+0000","last_active":"2024-04-25T17:01:31.049237+0000","last_peered":"2024-04-25T17:01:31.049237+0000","last_clean":"2024-04-25T17:01:31.049237+0000","last_became_active":"2024-04-25T15:46:31.703167+0000","last_became_peered":"2024-04-25T15:46:31.703167+0000","last_unstale":"2024-04-25T17:01:31.049237+0000","last_undegraded":"2024-04-25T17:01:31.049237+0000","last_fullsized":"2024-04-25T17:01:31.049237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:02.958438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":510,"num_write_kb":8426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"24'470","reported_seq":592,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.950114+0000","last_change":"2024-04-25T15:46:33.039900+0000","last_active":"2024-04-25T17:01:38.950114+0000","last_peered":"2024-04-25T17:01:38.950114+0000","last_clean":"2024-04-25T17:01:38.950114+0000","last_became_active":"2024-04-25T15:46:33.039613+0000","last_became_peered":"2024-04-25T15:46:33.039613+0000","last_unstale":"2024-04-25T17:01:38.950114+0000","last_undegraded":"2024-04-25T17:01:38.950114+0000","last_fullsized":"2024-04-25T17:01:38.950114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":36444,"num_write":435,"num_write_kb":71594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'805","reported_seq":856,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:11.165829+0000","last_change":"2024-04-25T15:46:31.684537+0000","last_active":"2024-04-25T17:01:11.165829+0000","last_peered":"2024-04-25T17:01:11.165829+0000","last_clean":"2024-04-25T17:01:11.165829+0000","last_became_active":"2024-04-25T15:46:31.684173+0000","last_became_peered":"2024-04-25T15:46:31.684173+0000","last_unstale":"2024-04-25T17:01:11.165829+0000","last_undegraded":"2024-04-25T17:01:11.165829+0000","last_fullsized":"2024-04-25T17:01:11.165829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:41.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":4496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'360","reported_seq":440,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.957203+0000","last_change":"2024-04-25T15:46:33.037831+0000","last_active":"2024-04-25T17:01:38.957203+0000","last_peered":"2024-04-25T17:01:38.957203+0000","last_clean":"2024-04-25T17:01:38.957203+0000","last_became_active":"2024-04-25T15:46:33.037529+0000","last_became_peered":"2024-04-25T15:46:33.037529+0000","last_unstale":"2024-04-25T17:01:38.957203+0000","last_undegraded":"2024-04-25T17:01:38.957203+0000","last_fullsized":"2024-04-25T17:01:38.957203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:20.677976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":10575,"num_write":335,"num_write_kb":42548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'799","reported_seq":850,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:13.079781+0000","last_change":"2024-04-25T15:46:31.704159+0000","last_active":"2024-04-25T17:00:13.079781+0000","last_peered":"2024-04-25T17:00:13.079781+0000","last_clean":"2024-04-25T17:00:13.079781+0000","last_became_active":"2024-04-25T15:46:31.703896+0000","last_became_peered":"2024-04-25T15:46:31.703896+0000","last_unstale":"2024-04-25T17:00:13.079781+0000","last_undegraded":"2024-04-25T17:00:13.079781+0000","last_fullsized":"2024-04-25T17:00:13.079781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":4482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'410","reported_seq":481,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.963314+0000","last_change":"2024-04-25T15:46:33.038719+0000","last_active":"2024-04-25T17:01:38.963314+0000","last_peered":"2024-04-25T17:01:38.963314+0000","last_clean":"2024-04-25T17:01:38.963314+0000","last_became_active":"2024-04-25T15:46:33.038380+0000","last_became_peered":"2024-04-25T15:46:33.038380+0000","last_unstale":"2024-04-25T17:01:38.963314+0000","last_undegraded":"2024-04-25T17:01:38.963314+0000","last_fullsized":"2024-04-25T17:01:38.963314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:13:33.423087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18534,"num_write":381,"num_write_kb":108433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'789","reported_seq":840,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:27.829293+0000","last_change":"2024-04-25T15:46:31.690489+0000","last_active":"2024-04-25T17:00:27.829293+0000","last_peered":"2024-04-25T17:00:27.829293+0000","last_clean":"2024-04-25T17:00:27.829293+0000","last_became_active":"2024-04-25T15:46:31.690181+0000","last_became_peered":"2024-04-25T15:46:31.690181+0000","last_unstale":"2024-04-25T17:00:27.829293+0000","last_undegraded":"2024-04-25T17:00:27.829293+0000","last_fullsized":"2024-04-25T17:00:27.829293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'428","reported_seq":501,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.971899+0000","last_change":"2024-04-25T15:46:33.036460+0000","last_active":"2024-04-25T17:01:38.971899+0000","last_peered":"2024-04-25T17:01:38.971899+0000","last_clean":"2024-04-25T17:01:38.971899+0000","last_became_active":"2024-04-25T15:46:33.036033+0000","last_became_peered":"2024-04-25T15:46:33.036033+0000","last_unstale":"2024-04-25T17:01:38.971899+0000","last_undegraded":"2024-04-25T17:01:38.971899+0000","last_fullsized":"2024-04-25T17:01:38.971899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13038,"num_write":401,"num_write_kb":62698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"24'332","reported_seq":383,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:59.295314+0000","last_change":"2024-04-25T15:46:31.703571+0000","last_active":"2024-04-25T17:00:59.295314+0000","last_peered":"2024-04-25T17:00:59.295314+0000","last_clean":"2024-04-25T17:00:59.295314+0000","last_became_active":"2024-04-25T15:46:31.703234+0000","last_became_peered":"2024-04-25T15:46:31.703234+0000","last_unstale":"2024-04-25T17:00:59.295314+0000","last_undegraded":"2024-04-25T17:00:59.295314+0000","last_fullsized":"2024-04-25T17:00:59.295314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'422","reported_seq":513,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.957568+0000","last_change":"2024-04-25T15:46:33.043464+0000","last_active":"2024-04-25T17:01:38.957568+0000","last_peered":"2024-04-25T17:01:38.957568+0000","last_clean":"2024-04-25T17:01:38.957568+0000","last_became_active":"2024-04-25T15:46:33.043145+0000","last_became_peered":"2024-04-25T15:46:33.043145+0000","last_unstale":"2024-04-25T17:01:38.957568+0000","last_undegraded":"2024-04-25T17:01:38.957568+0000","last_fullsized":"2024-04-25T17:01:38.957568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:06.648469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":16889,"num_write":397,"num_write_kb":47575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":151,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T16:58:32.437867+0000","last_change":"2024-04-25T15:46:20.235628+0000","last_active":"2024-04-25T16:58:32.437867+0000","last_peered":"2024-04-25T16:58:32.437867+0000","last_clean":"2024-04-25T16:58:32.437867+0000","last_became_active":"2024-04-25T15:46:20.234477+0000","last_became_peered":"2024-04-25T15:46:20.234477+0000","last_unstale":"2024-04-25T16:58:32.437867+0000","last_undegraded":"2024-04-25T16:58:32.437867+0000","last_fullsized":"2024-04-25T16:58:32.437867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:17.824148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:17.824148+0000","last_clean_scrub_stamp":"2024-04-25T15:46:17.824148+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:50:25.187348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"24'370","reported_seq":424,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:26.013195+0000","last_change":"2024-04-25T15:46:31.702774+0000","last_active":"2024-04-25T17:01:26.013195+0000","last_peered":"2024-04-25T17:01:26.013195+0000","last_clean":"2024-04-25T17:01:26.013195+0000","last_became_active":"2024-04-25T15:46:31.702517+0000","last_became_peered":"2024-04-25T15:46:31.702517+0000","last_unstale":"2024-04-25T17:01:26.013195+0000","last_undegraded":"2024-04-25T17:01:26.013195+0000","last_fullsized":"2024-04-25T17:01:26.013195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"24'359","reported_seq":436,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.912663+0000","last_change":"2024-04-25T15:46:33.043034+0000","last_active":"2024-04-25T17:01:38.912663+0000","last_peered":"2024-04-25T17:01:38.912663+0000","last_clean":"2024-04-25T17:01:38.912663+0000","last_became_active":"2024-04-25T15:46:33.042522+0000","last_became_peered":"2024-04-25T15:46:33.042522+0000","last_unstale":"2024-04-25T17:01:38.912663+0000","last_undegraded":"2024-04-25T17:01:38.912663+0000","last_fullsized":"2024-04-25T17:01:38.912663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:40.746464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13426,"num_write":320,"num_write_kb":38038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"24'500","reported_seq":555,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:42.449985+0000","last_change":"2024-04-25T15:46:31.689200+0000","last_active":"2024-04-25T17:00:42.449985+0000","last_peered":"2024-04-25T17:00:42.449985+0000","last_clean":"2024-04-25T17:00:42.449985+0000","last_became_active":"2024-04-25T15:46:31.687761+0000","last_became_peered":"2024-04-25T15:46:31.687761+0000","last_unstale":"2024-04-25T17:00:42.449985+0000","last_undegraded":"2024-04-25T17:00:42.449985+0000","last_fullsized":"2024-04-25T17:00:42.449985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":12491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'389","reported_seq":465,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.998213+0000","last_change":"2024-04-25T15:46:33.021652+0000","last_active":"2024-04-25T17:01:38.998213+0000","last_peered":"2024-04-25T17:01:38.998213+0000","last_clean":"2024-04-25T17:01:38.998213+0000","last_became_active":"2024-04-25T15:46:33.020828+0000","last_became_peered":"2024-04-25T15:46:33.020828+0000","last_unstale":"2024-04-25T17:01:38.998213+0000","last_undegraded":"2024-04-25T17:01:38.998213+0000","last_fullsized":"2024-04-25T17:01:38.998213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:11.243833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12952,"num_write":356,"num_write_kb":71047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"24'3154","reported_seq":6294,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:36.053305+0000","last_change":"2024-04-25T15:46:31.704698+0000","last_active":"2024-04-25T17:01:36.053305+0000","last_peered":"2024-04-25T17:01:36.053305+0000","last_clean":"2024-04-25T17:01:36.053305+0000","last_became_active":"2024-04-25T15:46:31.704412+0000","last_became_peered":"2024-04-25T15:46:31.704412+0000","last_unstale":"2024-04-25T17:01:36.053305+0000","last_undegraded":"2024-04-25T17:01:36.053305+0000","last_fullsized":"2024-04-25T17:01:36.053305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3154,"log_dups_size":0,"ondisk_log_size":3154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458732,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3086,"num_read_kb":3630,"num_write":3090,"num_write_kb":3631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'400","reported_seq":467,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.083969+0000","last_change":"2024-04-25T15:46:33.061942+0000","last_active":"2024-04-25T17:01:39.083969+0000","last_peered":"2024-04-25T17:01:39.083969+0000","last_clean":"2024-04-25T17:01:39.083969+0000","last_became_active":"2024-04-25T15:46:33.061619+0000","last_became_peered":"2024-04-25T15:46:33.061619+0000","last_unstale":"2024-04-25T17:01:39.083969+0000","last_undegraded":"2024-04-25T17:01:39.083969+0000","last_fullsized":"2024-04-25T17:01:39.083969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:45.123026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9644,"num_write":362,"num_write_kb":26127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"24'999","reported_seq":1053,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T16:59:27.308098+0000","last_change":"2024-04-25T15:46:31.690694+0000","last_active":"2024-04-25T16:59:27.308098+0000","last_peered":"2024-04-25T16:59:27.308098+0000","last_clean":"2024-04-25T16:59:27.308098+0000","last_became_active":"2024-04-25T15:46:31.690339+0000","last_became_peered":"2024-04-25T15:46:31.690339+0000","last_unstale":"2024-04-25T16:59:27.308098+0000","last_undegraded":"2024-04-25T16:59:27.308098+0000","last_fullsized":"2024-04-25T16:59:27.308098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":939,"num_write_kb":8657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'404","reported_seq":515,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.981609+0000","last_change":"2024-04-25T15:46:33.022306+0000","last_active":"2024-04-25T17:01:38.981609+0000","last_peered":"2024-04-25T17:01:38.981609+0000","last_clean":"2024-04-25T17:01:38.981609+0000","last_became_active":"2024-04-25T15:46:33.021995+0000","last_became_peered":"2024-04-25T15:46:33.021995+0000","last_unstale":"2024-04-25T17:01:38.981609+0000","last_undegraded":"2024-04-25T17:01:38.981609+0000","last_fullsized":"2024-04-25T17:01:38.981609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:03.749619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":19099,"num_write":371,"num_write_kb":59650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"24'307","reported_seq":361,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:40.165445+0000","last_change":"2024-04-25T15:46:31.684114+0000","last_active":"2024-04-25T17:00:40.165445+0000","last_peered":"2024-04-25T17:00:40.165445+0000","last_clean":"2024-04-25T17:00:40.165445+0000","last_became_active":"2024-04-25T15:46:31.683802+0000","last_became_peered":"2024-04-25T15:46:31.683802+0000","last_unstale":"2024-04-25T17:00:40.165445+0000","last_undegraded":"2024-04-25T17:00:40.165445+0000","last_fullsized":"2024-04-25T17:00:40.165445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'416","reported_seq":496,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.973398+0000","last_change":"2024-04-25T15:46:33.040119+0000","last_active":"2024-04-25T17:01:38.973398+0000","last_peered":"2024-04-25T17:01:38.973398+0000","last_clean":"2024-04-25T17:01:38.973398+0000","last_became_active":"2024-04-25T15:46:33.039820+0000","last_became_peered":"2024-04-25T15:46:33.039820+0000","last_unstale":"2024-04-25T17:01:38.973398+0000","last_undegraded":"2024-04-25T17:01:38.973398+0000","last_fullsized":"2024-04-25T17:01:38.973398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:06.648469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13405,"num_write":380,"num_write_kb":62960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"24'638","reported_seq":691,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:31.721553+0000","last_change":"2024-04-25T15:46:31.688610+0000","last_active":"2024-04-25T17:00:31.721553+0000","last_peered":"2024-04-25T17:00:31.721553+0000","last_clean":"2024-04-25T17:00:31.721553+0000","last_became_active":"2024-04-25T15:46:31.688274+0000","last_became_peered":"2024-04-25T15:46:31.688274+0000","last_unstale":"2024-04-25T17:00:31.721553+0000","last_undegraded":"2024-04-25T17:00:31.721553+0000","last_fullsized":"2024-04-25T17:00:31.721553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:02.574106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":579,"num_write_kb":8483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'387","reported_seq":510,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.161796+0000","last_change":"2024-04-25T15:46:33.062042+0000","last_active":"2024-04-25T17:01:39.161796+0000","last_peered":"2024-04-25T17:01:39.161796+0000","last_clean":"2024-04-25T17:01:39.161796+0000","last_became_active":"2024-04-25T15:46:33.061680+0000","last_became_peered":"2024-04-25T15:46:33.061680+0000","last_unstale":"2024-04-25T17:01:39.161796+0000","last_undegraded":"2024-04-25T17:01:39.161796+0000","last_fullsized":"2024-04-25T17:01:39.161796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":42014,"num_write":351,"num_write_kb":75036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"24'3879","reported_seq":3931,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:34.676603+0000","last_change":"2024-04-25T15:46:31.687114+0000","last_active":"2024-04-25T17:01:34.676603+0000","last_peered":"2024-04-25T17:01:34.676603+0000","last_clean":"2024-04-25T17:01:34.676603+0000","last_became_active":"2024-04-25T15:46:31.686758+0000","last_became_peered":"2024-04-25T15:46:31.686758+0000","last_unstale":"2024-04-25T17:01:34.676603+0000","last_undegraded":"2024-04-25T17:01:34.676603+0000","last_fullsized":"2024-04-25T17:01:34.676603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3879,"log_dups_size":0,"ondisk_log_size":3879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10737,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'337","reported_seq":410,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.922681+0000","last_change":"2024-04-25T15:46:33.031231+0000","last_active":"2024-04-25T17:01:38.922681+0000","last_peered":"2024-04-25T17:01:38.922681+0000","last_clean":"2024-04-25T17:01:38.922681+0000","last_became_active":"2024-04-25T15:46:33.030894+0000","last_became_peered":"2024-04-25T15:46:33.030894+0000","last_unstale":"2024-04-25T17:01:38.922681+0000","last_undegraded":"2024-04-25T17:01:38.922681+0000","last_fullsized":"2024-04-25T17:01:38.922681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:40.210974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11416,"num_write":310,"num_write_kb":17828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'235","reported_seq":287,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:53.830348+0000","last_change":"2024-04-25T15:46:31.688577+0000","last_active":"2024-04-25T17:00:53.830348+0000","last_peered":"2024-04-25T17:00:53.830348+0000","last_clean":"2024-04-25T17:00:53.830348+0000","last_became_active":"2024-04-25T15:46:31.687691+0000","last_became_peered":"2024-04-25T15:46:31.687691+0000","last_unstale":"2024-04-25T17:00:53.830348+0000","last_undegraded":"2024-04-25T17:00:53.830348+0000","last_fullsized":"2024-04-25T17:00:53.830348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'474","reported_seq":605,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.994840+0000","last_change":"2024-04-25T15:46:33.021249+0000","last_active":"2024-04-25T17:01:38.994840+0000","last_peered":"2024-04-25T17:01:38.994840+0000","last_clean":"2024-04-25T17:01:38.994840+0000","last_became_active":"2024-04-25T15:46:33.020779+0000","last_became_peered":"2024-04-25T15:46:33.020779+0000","last_unstale":"2024-04-25T17:01:38.994840+0000","last_undegraded":"2024-04-25T17:01:38.994840+0000","last_fullsized":"2024-04-25T17:01:38.994840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:39.504513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":41834,"num_write":442,"num_write_kb":97214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"24'714","reported_seq":766,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:36.706046+0000","last_change":"2024-04-25T15:46:31.689494+0000","last_active":"2024-04-25T17:00:36.706046+0000","last_peered":"2024-04-25T17:00:36.706046+0000","last_clean":"2024-04-25T17:00:36.706046+0000","last_became_active":"2024-04-25T15:46:31.688192+0000","last_became_peered":"2024-04-25T15:46:31.688192+0000","last_unstale":"2024-04-25T17:00:36.706046+0000","last_undegraded":"2024-04-25T17:00:36.706046+0000","last_fullsized":"2024-04-25T17:00:36.706046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":4437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"24'485","reported_seq":603,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.977098+0000","last_change":"2024-04-25T15:46:33.062043+0000","last_active":"2024-04-25T17:01:38.977098+0000","last_peered":"2024-04-25T17:01:38.977098+0000","last_clean":"2024-04-25T17:01:38.977098+0000","last_became_active":"2024-04-25T15:46:33.061651+0000","last_became_peered":"2024-04-25T15:46:33.061651+0000","last_unstale":"2024-04-25T17:01:38.977098+0000","last_undegraded":"2024-04-25T17:01:38.977098+0000","last_fullsized":"2024-04-25T17:01:38.977098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:21.340361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31150,"num_write":464,"num_write_kb":116869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'289","reported_seq":341,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:23.361014+0000","last_change":"2024-04-25T15:46:31.685055+0000","last_active":"2024-04-25T17:00:23.361014+0000","last_peered":"2024-04-25T17:00:23.361014+0000","last_clean":"2024-04-25T17:00:23.361014+0000","last_became_active":"2024-04-25T15:46:31.684706+0000","last_became_peered":"2024-04-25T15:46:31.684706+0000","last_unstale":"2024-04-25T17:00:23.361014+0000","last_undegraded":"2024-04-25T17:00:23.361014+0000","last_fullsized":"2024-04-25T17:00:23.361014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:29.917598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"24'407","reported_seq":500,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.916123+0000","last_change":"2024-04-25T15:46:32.929240+0000","last_active":"2024-04-25T17:01:38.916123+0000","last_peered":"2024-04-25T17:01:38.916123+0000","last_clean":"2024-04-25T17:01:38.916123+0000","last_became_active":"2024-04-25T15:46:32.928971+0000","last_became_peered":"2024-04-25T15:46:32.928971+0000","last_unstale":"2024-04-25T17:01:38.916123+0000","last_undegraded":"2024-04-25T17:01:38.916123+0000","last_fullsized":"2024-04-25T17:01:38.916123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:39.504513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21551,"num_write":373,"num_write_kb":54456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'743","reported_seq":795,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:22.524952+0000","last_change":"2024-04-25T15:46:31.687651+0000","last_active":"2024-04-25T17:00:22.524952+0000","last_peered":"2024-04-25T17:00:22.524952+0000","last_clean":"2024-04-25T17:00:22.524952+0000","last_became_active":"2024-04-25T15:46:31.687335+0000","last_became_peered":"2024-04-25T15:46:31.687335+0000","last_unstale":"2024-04-25T17:00:22.524952+0000","last_undegraded":"2024-04-25T17:00:22.524952+0000","last_fullsized":"2024-04-25T17:00:22.524952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"24'417","reported_seq":478,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.913659+0000","last_change":"2024-04-25T15:46:33.021215+0000","last_active":"2024-04-25T17:01:38.913659+0000","last_peered":"2024-04-25T17:01:38.913659+0000","last_clean":"2024-04-25T17:01:38.913659+0000","last_became_active":"2024-04-25T15:46:33.020855+0000","last_became_peered":"2024-04-25T15:46:33.020855+0000","last_unstale":"2024-04-25T17:01:38.913659+0000","last_undegraded":"2024-04-25T17:01:38.913659+0000","last_fullsized":"2024-04-25T17:01:38.913659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:54.058601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6898,"num_write":384,"num_write_kb":50772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'1028","reported_seq":1079,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.689923+0000","last_change":"2024-04-25T15:46:31.693099+0000","last_active":"2024-04-25T17:01:38.689923+0000","last_peered":"2024-04-25T17:01:38.689923+0000","last_clean":"2024-04-25T17:01:38.689923+0000","last_became_active":"2024-04-25T15:46:31.692762+0000","last_became_peered":"2024-04-25T15:46:31.692762+0000","last_unstale":"2024-04-25T17:01:38.689923+0000","last_undegraded":"2024-04-25T17:01:38.689923+0000","last_fullsized":"2024-04-25T17:01:38.689923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:29.917598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10888152,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":975,"num_write_kb":11131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"24'426","reported_seq":522,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996220+0000","last_change":"2024-04-25T15:46:33.014467+0000","last_active":"2024-04-25T17:01:38.996220+0000","last_peered":"2024-04-25T17:01:38.996220+0000","last_clean":"2024-04-25T17:01:38.996220+0000","last_became_active":"2024-04-25T15:46:33.014116+0000","last_became_peered":"2024-04-25T15:46:33.014116+0000","last_unstale":"2024-04-25T17:01:38.996220+0000","last_undegraded":"2024-04-25T17:01:38.996220+0000","last_fullsized":"2024-04-25T17:01:38.996220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:44.912712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25236,"num_write":391,"num_write_kb":71743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"24'397","reported_seq":515,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.977707+0000","last_change":"2024-04-25T15:46:33.040027+0000","last_active":"2024-04-25T17:01:38.977707+0000","last_peered":"2024-04-25T17:01:38.977707+0000","last_clean":"2024-04-25T17:01:38.977707+0000","last_became_active":"2024-04-25T15:46:33.039713+0000","last_became_peered":"2024-04-25T15:46:33.039713+0000","last_unstale":"2024-04-25T17:01:38.977707+0000","last_undegraded":"2024-04-25T17:01:38.977707+0000","last_fullsized":"2024-04-25T17:01:38.977707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:49.811317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":31357,"num_write":351,"num_write_kb":60889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"24'784","reported_seq":832,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:26.015449+0000","last_change":"2024-04-25T15:46:31.686712+0000","last_active":"2024-04-25T17:01:26.015449+0000","last_peered":"2024-04-25T17:01:26.015449+0000","last_clean":"2024-04-25T17:01:26.015449+0000","last_became_active":"2024-04-25T15:46:31.686390+0000","last_became_peered":"2024-04-25T15:46:31.686390+0000","last_unstale":"2024-04-25T17:01:26.015449+0000","last_undegraded":"2024-04-25T17:01:26.015449+0000","last_fullsized":"2024-04-25T17:01:26.015449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":4471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'374","reported_seq":433,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.968333+0000","last_change":"2024-04-25T15:46:33.041233+0000","last_active":"2024-04-25T17:01:38.968333+0000","last_peered":"2024-04-25T17:01:38.968333+0000","last_clean":"2024-04-25T17:01:38.968333+0000","last_became_active":"2024-04-25T15:46:33.040941+0000","last_became_peered":"2024-04-25T15:46:33.040941+0000","last_unstale":"2024-04-25T17:01:38.968333+0000","last_undegraded":"2024-04-25T17:01:38.968333+0000","last_fullsized":"2024-04-25T17:01:38.968333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8232,"num_write":346,"num_write_kb":71494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'1200","reported_seq":1248,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:19.564433+0000","last_change":"2024-04-25T15:46:31.688658+0000","last_active":"2024-04-25T17:01:19.564433+0000","last_peered":"2024-04-25T17:01:19.564433+0000","last_clean":"2024-04-25T17:01:19.564433+0000","last_became_active":"2024-04-25T15:46:31.688342+0000","last_became_peered":"2024-04-25T15:46:31.688342+0000","last_unstale":"2024-04-25T17:01:19.564433+0000","last_undegraded":"2024-04-25T17:01:19.564433+0000","last_fullsized":"2024-04-25T17:01:19.564433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1200,"log_dups_size":0,"ondisk_log_size":1200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":12844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"24'387","reported_seq":482,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.999769+0000","last_change":"2024-04-25T15:46:33.043423+0000","last_active":"2024-04-25T17:01:38.999769+0000","last_peered":"2024-04-25T17:01:38.999769+0000","last_clean":"2024-04-25T17:01:38.999769+0000","last_became_active":"2024-04-25T15:46:33.043134+0000","last_became_peered":"2024-04-25T15:46:33.043134+0000","last_unstale":"2024-04-25T17:01:38.999769+0000","last_undegraded":"2024-04-25T17:01:38.999769+0000","last_fullsized":"2024-04-25T17:01:38.999769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:40.746464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22111,"num_write":359,"num_write_kb":59931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"24'239","reported_seq":294,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:26.646409+0000","last_change":"2024-04-25T15:46:31.685427+0000","last_active":"2024-04-25T17:00:26.646409+0000","last_peered":"2024-04-25T17:00:26.646409+0000","last_clean":"2024-04-25T17:00:26.646409+0000","last_became_active":"2024-04-25T15:46:31.684729+0000","last_became_peered":"2024-04-25T15:46:31.684729+0000","last_unstale":"2024-04-25T17:00:26.646409+0000","last_undegraded":"2024-04-25T17:00:26.646409+0000","last_fullsized":"2024-04-25T17:00:26.646409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:06.621567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":4173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"24'427","reported_seq":551,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.907920+0000","last_change":"2024-04-25T15:46:33.012259+0000","last_active":"2024-04-25T17:01:38.907920+0000","last_peered":"2024-04-25T17:01:38.907920+0000","last_clean":"2024-04-25T17:01:38.907920+0000","last_became_active":"2024-04-25T15:46:33.011979+0000","last_became_peered":"2024-04-25T15:46:33.011979+0000","last_unstale":"2024-04-25T17:01:38.907920+0000","last_undegraded":"2024-04-25T17:01:38.907920+0000","last_fullsized":"2024-04-25T17:01:38.907920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:47.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":33589,"num_write":403,"num_write_kb":89000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"24'409","reported_seq":463,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:32.058200+0000","last_change":"2024-04-25T15:46:31.688031+0000","last_active":"2024-04-25T17:01:32.058200+0000","last_peered":"2024-04-25T17:01:32.058200+0000","last_clean":"2024-04-25T17:01:32.058200+0000","last_became_active":"2024-04-25T15:46:31.687705+0000","last_became_peered":"2024-04-25T15:46:31.687705+0000","last_unstale":"2024-04-25T17:01:32.058200+0000","last_undegraded":"2024-04-25T17:01:32.058200+0000","last_fullsized":"2024-04-25T17:01:32.058200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:28.618857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2746,"num_read_kb":1448171,"num_write":24417,"num_write_kb":4365214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26337,"ondisk_log_size":26337,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":184318122,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":3086,"num_read_kb":3630,"num_write":31925,"num_write_kb":196586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368795648,"data_stored":368636244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26820,"ondisk_log_size":26820,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510349,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140188,"kb_used_data":72916,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94231652,"statfs":{"total":96636764160,"available":96493211648,"internally_reserved":0,"allocated":74665984,"data_stored":74483790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510349,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120840,"kb_used_data":49408,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94251000,"statfs":{"total":96636764160,"available":96513024000,"internally_reserved":0,"allocated":50593792,"data_stored":50421810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510351,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108492,"kb_used_data":41220,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94263348,"statfs":{"total":96636764160,"available":96525668352,"internally_reserved":0,"allocated":42209280,"data_stored":42033230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510349,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119124,"kb_used_data":51852,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94252716,"statfs":{"total":96636764160,"available":96514781184,"internally_reserved":0,"allocated":53096448,"data_stored":52920718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510350,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93600,"kb_used_data":22168,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94278240,"statfs":{"total":96636764160,"available":96540917760,"internally_reserved":0,"allocated":22700032,"data_stored":22519792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510351,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125008,"kb_used_data":49416,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94246832,"statfs":{"total":96636764160,"available":96508755968,"internally_reserved":0,"allocated":50601984,"data_stored":50421404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543054,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128096,"kb_used_data":34456,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94243744,"statfs":{"total":96636764160,"available":96505593856,"internally_reserved":0,"allocated":35282944,"data_stored":35103852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":95877576},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543055,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99340,"kb_used_data":41796,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94272500,"statfs":{"total":96636764160,"available":96535040000,"internally_reserved":0,"allocated":42799104,"data_stored":42622880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41959424,"data_stored":41943700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50356224,"data_stored":50332592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22454272,"data_stored":22430980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35037184,"data_stored":35015040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":52850688,"data_stored":52831906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41963520,"data_stored":41944418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":50348032,"data_stored":50332998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73826304,"data_stored":73804610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T17:01:45.710 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T17:01:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.859+0000 7f02eca69640 1 Processor -- start 2024-04-25T17:01:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.860+0000 7f02eca69640 1 -- start start 2024-04-25T17:01:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.861+0000 7f02eca69640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02e80b41c0 0x7f02e80cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.861+0000 7f02eca69640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f02e80cd680 0x7f02e815c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.861+0000 7f02eca69640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e815cd60 con 0x7f02e815c6f0 2024-04-25T17:01:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.861+0000 7f02eca69640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f02e815cb00 con 0x7f02e80b41c0 2024-04-25T17:01:45.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.861+0000 7f02eca69640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f02e815d040 con 0x7f02e80cd680 2024-04-25T17:01:45.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.862+0000 7f02e659c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02e80b41c0 0x7f02e80cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:45.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.862+0000 7f02e5d9b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f02e80cd680 0x7f02e815c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:45.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.862+0000 7f02e5d9b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f02e80cd680 0x7f02e815c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53104/0 (socket says 172.21.15.59:53104) 2024-04-25T17:01:45.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.862+0000 7f02e5d9b640 1 -- 172.21.15.59:0/366382318 learned_addr learned my addr 172.21.15.59:0/366382318 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.866+0000 7f02e5d9b640 1 -- 172.21.15.59:0/366382318 >> v2:172.21.15.59:3300/0 conn(0x7f02e80b41c0 msgr2=0x7f02e80cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.866+0000 7f02e5d9b640 1 --2- 172.21.15.59:0/366382318 >> v2:172.21.15.59:3300/0 conn(0x7f02e80b41c0 0x7f02e80cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.866+0000 7f02e5d9b640 1 -- 172.21.15.59:0/366382318 >> v1:172.21.15.59:6789/0 conn(0x7f02e815c6f0 legacy=0x7f02e80ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:45.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.866+0000 7f02e5d9b640 1 -- 172.21.15.59:0/366382318 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e815d320 con 0x7f02e80cd680 2024-04-25T17:01:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.869+0000 7f02e5d9b640 1 --2- 172.21.15.59:0/366382318 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f02e80cd680 0x7f02e815c1b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009870 tx=0x7f02dc02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4deb7f060814205 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:45.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.872+0000 7f02e559a640 1 -- 172.21.15.59:0/366382318 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc037070 con 0x7f02e80cd680 2024-04-25T17:01:45.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.874+0000 7f02e559a640 1 -- 172.21.15.59:0/366382318 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02dc032440 con 0x7f02e80cd680 2024-04-25T17:01:45.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.874+0000 7f02e559a640 1 -- 172.21.15.59:0/366382318 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc032810 con 0x7f02e80cd680 2024-04-25T17:01:45.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.875+0000 7f02eca69640 1 -- 172.21.15.59:0/366382318 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f02e80cd680 msgr2=0x7f02e815c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:45.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.875+0000 7f02eca69640 1 --2- 172.21.15.59:0/366382318 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f02e80cd680 0x7f02e815c1b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009870 tx=0x7f02dc02a270 comp rx=0 tx=0).stop 2024-04-25T17:01:45.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.875+0000 7f02eca69640 1 -- 172.21.15.59:0/366382318 shutdown_connections 2024-04-25T17:01:45.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.875+0000 7f02eca69640 1 --2- 172.21.15.59:0/366382318 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f02e80cd680 0x7f02e815c1b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:45.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.875+0000 7f02eca69640 1 --2- 172.21.15.59:0/366382318 >> v2:172.21.15.59:3300/0 conn(0x7f02e80b41c0 0x7f02e80cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:45.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.875+0000 7f02eca69640 1 -- 172.21.15.59:0/366382318 >> 172.21.15.59:0/366382318 conn(0x7f02e806ed70 msgr2=0x7f02e806f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:45.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.875+0000 7f02eca69640 1 -- 172.21.15.59:0/366382318 shutdown_connections 2024-04-25T17:01:45.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.875+0000 7f02eca69640 1 -- 172.21.15.59:0/366382318 wait complete. 2024-04-25T17:01:45.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.877+0000 7f02eca69640 1 Processor -- start 2024-04-25T17:01:45.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.877+0000 7f02eca69640 1 -- start start 2024-04-25T17:01:45.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.878+0000 7f02eca69640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02e80b41c0 0x7f02e81f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:45.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.878+0000 7f02eca69640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f02e80cd680 0x7f02e81f3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:45.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.878+0000 7f02eca69640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e815c6f0 0x7f02e81580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:45.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.878+0000 7f02eca69640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f02e80b78a0 con 0x7f02e815c6f0 2024-04-25T17:01:45.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.878+0000 7f02eca69640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f02e80ce020 con 0x7f02e80b41c0 2024-04-25T17:01:45.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.878+0000 7f02eca69640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f02e80c51e0 con 0x7f02e80cd680 2024-04-25T17:01:45.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.879+0000 7f02e6d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e815c6f0 0x7f02e81580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:45.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.879+0000 7f02e5d9b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f02e80cd680 0x7f02e81f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:45.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.879+0000 7f02e6d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e815c6f0 0x7f02e81580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51118/0 (socket says 172.21.15.59:51118) 2024-04-25T17:01:45.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.879+0000 7f02e6d9d640 1 -- 172.21.15.59:0/3566812529 learned_addr learned my addr 172.21.15.59:0/3566812529 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:45.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.880+0000 7f02e659c640 1 --2- 172.21.15.59:0/3566812529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02e80b41c0 0x7f02e81f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:45.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.883+0000 7f02e6d9d640 1 -- 172.21.15.59:0/3566812529 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f02e80cd680 msgr2=0x7f02e81f3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:45.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.883+0000 7f02e6d9d640 1 --2- 172.21.15.59:0/3566812529 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f02e80cd680 0x7f02e81f3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:45.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.883+0000 7f02e6d9d640 1 -- 172.21.15.59:0/3566812529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02e80b41c0 msgr2=0x7f02e81f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:45.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.883+0000 7f02e6d9d640 1 --2- 172.21.15.59:0/3566812529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02e80b41c0 0x7f02e81f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:45.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.883+0000 7f02e6d9d640 1 -- 172.21.15.59:0/3566812529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e81f3a50 con 0x7f02e815c6f0 2024-04-25T17:01:45.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.886+0000 7f02e6d9d640 1 --2- 172.21.15.59:0/3566812529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e815c6f0 0x7f02e81580b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f02d800c680 tx=0x7f02d800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.895+0000 7f02d6ffd640 1 -- 172.21.15.59:0/3566812529 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d8003b70 con 0x7f02e815c6f0 2024-04-25T17:01:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.895+0000 7f02d6ffd640 1 -- 172.21.15.59:0/3566812529 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02d8003d10 con 0x7f02e815c6f0 2024-04-25T17:01:45.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.895+0000 7f02d6ffd640 1 -- 172.21.15.59:0/3566812529 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d8005310 con 0x7f02e815c6f0 2024-04-25T17:01:45.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.895+0000 7f02eca69640 1 -- 172.21.15.59:0/3566812529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e81f3030 con 0x7f02e815c6f0 2024-04-25T17:01:45.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.895+0000 7f02eca69640 1 -- 172.21.15.59:0/3566812529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e8155100 con 0x7f02e815c6f0 2024-04-25T17:01:45.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.897+0000 7f02eca69640 1 -- 172.21.15.59:0/3566812529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e80c8850 con 0x7f02e815c6f0 2024-04-25T17:01:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.920+0000 7f02d6ffd640 1 -- 172.21.15.59:0/3566812529 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f02d80054b0 con 0x7f02e815c6f0 2024-04-25T17:01:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.920+0000 7f02d6ffd640 1 --2- 172.21.15.59:0/3566812529 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f02c8074500 0x7f02c8076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:45.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.920+0000 7f02e659c640 1 --2- 172.21.15.59:0/3566812529 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f02c8074500 0x7f02c8076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:45.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.921+0000 7f02e659c640 1 --2- 172.21.15.59:0/3566812529 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f02c8074500 0x7f02c8076a10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009aa0 tx=0x7f02e0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:45.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:45.923+0000 7f02d6ffd640 1 -- 172.21.15.59:0/3566812529 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f02d80057a0 con 0x7f02e815c6f0 2024-04-25T17:01:46.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.204+0000 7f02d6ffd640 1 -- 172.21.15.59:0/3566812529 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f02e80c8850 con 0x7f02e815c6f0 2024-04-25T17:01:46.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.391+0000 7f02eca69640 1 -- 172.21.15.59:0/3566812529 --> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f02e8154b80 con 0x7f02c8074500 2024-04-25T17:01:46.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.398+0000 7f02d6ffd640 1 -- 172.21.15.59:0/3566812529 <== mgr.4102 v2:172.21.15.59:6800/2368090706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253925 (secure 0 0 0) 0x7f02e8154b80 con 0x7f02c8074500 2024-04-25T17:01:46.399 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T17:01:46.400 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T17:01:46.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.402+0000 7f02eca69640 1 -- 172.21.15.59:0/3566812529 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f02c8074500 msgr2=0x7f02c8076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:46.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.402+0000 7f02eca69640 1 --2- 172.21.15.59:0/3566812529 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f02c8074500 0x7f02c8076a10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009aa0 tx=0x7f02e0009190 comp rx=0 tx=0).stop 2024-04-25T17:01:46.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.402+0000 7f02eca69640 1 -- 172.21.15.59:0/3566812529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e815c6f0 msgr2=0x7f02e81580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:46.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.402+0000 7f02eca69640 1 --2- 172.21.15.59:0/3566812529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e815c6f0 0x7f02e81580b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f02d800c680 tx=0x7f02d800cb40 comp rx=0 tx=0).stop 2024-04-25T17:01:46.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.402+0000 7f02eca69640 1 -- 172.21.15.59:0/3566812529 shutdown_connections 2024-04-25T17:01:46.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.402+0000 7f02eca69640 1 --2- 172.21.15.59:0/3566812529 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f02c8074500 0x7f02c8076a10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:46.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.402+0000 7f02eca69640 1 --2- 172.21.15.59:0/3566812529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e815c6f0 0x7f02e81580b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:46.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.402+0000 7f02eca69640 1 --2- 172.21.15.59:0/3566812529 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f02e80cd680 0x7f02e81f3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.402+0000 7f02eca69640 1 --2- 172.21.15.59:0/3566812529 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02e80b41c0 0x7f02e81f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.402+0000 7f02eca69640 1 -- 172.21.15.59:0/3566812529 >> 172.21.15.59:0/3566812529 conn(0x7f02e806ed70 msgr2=0x7f02e80ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.402+0000 7f02eca69640 1 -- 172.21.15.59:0/3566812529 shutdown_connections 2024-04-25T17:01:46.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.402+0000 7f02eca69640 1 -- 172.21.15.59:0/3566812529 wait complete. 2024-04-25T17:01:46.412 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":2283,"stamp":"2024-04-25T17:01:45.417294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":184908490,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":5898,"num_read_kb":1451856,"num_write":56443,"num_write_kb":4563428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53229,"ondisk_log_size":53229,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":934688,"kb_used_data":363232,"kb_used_omap":12,"kb_used_meta":571379,"kb_avail":754040032,"statfs":{"total":773094113280,"available":772136992768,"internally_reserved":0,"allocated":371949568,"data_stored":370527476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":585092658},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2165,"num_objects":-4,"num_object_clones":0,"num_object_copies":-8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":26,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003026"},"pg_stats":[{"pgid":"3.3f","version":"24'430","reported_seq":557,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.999197+0000","last_change":"2024-04-25T15:47:08.942552+0000","last_active":"2024-04-25T17:01:38.999197+0000","last_peered":"2024-04-25T17:01:38.999197+0000","last_clean":"2024-04-25T17:01:38.999197+0000","last_became_active":"2024-04-25T15:47:08.942222+0000","last_became_peered":"2024-04-25T15:47:08.942222+0000","last_unstale":"2024-04-25T17:01:38.999197+0000","last_undegraded":"2024-04-25T17:01:38.999197+0000","last_fullsized":"2024-04-25T17:01:38.999197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":51437,"num_write":399,"num_write_kb":108426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"24'420","reported_seq":504,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.002197+0000","last_change":"2024-04-25T15:46:33.022420+0000","last_active":"2024-04-25T17:01:39.002197+0000","last_peered":"2024-04-25T17:01:39.002197+0000","last_clean":"2024-04-25T17:01:39.002197+0000","last_became_active":"2024-04-25T15:46:33.022095+0000","last_became_peered":"2024-04-25T15:46:33.022095+0000","last_unstale":"2024-04-25T17:01:39.002197+0000","last_undegraded":"2024-04-25T17:01:39.002197+0000","last_fullsized":"2024-04-25T17:01:39.002197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15735,"num_write":392,"num_write_kb":67130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"24'384","reported_seq":464,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.997245+0000","last_change":"2024-04-25T15:46:33.063451+0000","last_active":"2024-04-25T17:01:38.997245+0000","last_peered":"2024-04-25T17:01:38.997245+0000","last_clean":"2024-04-25T17:01:38.997245+0000","last_became_active":"2024-04-25T15:46:33.063038+0000","last_became_peered":"2024-04-25T15:46:33.063038+0000","last_unstale":"2024-04-25T17:01:38.997245+0000","last_undegraded":"2024-04-25T17:01:38.997245+0000","last_fullsized":"2024-04-25T17:01:38.997245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:49:29.792442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13830,"num_write":355,"num_write_kb":38647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"24'395","reported_seq":469,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.079625+0000","last_change":"2024-04-25T15:47:09.046881+0000","last_active":"2024-04-25T17:01:39.079625+0000","last_peered":"2024-04-25T17:01:39.079625+0000","last_clean":"2024-04-25T17:01:39.079625+0000","last_became_active":"2024-04-25T15:47:09.046576+0000","last_became_peered":"2024-04-25T15:47:09.046576+0000","last_unstale":"2024-04-25T17:01:39.079625+0000","last_undegraded":"2024-04-25T17:01:39.079625+0000","last_fullsized":"2024-04-25T17:01:39.079625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":6992,"num_write":371,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"24'432","reported_seq":558,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.951575+0000","last_change":"2024-04-25T15:46:33.063350+0000","last_active":"2024-04-25T17:01:38.951575+0000","last_peered":"2024-04-25T17:01:38.951575+0000","last_clean":"2024-04-25T17:01:38.951575+0000","last_became_active":"2024-04-25T15:46:33.063110+0000","last_became_peered":"2024-04-25T15:46:33.063110+0000","last_unstale":"2024-04-25T17:01:38.951575+0000","last_undegraded":"2024-04-25T17:01:38.951575+0000","last_fullsized":"2024-04-25T17:01:38.951575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":46382,"num_write":409,"num_write_kb":84827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"24'371","reported_seq":423,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.967663+0000","last_change":"2024-04-25T15:46:33.040765+0000","last_active":"2024-04-25T17:01:38.967663+0000","last_peered":"2024-04-25T17:01:38.967663+0000","last_clean":"2024-04-25T17:01:38.967663+0000","last_became_active":"2024-04-25T15:46:33.040272+0000","last_became_peered":"2024-04-25T15:46:33.040272+0000","last_unstale":"2024-04-25T17:01:38.967663+0000","last_undegraded":"2024-04-25T17:01:38.967663+0000","last_fullsized":"2024-04-25T17:01:38.967663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:20.677976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":345,"num_write_kb":38164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"24'405","reported_seq":505,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.942762+0000","last_change":"2024-04-25T15:46:33.037395+0000","last_active":"2024-04-25T17:01:38.942762+0000","last_peered":"2024-04-25T17:01:38.942762+0000","last_clean":"2024-04-25T17:01:38.942762+0000","last_became_active":"2024-04-25T15:46:33.036613+0000","last_became_peered":"2024-04-25T15:46:33.036613+0000","last_unstale":"2024-04-25T17:01:38.942762+0000","last_undegraded":"2024-04-25T17:01:38.942762+0000","last_fullsized":"2024-04-25T17:01:38.942762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29371,"num_write":377,"num_write_kb":63589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"24'387","reported_seq":479,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.079573+0000","last_change":"2024-04-25T15:47:09.047263+0000","last_active":"2024-04-25T17:01:39.079573+0000","last_peered":"2024-04-25T17:01:39.079573+0000","last_clean":"2024-04-25T17:01:39.079573+0000","last_became_active":"2024-04-25T15:47:09.046942+0000","last_became_peered":"2024-04-25T15:47:09.046942+0000","last_unstale":"2024-04-25T17:01:39.079573+0000","last_undegraded":"2024-04-25T17:01:39.079573+0000","last_fullsized":"2024-04-25T17:01:39.079573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37992,"num_write":353,"num_write_kb":79970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"24'414","reported_seq":514,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.962775+0000","last_change":"2024-04-25T15:46:33.043405+0000","last_active":"2024-04-25T17:01:38.962775+0000","last_peered":"2024-04-25T17:01:38.962775+0000","last_clean":"2024-04-25T17:01:38.962775+0000","last_became_active":"2024-04-25T15:46:33.043094+0000","last_became_peered":"2024-04-25T15:46:33.043094+0000","last_unstale":"2024-04-25T17:01:38.962775+0000","last_undegraded":"2024-04-25T17:01:38.962775+0000","last_fullsized":"2024-04-25T17:01:38.962775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:49.811317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25428,"num_write":377,"num_write_kb":51351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"24'395","reported_seq":472,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.004887+0000","last_change":"2024-04-25T15:46:33.037180+0000","last_active":"2024-04-25T17:01:39.004887+0000","last_peered":"2024-04-25T17:01:39.004887+0000","last_clean":"2024-04-25T17:01:39.004887+0000","last_became_active":"2024-04-25T15:46:33.036822+0000","last_became_peered":"2024-04-25T15:46:33.036822+0000","last_unstale":"2024-04-25T17:01:39.004887+0000","last_undegraded":"2024-04-25T17:01:39.004887+0000","last_fullsized":"2024-04-25T17:01:39.004887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:45.123026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15654,"num_write":362,"num_write_kb":47082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"24'382","reported_seq":452,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.993868+0000","last_change":"2024-04-25T15:46:33.040594+0000","last_active":"2024-04-25T17:01:38.993868+0000","last_peered":"2024-04-25T17:01:38.993868+0000","last_clean":"2024-04-25T17:01:38.993868+0000","last_became_active":"2024-04-25T15:46:33.040296+0000","last_became_peered":"2024-04-25T15:46:33.040296+0000","last_unstale":"2024-04-25T17:01:38.993868+0000","last_undegraded":"2024-04-25T17:01:38.993868+0000","last_fullsized":"2024-04-25T17:01:38.993868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:47.844325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9049,"num_write":364,"num_write_kb":58665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"24'374","reported_seq":475,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.990927+0000","last_change":"2024-04-25T15:46:33.011129+0000","last_active":"2024-04-25T17:01:38.990927+0000","last_peered":"2024-04-25T17:01:38.990927+0000","last_clean":"2024-04-25T17:01:38.990927+0000","last_became_active":"2024-04-25T15:46:33.010754+0000","last_became_peered":"2024-04-25T15:46:33.010754+0000","last_unstale":"2024-04-25T17:01:38.990927+0000","last_undegraded":"2024-04-25T17:01:38.990927+0000","last_fullsized":"2024-04-25T17:01:38.990927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:31.093111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27496,"num_write":346,"num_write_kb":71109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"24'401","reported_seq":495,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.923244+0000","last_change":"2024-04-25T15:46:33.011388+0000","last_active":"2024-04-25T17:01:38.923244+0000","last_peered":"2024-04-25T17:01:38.923244+0000","last_clean":"2024-04-25T17:01:38.923244+0000","last_became_active":"2024-04-25T15:46:33.011083+0000","last_became_peered":"2024-04-25T15:46:33.011083+0000","last_unstale":"2024-04-25T17:01:38.923244+0000","last_undegraded":"2024-04-25T17:01:38.923244+0000","last_fullsized":"2024-04-25T17:01:38.923244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:22.959149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":17390,"num_write":371,"num_write_kb":87698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"24'409","reported_seq":485,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.997095+0000","last_change":"2024-04-25T15:46:33.022531+0000","last_active":"2024-04-25T17:01:38.997095+0000","last_peered":"2024-04-25T17:01:38.997095+0000","last_clean":"2024-04-25T17:01:38.997095+0000","last_became_active":"2024-04-25T15:46:33.022214+0000","last_became_peered":"2024-04-25T15:46:33.022214+0000","last_unstale":"2024-04-25T17:01:38.997095+0000","last_undegraded":"2024-04-25T17:01:38.997095+0000","last_fullsized":"2024-04-25T17:01:38.997095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:19.052124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17435,"num_write":384,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"24'435","reported_seq":563,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.085228+0000","last_change":"2024-04-25T15:46:32.929715+0000","last_active":"2024-04-25T17:01:39.085228+0000","last_peered":"2024-04-25T17:01:39.085228+0000","last_clean":"2024-04-25T17:01:39.085228+0000","last_became_active":"2024-04-25T15:46:32.929386+0000","last_became_peered":"2024-04-25T15:46:32.929386+0000","last_unstale":"2024-04-25T17:01:39.085228+0000","last_undegraded":"2024-04-25T17:01:39.085228+0000","last_fullsized":"2024-04-25T17:01:39.085228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:47.844325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41362,"num_write":401,"num_write_kb":92598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"24'426","reported_seq":499,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.966357+0000","last_change":"2024-04-25T15:46:33.041583+0000","last_active":"2024-04-25T17:01:38.966357+0000","last_peered":"2024-04-25T17:01:38.966357+0000","last_clean":"2024-04-25T17:01:38.966357+0000","last_became_active":"2024-04-25T15:46:33.040240+0000","last_became_peered":"2024-04-25T15:46:33.040240+0000","last_unstale":"2024-04-25T17:01:38.966357+0000","last_undegraded":"2024-04-25T17:01:38.966357+0000","last_fullsized":"2024-04-25T17:01:38.966357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16384,"num_write":396,"num_write_kb":62713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"24'404","reported_seq":490,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.972544+0000","last_change":"2024-04-25T15:46:33.044561+0000","last_active":"2024-04-25T17:01:38.972544+0000","last_peered":"2024-04-25T17:01:38.972544+0000","last_clean":"2024-04-25T17:01:38.972544+0000","last_became_active":"2024-04-25T15:46:33.044065+0000","last_became_peered":"2024-04-25T15:46:33.044065+0000","last_unstale":"2024-04-25T17:01:38.972544+0000","last_undegraded":"2024-04-25T17:01:38.972544+0000","last_fullsized":"2024-04-25T17:01:38.972544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:33.557001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":15331,"num_write":377,"num_write_kb":71706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"24'418","reported_seq":517,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.079842+0000","last_change":"2024-04-25T15:46:33.061929+0000","last_active":"2024-04-25T17:01:39.079842+0000","last_peered":"2024-04-25T17:01:39.079842+0000","last_clean":"2024-04-25T17:01:39.079842+0000","last_became_active":"2024-04-25T15:46:33.061623+0000","last_became_peered":"2024-04-25T15:46:33.061623+0000","last_unstale":"2024-04-25T17:01:39.079842+0000","last_undegraded":"2024-04-25T17:01:39.079842+0000","last_fullsized":"2024-04-25T17:01:39.079842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:28.844626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29942,"num_write":388,"num_write_kb":91861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"24'442","reported_seq":554,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.948818+0000","last_change":"2024-04-25T15:46:33.063451+0000","last_active":"2024-04-25T17:01:38.948818+0000","last_peered":"2024-04-25T17:01:38.948818+0000","last_clean":"2024-04-25T17:01:38.948818+0000","last_became_active":"2024-04-25T15:46:33.063126+0000","last_became_peered":"2024-04-25T15:46:33.063126+0000","last_unstale":"2024-04-25T17:01:38.948818+0000","last_undegraded":"2024-04-25T17:01:38.948818+0000","last_fullsized":"2024-04-25T17:01:38.948818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:49.144595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":28728,"num_write":405,"num_write_kb":157712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"24'446","reported_seq":529,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996562+0000","last_change":"2024-04-25T15:46:33.014377+0000","last_active":"2024-04-25T17:01:38.996562+0000","last_peered":"2024-04-25T17:01:38.996562+0000","last_clean":"2024-04-25T17:01:38.996562+0000","last_became_active":"2024-04-25T15:46:33.014056+0000","last_became_peered":"2024-04-25T15:46:33.014056+0000","last_unstale":"2024-04-25T17:01:38.996562+0000","last_undegraded":"2024-04-25T17:01:38.996562+0000","last_fullsized":"2024-04-25T17:01:38.996562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:49.025646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19430,"num_write":422,"num_write_kb":59069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"24'420","reported_seq":529,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996828+0000","last_change":"2024-04-25T15:46:33.032744+0000","last_active":"2024-04-25T17:01:38.996828+0000","last_peered":"2024-04-25T17:01:38.996828+0000","last_clean":"2024-04-25T17:01:38.996828+0000","last_became_active":"2024-04-25T15:46:33.032498+0000","last_became_peered":"2024-04-25T15:46:33.032498+0000","last_unstale":"2024-04-25T17:01:38.996828+0000","last_undegraded":"2024-04-25T17:01:38.996828+0000","last_fullsized":"2024-04-25T17:01:38.996828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:04.861299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38942,"num_write":394,"num_write_kb":67464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"24'418","reported_seq":501,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.974586+0000","last_change":"2024-04-25T15:46:33.043548+0000","last_active":"2024-04-25T17:01:38.974586+0000","last_peered":"2024-04-25T17:01:38.974586+0000","last_clean":"2024-04-25T17:01:38.974586+0000","last_became_active":"2024-04-25T15:46:33.043251+0000","last_became_peered":"2024-04-25T15:46:33.043251+0000","last_unstale":"2024-04-25T17:01:38.974586+0000","last_undegraded":"2024-04-25T17:01:38.974586+0000","last_fullsized":"2024-04-25T17:01:38.974586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:04.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15275,"num_write":389,"num_write_kb":50799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"24'423","reported_seq":528,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.919948+0000","last_change":"2024-04-25T15:46:32.927532+0000","last_active":"2024-04-25T17:01:38.919948+0000","last_peered":"2024-04-25T17:01:38.919948+0000","last_clean":"2024-04-25T17:01:38.919948+0000","last_became_active":"2024-04-25T15:46:32.926836+0000","last_became_peered":"2024-04-25T15:46:32.926836+0000","last_unstale":"2024-04-25T17:01:38.919948+0000","last_undegraded":"2024-04-25T17:01:38.919948+0000","last_fullsized":"2024-04-25T17:01:38.919948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:21.339594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":23691,"num_write":392,"num_write_kb":92779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"24'428","reported_seq":517,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.972089+0000","last_change":"2024-04-25T15:46:33.041900+0000","last_active":"2024-04-25T17:01:38.972089+0000","last_peered":"2024-04-25T17:01:38.972089+0000","last_clean":"2024-04-25T17:01:38.972089+0000","last_became_active":"2024-04-25T15:46:33.040821+0000","last_became_peered":"2024-04-25T15:46:33.040821+0000","last_unstale":"2024-04-25T17:01:38.972089+0000","last_undegraded":"2024-04-25T17:01:38.972089+0000","last_fullsized":"2024-04-25T17:01:38.972089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18443,"num_write":400,"num_write_kb":50986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"24'394","reported_seq":477,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.907774+0000","last_change":"2024-04-25T15:46:32.926772+0000","last_active":"2024-04-25T17:01:38.907774+0000","last_peered":"2024-04-25T17:01:38.907774+0000","last_clean":"2024-04-25T17:01:38.907774+0000","last_became_active":"2024-04-25T15:46:32.926468+0000","last_became_peered":"2024-04-25T15:46:32.926468+0000","last_unstale":"2024-04-25T17:01:38.907774+0000","last_undegraded":"2024-04-25T17:01:38.907774+0000","last_fullsized":"2024-04-25T17:01:38.907774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:21:35.665923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16804,"num_write":379,"num_write_kb":50499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"24'462","reported_seq":583,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.005049+0000","last_change":"2024-04-25T15:46:33.031482+0000","last_active":"2024-04-25T17:01:39.005049+0000","last_peered":"2024-04-25T17:01:39.005049+0000","last_clean":"2024-04-25T17:01:39.005049+0000","last_became_active":"2024-04-25T15:46:33.031182+0000","last_became_peered":"2024-04-25T15:46:33.031182+0000","last_unstale":"2024-04-25T17:01:39.005049+0000","last_undegraded":"2024-04-25T17:01:39.005049+0000","last_fullsized":"2024-04-25T17:01:39.005049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":42888,"num_write":421,"num_write_kb":44012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"24'399","reported_seq":499,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.162134+0000","last_change":"2024-04-25T15:46:32.931992+0000","last_active":"2024-04-25T17:01:39.162134+0000","last_peered":"2024-04-25T17:01:39.162134+0000","last_clean":"2024-04-25T17:01:39.162134+0000","last_became_active":"2024-04-25T15:46:32.931684+0000","last_became_peered":"2024-04-25T15:46:32.931684+0000","last_unstale":"2024-04-25T17:01:39.162134+0000","last_undegraded":"2024-04-25T17:01:39.162134+0000","last_fullsized":"2024-04-25T17:01:39.162134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:12.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25944,"num_write":373,"num_write_kb":59184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"24'397","reported_seq":465,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.923787+0000","last_change":"2024-04-25T15:46:32.926461+0000","last_active":"2024-04-25T17:01:38.923787+0000","last_peered":"2024-04-25T17:01:38.923787+0000","last_clean":"2024-04-25T17:01:38.923787+0000","last_became_active":"2024-04-25T15:46:32.926136+0000","last_became_peered":"2024-04-25T15:46:32.926136+0000","last_unstale":"2024-04-25T17:01:38.923787+0000","last_undegraded":"2024-04-25T17:01:38.923787+0000","last_fullsized":"2024-04-25T17:01:38.923787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:29.896062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5076,"num_write":375,"num_write_kb":141478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"24'412","reported_seq":512,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.994782+0000","last_change":"2024-04-25T15:46:33.022460+0000","last_active":"2024-04-25T17:01:38.994782+0000","last_peered":"2024-04-25T17:01:38.994782+0000","last_clean":"2024-04-25T17:01:38.994782+0000","last_became_active":"2024-04-25T15:46:33.022116+0000","last_became_peered":"2024-04-25T15:46:33.022116+0000","last_unstale":"2024-04-25T17:01:38.994782+0000","last_undegraded":"2024-04-25T17:01:38.994782+0000","last_fullsized":"2024-04-25T17:01:38.994782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:22.980615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":30085,"num_write":382,"num_write_kb":75269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"24'493","reported_seq":633,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.972507+0000","last_change":"2024-04-25T15:46:33.040668+0000","last_active":"2024-04-25T17:01:38.972507+0000","last_peered":"2024-04-25T17:01:38.972507+0000","last_clean":"2024-04-25T17:01:38.972507+0000","last_became_active":"2024-04-25T15:46:33.040134+0000","last_became_peered":"2024-04-25T15:46:33.040134+0000","last_unstale":"2024-04-25T17:01:38.972507+0000","last_undegraded":"2024-04-25T17:01:38.972507+0000","last_fullsized":"2024-04-25T17:01:38.972507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:16.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44575,"num_write":459,"num_write_kb":113331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"24'453","reported_seq":584,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.078848+0000","last_change":"2024-04-25T15:47:08.950730+0000","last_active":"2024-04-25T17:01:39.078848+0000","last_peered":"2024-04-25T17:01:39.078848+0000","last_clean":"2024-04-25T17:01:39.078848+0000","last_became_active":"2024-04-25T15:47:08.950453+0000","last_became_peered":"2024-04-25T15:47:08.950453+0000","last_unstale":"2024-04-25T17:01:39.078848+0000","last_undegraded":"2024-04-25T17:01:39.078848+0000","last_fullsized":"2024-04-25T17:01:39.078848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:12.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":42323,"num_write":423,"num_write_kb":72432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"24'432","reported_seq":513,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996532+0000","last_change":"2024-04-25T15:46:33.022223+0000","last_active":"2024-04-25T17:01:38.996532+0000","last_peered":"2024-04-25T17:01:38.996532+0000","last_clean":"2024-04-25T17:01:38.996532+0000","last_became_active":"2024-04-25T15:46:33.021888+0000","last_became_peered":"2024-04-25T15:46:33.021888+0000","last_unstale":"2024-04-25T17:01:38.996532+0000","last_undegraded":"2024-04-25T17:01:38.996532+0000","last_fullsized":"2024-04-25T17:01:38.996532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:23.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16763,"num_write":405,"num_write_kb":80030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"24'382","reported_seq":443,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.984126+0000","last_change":"2024-04-25T15:46:32.929281+0000","last_active":"2024-04-25T17:01:38.984126+0000","last_peered":"2024-04-25T17:01:38.984126+0000","last_clean":"2024-04-25T17:01:38.984126+0000","last_became_active":"2024-04-25T15:46:32.929019+0000","last_became_peered":"2024-04-25T15:46:32.929019+0000","last_unstale":"2024-04-25T17:01:38.984126+0000","last_undegraded":"2024-04-25T17:01:38.984126+0000","last_fullsized":"2024-04-25T17:01:38.984126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:55.692126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5031,"num_write":350,"num_write_kb":37997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'222","reported_seq":270,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:35.310167+0000","last_change":"2024-04-25T15:46:31.685950+0000","last_active":"2024-04-25T17:01:35.310167+0000","last_peered":"2024-04-25T17:01:35.310167+0000","last_clean":"2024-04-25T17:01:35.310167+0000","last_became_active":"2024-04-25T15:46:31.685602+0000","last_became_peered":"2024-04-25T15:46:31.685602+0000","last_unstale":"2024-04-25T17:01:35.310167+0000","last_undegraded":"2024-04-25T17:01:35.310167+0000","last_fullsized":"2024-04-25T17:01:35.310167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:29.676427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"24'361","reported_seq":424,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.998822+0000","last_change":"2024-04-25T15:46:33.023655+0000","last_active":"2024-04-25T17:01:38.998822+0000","last_peered":"2024-04-25T17:01:38.998822+0000","last_clean":"2024-04-25T17:01:38.998822+0000","last_became_active":"2024-04-25T15:46:33.023432+0000","last_became_peered":"2024-04-25T15:46:33.023432+0000","last_unstale":"2024-04-25T17:01:38.998822+0000","last_undegraded":"2024-04-25T17:01:38.998822+0000","last_fullsized":"2024-04-25T17:01:38.998822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:21.339594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5878,"num_write":338,"num_write_kb":30071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1233","reported_seq":1281,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:35.017131+0000","last_change":"2024-04-25T15:46:31.659079+0000","last_active":"2024-04-25T17:00:35.017131+0000","last_peered":"2024-04-25T17:00:35.017131+0000","last_clean":"2024-04-25T17:00:35.017131+0000","last_became_active":"2024-04-25T15:46:31.658681+0000","last_became_peered":"2024-04-25T15:46:31.658681+0000","last_unstale":"2024-04-25T17:00:35.017131+0000","last_undegraded":"2024-04-25T17:00:35.017131+0000","last_fullsized":"2024-04-25T17:00:35.017131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1233,"log_dups_size":0,"ondisk_log_size":1233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":12901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"24'720","reported_seq":768,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:21.336832+0000","last_change":"2024-04-25T15:46:31.684220+0000","last_active":"2024-04-25T17:00:21.336832+0000","last_peered":"2024-04-25T17:00:21.336832+0000","last_clean":"2024-04-25T17:00:21.336832+0000","last_became_active":"2024-04-25T15:46:31.682936+0000","last_became_peered":"2024-04-25T15:46:31.682936+0000","last_unstale":"2024-04-25T17:00:21.336832+0000","last_undegraded":"2024-04-25T17:00:21.336832+0000","last_fullsized":"2024-04-25T17:00:21.336832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:53.729696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"24'432","reported_seq":504,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.919915+0000","last_change":"2024-04-25T15:46:33.019843+0000","last_active":"2024-04-25T17:01:38.919915+0000","last_peered":"2024-04-25T17:01:38.919915+0000","last_clean":"2024-04-25T17:01:38.919915+0000","last_became_active":"2024-04-25T15:46:33.019526+0000","last_became_peered":"2024-04-25T15:46:33.019526+0000","last_unstale":"2024-04-25T17:01:38.919915+0000","last_undegraded":"2024-04-25T17:01:38.919915+0000","last_fullsized":"2024-04-25T17:01:38.919915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:22.980615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10652,"num_write":400,"num_write_kb":42963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"24'1278","reported_seq":1327,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:27.319190+0000","last_change":"2024-04-25T15:46:31.689444+0000","last_active":"2024-04-25T17:01:27.319190+0000","last_peered":"2024-04-25T17:01:27.319190+0000","last_clean":"2024-04-25T17:01:27.319190+0000","last_became_active":"2024-04-25T15:46:31.689130+0000","last_became_peered":"2024-04-25T15:46:31.689130+0000","last_unstale":"2024-04-25T17:01:27.319190+0000","last_undegraded":"2024-04-25T17:01:27.319190+0000","last_fullsized":"2024-04-25T17:01:27.319190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1278,"log_dups_size":0,"ondisk_log_size":1278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":12905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"24'413","reported_seq":475,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.181021+0000","last_change":"2024-04-25T15:46:32.931979+0000","last_active":"2024-04-25T17:01:39.181021+0000","last_peered":"2024-04-25T17:01:39.181021+0000","last_clean":"2024-04-25T17:01:39.181021+0000","last_became_active":"2024-04-25T15:46:32.931648+0000","last_became_peered":"2024-04-25T15:46:32.931648+0000","last_unstale":"2024-04-25T17:01:39.181021+0000","last_undegraded":"2024-04-25T17:01:39.181021+0000","last_fullsized":"2024-04-25T17:01:39.181021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:23.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9624,"num_write":380,"num_write_kb":46532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"24'54","reported_seq":103,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:27.332734+0000","last_change":"2024-04-25T15:46:31.685721+0000","last_active":"2024-04-25T17:01:27.332734+0000","last_peered":"2024-04-25T17:01:27.332734+0000","last_clean":"2024-04-25T17:01:27.332734+0000","last_became_active":"2024-04-25T15:46:31.685244+0000","last_became_peered":"2024-04-25T15:46:31.685244+0000","last_unstale":"2024-04-25T17:01:27.332734+0000","last_undegraded":"2024-04-25T17:01:27.332734+0000","last_fullsized":"2024-04-25T17:01:27.332734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"24'416","reported_seq":506,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.973069+0000","last_change":"2024-04-25T15:46:33.043533+0000","last_active":"2024-04-25T17:01:38.973069+0000","last_peered":"2024-04-25T17:01:38.973069+0000","last_clean":"2024-04-25T17:01:38.973069+0000","last_became_active":"2024-04-25T15:46:33.043228+0000","last_became_peered":"2024-04-25T15:46:33.043228+0000","last_unstale":"2024-04-25T17:01:38.973069+0000","last_undegraded":"2024-04-25T17:01:38.973069+0000","last_fullsized":"2024-04-25T17:01:38.973069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26593,"num_write":386,"num_write_kb":54872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"24'373","reported_seq":422,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:15.484935+0000","last_change":"2024-04-25T15:46:31.692399+0000","last_active":"2024-04-25T17:01:15.484935+0000","last_peered":"2024-04-25T17:01:15.484935+0000","last_clean":"2024-04-25T17:01:15.484935+0000","last_became_active":"2024-04-25T15:46:31.692063+0000","last_became_peered":"2024-04-25T15:46:31.692063+0000","last_unstale":"2024-04-25T17:01:15.484935+0000","last_undegraded":"2024-04-25T17:01:15.484935+0000","last_fullsized":"2024-04-25T17:01:15.484935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'409","reported_seq":513,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.991611+0000","last_change":"2024-04-25T15:46:33.043275+0000","last_active":"2024-04-25T17:01:38.991611+0000","last_peered":"2024-04-25T17:01:38.991611+0000","last_clean":"2024-04-25T17:01:38.991611+0000","last_became_active":"2024-04-25T15:46:33.042941+0000","last_became_peered":"2024-04-25T15:46:33.042941+0000","last_unstale":"2024-04-25T17:01:38.991611+0000","last_undegraded":"2024-04-25T17:01:38.991611+0000","last_fullsized":"2024-04-25T17:01:38.991611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:22.959149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53704,"num_write":377,"num_write_kb":101029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'2113","reported_seq":2162,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:34.052959+0000","last_change":"2024-04-25T15:46:31.686299+0000","last_active":"2024-04-25T17:01:34.052959+0000","last_peered":"2024-04-25T17:01:34.052959+0000","last_clean":"2024-04-25T17:01:34.052959+0000","last_became_active":"2024-04-25T15:46:31.685993+0000","last_became_peered":"2024-04-25T15:46:31.685993+0000","last_unstale":"2024-04-25T17:01:34.052959+0000","last_undegraded":"2024-04-25T17:01:34.052959+0000","last_fullsized":"2024-04-25T17:01:34.052959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2113,"log_dups_size":0,"ondisk_log_size":2113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2065,"num_write_kb":6028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'405","reported_seq":535,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.989646+0000","last_change":"2024-04-25T15:46:33.035207+0000","last_active":"2024-04-25T17:01:38.989646+0000","last_peered":"2024-04-25T17:01:38.989646+0000","last_clean":"2024-04-25T17:01:38.989646+0000","last_became_active":"2024-04-25T15:46:33.034926+0000","last_became_peered":"2024-04-25T15:46:33.034926+0000","last_unstale":"2024-04-25T17:01:38.989646+0000","last_undegraded":"2024-04-25T17:01:38.989646+0000","last_fullsized":"2024-04-25T17:01:38.989646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:28.844626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":46433,"num_write":373,"num_write_kb":80369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'1505","reported_seq":1555,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:27.332697+0000","last_change":"2024-04-25T15:46:31.683086+0000","last_active":"2024-04-25T17:01:27.332697+0000","last_peered":"2024-04-25T17:01:27.332697+0000","last_clean":"2024-04-25T17:01:27.332697+0000","last_became_active":"2024-04-25T15:46:31.682661+0000","last_became_peered":"2024-04-25T15:46:31.682661+0000","last_unstale":"2024-04-25T17:01:27.332697+0000","last_undegraded":"2024-04-25T17:01:27.332697+0000","last_fullsized":"2024-04-25T17:01:27.332697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1505,"log_dups_size":0,"ondisk_log_size":1505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1466,"num_write_kb":13174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"24'389","reported_seq":486,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.951163+0000","last_change":"2024-04-25T15:46:33.034800+0000","last_active":"2024-04-25T17:01:38.951163+0000","last_peered":"2024-04-25T17:01:38.951163+0000","last_clean":"2024-04-25T17:01:38.951163+0000","last_became_active":"2024-04-25T15:46:33.034493+0000","last_became_peered":"2024-04-25T15:46:33.034493+0000","last_unstale":"2024-04-25T17:01:38.951163+0000","last_undegraded":"2024-04-25T17:01:38.951163+0000","last_fullsized":"2024-04-25T17:01:38.951163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:16.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":29846,"num_write":355,"num_write_kb":66952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"24'423","reported_seq":473,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:35.016607+0000","last_change":"2024-04-25T15:46:31.688398+0000","last_active":"2024-04-25T17:00:35.016607+0000","last_peered":"2024-04-25T17:00:35.016607+0000","last_clean":"2024-04-25T17:00:35.016607+0000","last_became_active":"2024-04-25T15:46:31.688096+0000","last_became_peered":"2024-04-25T15:46:31.688096+0000","last_unstale":"2024-04-25T17:00:35.016607+0000","last_undegraded":"2024-04-25T17:00:35.016607+0000","last_fullsized":"2024-04-25T17:00:35.016607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:53.729696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"24'423","reported_seq":498,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996679+0000","last_change":"2024-04-25T15:46:33.031520+0000","last_active":"2024-04-25T17:01:38.996679+0000","last_peered":"2024-04-25T17:01:38.996679+0000","last_clean":"2024-04-25T17:01:38.996679+0000","last_became_active":"2024-04-25T15:46:33.031282+0000","last_became_peered":"2024-04-25T15:46:33.031282+0000","last_unstale":"2024-04-25T17:01:38.996679+0000","last_undegraded":"2024-04-25T17:01:38.996679+0000","last_fullsized":"2024-04-25T17:01:38.996679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:41.663796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11364,"num_write":392,"num_write_kb":80312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"24'62","reported_seq":112,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:12.317879+0000","last_change":"2024-04-25T15:46:31.691191+0000","last_active":"2024-04-25T17:01:12.317879+0000","last_peered":"2024-04-25T17:01:12.317879+0000","last_clean":"2024-04-25T17:01:12.317879+0000","last_became_active":"2024-04-25T15:46:31.690848+0000","last_became_peered":"2024-04-25T15:46:31.690848+0000","last_unstale":"2024-04-25T17:01:12.317879+0000","last_undegraded":"2024-04-25T17:01:12.317879+0000","last_fullsized":"2024-04-25T17:01:12.317879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'391","reported_seq":450,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.964984+0000","last_change":"2024-04-25T15:46:33.040890+0000","last_active":"2024-04-25T17:01:38.964984+0000","last_peered":"2024-04-25T17:01:38.964984+0000","last_clean":"2024-04-25T17:01:38.964984+0000","last_became_active":"2024-04-25T15:46:33.040568+0000","last_became_peered":"2024-04-25T15:46:33.040568+0000","last_unstale":"2024-04-25T17:01:38.964984+0000","last_undegraded":"2024-04-25T17:01:38.964984+0000","last_fullsized":"2024-04-25T17:01:38.964984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:04.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":1556,"num_write":356,"num_write_kb":55877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"24'58","reported_seq":108,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T16:59:56.238276+0000","last_change":"2024-04-25T15:46:31.659031+0000","last_active":"2024-04-25T16:59:56.238276+0000","last_peered":"2024-04-25T16:59:56.238276+0000","last_clean":"2024-04-25T16:59:56.238276+0000","last_became_active":"2024-04-25T15:46:31.658670+0000","last_became_peered":"2024-04-25T15:46:31.658670+0000","last_unstale":"2024-04-25T16:59:56.238276+0000","last_undegraded":"2024-04-25T16:59:56.238276+0000","last_fullsized":"2024-04-25T16:59:56.238276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"24'439","reported_seq":516,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.993735+0000","last_change":"2024-04-25T15:46:33.021142+0000","last_active":"2024-04-25T17:01:38.993735+0000","last_peered":"2024-04-25T17:01:38.993735+0000","last_clean":"2024-04-25T17:01:38.993735+0000","last_became_active":"2024-04-25T15:46:33.020753+0000","last_became_peered":"2024-04-25T15:46:33.020753+0000","last_unstale":"2024-04-25T17:01:38.993735+0000","last_undegraded":"2024-04-25T17:01:38.993735+0000","last_fullsized":"2024-04-25T17:01:38.993735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17823,"num_write":412,"num_write_kb":54819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'566","reported_seq":616,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:31.049237+0000","last_change":"2024-04-25T15:46:31.703454+0000","last_active":"2024-04-25T17:01:31.049237+0000","last_peered":"2024-04-25T17:01:31.049237+0000","last_clean":"2024-04-25T17:01:31.049237+0000","last_became_active":"2024-04-25T15:46:31.703167+0000","last_became_peered":"2024-04-25T15:46:31.703167+0000","last_unstale":"2024-04-25T17:01:31.049237+0000","last_undegraded":"2024-04-25T17:01:31.049237+0000","last_fullsized":"2024-04-25T17:01:31.049237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:02.958438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":510,"num_write_kb":8426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"24'470","reported_seq":592,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.950114+0000","last_change":"2024-04-25T15:46:33.039900+0000","last_active":"2024-04-25T17:01:38.950114+0000","last_peered":"2024-04-25T17:01:38.950114+0000","last_clean":"2024-04-25T17:01:38.950114+0000","last_became_active":"2024-04-25T15:46:33.039613+0000","last_became_peered":"2024-04-25T15:46:33.039613+0000","last_unstale":"2024-04-25T17:01:38.950114+0000","last_undegraded":"2024-04-25T17:01:38.950114+0000","last_fullsized":"2024-04-25T17:01:38.950114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":36444,"num_write":435,"num_write_kb":71594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'805","reported_seq":856,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:11.165829+0000","last_change":"2024-04-25T15:46:31.684537+0000","last_active":"2024-04-25T17:01:11.165829+0000","last_peered":"2024-04-25T17:01:11.165829+0000","last_clean":"2024-04-25T17:01:11.165829+0000","last_became_active":"2024-04-25T15:46:31.684173+0000","last_became_peered":"2024-04-25T15:46:31.684173+0000","last_unstale":"2024-04-25T17:01:11.165829+0000","last_undegraded":"2024-04-25T17:01:11.165829+0000","last_fullsized":"2024-04-25T17:01:11.165829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:41.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":4496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'360","reported_seq":440,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.957203+0000","last_change":"2024-04-25T15:46:33.037831+0000","last_active":"2024-04-25T17:01:38.957203+0000","last_peered":"2024-04-25T17:01:38.957203+0000","last_clean":"2024-04-25T17:01:38.957203+0000","last_became_active":"2024-04-25T15:46:33.037529+0000","last_became_peered":"2024-04-25T15:46:33.037529+0000","last_unstale":"2024-04-25T17:01:38.957203+0000","last_undegraded":"2024-04-25T17:01:38.957203+0000","last_fullsized":"2024-04-25T17:01:38.957203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:20.677976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":10575,"num_write":335,"num_write_kb":42548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'799","reported_seq":850,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:13.079781+0000","last_change":"2024-04-25T15:46:31.704159+0000","last_active":"2024-04-25T17:00:13.079781+0000","last_peered":"2024-04-25T17:00:13.079781+0000","last_clean":"2024-04-25T17:00:13.079781+0000","last_became_active":"2024-04-25T15:46:31.703896+0000","last_became_peered":"2024-04-25T15:46:31.703896+0000","last_unstale":"2024-04-25T17:00:13.079781+0000","last_undegraded":"2024-04-25T17:00:13.079781+0000","last_fullsized":"2024-04-25T17:00:13.079781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":4482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'410","reported_seq":481,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.963314+0000","last_change":"2024-04-25T15:46:33.038719+0000","last_active":"2024-04-25T17:01:38.963314+0000","last_peered":"2024-04-25T17:01:38.963314+0000","last_clean":"2024-04-25T17:01:38.963314+0000","last_became_active":"2024-04-25T15:46:33.038380+0000","last_became_peered":"2024-04-25T15:46:33.038380+0000","last_unstale":"2024-04-25T17:01:38.963314+0000","last_undegraded":"2024-04-25T17:01:38.963314+0000","last_fullsized":"2024-04-25T17:01:38.963314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:13:33.423087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18534,"num_write":381,"num_write_kb":108433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'789","reported_seq":840,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:27.829293+0000","last_change":"2024-04-25T15:46:31.690489+0000","last_active":"2024-04-25T17:00:27.829293+0000","last_peered":"2024-04-25T17:00:27.829293+0000","last_clean":"2024-04-25T17:00:27.829293+0000","last_became_active":"2024-04-25T15:46:31.690181+0000","last_became_peered":"2024-04-25T15:46:31.690181+0000","last_unstale":"2024-04-25T17:00:27.829293+0000","last_undegraded":"2024-04-25T17:00:27.829293+0000","last_fullsized":"2024-04-25T17:00:27.829293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'428","reported_seq":501,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.971899+0000","last_change":"2024-04-25T15:46:33.036460+0000","last_active":"2024-04-25T17:01:38.971899+0000","last_peered":"2024-04-25T17:01:38.971899+0000","last_clean":"2024-04-25T17:01:38.971899+0000","last_became_active":"2024-04-25T15:46:33.036033+0000","last_became_peered":"2024-04-25T15:46:33.036033+0000","last_unstale":"2024-04-25T17:01:38.971899+0000","last_undegraded":"2024-04-25T17:01:38.971899+0000","last_fullsized":"2024-04-25T17:01:38.971899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13038,"num_write":401,"num_write_kb":62698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"24'332","reported_seq":383,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:59.295314+0000","last_change":"2024-04-25T15:46:31.703571+0000","last_active":"2024-04-25T17:00:59.295314+0000","last_peered":"2024-04-25T17:00:59.295314+0000","last_clean":"2024-04-25T17:00:59.295314+0000","last_became_active":"2024-04-25T15:46:31.703234+0000","last_became_peered":"2024-04-25T15:46:31.703234+0000","last_unstale":"2024-04-25T17:00:59.295314+0000","last_undegraded":"2024-04-25T17:00:59.295314+0000","last_fullsized":"2024-04-25T17:00:59.295314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'422","reported_seq":513,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.957568+0000","last_change":"2024-04-25T15:46:33.043464+0000","last_active":"2024-04-25T17:01:38.957568+0000","last_peered":"2024-04-25T17:01:38.957568+0000","last_clean":"2024-04-25T17:01:38.957568+0000","last_became_active":"2024-04-25T15:46:33.043145+0000","last_became_peered":"2024-04-25T15:46:33.043145+0000","last_unstale":"2024-04-25T17:01:38.957568+0000","last_undegraded":"2024-04-25T17:01:38.957568+0000","last_fullsized":"2024-04-25T17:01:38.957568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:06.648469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":16889,"num_write":397,"num_write_kb":47575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":151,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T16:58:32.437867+0000","last_change":"2024-04-25T15:46:20.235628+0000","last_active":"2024-04-25T16:58:32.437867+0000","last_peered":"2024-04-25T16:58:32.437867+0000","last_clean":"2024-04-25T16:58:32.437867+0000","last_became_active":"2024-04-25T15:46:20.234477+0000","last_became_peered":"2024-04-25T15:46:20.234477+0000","last_unstale":"2024-04-25T16:58:32.437867+0000","last_undegraded":"2024-04-25T16:58:32.437867+0000","last_fullsized":"2024-04-25T16:58:32.437867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:17.824148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:17.824148+0000","last_clean_scrub_stamp":"2024-04-25T15:46:17.824148+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:50:25.187348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"24'370","reported_seq":424,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:26.013195+0000","last_change":"2024-04-25T15:46:31.702774+0000","last_active":"2024-04-25T17:01:26.013195+0000","last_peered":"2024-04-25T17:01:26.013195+0000","last_clean":"2024-04-25T17:01:26.013195+0000","last_became_active":"2024-04-25T15:46:31.702517+0000","last_became_peered":"2024-04-25T15:46:31.702517+0000","last_unstale":"2024-04-25T17:01:26.013195+0000","last_undegraded":"2024-04-25T17:01:26.013195+0000","last_fullsized":"2024-04-25T17:01:26.013195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"24'359","reported_seq":436,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.912663+0000","last_change":"2024-04-25T15:46:33.043034+0000","last_active":"2024-04-25T17:01:38.912663+0000","last_peered":"2024-04-25T17:01:38.912663+0000","last_clean":"2024-04-25T17:01:38.912663+0000","last_became_active":"2024-04-25T15:46:33.042522+0000","last_became_peered":"2024-04-25T15:46:33.042522+0000","last_unstale":"2024-04-25T17:01:38.912663+0000","last_undegraded":"2024-04-25T17:01:38.912663+0000","last_fullsized":"2024-04-25T17:01:38.912663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:40.746464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13426,"num_write":320,"num_write_kb":38038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"24'500","reported_seq":555,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:42.449985+0000","last_change":"2024-04-25T15:46:31.689200+0000","last_active":"2024-04-25T17:00:42.449985+0000","last_peered":"2024-04-25T17:00:42.449985+0000","last_clean":"2024-04-25T17:00:42.449985+0000","last_became_active":"2024-04-25T15:46:31.687761+0000","last_became_peered":"2024-04-25T15:46:31.687761+0000","last_unstale":"2024-04-25T17:00:42.449985+0000","last_undegraded":"2024-04-25T17:00:42.449985+0000","last_fullsized":"2024-04-25T17:00:42.449985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":12491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'389","reported_seq":465,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.998213+0000","last_change":"2024-04-25T15:46:33.021652+0000","last_active":"2024-04-25T17:01:38.998213+0000","last_peered":"2024-04-25T17:01:38.998213+0000","last_clean":"2024-04-25T17:01:38.998213+0000","last_became_active":"2024-04-25T15:46:33.020828+0000","last_became_peered":"2024-04-25T15:46:33.020828+0000","last_unstale":"2024-04-25T17:01:38.998213+0000","last_undegraded":"2024-04-25T17:01:38.998213+0000","last_fullsized":"2024-04-25T17:01:38.998213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:11.243833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12952,"num_write":356,"num_write_kb":71047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"24'3154","reported_seq":6294,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:36.053305+0000","last_change":"2024-04-25T15:46:31.704698+0000","last_active":"2024-04-25T17:01:36.053305+0000","last_peered":"2024-04-25T17:01:36.053305+0000","last_clean":"2024-04-25T17:01:36.053305+0000","last_became_active":"2024-04-25T15:46:31.704412+0000","last_became_peered":"2024-04-25T15:46:31.704412+0000","last_unstale":"2024-04-25T17:01:36.053305+0000","last_undegraded":"2024-04-25T17:01:36.053305+0000","last_fullsized":"2024-04-25T17:01:36.053305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3154,"log_dups_size":0,"ondisk_log_size":3154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458732,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3086,"num_read_kb":3630,"num_write":3090,"num_write_kb":3631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'400","reported_seq":467,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.083969+0000","last_change":"2024-04-25T15:46:33.061942+0000","last_active":"2024-04-25T17:01:39.083969+0000","last_peered":"2024-04-25T17:01:39.083969+0000","last_clean":"2024-04-25T17:01:39.083969+0000","last_became_active":"2024-04-25T15:46:33.061619+0000","last_became_peered":"2024-04-25T15:46:33.061619+0000","last_unstale":"2024-04-25T17:01:39.083969+0000","last_undegraded":"2024-04-25T17:01:39.083969+0000","last_fullsized":"2024-04-25T17:01:39.083969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:45.123026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9644,"num_write":362,"num_write_kb":26127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"24'999","reported_seq":1053,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T16:59:27.308098+0000","last_change":"2024-04-25T15:46:31.690694+0000","last_active":"2024-04-25T16:59:27.308098+0000","last_peered":"2024-04-25T16:59:27.308098+0000","last_clean":"2024-04-25T16:59:27.308098+0000","last_became_active":"2024-04-25T15:46:31.690339+0000","last_became_peered":"2024-04-25T15:46:31.690339+0000","last_unstale":"2024-04-25T16:59:27.308098+0000","last_undegraded":"2024-04-25T16:59:27.308098+0000","last_fullsized":"2024-04-25T16:59:27.308098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":939,"num_write_kb":8657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'404","reported_seq":515,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.981609+0000","last_change":"2024-04-25T15:46:33.022306+0000","last_active":"2024-04-25T17:01:38.981609+0000","last_peered":"2024-04-25T17:01:38.981609+0000","last_clean":"2024-04-25T17:01:38.981609+0000","last_became_active":"2024-04-25T15:46:33.021995+0000","last_became_peered":"2024-04-25T15:46:33.021995+0000","last_unstale":"2024-04-25T17:01:38.981609+0000","last_undegraded":"2024-04-25T17:01:38.981609+0000","last_fullsized":"2024-04-25T17:01:38.981609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:03.749619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":19099,"num_write":371,"num_write_kb":59650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"24'307","reported_seq":361,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:40.165445+0000","last_change":"2024-04-25T15:46:31.684114+0000","last_active":"2024-04-25T17:00:40.165445+0000","last_peered":"2024-04-25T17:00:40.165445+0000","last_clean":"2024-04-25T17:00:40.165445+0000","last_became_active":"2024-04-25T15:46:31.683802+0000","last_became_peered":"2024-04-25T15:46:31.683802+0000","last_unstale":"2024-04-25T17:00:40.165445+0000","last_undegraded":"2024-04-25T17:00:40.165445+0000","last_fullsized":"2024-04-25T17:00:40.165445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'416","reported_seq":496,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.973398+0000","last_change":"2024-04-25T15:46:33.040119+0000","last_active":"2024-04-25T17:01:38.973398+0000","last_peered":"2024-04-25T17:01:38.973398+0000","last_clean":"2024-04-25T17:01:38.973398+0000","last_became_active":"2024-04-25T15:46:33.039820+0000","last_became_peered":"2024-04-25T15:46:33.039820+0000","last_unstale":"2024-04-25T17:01:38.973398+0000","last_undegraded":"2024-04-25T17:01:38.973398+0000","last_fullsized":"2024-04-25T17:01:38.973398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:06.648469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13405,"num_write":380,"num_write_kb":62960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"24'638","reported_seq":691,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:31.721553+0000","last_change":"2024-04-25T15:46:31.688610+0000","last_active":"2024-04-25T17:00:31.721553+0000","last_peered":"2024-04-25T17:00:31.721553+0000","last_clean":"2024-04-25T17:00:31.721553+0000","last_became_active":"2024-04-25T15:46:31.688274+0000","last_became_peered":"2024-04-25T15:46:31.688274+0000","last_unstale":"2024-04-25T17:00:31.721553+0000","last_undegraded":"2024-04-25T17:00:31.721553+0000","last_fullsized":"2024-04-25T17:00:31.721553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:02.574106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":579,"num_write_kb":8483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'387","reported_seq":510,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.161796+0000","last_change":"2024-04-25T15:46:33.062042+0000","last_active":"2024-04-25T17:01:39.161796+0000","last_peered":"2024-04-25T17:01:39.161796+0000","last_clean":"2024-04-25T17:01:39.161796+0000","last_became_active":"2024-04-25T15:46:33.061680+0000","last_became_peered":"2024-04-25T15:46:33.061680+0000","last_unstale":"2024-04-25T17:01:39.161796+0000","last_undegraded":"2024-04-25T17:01:39.161796+0000","last_fullsized":"2024-04-25T17:01:39.161796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":42014,"num_write":351,"num_write_kb":75036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"24'3879","reported_seq":3931,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:34.676603+0000","last_change":"2024-04-25T15:46:31.687114+0000","last_active":"2024-04-25T17:01:34.676603+0000","last_peered":"2024-04-25T17:01:34.676603+0000","last_clean":"2024-04-25T17:01:34.676603+0000","last_became_active":"2024-04-25T15:46:31.686758+0000","last_became_peered":"2024-04-25T15:46:31.686758+0000","last_unstale":"2024-04-25T17:01:34.676603+0000","last_undegraded":"2024-04-25T17:01:34.676603+0000","last_fullsized":"2024-04-25T17:01:34.676603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3879,"log_dups_size":0,"ondisk_log_size":3879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10737,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'337","reported_seq":410,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.922681+0000","last_change":"2024-04-25T15:46:33.031231+0000","last_active":"2024-04-25T17:01:38.922681+0000","last_peered":"2024-04-25T17:01:38.922681+0000","last_clean":"2024-04-25T17:01:38.922681+0000","last_became_active":"2024-04-25T15:46:33.030894+0000","last_became_peered":"2024-04-25T15:46:33.030894+0000","last_unstale":"2024-04-25T17:01:38.922681+0000","last_undegraded":"2024-04-25T17:01:38.922681+0000","last_fullsized":"2024-04-25T17:01:38.922681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:40.210974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11416,"num_write":310,"num_write_kb":17828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'235","reported_seq":287,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:53.830348+0000","last_change":"2024-04-25T15:46:31.688577+0000","last_active":"2024-04-25T17:00:53.830348+0000","last_peered":"2024-04-25T17:00:53.830348+0000","last_clean":"2024-04-25T17:00:53.830348+0000","last_became_active":"2024-04-25T15:46:31.687691+0000","last_became_peered":"2024-04-25T15:46:31.687691+0000","last_unstale":"2024-04-25T17:00:53.830348+0000","last_undegraded":"2024-04-25T17:00:53.830348+0000","last_fullsized":"2024-04-25T17:00:53.830348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'474","reported_seq":605,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.994840+0000","last_change":"2024-04-25T15:46:33.021249+0000","last_active":"2024-04-25T17:01:38.994840+0000","last_peered":"2024-04-25T17:01:38.994840+0000","last_clean":"2024-04-25T17:01:38.994840+0000","last_became_active":"2024-04-25T15:46:33.020779+0000","last_became_peered":"2024-04-25T15:46:33.020779+0000","last_unstale":"2024-04-25T17:01:38.994840+0000","last_undegraded":"2024-04-25T17:01:38.994840+0000","last_fullsized":"2024-04-25T17:01:38.994840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:39.504513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":41834,"num_write":442,"num_write_kb":97214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"24'714","reported_seq":766,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:36.706046+0000","last_change":"2024-04-25T15:46:31.689494+0000","last_active":"2024-04-25T17:00:36.706046+0000","last_peered":"2024-04-25T17:00:36.706046+0000","last_clean":"2024-04-25T17:00:36.706046+0000","last_became_active":"2024-04-25T15:46:31.688192+0000","last_became_peered":"2024-04-25T15:46:31.688192+0000","last_unstale":"2024-04-25T17:00:36.706046+0000","last_undegraded":"2024-04-25T17:00:36.706046+0000","last_fullsized":"2024-04-25T17:00:36.706046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":4437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"24'485","reported_seq":603,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.977098+0000","last_change":"2024-04-25T15:46:33.062043+0000","last_active":"2024-04-25T17:01:38.977098+0000","last_peered":"2024-04-25T17:01:38.977098+0000","last_clean":"2024-04-25T17:01:38.977098+0000","last_became_active":"2024-04-25T15:46:33.061651+0000","last_became_peered":"2024-04-25T15:46:33.061651+0000","last_unstale":"2024-04-25T17:01:38.977098+0000","last_undegraded":"2024-04-25T17:01:38.977098+0000","last_fullsized":"2024-04-25T17:01:38.977098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:21.340361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31150,"num_write":464,"num_write_kb":116869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'289","reported_seq":341,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:23.361014+0000","last_change":"2024-04-25T15:46:31.685055+0000","last_active":"2024-04-25T17:00:23.361014+0000","last_peered":"2024-04-25T17:00:23.361014+0000","last_clean":"2024-04-25T17:00:23.361014+0000","last_became_active":"2024-04-25T15:46:31.684706+0000","last_became_peered":"2024-04-25T15:46:31.684706+0000","last_unstale":"2024-04-25T17:00:23.361014+0000","last_undegraded":"2024-04-25T17:00:23.361014+0000","last_fullsized":"2024-04-25T17:00:23.361014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:29.917598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"24'407","reported_seq":500,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.916123+0000","last_change":"2024-04-25T15:46:32.929240+0000","last_active":"2024-04-25T17:01:38.916123+0000","last_peered":"2024-04-25T17:01:38.916123+0000","last_clean":"2024-04-25T17:01:38.916123+0000","last_became_active":"2024-04-25T15:46:32.928971+0000","last_became_peered":"2024-04-25T15:46:32.928971+0000","last_unstale":"2024-04-25T17:01:38.916123+0000","last_undegraded":"2024-04-25T17:01:38.916123+0000","last_fullsized":"2024-04-25T17:01:38.916123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:39.504513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21551,"num_write":373,"num_write_kb":54456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'743","reported_seq":795,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:22.524952+0000","last_change":"2024-04-25T15:46:31.687651+0000","last_active":"2024-04-25T17:00:22.524952+0000","last_peered":"2024-04-25T17:00:22.524952+0000","last_clean":"2024-04-25T17:00:22.524952+0000","last_became_active":"2024-04-25T15:46:31.687335+0000","last_became_peered":"2024-04-25T15:46:31.687335+0000","last_unstale":"2024-04-25T17:00:22.524952+0000","last_undegraded":"2024-04-25T17:00:22.524952+0000","last_fullsized":"2024-04-25T17:00:22.524952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"24'417","reported_seq":478,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.913659+0000","last_change":"2024-04-25T15:46:33.021215+0000","last_active":"2024-04-25T17:01:38.913659+0000","last_peered":"2024-04-25T17:01:38.913659+0000","last_clean":"2024-04-25T17:01:38.913659+0000","last_became_active":"2024-04-25T15:46:33.020855+0000","last_became_peered":"2024-04-25T15:46:33.020855+0000","last_unstale":"2024-04-25T17:01:38.913659+0000","last_undegraded":"2024-04-25T17:01:38.913659+0000","last_fullsized":"2024-04-25T17:01:38.913659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:54.058601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6898,"num_write":384,"num_write_kb":50772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'1028","reported_seq":1079,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.689923+0000","last_change":"2024-04-25T15:46:31.693099+0000","last_active":"2024-04-25T17:01:38.689923+0000","last_peered":"2024-04-25T17:01:38.689923+0000","last_clean":"2024-04-25T17:01:38.689923+0000","last_became_active":"2024-04-25T15:46:31.692762+0000","last_became_peered":"2024-04-25T15:46:31.692762+0000","last_unstale":"2024-04-25T17:01:38.689923+0000","last_undegraded":"2024-04-25T17:01:38.689923+0000","last_fullsized":"2024-04-25T17:01:38.689923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:29.917598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10888152,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":975,"num_write_kb":11131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"24'426","reported_seq":522,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996220+0000","last_change":"2024-04-25T15:46:33.014467+0000","last_active":"2024-04-25T17:01:38.996220+0000","last_peered":"2024-04-25T17:01:38.996220+0000","last_clean":"2024-04-25T17:01:38.996220+0000","last_became_active":"2024-04-25T15:46:33.014116+0000","last_became_peered":"2024-04-25T15:46:33.014116+0000","last_unstale":"2024-04-25T17:01:38.996220+0000","last_undegraded":"2024-04-25T17:01:38.996220+0000","last_fullsized":"2024-04-25T17:01:38.996220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:44.912712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25236,"num_write":391,"num_write_kb":71743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"24'397","reported_seq":515,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.977707+0000","last_change":"2024-04-25T15:46:33.040027+0000","last_active":"2024-04-25T17:01:38.977707+0000","last_peered":"2024-04-25T17:01:38.977707+0000","last_clean":"2024-04-25T17:01:38.977707+0000","last_became_active":"2024-04-25T15:46:33.039713+0000","last_became_peered":"2024-04-25T15:46:33.039713+0000","last_unstale":"2024-04-25T17:01:38.977707+0000","last_undegraded":"2024-04-25T17:01:38.977707+0000","last_fullsized":"2024-04-25T17:01:38.977707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:49.811317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":31357,"num_write":351,"num_write_kb":60889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"24'784","reported_seq":832,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:26.015449+0000","last_change":"2024-04-25T15:46:31.686712+0000","last_active":"2024-04-25T17:01:26.015449+0000","last_peered":"2024-04-25T17:01:26.015449+0000","last_clean":"2024-04-25T17:01:26.015449+0000","last_became_active":"2024-04-25T15:46:31.686390+0000","last_became_peered":"2024-04-25T15:46:31.686390+0000","last_unstale":"2024-04-25T17:01:26.015449+0000","last_undegraded":"2024-04-25T17:01:26.015449+0000","last_fullsized":"2024-04-25T17:01:26.015449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":4471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'374","reported_seq":433,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.968333+0000","last_change":"2024-04-25T15:46:33.041233+0000","last_active":"2024-04-25T17:01:38.968333+0000","last_peered":"2024-04-25T17:01:38.968333+0000","last_clean":"2024-04-25T17:01:38.968333+0000","last_became_active":"2024-04-25T15:46:33.040941+0000","last_became_peered":"2024-04-25T15:46:33.040941+0000","last_unstale":"2024-04-25T17:01:38.968333+0000","last_undegraded":"2024-04-25T17:01:38.968333+0000","last_fullsized":"2024-04-25T17:01:38.968333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8232,"num_write":346,"num_write_kb":71494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'1200","reported_seq":1248,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:19.564433+0000","last_change":"2024-04-25T15:46:31.688658+0000","last_active":"2024-04-25T17:01:19.564433+0000","last_peered":"2024-04-25T17:01:19.564433+0000","last_clean":"2024-04-25T17:01:19.564433+0000","last_became_active":"2024-04-25T15:46:31.688342+0000","last_became_peered":"2024-04-25T15:46:31.688342+0000","last_unstale":"2024-04-25T17:01:19.564433+0000","last_undegraded":"2024-04-25T17:01:19.564433+0000","last_fullsized":"2024-04-25T17:01:19.564433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1200,"log_dups_size":0,"ondisk_log_size":1200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":12844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"24'387","reported_seq":482,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.999769+0000","last_change":"2024-04-25T15:46:33.043423+0000","last_active":"2024-04-25T17:01:38.999769+0000","last_peered":"2024-04-25T17:01:38.999769+0000","last_clean":"2024-04-25T17:01:38.999769+0000","last_became_active":"2024-04-25T15:46:33.043134+0000","last_became_peered":"2024-04-25T15:46:33.043134+0000","last_unstale":"2024-04-25T17:01:38.999769+0000","last_undegraded":"2024-04-25T17:01:38.999769+0000","last_fullsized":"2024-04-25T17:01:38.999769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:40.746464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22111,"num_write":359,"num_write_kb":59931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"24'239","reported_seq":294,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:26.646409+0000","last_change":"2024-04-25T15:46:31.685427+0000","last_active":"2024-04-25T17:00:26.646409+0000","last_peered":"2024-04-25T17:00:26.646409+0000","last_clean":"2024-04-25T17:00:26.646409+0000","last_became_active":"2024-04-25T15:46:31.684729+0000","last_became_peered":"2024-04-25T15:46:31.684729+0000","last_unstale":"2024-04-25T17:00:26.646409+0000","last_undegraded":"2024-04-25T17:00:26.646409+0000","last_fullsized":"2024-04-25T17:00:26.646409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:06.621567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":4173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"24'427","reported_seq":551,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.907920+0000","last_change":"2024-04-25T15:46:33.012259+0000","last_active":"2024-04-25T17:01:38.907920+0000","last_peered":"2024-04-25T17:01:38.907920+0000","last_clean":"2024-04-25T17:01:38.907920+0000","last_became_active":"2024-04-25T15:46:33.011979+0000","last_became_peered":"2024-04-25T15:46:33.011979+0000","last_unstale":"2024-04-25T17:01:38.907920+0000","last_undegraded":"2024-04-25T17:01:38.907920+0000","last_fullsized":"2024-04-25T17:01:38.907920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:47.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":33589,"num_write":403,"num_write_kb":89000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"24'409","reported_seq":463,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:32.058200+0000","last_change":"2024-04-25T15:46:31.688031+0000","last_active":"2024-04-25T17:01:32.058200+0000","last_peered":"2024-04-25T17:01:32.058200+0000","last_clean":"2024-04-25T17:01:32.058200+0000","last_became_active":"2024-04-25T15:46:31.687705+0000","last_became_peered":"2024-04-25T15:46:31.687705+0000","last_unstale":"2024-04-25T17:01:32.058200+0000","last_undegraded":"2024-04-25T17:01:32.058200+0000","last_fullsized":"2024-04-25T17:01:32.058200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:28.618857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2746,"num_read_kb":1448171,"num_write":24417,"num_write_kb":4365214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26337,"ondisk_log_size":26337,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":184318122,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":3086,"num_read_kb":3630,"num_write":31925,"num_write_kb":196586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368795648,"data_stored":368636244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26820,"ondisk_log_size":26820,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510349,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140188,"kb_used_data":72916,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94231652,"statfs":{"total":96636764160,"available":96493211648,"internally_reserved":0,"allocated":74665984,"data_stored":74483790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510349,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120840,"kb_used_data":49408,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94251000,"statfs":{"total":96636764160,"available":96513024000,"internally_reserved":0,"allocated":50593792,"data_stored":50421810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510351,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108492,"kb_used_data":41220,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94263348,"statfs":{"total":96636764160,"available":96525668352,"internally_reserved":0,"allocated":42209280,"data_stored":42033230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510349,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119124,"kb_used_data":51852,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94252716,"statfs":{"total":96636764160,"available":96514781184,"internally_reserved":0,"allocated":53096448,"data_stored":52920718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510350,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93600,"kb_used_data":22168,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94278240,"statfs":{"total":96636764160,"available":96540917760,"internally_reserved":0,"allocated":22700032,"data_stored":22519792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510351,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125008,"kb_used_data":49416,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94246832,"statfs":{"total":96636764160,"available":96508755968,"internally_reserved":0,"allocated":50601984,"data_stored":50421404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543054,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128096,"kb_used_data":34456,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94243744,"statfs":{"total":96636764160,"available":96505593856,"internally_reserved":0,"allocated":35282944,"data_stored":35103852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":95877576},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543055,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99340,"kb_used_data":41796,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94272500,"statfs":{"total":96636764160,"available":96535040000,"internally_reserved":0,"allocated":42799104,"data_stored":42622880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41959424,"data_stored":41943700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50356224,"data_stored":50332592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22454272,"data_stored":22430980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35037184,"data_stored":35015040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":52850688,"data_stored":52831906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41963520,"data_stored":41944418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":50348032,"data_stored":50332998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73826304,"data_stored":73804610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T17:01:46.416 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T17:01:46.416 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T17:01:46.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.567+0000 7fb597630640 1 Processor -- start 2024-04-25T17:01:46.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.567+0000 7fb597630640 1 -- start start 2024-04-25T17:01:46.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.568+0000 7fb597630640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb5900cec50 0x7fb59015c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:46.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.568+0000 7fb597630640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb59015cd60 con 0x7fb59015c1b0 2024-04-25T17:01:46.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.568+0000 7fb597630640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb59015d040 con 0x7fb5900b41c0 2024-04-25T17:01:46.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.568+0000 7fb597630640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fb59015cb00 con 0x7fb5900cec50 2024-04-25T17:01:46.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.569+0000 7fb594bcb640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb59015c1b0 0x7fb5900ce540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50532/0 (socket says 172.21.15.59:50532) 2024-04-25T17:01:46.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.569+0000 7fb594bcb640 1 -- 172.21.15.59:0/1266086043 learned_addr learned my addr 172.21.15.59:0/1266086043 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T17:01:46.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.569+0000 7fb595bcd640 1 --2- 172.21.15.59:0/1266086043 >> v2:172.21.15.64:3300/0 conn(0x7fb5900cec50 0x7fb59015c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:46.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.572+0000 7fb587fff640 1 -- 172.21.15.59:0/1266086043 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3697041485 0 0) 0x7fb59015cd60 con 0x7fb59015c1b0 2024-04-25T17:01:46.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.572+0000 7fb587fff640 1 -- 172.21.15.59:0/1266086043 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb57c003520 con 0x7fb59015c1b0 2024-04-25T17:01:46.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.573+0000 7fb595bcd640 1 -- 172.21.15.59:0/1266086043 >> v1:172.21.15.64:6789/0 conn(0x7fb5900b41c0 legacy=0x7fb5900cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:46.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.573+0000 7fb595bcd640 1 -- 172.21.15.59:0/1266086043 >> v1:172.21.15.59:6789/0 conn(0x7fb59015c1b0 legacy=0x7fb5900ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:46.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.573+0000 7fb595bcd640 1 -- 172.21.15.59:0/1266086043 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb59015d320 con 0x7fb5900cec50 2024-04-25T17:01:46.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.577+0000 7fb595bcd640 1 --2- 172.21.15.59:0/1266086043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5900cec50 0x7fb59015c5c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb588009d90 tx=0x7fb58802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e99825446110950c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:46.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.581+0000 7fb587fff640 1 -- 172.21.15.59:0/1266086043 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588007740 con 0x7fb5900cec50 2024-04-25T17:01:46.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.581+0000 7fb587fff640 1 -- 172.21.15.59:0/1266086043 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5880078e0 con 0x7fb5900cec50 2024-04-25T17:01:46.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.581+0000 7fb587fff640 1 -- 172.21.15.59:0/1266086043 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588007cb0 con 0x7fb5900cec50 2024-04-25T17:01:46.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.582+0000 7fb597630640 1 -- 172.21.15.59:0/1266086043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5900cec50 msgr2=0x7fb59015c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:46.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.582+0000 7fb597630640 1 --2- 172.21.15.59:0/1266086043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5900cec50 0x7fb59015c5c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb588009d90 tx=0x7fb58802a6f0 comp rx=0 tx=0).stop 2024-04-25T17:01:46.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.582+0000 7fb597630640 1 -- 172.21.15.59:0/1266086043 shutdown_connections 2024-04-25T17:01:46.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.582+0000 7fb597630640 1 --2- 172.21.15.59:0/1266086043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5900cec50 0x7fb59015c5c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:46.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.582+0000 7fb597630640 1 -- 172.21.15.59:0/1266086043 >> 172.21.15.59:0/1266086043 conn(0x7fb59006ed70 msgr2=0x7fb59006f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:46.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.582+0000 7fb597630640 1 -- 172.21.15.59:0/1266086043 shutdown_connections 2024-04-25T17:01:46.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.582+0000 7fb597630640 1 -- 172.21.15.59:0/1266086043 wait complete. 2024-04-25T17:01:46.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.584+0000 7fb597630640 1 Processor -- start 2024-04-25T17:01:46.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.584+0000 7fb597630640 1 -- start start 2024-04-25T17:01:46.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.585+0000 7fb597630640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb5900b41c0 0x7fb5901f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:46.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.585+0000 7fb597630640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5900cec50 0x7fb59015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:46.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.585+0000 7fb597630640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59015c1b0 0x7fb590156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:46.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.585+0000 7fb597630640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb5900b78a0 con 0x7fb59015c1b0 2024-04-25T17:01:46.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.585+0000 7fb597630640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb5900ce020 con 0x7fb5900cec50 2024-04-25T17:01:46.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.585+0000 7fb597630640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fb5900c51e0 con 0x7fb5900b41c0 2024-04-25T17:01:46.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.586+0000 7fb595bcd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59015c1b0 0x7fb590156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:46.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.586+0000 7fb5953cc640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb5900b41c0 0x7fb5901f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:46.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.586+0000 7fb594bcb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5900cec50 0x7fb59015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:46.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.586+0000 7fb5953cc640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb5900b41c0 0x7fb5901f6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53120/0 (socket says 172.21.15.59:53120) 2024-04-25T17:01:46.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.586+0000 7fb5953cc640 1 -- 172.21.15.59:0/2535821123 learned_addr learned my addr 172.21.15.59:0/2535821123 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:46.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.590+0000 7fb595bcd640 1 -- 172.21.15.59:0/2535821123 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb5900b41c0 msgr2=0x7fb5901f6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:46.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.590+0000 7fb595bcd640 1 --2- 172.21.15.59:0/2535821123 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb5900b41c0 0x7fb5901f6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:46.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.590+0000 7fb595bcd640 1 -- 172.21.15.59:0/2535821123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5900cec50 msgr2=0x7fb59015afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:46.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.590+0000 7fb595bcd640 1 --2- 172.21.15.59:0/2535821123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5900cec50 0x7fb59015afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:46.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.590+0000 7fb595bcd640 1 -- 172.21.15.59:0/2535821123 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb59015ad40 con 0x7fb59015c1b0 2024-04-25T17:01:46.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.590+0000 7fb594bcb640 1 --2- 172.21.15.59:0/2535821123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5900cec50 0x7fb59015afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:01:46.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.593+0000 7fb595bcd640 1 --2- 172.21.15.59:0/2535821123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59015c1b0 0x7fb590156d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb588031000 tx=0x7fb588004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:46.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.597+0000 7fb585ffb640 1 -- 172.21.15.59:0/2535821123 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58803f070 con 0x7fb59015c1b0 2024-04-25T17:01:46.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.597+0000 7fb585ffb640 1 -- 172.21.15.59:0/2535821123 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb588031ac0 con 0x7fb59015c1b0 2024-04-25T17:01:46.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.597+0000 7fb597630640 1 -- 172.21.15.59:0/2535821123 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb590157730 con 0x7fb59015c1b0 2024-04-25T17:01:46.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.597+0000 7fb585ffb640 1 -- 172.21.15.59:0/2535821123 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588044460 con 0x7fb59015c1b0 2024-04-25T17:01:46.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.597+0000 7fb597630640 1 -- 172.21.15.59:0/2535821123 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb590159f80 con 0x7fb59015c1b0 2024-04-25T17:01:46.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.599+0000 7fb597630640 1 -- 172.21.15.59:0/2535821123 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5900cbe20 con 0x7fb59015c1b0 2024-04-25T17:01:46.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.623+0000 7fb585ffb640 1 -- 172.21.15.59:0/2535821123 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb58803b410 con 0x7fb59015c1b0 2024-04-25T17:01:46.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.623+0000 7fb585ffb640 1 --2- 172.21.15.59:0/2535821123 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb574074500 0x7fb574076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:46.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.623+0000 7fb5953cc640 1 --2- 172.21.15.59:0/2535821123 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb574074500 0x7fb574076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:46.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.624+0000 7fb5953cc640 1 --2- 172.21.15.59:0/2535821123 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb574074500 0x7fb574076a10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0017a0 tx=0x7fb58c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:46.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.908+0000 7fb585ffb640 1 -- 172.21.15.59:0/2535821123 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fb588007840 con 0x7fb59015c1b0 2024-04-25T17:01:46.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:46.908+0000 7fb585ffb640 1 -- 172.21.15.59:0/2535821123 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb5900cbe20 con 0x7fb59015c1b0 2024-04-25T17:01:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.093+0000 7fb597630640 1 -- 172.21.15.59:0/2535821123 --> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5900698a0 con 0x7fb574074500 2024-04-25T17:01:47.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.099+0000 7fb585ffb640 1 -- 172.21.15.59:0/2535821123 <== mgr.4102 v2:172.21.15.59:6800/2368090706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253925 (secure 0 0 0) 0x7fb5900698a0 con 0x7fb574074500 2024-04-25T17:01:47.100 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T17:01:47.101 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T17:01:47.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.103+0000 7fb597630640 1 -- 172.21.15.59:0/2535821123 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb574074500 msgr2=0x7fb574076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:47.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.103+0000 7fb597630640 1 --2- 172.21.15.59:0/2535821123 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb574074500 0x7fb574076a10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0017a0 tx=0x7fb58c009040 comp rx=0 tx=0).stop 2024-04-25T17:01:47.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.103+0000 7fb597630640 1 -- 172.21.15.59:0/2535821123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59015c1b0 msgr2=0x7fb590156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:47.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.103+0000 7fb597630640 1 --2- 172.21.15.59:0/2535821123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59015c1b0 0x7fb590156d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb588031000 tx=0x7fb588004a40 comp rx=0 tx=0).stop 2024-04-25T17:01:47.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.103+0000 7fb597630640 1 -- 172.21.15.59:0/2535821123 shutdown_connections 2024-04-25T17:01:47.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.103+0000 7fb597630640 1 --2- 172.21.15.59:0/2535821123 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb574074500 0x7fb574076a10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:47.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.103+0000 7fb597630640 1 --2- 172.21.15.59:0/2535821123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb59015c1b0 0x7fb590156d80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:47.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.103+0000 7fb597630640 1 --2- 172.21.15.59:0/2535821123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5900cec50 0x7fb59015afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:47.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.103+0000 7fb597630640 1 --2- 172.21.15.59:0/2535821123 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb5900b41c0 0x7fb5901f6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:47.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.103+0000 7fb597630640 1 -- 172.21.15.59:0/2535821123 >> 172.21.15.59:0/2535821123 conn(0x7fb59006ed70 msgr2=0x7fb590075ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:47.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.103+0000 7fb597630640 1 -- 172.21.15.59:0/2535821123 shutdown_connections 2024-04-25T17:01:47.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.103+0000 7fb597630640 1 -- 172.21.15.59:0/2535821123 wait complete. 2024-04-25T17:01:47.113 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":2283,"stamp":"2024-04-25T17:01:45.417294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":184908490,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":5898,"num_read_kb":1451856,"num_write":56443,"num_write_kb":4563428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53229,"ondisk_log_size":53229,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":934688,"kb_used_data":363232,"kb_used_omap":12,"kb_used_meta":571379,"kb_avail":754040032,"statfs":{"total":773094113280,"available":772136992768,"internally_reserved":0,"allocated":371949568,"data_stored":370527476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":585092658},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2165,"num_objects":-4,"num_object_clones":0,"num_object_copies":-8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":26,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003026"},"pg_stats":[{"pgid":"3.3f","version":"24'430","reported_seq":557,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.999197+0000","last_change":"2024-04-25T15:47:08.942552+0000","last_active":"2024-04-25T17:01:38.999197+0000","last_peered":"2024-04-25T17:01:38.999197+0000","last_clean":"2024-04-25T17:01:38.999197+0000","last_became_active":"2024-04-25T15:47:08.942222+0000","last_became_peered":"2024-04-25T15:47:08.942222+0000","last_unstale":"2024-04-25T17:01:38.999197+0000","last_undegraded":"2024-04-25T17:01:38.999197+0000","last_fullsized":"2024-04-25T17:01:38.999197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":51437,"num_write":399,"num_write_kb":108426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"24'420","reported_seq":504,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.002197+0000","last_change":"2024-04-25T15:46:33.022420+0000","last_active":"2024-04-25T17:01:39.002197+0000","last_peered":"2024-04-25T17:01:39.002197+0000","last_clean":"2024-04-25T17:01:39.002197+0000","last_became_active":"2024-04-25T15:46:33.022095+0000","last_became_peered":"2024-04-25T15:46:33.022095+0000","last_unstale":"2024-04-25T17:01:39.002197+0000","last_undegraded":"2024-04-25T17:01:39.002197+0000","last_fullsized":"2024-04-25T17:01:39.002197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15735,"num_write":392,"num_write_kb":67130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"24'384","reported_seq":464,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.997245+0000","last_change":"2024-04-25T15:46:33.063451+0000","last_active":"2024-04-25T17:01:38.997245+0000","last_peered":"2024-04-25T17:01:38.997245+0000","last_clean":"2024-04-25T17:01:38.997245+0000","last_became_active":"2024-04-25T15:46:33.063038+0000","last_became_peered":"2024-04-25T15:46:33.063038+0000","last_unstale":"2024-04-25T17:01:38.997245+0000","last_undegraded":"2024-04-25T17:01:38.997245+0000","last_fullsized":"2024-04-25T17:01:38.997245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:49:29.792442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13830,"num_write":355,"num_write_kb":38647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"24'395","reported_seq":469,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.079625+0000","last_change":"2024-04-25T15:47:09.046881+0000","last_active":"2024-04-25T17:01:39.079625+0000","last_peered":"2024-04-25T17:01:39.079625+0000","last_clean":"2024-04-25T17:01:39.079625+0000","last_became_active":"2024-04-25T15:47:09.046576+0000","last_became_peered":"2024-04-25T15:47:09.046576+0000","last_unstale":"2024-04-25T17:01:39.079625+0000","last_undegraded":"2024-04-25T17:01:39.079625+0000","last_fullsized":"2024-04-25T17:01:39.079625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":6992,"num_write":371,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"24'432","reported_seq":558,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.951575+0000","last_change":"2024-04-25T15:46:33.063350+0000","last_active":"2024-04-25T17:01:38.951575+0000","last_peered":"2024-04-25T17:01:38.951575+0000","last_clean":"2024-04-25T17:01:38.951575+0000","last_became_active":"2024-04-25T15:46:33.063110+0000","last_became_peered":"2024-04-25T15:46:33.063110+0000","last_unstale":"2024-04-25T17:01:38.951575+0000","last_undegraded":"2024-04-25T17:01:38.951575+0000","last_fullsized":"2024-04-25T17:01:38.951575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":46382,"num_write":409,"num_write_kb":84827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"24'371","reported_seq":423,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.967663+0000","last_change":"2024-04-25T15:46:33.040765+0000","last_active":"2024-04-25T17:01:38.967663+0000","last_peered":"2024-04-25T17:01:38.967663+0000","last_clean":"2024-04-25T17:01:38.967663+0000","last_became_active":"2024-04-25T15:46:33.040272+0000","last_became_peered":"2024-04-25T15:46:33.040272+0000","last_unstale":"2024-04-25T17:01:38.967663+0000","last_undegraded":"2024-04-25T17:01:38.967663+0000","last_fullsized":"2024-04-25T17:01:38.967663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:20.677976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":345,"num_write_kb":38164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"24'405","reported_seq":505,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.942762+0000","last_change":"2024-04-25T15:46:33.037395+0000","last_active":"2024-04-25T17:01:38.942762+0000","last_peered":"2024-04-25T17:01:38.942762+0000","last_clean":"2024-04-25T17:01:38.942762+0000","last_became_active":"2024-04-25T15:46:33.036613+0000","last_became_peered":"2024-04-25T15:46:33.036613+0000","last_unstale":"2024-04-25T17:01:38.942762+0000","last_undegraded":"2024-04-25T17:01:38.942762+0000","last_fullsized":"2024-04-25T17:01:38.942762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29371,"num_write":377,"num_write_kb":63589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"24'387","reported_seq":479,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.079573+0000","last_change":"2024-04-25T15:47:09.047263+0000","last_active":"2024-04-25T17:01:39.079573+0000","last_peered":"2024-04-25T17:01:39.079573+0000","last_clean":"2024-04-25T17:01:39.079573+0000","last_became_active":"2024-04-25T15:47:09.046942+0000","last_became_peered":"2024-04-25T15:47:09.046942+0000","last_unstale":"2024-04-25T17:01:39.079573+0000","last_undegraded":"2024-04-25T17:01:39.079573+0000","last_fullsized":"2024-04-25T17:01:39.079573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37992,"num_write":353,"num_write_kb":79970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"24'414","reported_seq":514,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.962775+0000","last_change":"2024-04-25T15:46:33.043405+0000","last_active":"2024-04-25T17:01:38.962775+0000","last_peered":"2024-04-25T17:01:38.962775+0000","last_clean":"2024-04-25T17:01:38.962775+0000","last_became_active":"2024-04-25T15:46:33.043094+0000","last_became_peered":"2024-04-25T15:46:33.043094+0000","last_unstale":"2024-04-25T17:01:38.962775+0000","last_undegraded":"2024-04-25T17:01:38.962775+0000","last_fullsized":"2024-04-25T17:01:38.962775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:49.811317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25428,"num_write":377,"num_write_kb":51351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"24'395","reported_seq":472,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.004887+0000","last_change":"2024-04-25T15:46:33.037180+0000","last_active":"2024-04-25T17:01:39.004887+0000","last_peered":"2024-04-25T17:01:39.004887+0000","last_clean":"2024-04-25T17:01:39.004887+0000","last_became_active":"2024-04-25T15:46:33.036822+0000","last_became_peered":"2024-04-25T15:46:33.036822+0000","last_unstale":"2024-04-25T17:01:39.004887+0000","last_undegraded":"2024-04-25T17:01:39.004887+0000","last_fullsized":"2024-04-25T17:01:39.004887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:45.123026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15654,"num_write":362,"num_write_kb":47082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"24'382","reported_seq":452,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.993868+0000","last_change":"2024-04-25T15:46:33.040594+0000","last_active":"2024-04-25T17:01:38.993868+0000","last_peered":"2024-04-25T17:01:38.993868+0000","last_clean":"2024-04-25T17:01:38.993868+0000","last_became_active":"2024-04-25T15:46:33.040296+0000","last_became_peered":"2024-04-25T15:46:33.040296+0000","last_unstale":"2024-04-25T17:01:38.993868+0000","last_undegraded":"2024-04-25T17:01:38.993868+0000","last_fullsized":"2024-04-25T17:01:38.993868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:47.844325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9049,"num_write":364,"num_write_kb":58665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"24'374","reported_seq":475,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.990927+0000","last_change":"2024-04-25T15:46:33.011129+0000","last_active":"2024-04-25T17:01:38.990927+0000","last_peered":"2024-04-25T17:01:38.990927+0000","last_clean":"2024-04-25T17:01:38.990927+0000","last_became_active":"2024-04-25T15:46:33.010754+0000","last_became_peered":"2024-04-25T15:46:33.010754+0000","last_unstale":"2024-04-25T17:01:38.990927+0000","last_undegraded":"2024-04-25T17:01:38.990927+0000","last_fullsized":"2024-04-25T17:01:38.990927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:31.093111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27496,"num_write":346,"num_write_kb":71109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"24'401","reported_seq":495,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.923244+0000","last_change":"2024-04-25T15:46:33.011388+0000","last_active":"2024-04-25T17:01:38.923244+0000","last_peered":"2024-04-25T17:01:38.923244+0000","last_clean":"2024-04-25T17:01:38.923244+0000","last_became_active":"2024-04-25T15:46:33.011083+0000","last_became_peered":"2024-04-25T15:46:33.011083+0000","last_unstale":"2024-04-25T17:01:38.923244+0000","last_undegraded":"2024-04-25T17:01:38.923244+0000","last_fullsized":"2024-04-25T17:01:38.923244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:22.959149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":17390,"num_write":371,"num_write_kb":87698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"24'409","reported_seq":485,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.997095+0000","last_change":"2024-04-25T15:46:33.022531+0000","last_active":"2024-04-25T17:01:38.997095+0000","last_peered":"2024-04-25T17:01:38.997095+0000","last_clean":"2024-04-25T17:01:38.997095+0000","last_became_active":"2024-04-25T15:46:33.022214+0000","last_became_peered":"2024-04-25T15:46:33.022214+0000","last_unstale":"2024-04-25T17:01:38.997095+0000","last_undegraded":"2024-04-25T17:01:38.997095+0000","last_fullsized":"2024-04-25T17:01:38.997095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:19.052124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17435,"num_write":384,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"24'435","reported_seq":563,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.085228+0000","last_change":"2024-04-25T15:46:32.929715+0000","last_active":"2024-04-25T17:01:39.085228+0000","last_peered":"2024-04-25T17:01:39.085228+0000","last_clean":"2024-04-25T17:01:39.085228+0000","last_became_active":"2024-04-25T15:46:32.929386+0000","last_became_peered":"2024-04-25T15:46:32.929386+0000","last_unstale":"2024-04-25T17:01:39.085228+0000","last_undegraded":"2024-04-25T17:01:39.085228+0000","last_fullsized":"2024-04-25T17:01:39.085228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:47.844325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41362,"num_write":401,"num_write_kb":92598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"24'426","reported_seq":499,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.966357+0000","last_change":"2024-04-25T15:46:33.041583+0000","last_active":"2024-04-25T17:01:38.966357+0000","last_peered":"2024-04-25T17:01:38.966357+0000","last_clean":"2024-04-25T17:01:38.966357+0000","last_became_active":"2024-04-25T15:46:33.040240+0000","last_became_peered":"2024-04-25T15:46:33.040240+0000","last_unstale":"2024-04-25T17:01:38.966357+0000","last_undegraded":"2024-04-25T17:01:38.966357+0000","last_fullsized":"2024-04-25T17:01:38.966357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16384,"num_write":396,"num_write_kb":62713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"24'404","reported_seq":490,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.972544+0000","last_change":"2024-04-25T15:46:33.044561+0000","last_active":"2024-04-25T17:01:38.972544+0000","last_peered":"2024-04-25T17:01:38.972544+0000","last_clean":"2024-04-25T17:01:38.972544+0000","last_became_active":"2024-04-25T15:46:33.044065+0000","last_became_peered":"2024-04-25T15:46:33.044065+0000","last_unstale":"2024-04-25T17:01:38.972544+0000","last_undegraded":"2024-04-25T17:01:38.972544+0000","last_fullsized":"2024-04-25T17:01:38.972544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:33.557001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":15331,"num_write":377,"num_write_kb":71706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"24'418","reported_seq":517,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.079842+0000","last_change":"2024-04-25T15:46:33.061929+0000","last_active":"2024-04-25T17:01:39.079842+0000","last_peered":"2024-04-25T17:01:39.079842+0000","last_clean":"2024-04-25T17:01:39.079842+0000","last_became_active":"2024-04-25T15:46:33.061623+0000","last_became_peered":"2024-04-25T15:46:33.061623+0000","last_unstale":"2024-04-25T17:01:39.079842+0000","last_undegraded":"2024-04-25T17:01:39.079842+0000","last_fullsized":"2024-04-25T17:01:39.079842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:28.844626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29942,"num_write":388,"num_write_kb":91861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"24'442","reported_seq":554,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.948818+0000","last_change":"2024-04-25T15:46:33.063451+0000","last_active":"2024-04-25T17:01:38.948818+0000","last_peered":"2024-04-25T17:01:38.948818+0000","last_clean":"2024-04-25T17:01:38.948818+0000","last_became_active":"2024-04-25T15:46:33.063126+0000","last_became_peered":"2024-04-25T15:46:33.063126+0000","last_unstale":"2024-04-25T17:01:38.948818+0000","last_undegraded":"2024-04-25T17:01:38.948818+0000","last_fullsized":"2024-04-25T17:01:38.948818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:49.144595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":28728,"num_write":405,"num_write_kb":157712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"24'446","reported_seq":529,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996562+0000","last_change":"2024-04-25T15:46:33.014377+0000","last_active":"2024-04-25T17:01:38.996562+0000","last_peered":"2024-04-25T17:01:38.996562+0000","last_clean":"2024-04-25T17:01:38.996562+0000","last_became_active":"2024-04-25T15:46:33.014056+0000","last_became_peered":"2024-04-25T15:46:33.014056+0000","last_unstale":"2024-04-25T17:01:38.996562+0000","last_undegraded":"2024-04-25T17:01:38.996562+0000","last_fullsized":"2024-04-25T17:01:38.996562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:49.025646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19430,"num_write":422,"num_write_kb":59069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"24'420","reported_seq":529,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996828+0000","last_change":"2024-04-25T15:46:33.032744+0000","last_active":"2024-04-25T17:01:38.996828+0000","last_peered":"2024-04-25T17:01:38.996828+0000","last_clean":"2024-04-25T17:01:38.996828+0000","last_became_active":"2024-04-25T15:46:33.032498+0000","last_became_peered":"2024-04-25T15:46:33.032498+0000","last_unstale":"2024-04-25T17:01:38.996828+0000","last_undegraded":"2024-04-25T17:01:38.996828+0000","last_fullsized":"2024-04-25T17:01:38.996828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:04.861299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38942,"num_write":394,"num_write_kb":67464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"24'418","reported_seq":501,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.974586+0000","last_change":"2024-04-25T15:46:33.043548+0000","last_active":"2024-04-25T17:01:38.974586+0000","last_peered":"2024-04-25T17:01:38.974586+0000","last_clean":"2024-04-25T17:01:38.974586+0000","last_became_active":"2024-04-25T15:46:33.043251+0000","last_became_peered":"2024-04-25T15:46:33.043251+0000","last_unstale":"2024-04-25T17:01:38.974586+0000","last_undegraded":"2024-04-25T17:01:38.974586+0000","last_fullsized":"2024-04-25T17:01:38.974586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:04.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15275,"num_write":389,"num_write_kb":50799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"24'423","reported_seq":528,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.919948+0000","last_change":"2024-04-25T15:46:32.927532+0000","last_active":"2024-04-25T17:01:38.919948+0000","last_peered":"2024-04-25T17:01:38.919948+0000","last_clean":"2024-04-25T17:01:38.919948+0000","last_became_active":"2024-04-25T15:46:32.926836+0000","last_became_peered":"2024-04-25T15:46:32.926836+0000","last_unstale":"2024-04-25T17:01:38.919948+0000","last_undegraded":"2024-04-25T17:01:38.919948+0000","last_fullsized":"2024-04-25T17:01:38.919948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:21.339594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":23691,"num_write":392,"num_write_kb":92779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"24'428","reported_seq":517,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.972089+0000","last_change":"2024-04-25T15:46:33.041900+0000","last_active":"2024-04-25T17:01:38.972089+0000","last_peered":"2024-04-25T17:01:38.972089+0000","last_clean":"2024-04-25T17:01:38.972089+0000","last_became_active":"2024-04-25T15:46:33.040821+0000","last_became_peered":"2024-04-25T15:46:33.040821+0000","last_unstale":"2024-04-25T17:01:38.972089+0000","last_undegraded":"2024-04-25T17:01:38.972089+0000","last_fullsized":"2024-04-25T17:01:38.972089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18443,"num_write":400,"num_write_kb":50986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"24'394","reported_seq":477,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.907774+0000","last_change":"2024-04-25T15:46:32.926772+0000","last_active":"2024-04-25T17:01:38.907774+0000","last_peered":"2024-04-25T17:01:38.907774+0000","last_clean":"2024-04-25T17:01:38.907774+0000","last_became_active":"2024-04-25T15:46:32.926468+0000","last_became_peered":"2024-04-25T15:46:32.926468+0000","last_unstale":"2024-04-25T17:01:38.907774+0000","last_undegraded":"2024-04-25T17:01:38.907774+0000","last_fullsized":"2024-04-25T17:01:38.907774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:21:35.665923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16804,"num_write":379,"num_write_kb":50499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"24'462","reported_seq":583,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.005049+0000","last_change":"2024-04-25T15:46:33.031482+0000","last_active":"2024-04-25T17:01:39.005049+0000","last_peered":"2024-04-25T17:01:39.005049+0000","last_clean":"2024-04-25T17:01:39.005049+0000","last_became_active":"2024-04-25T15:46:33.031182+0000","last_became_peered":"2024-04-25T15:46:33.031182+0000","last_unstale":"2024-04-25T17:01:39.005049+0000","last_undegraded":"2024-04-25T17:01:39.005049+0000","last_fullsized":"2024-04-25T17:01:39.005049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":42888,"num_write":421,"num_write_kb":44012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"24'399","reported_seq":499,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.162134+0000","last_change":"2024-04-25T15:46:32.931992+0000","last_active":"2024-04-25T17:01:39.162134+0000","last_peered":"2024-04-25T17:01:39.162134+0000","last_clean":"2024-04-25T17:01:39.162134+0000","last_became_active":"2024-04-25T15:46:32.931684+0000","last_became_peered":"2024-04-25T15:46:32.931684+0000","last_unstale":"2024-04-25T17:01:39.162134+0000","last_undegraded":"2024-04-25T17:01:39.162134+0000","last_fullsized":"2024-04-25T17:01:39.162134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:12.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25944,"num_write":373,"num_write_kb":59184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"24'397","reported_seq":465,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.923787+0000","last_change":"2024-04-25T15:46:32.926461+0000","last_active":"2024-04-25T17:01:38.923787+0000","last_peered":"2024-04-25T17:01:38.923787+0000","last_clean":"2024-04-25T17:01:38.923787+0000","last_became_active":"2024-04-25T15:46:32.926136+0000","last_became_peered":"2024-04-25T15:46:32.926136+0000","last_unstale":"2024-04-25T17:01:38.923787+0000","last_undegraded":"2024-04-25T17:01:38.923787+0000","last_fullsized":"2024-04-25T17:01:38.923787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:29.896062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5076,"num_write":375,"num_write_kb":141478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"24'412","reported_seq":512,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.994782+0000","last_change":"2024-04-25T15:46:33.022460+0000","last_active":"2024-04-25T17:01:38.994782+0000","last_peered":"2024-04-25T17:01:38.994782+0000","last_clean":"2024-04-25T17:01:38.994782+0000","last_became_active":"2024-04-25T15:46:33.022116+0000","last_became_peered":"2024-04-25T15:46:33.022116+0000","last_unstale":"2024-04-25T17:01:38.994782+0000","last_undegraded":"2024-04-25T17:01:38.994782+0000","last_fullsized":"2024-04-25T17:01:38.994782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:22.980615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":30085,"num_write":382,"num_write_kb":75269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"24'493","reported_seq":633,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.972507+0000","last_change":"2024-04-25T15:46:33.040668+0000","last_active":"2024-04-25T17:01:38.972507+0000","last_peered":"2024-04-25T17:01:38.972507+0000","last_clean":"2024-04-25T17:01:38.972507+0000","last_became_active":"2024-04-25T15:46:33.040134+0000","last_became_peered":"2024-04-25T15:46:33.040134+0000","last_unstale":"2024-04-25T17:01:38.972507+0000","last_undegraded":"2024-04-25T17:01:38.972507+0000","last_fullsized":"2024-04-25T17:01:38.972507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:16.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44575,"num_write":459,"num_write_kb":113331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"24'453","reported_seq":584,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.078848+0000","last_change":"2024-04-25T15:47:08.950730+0000","last_active":"2024-04-25T17:01:39.078848+0000","last_peered":"2024-04-25T17:01:39.078848+0000","last_clean":"2024-04-25T17:01:39.078848+0000","last_became_active":"2024-04-25T15:47:08.950453+0000","last_became_peered":"2024-04-25T15:47:08.950453+0000","last_unstale":"2024-04-25T17:01:39.078848+0000","last_undegraded":"2024-04-25T17:01:39.078848+0000","last_fullsized":"2024-04-25T17:01:39.078848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:37:12.149554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":42323,"num_write":423,"num_write_kb":72432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"24'432","reported_seq":513,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996532+0000","last_change":"2024-04-25T15:46:33.022223+0000","last_active":"2024-04-25T17:01:38.996532+0000","last_peered":"2024-04-25T17:01:38.996532+0000","last_clean":"2024-04-25T17:01:38.996532+0000","last_became_active":"2024-04-25T15:46:33.021888+0000","last_became_peered":"2024-04-25T15:46:33.021888+0000","last_unstale":"2024-04-25T17:01:38.996532+0000","last_undegraded":"2024-04-25T17:01:38.996532+0000","last_fullsized":"2024-04-25T17:01:38.996532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:23.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16763,"num_write":405,"num_write_kb":80030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"24'382","reported_seq":443,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.984126+0000","last_change":"2024-04-25T15:46:32.929281+0000","last_active":"2024-04-25T17:01:38.984126+0000","last_peered":"2024-04-25T17:01:38.984126+0000","last_clean":"2024-04-25T17:01:38.984126+0000","last_became_active":"2024-04-25T15:46:32.929019+0000","last_became_peered":"2024-04-25T15:46:32.929019+0000","last_unstale":"2024-04-25T17:01:38.984126+0000","last_undegraded":"2024-04-25T17:01:38.984126+0000","last_fullsized":"2024-04-25T17:01:38.984126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:55.692126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5031,"num_write":350,"num_write_kb":37997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'222","reported_seq":270,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:35.310167+0000","last_change":"2024-04-25T15:46:31.685950+0000","last_active":"2024-04-25T17:01:35.310167+0000","last_peered":"2024-04-25T17:01:35.310167+0000","last_clean":"2024-04-25T17:01:35.310167+0000","last_became_active":"2024-04-25T15:46:31.685602+0000","last_became_peered":"2024-04-25T15:46:31.685602+0000","last_unstale":"2024-04-25T17:01:35.310167+0000","last_undegraded":"2024-04-25T17:01:35.310167+0000","last_fullsized":"2024-04-25T17:01:35.310167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:29.676427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"24'361","reported_seq":424,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.998822+0000","last_change":"2024-04-25T15:46:33.023655+0000","last_active":"2024-04-25T17:01:38.998822+0000","last_peered":"2024-04-25T17:01:38.998822+0000","last_clean":"2024-04-25T17:01:38.998822+0000","last_became_active":"2024-04-25T15:46:33.023432+0000","last_became_peered":"2024-04-25T15:46:33.023432+0000","last_unstale":"2024-04-25T17:01:38.998822+0000","last_undegraded":"2024-04-25T17:01:38.998822+0000","last_fullsized":"2024-04-25T17:01:38.998822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:21.339594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5878,"num_write":338,"num_write_kb":30071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1233","reported_seq":1281,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:35.017131+0000","last_change":"2024-04-25T15:46:31.659079+0000","last_active":"2024-04-25T17:00:35.017131+0000","last_peered":"2024-04-25T17:00:35.017131+0000","last_clean":"2024-04-25T17:00:35.017131+0000","last_became_active":"2024-04-25T15:46:31.658681+0000","last_became_peered":"2024-04-25T15:46:31.658681+0000","last_unstale":"2024-04-25T17:00:35.017131+0000","last_undegraded":"2024-04-25T17:00:35.017131+0000","last_fullsized":"2024-04-25T17:00:35.017131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1233,"log_dups_size":0,"ondisk_log_size":1233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":12901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"24'720","reported_seq":768,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:21.336832+0000","last_change":"2024-04-25T15:46:31.684220+0000","last_active":"2024-04-25T17:00:21.336832+0000","last_peered":"2024-04-25T17:00:21.336832+0000","last_clean":"2024-04-25T17:00:21.336832+0000","last_became_active":"2024-04-25T15:46:31.682936+0000","last_became_peered":"2024-04-25T15:46:31.682936+0000","last_unstale":"2024-04-25T17:00:21.336832+0000","last_undegraded":"2024-04-25T17:00:21.336832+0000","last_fullsized":"2024-04-25T17:00:21.336832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:53.729696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"24'432","reported_seq":504,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.919915+0000","last_change":"2024-04-25T15:46:33.019843+0000","last_active":"2024-04-25T17:01:38.919915+0000","last_peered":"2024-04-25T17:01:38.919915+0000","last_clean":"2024-04-25T17:01:38.919915+0000","last_became_active":"2024-04-25T15:46:33.019526+0000","last_became_peered":"2024-04-25T15:46:33.019526+0000","last_unstale":"2024-04-25T17:01:38.919915+0000","last_undegraded":"2024-04-25T17:01:38.919915+0000","last_fullsized":"2024-04-25T17:01:38.919915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:22.980615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10652,"num_write":400,"num_write_kb":42963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"24'1278","reported_seq":1327,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:27.319190+0000","last_change":"2024-04-25T15:46:31.689444+0000","last_active":"2024-04-25T17:01:27.319190+0000","last_peered":"2024-04-25T17:01:27.319190+0000","last_clean":"2024-04-25T17:01:27.319190+0000","last_became_active":"2024-04-25T15:46:31.689130+0000","last_became_peered":"2024-04-25T15:46:31.689130+0000","last_unstale":"2024-04-25T17:01:27.319190+0000","last_undegraded":"2024-04-25T17:01:27.319190+0000","last_fullsized":"2024-04-25T17:01:27.319190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1278,"log_dups_size":0,"ondisk_log_size":1278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":12905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"24'413","reported_seq":475,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.181021+0000","last_change":"2024-04-25T15:46:32.931979+0000","last_active":"2024-04-25T17:01:39.181021+0000","last_peered":"2024-04-25T17:01:39.181021+0000","last_clean":"2024-04-25T17:01:39.181021+0000","last_became_active":"2024-04-25T15:46:32.931648+0000","last_became_peered":"2024-04-25T15:46:32.931648+0000","last_unstale":"2024-04-25T17:01:39.181021+0000","last_undegraded":"2024-04-25T17:01:39.181021+0000","last_fullsized":"2024-04-25T17:01:39.181021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:23.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9624,"num_write":380,"num_write_kb":46532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"24'54","reported_seq":103,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:27.332734+0000","last_change":"2024-04-25T15:46:31.685721+0000","last_active":"2024-04-25T17:01:27.332734+0000","last_peered":"2024-04-25T17:01:27.332734+0000","last_clean":"2024-04-25T17:01:27.332734+0000","last_became_active":"2024-04-25T15:46:31.685244+0000","last_became_peered":"2024-04-25T15:46:31.685244+0000","last_unstale":"2024-04-25T17:01:27.332734+0000","last_undegraded":"2024-04-25T17:01:27.332734+0000","last_fullsized":"2024-04-25T17:01:27.332734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"24'416","reported_seq":506,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.973069+0000","last_change":"2024-04-25T15:46:33.043533+0000","last_active":"2024-04-25T17:01:38.973069+0000","last_peered":"2024-04-25T17:01:38.973069+0000","last_clean":"2024-04-25T17:01:38.973069+0000","last_became_active":"2024-04-25T15:46:33.043228+0000","last_became_peered":"2024-04-25T15:46:33.043228+0000","last_unstale":"2024-04-25T17:01:38.973069+0000","last_undegraded":"2024-04-25T17:01:38.973069+0000","last_fullsized":"2024-04-25T17:01:38.973069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26593,"num_write":386,"num_write_kb":54872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"24'373","reported_seq":422,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:15.484935+0000","last_change":"2024-04-25T15:46:31.692399+0000","last_active":"2024-04-25T17:01:15.484935+0000","last_peered":"2024-04-25T17:01:15.484935+0000","last_clean":"2024-04-25T17:01:15.484935+0000","last_became_active":"2024-04-25T15:46:31.692063+0000","last_became_peered":"2024-04-25T15:46:31.692063+0000","last_unstale":"2024-04-25T17:01:15.484935+0000","last_undegraded":"2024-04-25T17:01:15.484935+0000","last_fullsized":"2024-04-25T17:01:15.484935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'409","reported_seq":513,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.991611+0000","last_change":"2024-04-25T15:46:33.043275+0000","last_active":"2024-04-25T17:01:38.991611+0000","last_peered":"2024-04-25T17:01:38.991611+0000","last_clean":"2024-04-25T17:01:38.991611+0000","last_became_active":"2024-04-25T15:46:33.042941+0000","last_became_peered":"2024-04-25T15:46:33.042941+0000","last_unstale":"2024-04-25T17:01:38.991611+0000","last_undegraded":"2024-04-25T17:01:38.991611+0000","last_fullsized":"2024-04-25T17:01:38.991611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:22.959149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53704,"num_write":377,"num_write_kb":101029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'2113","reported_seq":2162,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:34.052959+0000","last_change":"2024-04-25T15:46:31.686299+0000","last_active":"2024-04-25T17:01:34.052959+0000","last_peered":"2024-04-25T17:01:34.052959+0000","last_clean":"2024-04-25T17:01:34.052959+0000","last_became_active":"2024-04-25T15:46:31.685993+0000","last_became_peered":"2024-04-25T15:46:31.685993+0000","last_unstale":"2024-04-25T17:01:34.052959+0000","last_undegraded":"2024-04-25T17:01:34.052959+0000","last_fullsized":"2024-04-25T17:01:34.052959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2113,"log_dups_size":0,"ondisk_log_size":2113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2065,"num_write_kb":6028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'405","reported_seq":535,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.989646+0000","last_change":"2024-04-25T15:46:33.035207+0000","last_active":"2024-04-25T17:01:38.989646+0000","last_peered":"2024-04-25T17:01:38.989646+0000","last_clean":"2024-04-25T17:01:38.989646+0000","last_became_active":"2024-04-25T15:46:33.034926+0000","last_became_peered":"2024-04-25T15:46:33.034926+0000","last_unstale":"2024-04-25T17:01:38.989646+0000","last_undegraded":"2024-04-25T17:01:38.989646+0000","last_fullsized":"2024-04-25T17:01:38.989646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:28.844626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":46433,"num_write":373,"num_write_kb":80369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'1505","reported_seq":1555,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:27.332697+0000","last_change":"2024-04-25T15:46:31.683086+0000","last_active":"2024-04-25T17:01:27.332697+0000","last_peered":"2024-04-25T17:01:27.332697+0000","last_clean":"2024-04-25T17:01:27.332697+0000","last_became_active":"2024-04-25T15:46:31.682661+0000","last_became_peered":"2024-04-25T15:46:31.682661+0000","last_unstale":"2024-04-25T17:01:27.332697+0000","last_undegraded":"2024-04-25T17:01:27.332697+0000","last_fullsized":"2024-04-25T17:01:27.332697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1505,"log_dups_size":0,"ondisk_log_size":1505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1466,"num_write_kb":13174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"24'389","reported_seq":486,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.951163+0000","last_change":"2024-04-25T15:46:33.034800+0000","last_active":"2024-04-25T17:01:38.951163+0000","last_peered":"2024-04-25T17:01:38.951163+0000","last_clean":"2024-04-25T17:01:38.951163+0000","last_became_active":"2024-04-25T15:46:33.034493+0000","last_became_peered":"2024-04-25T15:46:33.034493+0000","last_unstale":"2024-04-25T17:01:38.951163+0000","last_undegraded":"2024-04-25T17:01:38.951163+0000","last_fullsized":"2024-04-25T17:01:38.951163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:16.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":29846,"num_write":355,"num_write_kb":66952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"24'423","reported_seq":473,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:35.016607+0000","last_change":"2024-04-25T15:46:31.688398+0000","last_active":"2024-04-25T17:00:35.016607+0000","last_peered":"2024-04-25T17:00:35.016607+0000","last_clean":"2024-04-25T17:00:35.016607+0000","last_became_active":"2024-04-25T15:46:31.688096+0000","last_became_peered":"2024-04-25T15:46:31.688096+0000","last_unstale":"2024-04-25T17:00:35.016607+0000","last_undegraded":"2024-04-25T17:00:35.016607+0000","last_fullsized":"2024-04-25T17:00:35.016607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:53.729696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"24'423","reported_seq":498,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996679+0000","last_change":"2024-04-25T15:46:33.031520+0000","last_active":"2024-04-25T17:01:38.996679+0000","last_peered":"2024-04-25T17:01:38.996679+0000","last_clean":"2024-04-25T17:01:38.996679+0000","last_became_active":"2024-04-25T15:46:33.031282+0000","last_became_peered":"2024-04-25T15:46:33.031282+0000","last_unstale":"2024-04-25T17:01:38.996679+0000","last_undegraded":"2024-04-25T17:01:38.996679+0000","last_fullsized":"2024-04-25T17:01:38.996679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:41.663796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11364,"num_write":392,"num_write_kb":80312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"24'62","reported_seq":112,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:12.317879+0000","last_change":"2024-04-25T15:46:31.691191+0000","last_active":"2024-04-25T17:01:12.317879+0000","last_peered":"2024-04-25T17:01:12.317879+0000","last_clean":"2024-04-25T17:01:12.317879+0000","last_became_active":"2024-04-25T15:46:31.690848+0000","last_became_peered":"2024-04-25T15:46:31.690848+0000","last_unstale":"2024-04-25T17:01:12.317879+0000","last_undegraded":"2024-04-25T17:01:12.317879+0000","last_fullsized":"2024-04-25T17:01:12.317879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'391","reported_seq":450,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.964984+0000","last_change":"2024-04-25T15:46:33.040890+0000","last_active":"2024-04-25T17:01:38.964984+0000","last_peered":"2024-04-25T17:01:38.964984+0000","last_clean":"2024-04-25T17:01:38.964984+0000","last_became_active":"2024-04-25T15:46:33.040568+0000","last_became_peered":"2024-04-25T15:46:33.040568+0000","last_unstale":"2024-04-25T17:01:38.964984+0000","last_undegraded":"2024-04-25T17:01:38.964984+0000","last_fullsized":"2024-04-25T17:01:38.964984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:04.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":1556,"num_write":356,"num_write_kb":55877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"24'58","reported_seq":108,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T16:59:56.238276+0000","last_change":"2024-04-25T15:46:31.659031+0000","last_active":"2024-04-25T16:59:56.238276+0000","last_peered":"2024-04-25T16:59:56.238276+0000","last_clean":"2024-04-25T16:59:56.238276+0000","last_became_active":"2024-04-25T15:46:31.658670+0000","last_became_peered":"2024-04-25T15:46:31.658670+0000","last_unstale":"2024-04-25T16:59:56.238276+0000","last_undegraded":"2024-04-25T16:59:56.238276+0000","last_fullsized":"2024-04-25T16:59:56.238276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"24'439","reported_seq":516,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.993735+0000","last_change":"2024-04-25T15:46:33.021142+0000","last_active":"2024-04-25T17:01:38.993735+0000","last_peered":"2024-04-25T17:01:38.993735+0000","last_clean":"2024-04-25T17:01:38.993735+0000","last_became_active":"2024-04-25T15:46:33.020753+0000","last_became_peered":"2024-04-25T15:46:33.020753+0000","last_unstale":"2024-04-25T17:01:38.993735+0000","last_undegraded":"2024-04-25T17:01:38.993735+0000","last_fullsized":"2024-04-25T17:01:38.993735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17823,"num_write":412,"num_write_kb":54819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'566","reported_seq":616,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:31.049237+0000","last_change":"2024-04-25T15:46:31.703454+0000","last_active":"2024-04-25T17:01:31.049237+0000","last_peered":"2024-04-25T17:01:31.049237+0000","last_clean":"2024-04-25T17:01:31.049237+0000","last_became_active":"2024-04-25T15:46:31.703167+0000","last_became_peered":"2024-04-25T15:46:31.703167+0000","last_unstale":"2024-04-25T17:01:31.049237+0000","last_undegraded":"2024-04-25T17:01:31.049237+0000","last_fullsized":"2024-04-25T17:01:31.049237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:02.958438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":510,"num_write_kb":8426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"24'470","reported_seq":592,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.950114+0000","last_change":"2024-04-25T15:46:33.039900+0000","last_active":"2024-04-25T17:01:38.950114+0000","last_peered":"2024-04-25T17:01:38.950114+0000","last_clean":"2024-04-25T17:01:38.950114+0000","last_became_active":"2024-04-25T15:46:33.039613+0000","last_became_peered":"2024-04-25T15:46:33.039613+0000","last_unstale":"2024-04-25T17:01:38.950114+0000","last_undegraded":"2024-04-25T17:01:38.950114+0000","last_fullsized":"2024-04-25T17:01:38.950114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":36444,"num_write":435,"num_write_kb":71594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'805","reported_seq":856,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:11.165829+0000","last_change":"2024-04-25T15:46:31.684537+0000","last_active":"2024-04-25T17:01:11.165829+0000","last_peered":"2024-04-25T17:01:11.165829+0000","last_clean":"2024-04-25T17:01:11.165829+0000","last_became_active":"2024-04-25T15:46:31.684173+0000","last_became_peered":"2024-04-25T15:46:31.684173+0000","last_unstale":"2024-04-25T17:01:11.165829+0000","last_undegraded":"2024-04-25T17:01:11.165829+0000","last_fullsized":"2024-04-25T17:01:11.165829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:41.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":4496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'360","reported_seq":440,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.957203+0000","last_change":"2024-04-25T15:46:33.037831+0000","last_active":"2024-04-25T17:01:38.957203+0000","last_peered":"2024-04-25T17:01:38.957203+0000","last_clean":"2024-04-25T17:01:38.957203+0000","last_became_active":"2024-04-25T15:46:33.037529+0000","last_became_peered":"2024-04-25T15:46:33.037529+0000","last_unstale":"2024-04-25T17:01:38.957203+0000","last_undegraded":"2024-04-25T17:01:38.957203+0000","last_fullsized":"2024-04-25T17:01:38.957203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:20.677976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":10575,"num_write":335,"num_write_kb":42548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'799","reported_seq":850,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:13.079781+0000","last_change":"2024-04-25T15:46:31.704159+0000","last_active":"2024-04-25T17:00:13.079781+0000","last_peered":"2024-04-25T17:00:13.079781+0000","last_clean":"2024-04-25T17:00:13.079781+0000","last_became_active":"2024-04-25T15:46:31.703896+0000","last_became_peered":"2024-04-25T15:46:31.703896+0000","last_unstale":"2024-04-25T17:00:13.079781+0000","last_undegraded":"2024-04-25T17:00:13.079781+0000","last_fullsized":"2024-04-25T17:00:13.079781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":4482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'410","reported_seq":481,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.963314+0000","last_change":"2024-04-25T15:46:33.038719+0000","last_active":"2024-04-25T17:01:38.963314+0000","last_peered":"2024-04-25T17:01:38.963314+0000","last_clean":"2024-04-25T17:01:38.963314+0000","last_became_active":"2024-04-25T15:46:33.038380+0000","last_became_peered":"2024-04-25T15:46:33.038380+0000","last_unstale":"2024-04-25T17:01:38.963314+0000","last_undegraded":"2024-04-25T17:01:38.963314+0000","last_fullsized":"2024-04-25T17:01:38.963314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:13:33.423087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18534,"num_write":381,"num_write_kb":108433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'789","reported_seq":840,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:27.829293+0000","last_change":"2024-04-25T15:46:31.690489+0000","last_active":"2024-04-25T17:00:27.829293+0000","last_peered":"2024-04-25T17:00:27.829293+0000","last_clean":"2024-04-25T17:00:27.829293+0000","last_became_active":"2024-04-25T15:46:31.690181+0000","last_became_peered":"2024-04-25T15:46:31.690181+0000","last_unstale":"2024-04-25T17:00:27.829293+0000","last_undegraded":"2024-04-25T17:00:27.829293+0000","last_fullsized":"2024-04-25T17:00:27.829293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'428","reported_seq":501,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.971899+0000","last_change":"2024-04-25T15:46:33.036460+0000","last_active":"2024-04-25T17:01:38.971899+0000","last_peered":"2024-04-25T17:01:38.971899+0000","last_clean":"2024-04-25T17:01:38.971899+0000","last_became_active":"2024-04-25T15:46:33.036033+0000","last_became_peered":"2024-04-25T15:46:33.036033+0000","last_unstale":"2024-04-25T17:01:38.971899+0000","last_undegraded":"2024-04-25T17:01:38.971899+0000","last_fullsized":"2024-04-25T17:01:38.971899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13038,"num_write":401,"num_write_kb":62698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"24'332","reported_seq":383,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:59.295314+0000","last_change":"2024-04-25T15:46:31.703571+0000","last_active":"2024-04-25T17:00:59.295314+0000","last_peered":"2024-04-25T17:00:59.295314+0000","last_clean":"2024-04-25T17:00:59.295314+0000","last_became_active":"2024-04-25T15:46:31.703234+0000","last_became_peered":"2024-04-25T15:46:31.703234+0000","last_unstale":"2024-04-25T17:00:59.295314+0000","last_undegraded":"2024-04-25T17:00:59.295314+0000","last_fullsized":"2024-04-25T17:00:59.295314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'422","reported_seq":513,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.957568+0000","last_change":"2024-04-25T15:46:33.043464+0000","last_active":"2024-04-25T17:01:38.957568+0000","last_peered":"2024-04-25T17:01:38.957568+0000","last_clean":"2024-04-25T17:01:38.957568+0000","last_became_active":"2024-04-25T15:46:33.043145+0000","last_became_peered":"2024-04-25T15:46:33.043145+0000","last_unstale":"2024-04-25T17:01:38.957568+0000","last_undegraded":"2024-04-25T17:01:38.957568+0000","last_fullsized":"2024-04-25T17:01:38.957568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:06.648469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":16889,"num_write":397,"num_write_kb":47575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":151,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T16:58:32.437867+0000","last_change":"2024-04-25T15:46:20.235628+0000","last_active":"2024-04-25T16:58:32.437867+0000","last_peered":"2024-04-25T16:58:32.437867+0000","last_clean":"2024-04-25T16:58:32.437867+0000","last_became_active":"2024-04-25T15:46:20.234477+0000","last_became_peered":"2024-04-25T15:46:20.234477+0000","last_unstale":"2024-04-25T16:58:32.437867+0000","last_undegraded":"2024-04-25T16:58:32.437867+0000","last_fullsized":"2024-04-25T16:58:32.437867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:17.824148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:17.824148+0000","last_clean_scrub_stamp":"2024-04-25T15:46:17.824148+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:50:25.187348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"24'370","reported_seq":424,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:26.013195+0000","last_change":"2024-04-25T15:46:31.702774+0000","last_active":"2024-04-25T17:01:26.013195+0000","last_peered":"2024-04-25T17:01:26.013195+0000","last_clean":"2024-04-25T17:01:26.013195+0000","last_became_active":"2024-04-25T15:46:31.702517+0000","last_became_peered":"2024-04-25T15:46:31.702517+0000","last_unstale":"2024-04-25T17:01:26.013195+0000","last_undegraded":"2024-04-25T17:01:26.013195+0000","last_fullsized":"2024-04-25T17:01:26.013195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"24'359","reported_seq":436,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.912663+0000","last_change":"2024-04-25T15:46:33.043034+0000","last_active":"2024-04-25T17:01:38.912663+0000","last_peered":"2024-04-25T17:01:38.912663+0000","last_clean":"2024-04-25T17:01:38.912663+0000","last_became_active":"2024-04-25T15:46:33.042522+0000","last_became_peered":"2024-04-25T15:46:33.042522+0000","last_unstale":"2024-04-25T17:01:38.912663+0000","last_undegraded":"2024-04-25T17:01:38.912663+0000","last_fullsized":"2024-04-25T17:01:38.912663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:40.746464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13426,"num_write":320,"num_write_kb":38038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"24'500","reported_seq":555,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:42.449985+0000","last_change":"2024-04-25T15:46:31.689200+0000","last_active":"2024-04-25T17:00:42.449985+0000","last_peered":"2024-04-25T17:00:42.449985+0000","last_clean":"2024-04-25T17:00:42.449985+0000","last_became_active":"2024-04-25T15:46:31.687761+0000","last_became_peered":"2024-04-25T15:46:31.687761+0000","last_unstale":"2024-04-25T17:00:42.449985+0000","last_undegraded":"2024-04-25T17:00:42.449985+0000","last_fullsized":"2024-04-25T17:00:42.449985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":12491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'389","reported_seq":465,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.998213+0000","last_change":"2024-04-25T15:46:33.021652+0000","last_active":"2024-04-25T17:01:38.998213+0000","last_peered":"2024-04-25T17:01:38.998213+0000","last_clean":"2024-04-25T17:01:38.998213+0000","last_became_active":"2024-04-25T15:46:33.020828+0000","last_became_peered":"2024-04-25T15:46:33.020828+0000","last_unstale":"2024-04-25T17:01:38.998213+0000","last_undegraded":"2024-04-25T17:01:38.998213+0000","last_fullsized":"2024-04-25T17:01:38.998213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:11.243833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12952,"num_write":356,"num_write_kb":71047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"24'3154","reported_seq":6294,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:36.053305+0000","last_change":"2024-04-25T15:46:31.704698+0000","last_active":"2024-04-25T17:01:36.053305+0000","last_peered":"2024-04-25T17:01:36.053305+0000","last_clean":"2024-04-25T17:01:36.053305+0000","last_became_active":"2024-04-25T15:46:31.704412+0000","last_became_peered":"2024-04-25T15:46:31.704412+0000","last_unstale":"2024-04-25T17:01:36.053305+0000","last_undegraded":"2024-04-25T17:01:36.053305+0000","last_fullsized":"2024-04-25T17:01:36.053305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3154,"log_dups_size":0,"ondisk_log_size":3154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458732,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3086,"num_read_kb":3630,"num_write":3090,"num_write_kb":3631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'400","reported_seq":467,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.083969+0000","last_change":"2024-04-25T15:46:33.061942+0000","last_active":"2024-04-25T17:01:39.083969+0000","last_peered":"2024-04-25T17:01:39.083969+0000","last_clean":"2024-04-25T17:01:39.083969+0000","last_became_active":"2024-04-25T15:46:33.061619+0000","last_became_peered":"2024-04-25T15:46:33.061619+0000","last_unstale":"2024-04-25T17:01:39.083969+0000","last_undegraded":"2024-04-25T17:01:39.083969+0000","last_fullsized":"2024-04-25T17:01:39.083969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:45.123026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9644,"num_write":362,"num_write_kb":26127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"24'999","reported_seq":1053,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T16:59:27.308098+0000","last_change":"2024-04-25T15:46:31.690694+0000","last_active":"2024-04-25T16:59:27.308098+0000","last_peered":"2024-04-25T16:59:27.308098+0000","last_clean":"2024-04-25T16:59:27.308098+0000","last_became_active":"2024-04-25T15:46:31.690339+0000","last_became_peered":"2024-04-25T15:46:31.690339+0000","last_unstale":"2024-04-25T16:59:27.308098+0000","last_undegraded":"2024-04-25T16:59:27.308098+0000","last_fullsized":"2024-04-25T16:59:27.308098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":939,"num_write_kb":8657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'404","reported_seq":515,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.981609+0000","last_change":"2024-04-25T15:46:33.022306+0000","last_active":"2024-04-25T17:01:38.981609+0000","last_peered":"2024-04-25T17:01:38.981609+0000","last_clean":"2024-04-25T17:01:38.981609+0000","last_became_active":"2024-04-25T15:46:33.021995+0000","last_became_peered":"2024-04-25T15:46:33.021995+0000","last_unstale":"2024-04-25T17:01:38.981609+0000","last_undegraded":"2024-04-25T17:01:38.981609+0000","last_fullsized":"2024-04-25T17:01:38.981609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:03.749619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":19099,"num_write":371,"num_write_kb":59650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"24'307","reported_seq":361,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:40.165445+0000","last_change":"2024-04-25T15:46:31.684114+0000","last_active":"2024-04-25T17:00:40.165445+0000","last_peered":"2024-04-25T17:00:40.165445+0000","last_clean":"2024-04-25T17:00:40.165445+0000","last_became_active":"2024-04-25T15:46:31.683802+0000","last_became_peered":"2024-04-25T15:46:31.683802+0000","last_unstale":"2024-04-25T17:00:40.165445+0000","last_undegraded":"2024-04-25T17:00:40.165445+0000","last_fullsized":"2024-04-25T17:00:40.165445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'416","reported_seq":496,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.973398+0000","last_change":"2024-04-25T15:46:33.040119+0000","last_active":"2024-04-25T17:01:38.973398+0000","last_peered":"2024-04-25T17:01:38.973398+0000","last_clean":"2024-04-25T17:01:38.973398+0000","last_became_active":"2024-04-25T15:46:33.039820+0000","last_became_peered":"2024-04-25T15:46:33.039820+0000","last_unstale":"2024-04-25T17:01:38.973398+0000","last_undegraded":"2024-04-25T17:01:38.973398+0000","last_fullsized":"2024-04-25T17:01:38.973398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:06.648469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13405,"num_write":380,"num_write_kb":62960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"24'638","reported_seq":691,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:31.721553+0000","last_change":"2024-04-25T15:46:31.688610+0000","last_active":"2024-04-25T17:00:31.721553+0000","last_peered":"2024-04-25T17:00:31.721553+0000","last_clean":"2024-04-25T17:00:31.721553+0000","last_became_active":"2024-04-25T15:46:31.688274+0000","last_became_peered":"2024-04-25T15:46:31.688274+0000","last_unstale":"2024-04-25T17:00:31.721553+0000","last_undegraded":"2024-04-25T17:00:31.721553+0000","last_fullsized":"2024-04-25T17:00:31.721553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:02.574106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":579,"num_write_kb":8483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'387","reported_seq":510,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.161796+0000","last_change":"2024-04-25T15:46:33.062042+0000","last_active":"2024-04-25T17:01:39.161796+0000","last_peered":"2024-04-25T17:01:39.161796+0000","last_clean":"2024-04-25T17:01:39.161796+0000","last_became_active":"2024-04-25T15:46:33.061680+0000","last_became_peered":"2024-04-25T15:46:33.061680+0000","last_unstale":"2024-04-25T17:01:39.161796+0000","last_undegraded":"2024-04-25T17:01:39.161796+0000","last_fullsized":"2024-04-25T17:01:39.161796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":42014,"num_write":351,"num_write_kb":75036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"24'3879","reported_seq":3931,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:34.676603+0000","last_change":"2024-04-25T15:46:31.687114+0000","last_active":"2024-04-25T17:01:34.676603+0000","last_peered":"2024-04-25T17:01:34.676603+0000","last_clean":"2024-04-25T17:01:34.676603+0000","last_became_active":"2024-04-25T15:46:31.686758+0000","last_became_peered":"2024-04-25T15:46:31.686758+0000","last_unstale":"2024-04-25T17:01:34.676603+0000","last_undegraded":"2024-04-25T17:01:34.676603+0000","last_fullsized":"2024-04-25T17:01:34.676603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3879,"log_dups_size":0,"ondisk_log_size":3879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10737,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'337","reported_seq":410,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.922681+0000","last_change":"2024-04-25T15:46:33.031231+0000","last_active":"2024-04-25T17:01:38.922681+0000","last_peered":"2024-04-25T17:01:38.922681+0000","last_clean":"2024-04-25T17:01:38.922681+0000","last_became_active":"2024-04-25T15:46:33.030894+0000","last_became_peered":"2024-04-25T15:46:33.030894+0000","last_unstale":"2024-04-25T17:01:38.922681+0000","last_undegraded":"2024-04-25T17:01:38.922681+0000","last_fullsized":"2024-04-25T17:01:38.922681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:40.210974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11416,"num_write":310,"num_write_kb":17828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'235","reported_seq":287,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:53.830348+0000","last_change":"2024-04-25T15:46:31.688577+0000","last_active":"2024-04-25T17:00:53.830348+0000","last_peered":"2024-04-25T17:00:53.830348+0000","last_clean":"2024-04-25T17:00:53.830348+0000","last_became_active":"2024-04-25T15:46:31.687691+0000","last_became_peered":"2024-04-25T15:46:31.687691+0000","last_unstale":"2024-04-25T17:00:53.830348+0000","last_undegraded":"2024-04-25T17:00:53.830348+0000","last_fullsized":"2024-04-25T17:00:53.830348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'474","reported_seq":605,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.994840+0000","last_change":"2024-04-25T15:46:33.021249+0000","last_active":"2024-04-25T17:01:38.994840+0000","last_peered":"2024-04-25T17:01:38.994840+0000","last_clean":"2024-04-25T17:01:38.994840+0000","last_became_active":"2024-04-25T15:46:33.020779+0000","last_became_peered":"2024-04-25T15:46:33.020779+0000","last_unstale":"2024-04-25T17:01:38.994840+0000","last_undegraded":"2024-04-25T17:01:38.994840+0000","last_fullsized":"2024-04-25T17:01:38.994840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:39.504513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":41834,"num_write":442,"num_write_kb":97214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"24'714","reported_seq":766,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:36.706046+0000","last_change":"2024-04-25T15:46:31.689494+0000","last_active":"2024-04-25T17:00:36.706046+0000","last_peered":"2024-04-25T17:00:36.706046+0000","last_clean":"2024-04-25T17:00:36.706046+0000","last_became_active":"2024-04-25T15:46:31.688192+0000","last_became_peered":"2024-04-25T15:46:31.688192+0000","last_unstale":"2024-04-25T17:00:36.706046+0000","last_undegraded":"2024-04-25T17:00:36.706046+0000","last_fullsized":"2024-04-25T17:00:36.706046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":4437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"24'485","reported_seq":603,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.977098+0000","last_change":"2024-04-25T15:46:33.062043+0000","last_active":"2024-04-25T17:01:38.977098+0000","last_peered":"2024-04-25T17:01:38.977098+0000","last_clean":"2024-04-25T17:01:38.977098+0000","last_became_active":"2024-04-25T15:46:33.061651+0000","last_became_peered":"2024-04-25T15:46:33.061651+0000","last_unstale":"2024-04-25T17:01:38.977098+0000","last_undegraded":"2024-04-25T17:01:38.977098+0000","last_fullsized":"2024-04-25T17:01:38.977098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:21.340361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31150,"num_write":464,"num_write_kb":116869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'289","reported_seq":341,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:23.361014+0000","last_change":"2024-04-25T15:46:31.685055+0000","last_active":"2024-04-25T17:00:23.361014+0000","last_peered":"2024-04-25T17:00:23.361014+0000","last_clean":"2024-04-25T17:00:23.361014+0000","last_became_active":"2024-04-25T15:46:31.684706+0000","last_became_peered":"2024-04-25T15:46:31.684706+0000","last_unstale":"2024-04-25T17:00:23.361014+0000","last_undegraded":"2024-04-25T17:00:23.361014+0000","last_fullsized":"2024-04-25T17:00:23.361014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:29.917598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"24'407","reported_seq":500,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.916123+0000","last_change":"2024-04-25T15:46:32.929240+0000","last_active":"2024-04-25T17:01:38.916123+0000","last_peered":"2024-04-25T17:01:38.916123+0000","last_clean":"2024-04-25T17:01:38.916123+0000","last_became_active":"2024-04-25T15:46:32.928971+0000","last_became_peered":"2024-04-25T15:46:32.928971+0000","last_unstale":"2024-04-25T17:01:38.916123+0000","last_undegraded":"2024-04-25T17:01:38.916123+0000","last_fullsized":"2024-04-25T17:01:38.916123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:39.504513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21551,"num_write":373,"num_write_kb":54456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'743","reported_seq":795,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:22.524952+0000","last_change":"2024-04-25T15:46:31.687651+0000","last_active":"2024-04-25T17:00:22.524952+0000","last_peered":"2024-04-25T17:00:22.524952+0000","last_clean":"2024-04-25T17:00:22.524952+0000","last_became_active":"2024-04-25T15:46:31.687335+0000","last_became_peered":"2024-04-25T15:46:31.687335+0000","last_unstale":"2024-04-25T17:00:22.524952+0000","last_undegraded":"2024-04-25T17:00:22.524952+0000","last_fullsized":"2024-04-25T17:00:22.524952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"24'417","reported_seq":478,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.913659+0000","last_change":"2024-04-25T15:46:33.021215+0000","last_active":"2024-04-25T17:01:38.913659+0000","last_peered":"2024-04-25T17:01:38.913659+0000","last_clean":"2024-04-25T17:01:38.913659+0000","last_became_active":"2024-04-25T15:46:33.020855+0000","last_became_peered":"2024-04-25T15:46:33.020855+0000","last_unstale":"2024-04-25T17:01:38.913659+0000","last_undegraded":"2024-04-25T17:01:38.913659+0000","last_fullsized":"2024-04-25T17:01:38.913659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:49:54.058601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6898,"num_write":384,"num_write_kb":50772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'1028","reported_seq":1079,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.689923+0000","last_change":"2024-04-25T15:46:31.693099+0000","last_active":"2024-04-25T17:01:38.689923+0000","last_peered":"2024-04-25T17:01:38.689923+0000","last_clean":"2024-04-25T17:01:38.689923+0000","last_became_active":"2024-04-25T15:46:31.692762+0000","last_became_peered":"2024-04-25T15:46:31.692762+0000","last_unstale":"2024-04-25T17:01:38.689923+0000","last_undegraded":"2024-04-25T17:01:38.689923+0000","last_fullsized":"2024-04-25T17:01:38.689923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:29.917598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10888152,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":975,"num_write_kb":11131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"24'426","reported_seq":522,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996220+0000","last_change":"2024-04-25T15:46:33.014467+0000","last_active":"2024-04-25T17:01:38.996220+0000","last_peered":"2024-04-25T17:01:38.996220+0000","last_clean":"2024-04-25T17:01:38.996220+0000","last_became_active":"2024-04-25T15:46:33.014116+0000","last_became_peered":"2024-04-25T15:46:33.014116+0000","last_unstale":"2024-04-25T17:01:38.996220+0000","last_undegraded":"2024-04-25T17:01:38.996220+0000","last_fullsized":"2024-04-25T17:01:38.996220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:44.912712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25236,"num_write":391,"num_write_kb":71743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"24'397","reported_seq":515,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.977707+0000","last_change":"2024-04-25T15:46:33.040027+0000","last_active":"2024-04-25T17:01:38.977707+0000","last_peered":"2024-04-25T17:01:38.977707+0000","last_clean":"2024-04-25T17:01:38.977707+0000","last_became_active":"2024-04-25T15:46:33.039713+0000","last_became_peered":"2024-04-25T15:46:33.039713+0000","last_unstale":"2024-04-25T17:01:38.977707+0000","last_undegraded":"2024-04-25T17:01:38.977707+0000","last_fullsized":"2024-04-25T17:01:38.977707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:49.811317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":31357,"num_write":351,"num_write_kb":60889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"24'784","reported_seq":832,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:26.015449+0000","last_change":"2024-04-25T15:46:31.686712+0000","last_active":"2024-04-25T17:01:26.015449+0000","last_peered":"2024-04-25T17:01:26.015449+0000","last_clean":"2024-04-25T17:01:26.015449+0000","last_became_active":"2024-04-25T15:46:31.686390+0000","last_became_peered":"2024-04-25T15:46:31.686390+0000","last_unstale":"2024-04-25T17:01:26.015449+0000","last_undegraded":"2024-04-25T17:01:26.015449+0000","last_fullsized":"2024-04-25T17:01:26.015449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":4471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'374","reported_seq":433,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.968333+0000","last_change":"2024-04-25T15:46:33.041233+0000","last_active":"2024-04-25T17:01:38.968333+0000","last_peered":"2024-04-25T17:01:38.968333+0000","last_clean":"2024-04-25T17:01:38.968333+0000","last_became_active":"2024-04-25T15:46:33.040941+0000","last_became_peered":"2024-04-25T15:46:33.040941+0000","last_unstale":"2024-04-25T17:01:38.968333+0000","last_undegraded":"2024-04-25T17:01:38.968333+0000","last_fullsized":"2024-04-25T17:01:38.968333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8232,"num_write":346,"num_write_kb":71494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'1200","reported_seq":1248,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:19.564433+0000","last_change":"2024-04-25T15:46:31.688658+0000","last_active":"2024-04-25T17:01:19.564433+0000","last_peered":"2024-04-25T17:01:19.564433+0000","last_clean":"2024-04-25T17:01:19.564433+0000","last_became_active":"2024-04-25T15:46:31.688342+0000","last_became_peered":"2024-04-25T15:46:31.688342+0000","last_unstale":"2024-04-25T17:01:19.564433+0000","last_undegraded":"2024-04-25T17:01:19.564433+0000","last_fullsized":"2024-04-25T17:01:19.564433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1200,"log_dups_size":0,"ondisk_log_size":1200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":12844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"24'387","reported_seq":482,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.999769+0000","last_change":"2024-04-25T15:46:33.043423+0000","last_active":"2024-04-25T17:01:38.999769+0000","last_peered":"2024-04-25T17:01:38.999769+0000","last_clean":"2024-04-25T17:01:38.999769+0000","last_became_active":"2024-04-25T15:46:33.043134+0000","last_became_peered":"2024-04-25T15:46:33.043134+0000","last_unstale":"2024-04-25T17:01:38.999769+0000","last_undegraded":"2024-04-25T17:01:38.999769+0000","last_fullsized":"2024-04-25T17:01:38.999769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:16:40.746464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22111,"num_write":359,"num_write_kb":59931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"24'239","reported_seq":294,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:26.646409+0000","last_change":"2024-04-25T15:46:31.685427+0000","last_active":"2024-04-25T17:00:26.646409+0000","last_peered":"2024-04-25T17:00:26.646409+0000","last_clean":"2024-04-25T17:00:26.646409+0000","last_became_active":"2024-04-25T15:46:31.684729+0000","last_became_peered":"2024-04-25T15:46:31.684729+0000","last_unstale":"2024-04-25T17:00:26.646409+0000","last_undegraded":"2024-04-25T17:00:26.646409+0000","last_fullsized":"2024-04-25T17:00:26.646409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:10:06.621567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":4173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"24'427","reported_seq":551,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.907920+0000","last_change":"2024-04-25T15:46:33.012259+0000","last_active":"2024-04-25T17:01:38.907920+0000","last_peered":"2024-04-25T17:01:38.907920+0000","last_clean":"2024-04-25T17:01:38.907920+0000","last_became_active":"2024-04-25T15:46:33.011979+0000","last_became_peered":"2024-04-25T15:46:33.011979+0000","last_unstale":"2024-04-25T17:01:38.907920+0000","last_undegraded":"2024-04-25T17:01:38.907920+0000","last_fullsized":"2024-04-25T17:01:38.907920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:47.827970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":33589,"num_write":403,"num_write_kb":89000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"24'409","reported_seq":463,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:32.058200+0000","last_change":"2024-04-25T15:46:31.688031+0000","last_active":"2024-04-25T17:01:32.058200+0000","last_peered":"2024-04-25T17:01:32.058200+0000","last_clean":"2024-04-25T17:01:32.058200+0000","last_became_active":"2024-04-25T15:46:31.687705+0000","last_became_peered":"2024-04-25T15:46:31.687705+0000","last_unstale":"2024-04-25T17:01:32.058200+0000","last_undegraded":"2024-04-25T17:01:32.058200+0000","last_fullsized":"2024-04-25T17:01:32.058200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:28.618857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2746,"num_read_kb":1448171,"num_write":24417,"num_write_kb":4365214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26337,"ondisk_log_size":26337,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":184318122,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":3086,"num_read_kb":3630,"num_write":31925,"num_write_kb":196586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368795648,"data_stored":368636244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26820,"ondisk_log_size":26820,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510349,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140188,"kb_used_data":72916,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94231652,"statfs":{"total":96636764160,"available":96493211648,"internally_reserved":0,"allocated":74665984,"data_stored":74483790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510349,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120840,"kb_used_data":49408,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94251000,"statfs":{"total":96636764160,"available":96513024000,"internally_reserved":0,"allocated":50593792,"data_stored":50421810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510351,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108492,"kb_used_data":41220,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94263348,"statfs":{"total":96636764160,"available":96525668352,"internally_reserved":0,"allocated":42209280,"data_stored":42033230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510349,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119124,"kb_used_data":51852,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94252716,"statfs":{"total":96636764160,"available":96514781184,"internally_reserved":0,"allocated":53096448,"data_stored":52920718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510350,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93600,"kb_used_data":22168,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94278240,"statfs":{"total":96636764160,"available":96540917760,"internally_reserved":0,"allocated":22700032,"data_stored":22519792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510351,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125008,"kb_used_data":49416,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94246832,"statfs":{"total":96636764160,"available":96508755968,"internally_reserved":0,"allocated":50601984,"data_stored":50421404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543054,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128096,"kb_used_data":34456,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94243744,"statfs":{"total":96636764160,"available":96505593856,"internally_reserved":0,"allocated":35282944,"data_stored":35103852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":95877576},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543055,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99340,"kb_used_data":41796,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94272500,"statfs":{"total":96636764160,"available":96535040000,"internally_reserved":0,"allocated":42799104,"data_stored":42622880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41959424,"data_stored":41943700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50356224,"data_stored":50332592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22454272,"data_stored":22430980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35037184,"data_stored":35015040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":52850688,"data_stored":52831906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41963520,"data_stored":41944418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":50348032,"data_stored":50332998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73826304,"data_stored":73804610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T17:01:47.117 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T17:01:47.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.272+0000 7fa5028b1640 1 Processor -- start 2024-04-25T17:01:47.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.273+0000 7fa5028b1640 1 -- start start 2024-04-25T17:01:47.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.274+0000 7fa5028b1640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa4fc0c49d0 0x7fa4fc152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:47.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.274+0000 7fa5028b1640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa4fc15c2d0 0x7fa4fc0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:47.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.274+0000 7fa5028b1640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4fc0c79a0 con 0x7fa4fc15bec0 2024-04-25T17:01:47.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.274+0000 7fa5028b1640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa4fc0c8610 con 0x7fa4fc15c2d0 2024-04-25T17:01:47.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.274+0000 7fa5028b1640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fa4fc0c8050 con 0x7fa4fc0c49d0 2024-04-25T17:01:47.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.310+0000 7fa500e4e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa4fc15c2d0 0x7fa4fc0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:47.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.311+0000 7fa500e4e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa4fc15c2d0 0x7fa4fc0c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51146/0 (socket says 172.21.15.59:51146) 2024-04-25T17:01:47.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.311+0000 7fa500e4e640 1 -- 172.21.15.59:0/64403698 learned_addr learned my addr 172.21.15.59:0/64403698 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:47.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.314+0000 7fa500e4e640 1 -- 172.21.15.59:0/64403698 >> v2:172.21.15.64:3300/0 conn(0x7fa4fc0c49d0 msgr2=0x7fa4fc152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:47.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.314+0000 7fa500e4e640 1 --2- 172.21.15.59:0/64403698 >> v2:172.21.15.64:3300/0 conn(0x7fa4fc0c49d0 0x7fa4fc152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:47.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.314+0000 7fa500e4e640 1 -- 172.21.15.59:0/64403698 >> v1:172.21.15.64:6789/0 conn(0x7fa4fc15bec0 legacy=0x7fa4fc0c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:47.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.314+0000 7fa500e4e640 1 -- 172.21.15.59:0/64403698 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4fc0c8330 con 0x7fa4fc15c2d0 2024-04-25T17:01:47.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.317+0000 7fa500e4e640 1 --2- 172.21.15.59:0/64403698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4fc15c2d0 0x7fa4fc0c5300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0cb000 tx=0x7fa4f402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde474944bb586fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:47.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.322+0000 7fa4faffd640 1 -- 172.21.15.59:0/64403698 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4036070 con 0x7fa4fc15c2d0 2024-04-25T17:01:47.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.322+0000 7fa4faffd640 1 -- 172.21.15.59:0/64403698 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f4031600 con 0x7fa4fc15c2d0 2024-04-25T17:01:47.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.322+0000 7fa4faffd640 1 -- 172.21.15.59:0/64403698 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40319d0 con 0x7fa4fc15c2d0 2024-04-25T17:01:47.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.323+0000 7fa5028b1640 1 -- 172.21.15.59:0/64403698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4fc15c2d0 msgr2=0x7fa4fc0c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:47.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.323+0000 7fa5028b1640 1 --2- 172.21.15.59:0/64403698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4fc15c2d0 0x7fa4fc0c5300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0cb000 tx=0x7fa4f402a6f0 comp rx=0 tx=0).stop 2024-04-25T17:01:47.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.323+0000 7fa5028b1640 1 -- 172.21.15.59:0/64403698 shutdown_connections 2024-04-25T17:01:47.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.323+0000 7fa5028b1640 1 --2- 172.21.15.59:0/64403698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4fc15c2d0 0x7fa4fc0c5300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:47.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.323+0000 7fa5028b1640 1 --2- 172.21.15.59:0/64403698 >> v2:172.21.15.64:3300/0 conn(0x7fa4fc0c49d0 0x7fa4fc152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:47.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.323+0000 7fa5028b1640 1 -- 172.21.15.59:0/64403698 >> 172.21.15.59:0/64403698 conn(0x7fa4fc068900 msgr2=0x7fa4fc06f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:47.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.323+0000 7fa5028b1640 1 -- 172.21.15.59:0/64403698 shutdown_connections 2024-04-25T17:01:47.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.323+0000 7fa5028b1640 1 -- 172.21.15.59:0/64403698 wait complete. 2024-04-25T17:01:47.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.325+0000 7fa5028b1640 1 Processor -- start 2024-04-25T17:01:47.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.325+0000 7fa5028b1640 1 -- start start 2024-04-25T17:01:47.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.326+0000 7fa5028b1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4fc0c49d0 0x7fa4fc156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:47.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.326+0000 7fa5028b1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4fc15bec0 0x7fa4fc1efb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.326+0000 7fa5028b1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4fc15c2d0 0x7fa4fc15b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.326+0000 7fa5028b1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc0cdb50 con 0x7fa4fc0c49d0 2024-04-25T17:01:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.326+0000 7fa5028b1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc0cd870 con 0x7fa4fc15c2d0 2024-04-25T17:01:47.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.326+0000 7fa5028b1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fa4fc0ce070 con 0x7fa4fc15bec0 2024-04-25T17:01:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.327+0000 7fa4fbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4fc0c49d0 0x7fa4fc156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.327+0000 7fa4fb7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4fc15bec0 0x7fa4fc1efb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.327+0000 7fa500e4e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4fc15c2d0 0x7fa4fc15b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.327+0000 7fa4fb7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4fc15bec0 0x7fa4fc1efb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53136/0 (socket says 172.21.15.59:53136) 2024-04-25T17:01:47.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.327+0000 7fa4fb7fe640 1 -- 172.21.15.59:0/3101416689 learned_addr learned my addr 172.21.15.59:0/3101416689 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:47.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.332+0000 7fa500e4e640 1 -- 172.21.15.59:0/3101416689 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4fc15bec0 msgr2=0x7fa4fc1efb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.332+0000 7fa500e4e640 1 --2- 172.21.15.59:0/3101416689 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4fc15bec0 0x7fa4fc1efb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.332+0000 7fa500e4e640 1 -- 172.21.15.59:0/3101416689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4fc0c49d0 msgr2=0x7fa4fc156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.332+0000 7fa500e4e640 1 --2- 172.21.15.59:0/3101416689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4fc0c49d0 0x7fa4fc156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.332+0000 7fa500e4e640 1 -- 172.21.15.59:0/3101416689 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4fc1f0050 con 0x7fa4fc15c2d0 2024-04-25T17:01:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.332+0000 7fa4fb7fe640 1 --2- 172.21.15.59:0/3101416689 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4fc15bec0 0x7fa4fc1efb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:01:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.335+0000 7fa500e4e640 1 --2- 172.21.15.59:0/3101416689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4fc15c2d0 0x7fa4fc15b000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4030000 tx=0x7fa4f4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:47.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.339+0000 7fa4f8ff9640 1 -- 172.21.15.59:0/3101416689 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4041030 con 0x7fa4fc15c2d0 2024-04-25T17:01:47.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.339+0000 7fa4f8ff9640 1 -- 172.21.15.59:0/3101416689 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f4037040 con 0x7fa4fc15c2d0 2024-04-25T17:01:47.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.339+0000 7fa5028b1640 1 -- 172.21.15.59:0/3101416689 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4fc151660 con 0x7fa4fc15c2d0 2024-04-25T17:01:47.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.339+0000 7fa4f8ff9640 1 -- 172.21.15.59:0/3101416689 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4036070 con 0x7fa4fc15c2d0 2024-04-25T17:01:47.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.339+0000 7fa5028b1640 1 -- 172.21.15.59:0/3101416689 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4fc151c20 con 0x7fa4fc15c2d0 2024-04-25T17:01:47.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.340+0000 7fa5028b1640 1 -- 172.21.15.59:0/3101416689 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4fc1513f0 con 0x7fa4fc15c2d0 2024-04-25T17:01:47.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.362+0000 7fa4f8ff9640 1 -- 172.21.15.59:0/3101416689 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa4f4044070 con 0x7fa4fc15c2d0 2024-04-25T17:01:47.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.362+0000 7fa4f8ff9640 1 --2- 172.21.15.59:0/3101416689 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fa4e8074530 0x7fa4e8076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:47.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.362+0000 7fa4fbfff640 1 --2- 172.21.15.59:0/3101416689 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fa4e8074530 0x7fa4e8076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:47.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.363+0000 7fa4fbfff640 1 --2- 172.21.15.59:0/3101416689 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fa4e8074530 0x7fa4e8076a40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0098e0 tx=0x7fa4ec009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:47.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.366+0000 7fa4f8ff9640 1 -- 172.21.15.59:0/3101416689 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fa4f407c5a0 con 0x7fa4fc15c2d0 2024-04-25T17:01:47.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.644+0000 7fa4f8ff9640 1 -- 172.21.15.59:0/3101416689 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa4f404b070 con 0x7fa4fc15c2d0 2024-04-25T17:01:47.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.832+0000 7fa5028b1640 1 -- 172.21.15.59:0/3101416689 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4fc0cb620 con 0x7fa4fc15c2d0 2024-04-25T17:01:47.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.875+0000 7fa4f8ff9640 1 -- 172.21.15.59:0/3101416689 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16795 (secure 0 0 0) 0x7fa4fc0cb620 con 0x7fa4fc15c2d0 2024-04-25T17:01:47.873 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T17:01:47.873 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"9bb5d7ca-5217-467b-882c-0a18cd57f08f","created":"2024-04-25T15:46:00.198001+0000","modified":"2024-04-25T15:47:08.715345+0000","last_up_change":"2024-04-25T15:46:15.850827+0000","last_in_change":"2024-04-25T15:46:06.311980+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:46:16.936340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:30.174141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:31.372481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34cee654-11dd-4f4b-99fe-093462f8abad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6803","nonce":1314235095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6805","nonce":1314235095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6809","nonce":1314235095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6807","nonce":1314235095}]},"public_addr":"172.21.15.59:6803/1314235095","cluster_addr":"172.21.15.59:6805/1314235095","heartbeat_back_addr":"172.21.15.59:6809/1314235095","heartbeat_front_addr":"172.21.15.59:6807/1314235095","state":["exists","up"]},{"osd":1,"uuid":"3c15505b-4abd-4a24-b30c-edc2732f8ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6827","nonce":3550810151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6829","nonce":3550810151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6833","nonce":3550810151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6831","nonce":3550810151}]},"public_addr":"172.21.15.59:6827/3550810151","cluster_addr":"172.21.15.59:6829/3550810151","heartbeat_back_addr":"172.21.15.59:6833/3550810151","heartbeat_front_addr":"172.21.15.59:6831/3550810151","state":["exists","up"]},{"osd":2,"uuid":"5884bf21-e6b4-4813-b8bc-6baa92443c87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6811","nonce":1651189093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6813","nonce":1651189093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6817","nonce":1651189093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6815","nonce":1651189093}]},"public_addr":"172.21.15.59:6811/1651189093","cluster_addr":"172.21.15.59:6813/1651189093","heartbeat_back_addr":"172.21.15.59:6817/1651189093","heartbeat_front_addr":"172.21.15.59:6815/1651189093","state":["exists","up"]},{"osd":3,"uuid":"6ff71700-3b00-4350-b3c9-f6c41ec46b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6819","nonce":1300858236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6821","nonce":1300858236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6825","nonce":1300858236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6823","nonce":1300858236}]},"public_addr":"172.21.15.59:6819/1300858236","cluster_addr":"172.21.15.59:6821/1300858236","heartbeat_back_addr":"172.21.15.59:6825/1300858236","heartbeat_front_addr":"172.21.15.59:6823/1300858236","state":["exists","up"]},{"osd":4,"uuid":"d0a72143-93fd-4712-aadb-f3fade303426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6817","nonce":2206186554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6819","nonce":2206186554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6823","nonce":2206186554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6821","nonce":2206186554}]},"public_addr":"172.21.15.64:6817/2206186554","cluster_addr":"172.21.15.64:6819/2206186554","heartbeat_back_addr":"172.21.15.64:6823/2206186554","heartbeat_front_addr":"172.21.15.64:6821/2206186554","state":["exists","up"]},{"osd":5,"uuid":"9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6825","nonce":639697697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6827","nonce":639697697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6831","nonce":639697697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6829","nonce":639697697}]},"public_addr":"172.21.15.64:6825/639697697","cluster_addr":"172.21.15.64:6827/639697697","heartbeat_back_addr":"172.21.15.64:6831/639697697","heartbeat_front_addr":"172.21.15.64:6829/639697697","state":["exists","up"]},{"osd":6,"uuid":"311d9a6b-8fbc-4809-8d33-b9248a3562f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6809","nonce":2335675289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6811","nonce":2335675289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6815","nonce":2335675289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6813","nonce":2335675289}]},"public_addr":"172.21.15.64:6809/2335675289","cluster_addr":"172.21.15.64:6811/2335675289","heartbeat_back_addr":"172.21.15.64:6815/2335675289","heartbeat_front_addr":"172.21.15.64:6813/2335675289","state":["exists","up"]},{"osd":7,"uuid":"d0f7436e-882f-4aa7-b2ae-684b9894b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6801","nonce":970439753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6803","nonce":970439753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6807","nonce":970439753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6805","nonce":970439753}]},"public_addr":"172.21.15.64:6801/970439753","cluster_addr":"172.21.15.64:6803/970439753","heartbeat_back_addr":"172.21.15.64:6807/970439753","heartbeat_front_addr":"172.21.15.64:6805/970439753","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.807777+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.945589+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.926832+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.943537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.925062+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.957550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.913559+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.839159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T17:01:47.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.877+0000 7fa5028b1640 1 -- 172.21.15.59:0/3101416689 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fa4e8074530 msgr2=0x7fa4e8076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:47.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.877+0000 7fa5028b1640 1 --2- 172.21.15.59:0/3101416689 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fa4e8074530 0x7fa4e8076a40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0098e0 tx=0x7fa4ec009060 comp rx=0 tx=0).stop 2024-04-25T17:01:47.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.877+0000 7fa5028b1640 1 -- 172.21.15.59:0/3101416689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4fc15c2d0 msgr2=0x7fa4fc15b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:47.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.877+0000 7fa5028b1640 1 --2- 172.21.15.59:0/3101416689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4fc15c2d0 0x7fa4fc15b000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4030000 tx=0x7fa4f4004a40 comp rx=0 tx=0).stop 2024-04-25T17:01:47.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.877+0000 7fa5028b1640 1 -- 172.21.15.59:0/3101416689 shutdown_connections 2024-04-25T17:01:47.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.877+0000 7fa5028b1640 1 --2- 172.21.15.59:0/3101416689 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fa4e8074530 0x7fa4e8076a40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:47.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.877+0000 7fa5028b1640 1 --2- 172.21.15.59:0/3101416689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4fc15c2d0 0x7fa4fc15b000 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:47.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.877+0000 7fa5028b1640 1 --2- 172.21.15.59:0/3101416689 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4fc15bec0 0x7fa4fc1efb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:47.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.877+0000 7fa5028b1640 1 --2- 172.21.15.59:0/3101416689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4fc0c49d0 0x7fa4fc156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:47.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.877+0000 7fa5028b1640 1 -- 172.21.15.59:0/3101416689 >> 172.21.15.59:0/3101416689 conn(0x7fa4fc068900 msgr2=0x7fa4fc070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:47.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.877+0000 7fa5028b1640 1 -- 172.21.15.59:0/3101416689 shutdown_connections 2024-04-25T17:01:47.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:47.877+0000 7fa5028b1640 1 -- 172.21.15.59:0/3101416689 wait complete. 2024-04-25T17:01:48.888 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T17:01:48.888 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T17:01:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.011+0000 7f3d32772640 1 Processor -- start 2024-04-25T17:01:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.011+0000 7f3d32772640 1 -- start start 2024-04-25T17:01:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.012+0000 7f3d32772640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3d2c159c20 0x7f3d2c153350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.012+0000 7f3d32772640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d2c0c4ce0 0x7f3d2c0c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.012+0000 7f3d32772640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d2c15d6f0 con 0x7f3d2c0cd4d0 2024-04-25T17:01:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.012+0000 7f3d32772640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f3d2c0c8c90 con 0x7f3d2c0c4ce0 2024-04-25T17:01:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.012+0000 7f3d32772640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f3d2c153890 con 0x7f3d2c159c20 2024-04-25T17:01:49.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.013+0000 7f3d2b7fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d2c0c4ce0 0x7f3d2c0c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.013+0000 7f3d2bfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3d2c159c20 0x7f3d2c153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.013+0000 7f3d30d0f640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3d2c0cd4d0 0x7f3d2c0c9f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50546/0 (socket says 172.21.15.59:50546) 2024-04-25T17:01:49.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.013+0000 7f3d30d0f640 1 -- 172.21.15.59:0/1803623884 learned_addr learned my addr 172.21.15.59:0/1803623884 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T17:01:49.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.016+0000 7f3d2bfff640 1 -- 172.21.15.59:0/1803623884 >> v2:172.21.15.59:3300/0 conn(0x7f3d2c0c4ce0 msgr2=0x7f3d2c0c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:49.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.016+0000 7f3d2bfff640 1 --2- 172.21.15.59:0/1803623884 >> v2:172.21.15.59:3300/0 conn(0x7f3d2c0c4ce0 0x7f3d2c0c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.016+0000 7f3d2bfff640 1 -- 172.21.15.59:0/1803623884 >> v1:172.21.15.59:6789/0 conn(0x7f3d2c0cd4d0 legacy=0x7f3d2c0c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.016+0000 7f3d2bfff640 1 -- 172.21.15.59:0/1803623884 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2c0c89b0 con 0x7f3d2c159c20 2024-04-25T17:01:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.018+0000 7f3d2bfff640 1 --2- 172.21.15.59:0/1803623884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d2c159c20 0x7f3d2c153350 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0097a0 tx=0x7f3d1c02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec5b77cd20c24cd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.022+0000 7f3d2affd640 1 -- 172.21.15.59:0/1803623884 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c037070 con 0x7f3d2c159c20 2024-04-25T17:01:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.022+0000 7f3d2affd640 1 -- 172.21.15.59:0/1803623884 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d1c032440 con 0x7f3d2c159c20 2024-04-25T17:01:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.022+0000 7f3d2affd640 1 -- 172.21.15.59:0/1803623884 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c032810 con 0x7f3d2c159c20 2024-04-25T17:01:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.023+0000 7f3d32772640 1 -- 172.21.15.59:0/1803623884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d2c159c20 msgr2=0x7f3d2c153350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.023+0000 7f3d32772640 1 --2- 172.21.15.59:0/1803623884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d2c159c20 0x7f3d2c153350 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0097a0 tx=0x7f3d1c02a1e0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.023+0000 7f3d32772640 1 -- 172.21.15.59:0/1803623884 shutdown_connections 2024-04-25T17:01:49.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.023+0000 7f3d32772640 1 --2- 172.21.15.59:0/1803623884 >> v2:172.21.15.59:3300/0 conn(0x7f3d2c0c4ce0 0x7f3d2c0c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.023+0000 7f3d32772640 1 --2- 172.21.15.59:0/1803623884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d2c159c20 0x7f3d2c153350 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.023+0000 7f3d32772640 1 -- 172.21.15.59:0/1803623884 >> 172.21.15.59:0/1803623884 conn(0x7f3d2c06f1c0 msgr2=0x7f3d2c06f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:49.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.023+0000 7f3d32772640 1 -- 172.21.15.59:0/1803623884 shutdown_connections 2024-04-25T17:01:49.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.023+0000 7f3d32772640 1 -- 172.21.15.59:0/1803623884 wait complete. 2024-04-25T17:01:49.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.025+0000 7f3d32772640 1 Processor -- start 2024-04-25T17:01:49.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.025+0000 7f3d32772640 1 -- start start 2024-04-25T17:01:49.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.026+0000 7f3d32772640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d2c0c4ce0 0x7f3d2c1f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.026+0000 7f3d32772640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3d2c0cd4d0 0x7f3d2c147220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.026+0000 7f3d32772640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d2c159c20 0x7f3d2c0cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.026+0000 7f3d32772640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2c15cef0 con 0x7f3d2c0c4ce0 2024-04-25T17:01:49.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.026+0000 7f3d32772640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2c15cc10 con 0x7f3d2c159c20 2024-04-25T17:01:49.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.026+0000 7f3d32772640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f3d2c15d1d0 con 0x7f3d2c0cd4d0 2024-04-25T17:01:49.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.027+0000 7f3d2bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d2c0c4ce0 0x7f3d2c1f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.027+0000 7f3d2b7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3d2c0cd4d0 0x7f3d2c147220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.027+0000 7f3d30d0f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d2c159c20 0x7f3d2c0cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.027+0000 7f3d2bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d2c0c4ce0 0x7f3d2c1f0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51176/0 (socket says 172.21.15.59:51176) 2024-04-25T17:01:49.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.027+0000 7f3d2bfff640 1 -- 172.21.15.59:0/880474150 learned_addr learned my addr 172.21.15.59:0/880474150 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:49.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.032+0000 7f3d2bfff640 1 -- 172.21.15.59:0/880474150 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3d2c0cd4d0 msgr2=0x7f3d2c147220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.032+0000 7f3d2bfff640 1 --2- 172.21.15.59:0/880474150 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3d2c0cd4d0 0x7f3d2c147220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.032+0000 7f3d2bfff640 1 -- 172.21.15.59:0/880474150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d2c159c20 msgr2=0x7f3d2c0cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.032+0000 7f3d2bfff640 1 --2- 172.21.15.59:0/880474150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d2c159c20 0x7f3d2c0cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.032+0000 7f3d2bfff640 1 -- 172.21.15.59:0/880474150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2c147760 con 0x7f3d2c0c4ce0 2024-04-25T17:01:49.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.034+0000 7f3d2bfff640 1 --2- 172.21.15.59:0/880474150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d2c0c4ce0 0x7f3d2c1f0df0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c035040 tx=0x7f3d1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:49.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.038+0000 7f3d28ff9640 1 -- 172.21.15.59:0/880474150 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c037040 con 0x7f3d2c0c4ce0 2024-04-25T17:01:49.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.038+0000 7f3d28ff9640 1 -- 172.21.15.59:0/880474150 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d1c030500 con 0x7f3d2c0c4ce0 2024-04-25T17:01:49.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.038+0000 7f3d28ff9640 1 -- 172.21.15.59:0/880474150 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c030910 con 0x7f3d2c0c4ce0 2024-04-25T17:01:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.038+0000 7f3d32772640 1 -- 172.21.15.59:0/880474150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d2c148cb0 con 0x7f3d2c0c4ce0 2024-04-25T17:01:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.038+0000 7f3d32772640 1 -- 172.21.15.59:0/880474150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d2c1525c0 con 0x7f3d2c0c4ce0 2024-04-25T17:01:49.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.039+0000 7f3d32772640 1 -- 172.21.15.59:0/880474150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d2c1e3ed0 con 0x7f3d2c0c4ce0 2024-04-25T17:01:49.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.063+0000 7f3d28ff9640 1 -- 172.21.15.59:0/880474150 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3d1c044020 con 0x7f3d2c0c4ce0 2024-04-25T17:01:49.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.063+0000 7f3d28ff9640 1 --2- 172.21.15.59:0/880474150 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f3d180744e0 0x7f3d180769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.063+0000 7f3d2b7fe640 1 --2- 172.21.15.59:0/880474150 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f3d180744e0 0x7f3d180769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.064+0000 7f3d2b7fe640 1 --2- 172.21.15.59:0/880474150 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f3d180744e0 0x7f3d180769f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c1edfa0 tx=0x7f3d20009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.070+0000 7f3d28ff9640 1 -- 172.21.15.59:0/880474150 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f3d1c0b4500 con 0x7f3d2c0c4ce0 2024-04-25T17:01:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.070+0000 7f3d28ff9640 1 --2- 172.21.15.59:0/880474150 >> [v2:172.21.15.59:6802/1314235095,v1:172.21.15.59:6803/1314235095] conn(0x7f3d1807c8b0 0x7f3d1807ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.070+0000 7f3d28ff9640 1 -- 172.21.15.59:0/880474150 --> [v2:172.21.15.59:6802/1314235095,v1:172.21.15.59:6803/1314235095] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d1c032440 con 0x7f3d1807c8b0 2024-04-25T17:01:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.070+0000 7f3d28ff9640 1 -- 172.21.15.59:0/880474150 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3d1c07c650 con 0x7f3d2c0c4ce0 2024-04-25T17:01:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.070+0000 7f3d30d0f640 1 --2- 172.21.15.59:0/880474150 >> [v2:172.21.15.59:6802/1314235095,v1:172.21.15.59:6803/1314235095] conn(0x7f3d1807c8b0 0x7f3d1807ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.070+0000 7f3d30d0f640 1 --2- 172.21.15.59:0/880474150 >> [v2:172.21.15.59:6802/1314235095,v1:172.21.15.59:6803/1314235095] conn(0x7f3d1807c8b0 0x7f3d1807ed80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:49.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.071+0000 7f3d28ff9640 1 -- 172.21.15.59:0/880474150 <== osd.0 v2:172.21.15.59:6802/1314235095 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d1c032440 con 0x7f3d1807c8b0 2024-04-25T17:01:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.084+0000 7f3d32772640 1 -- 172.21.15.59:0/880474150 --> [v2:172.21.15.59:6802/1314235095,v1:172.21.15.59:6803/1314235095] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3d2c0ce410 con 0x7f3d1807c8b0 2024-04-25T17:01:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.084+0000 7f3d28ff9640 1 -- 172.21.15.59:0/880474150 <== osd.0 v2:172.21.15.59:6802/1314235095 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3d2c0ce410 con 0x7f3d1807c8b0 2024-04-25T17:01:49.083 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T17:01:49.083 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T17:01:49.083 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T17:01:49.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.085+0000 7f3d32772640 1 -- 172.21.15.59:0/880474150 >> [v2:172.21.15.59:6802/1314235095,v1:172.21.15.59:6803/1314235095] conn(0x7f3d1807c8b0 msgr2=0x7f3d1807ed80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.085+0000 7f3d32772640 1 --2- 172.21.15.59:0/880474150 >> [v2:172.21.15.59:6802/1314235095,v1:172.21.15.59:6803/1314235095] conn(0x7f3d1807c8b0 0x7f3d1807ed80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.085+0000 7f3d32772640 1 -- 172.21.15.59:0/880474150 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f3d180744e0 msgr2=0x7f3d180769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.085+0000 7f3d32772640 1 --2- 172.21.15.59:0/880474150 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f3d180744e0 0x7f3d180769f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c1edfa0 tx=0x7f3d20009190 comp rx=0 tx=0).stop 2024-04-25T17:01:49.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.085+0000 7f3d32772640 1 -- 172.21.15.59:0/880474150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d2c0c4ce0 msgr2=0x7f3d2c1f0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.085+0000 7f3d32772640 1 --2- 172.21.15.59:0/880474150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d2c0c4ce0 0x7f3d2c1f0df0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c035040 tx=0x7f3d1c0046c0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.085+0000 7f3d30d0f640 1 -- 172.21.15.59:0/880474150 reap_dead start 2024-04-25T17:01:49.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.085+0000 7f3d32772640 1 -- 172.21.15.59:0/880474150 shutdown_connections 2024-04-25T17:01:49.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.085+0000 7f3d32772640 1 -- 172.21.15.59:0/880474150 >> 172.21.15.59:0/880474150 conn(0x7f3d2c06f1c0 msgr2=0x7f3d2c0c9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:49.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.085+0000 7f3d32772640 1 -- 172.21.15.59:0/880474150 shutdown_connections 2024-04-25T17:01:49.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.085+0000 7f3d32772640 1 -- 172.21.15.59:0/880474150 wait complete. 2024-04-25T17:01:49.094 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T17:01:49.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.209+0000 7f29fad57640 1 Processor -- start 2024-04-25T17:01:49.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.209+0000 7f29fad57640 1 -- start start 2024-04-25T17:01:49.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.210+0000 7f29fad57640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29f40ca500 0x7f29f4156840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.211+0000 7f29fad57640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f29f40c51a0 0x7f29f40c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.211+0000 7f29fad57640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29f408d7c0 con 0x7f29f415d040 2024-04-25T17:01:49.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.211+0000 7f29fad57640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f29f4071900 con 0x7f29f40c51a0 2024-04-25T17:01:49.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.211+0000 7f29fad57640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f29f4156d80 con 0x7f29f40ca500 2024-04-25T17:01:49.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.211+0000 7f29ebfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29f40ca500 0x7f29f4156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.212+0000 7f29ebfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29f40ca500 0x7f29f4156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53150/0 (socket says 172.21.15.59:53150) 2024-04-25T17:01:49.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.212+0000 7f29ebfff640 1 -- 172.21.15.59:0/81808622 learned_addr learned my addr 172.21.15.59:0/81808622 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:49.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.214+0000 7f29f92f4640 1 --2- 172.21.15.59:0/81808622 >> v2:172.21.15.64:3300/0 conn(0x7f29f40c51a0 0x7f29f40c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.215+0000 7f29ebfff640 1 -- 172.21.15.59:0/81808622 >> v2:172.21.15.64:3300/0 conn(0x7f29f40c51a0 msgr2=0x7f29f40c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:49.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.215+0000 7f29ebfff640 1 --2- 172.21.15.59:0/81808622 >> v2:172.21.15.64:3300/0 conn(0x7f29f40c51a0 0x7f29f40c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.215+0000 7f29ebfff640 1 -- 172.21.15.59:0/81808622 >> v1:172.21.15.59:6789/0 conn(0x7f29f415d040 legacy=0x7f29f406e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.215+0000 7f29ebfff640 1 -- 172.21.15.59:0/81808622 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f415d510 con 0x7f29f40ca500 2024-04-25T17:01:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.219+0000 7f29ebfff640 1 --2- 172.21.15.59:0/81808622 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29f40ca500 0x7f29f4156840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009870 tx=0x7f29e402a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c0f8f9c92ff4602 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.224+0000 7f29eb7fe640 1 -- 172.21.15.59:0/81808622 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4037070 con 0x7f29f40ca500 2024-04-25T17:01:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.224+0000 7f29eb7fe640 1 -- 172.21.15.59:0/81808622 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e402ae50 con 0x7f29f40ca500 2024-04-25T17:01:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.224+0000 7f29eb7fe640 1 -- 172.21.15.59:0/81808622 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4032860 con 0x7f29f40ca500 2024-04-25T17:01:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.225+0000 7f29fad57640 1 -- 172.21.15.59:0/81808622 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29f40ca500 msgr2=0x7f29f4156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.225+0000 7f29fad57640 1 --2- 172.21.15.59:0/81808622 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29f40ca500 0x7f29f4156840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009870 tx=0x7f29e402a300 comp rx=0 tx=0).stop 2024-04-25T17:01:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.225+0000 7f29fad57640 1 -- 172.21.15.59:0/81808622 shutdown_connections 2024-04-25T17:01:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.225+0000 7f29fad57640 1 --2- 172.21.15.59:0/81808622 >> v2:172.21.15.64:3300/0 conn(0x7f29f40c51a0 0x7f29f40c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.225+0000 7f29fad57640 1 --2- 172.21.15.59:0/81808622 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29f40ca500 0x7f29f4156840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.225+0000 7f29fad57640 1 -- 172.21.15.59:0/81808622 >> 172.21.15.59:0/81808622 conn(0x7f29f4068ed0 msgr2=0x7f29f4073110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.225+0000 7f29fad57640 1 -- 172.21.15.59:0/81808622 shutdown_connections 2024-04-25T17:01:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.225+0000 7f29fad57640 1 -- 172.21.15.59:0/81808622 wait complete. 2024-04-25T17:01:49.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.227+0000 7f29fad57640 1 Processor -- start 2024-04-25T17:01:49.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.227+0000 7f29fad57640 1 -- start start 2024-04-25T17:01:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.228+0000 7f29fad57640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29f40c51a0 0x7f29f415be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.228+0000 7f29fad57640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29f40ca500 0x7f29f415a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.228+0000 7f29fad57640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29f415d040 0x7f29f414ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.228+0000 7f29fad57640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f29f40712b0 con 0x7f29f40c51a0 2024-04-25T17:01:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.228+0000 7f29fad57640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f29f4070fd0 con 0x7f29f415d040 2024-04-25T17:01:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.228+0000 7f29fad57640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f29f4071590 con 0x7f29f40ca500 2024-04-25T17:01:49.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.229+0000 7f29f8af3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29f40c51a0 0x7f29f415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.229+0000 7f29ebfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29f40ca500 0x7f29f415a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.229+0000 7f29f92f4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29f415d040 0x7f29f414ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.229+0000 7f29ebfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29f40ca500 0x7f29f415a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53152/0 (socket says 172.21.15.59:53152) 2024-04-25T17:01:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.229+0000 7f29ebfff640 1 -- 172.21.15.59:0/3068832219 learned_addr learned my addr 172.21.15.59:0/3068832219 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.233+0000 7f29f8af3640 1 -- 172.21.15.59:0/3068832219 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29f40ca500 msgr2=0x7f29f415a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.233+0000 7f29f8af3640 1 --2- 172.21.15.59:0/3068832219 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29f40ca500 0x7f29f415a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.233+0000 7f29f8af3640 1 -- 172.21.15.59:0/3068832219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29f415d040 msgr2=0x7f29f414ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.233+0000 7f29f8af3640 1 --2- 172.21.15.59:0/3068832219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29f415d040 0x7f29f414ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.233+0000 7f29f8af3640 1 -- 172.21.15.59:0/3068832219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f415a760 con 0x7f29f40c51a0 2024-04-25T17:01:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.233+0000 7f29ebfff640 1 --2- 172.21.15.59:0/3068832219 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29f40ca500 0x7f29f415a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:01:49.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.236+0000 7f29f8af3640 1 --2- 172.21.15.59:0/3068832219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29f40c51a0 0x7f29f415be40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f29f000c390 tx=0x7f29f000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:49.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.240+0000 7f29e97fa640 1 -- 172.21.15.59:0/3068832219 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0017070 con 0x7f29f40c51a0 2024-04-25T17:01:49.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.240+0000 7f29e97fa640 1 -- 172.21.15.59:0/3068832219 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f00052d0 con 0x7f29f40c51a0 2024-04-25T17:01:49.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.240+0000 7f29fad57640 1 -- 172.21.15.59:0/3068832219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f415c4a0 con 0x7f29f40c51a0 2024-04-25T17:01:49.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.240+0000 7f29e97fa640 1 -- 172.21.15.59:0/3068832219 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0003850 con 0x7f29f40c51a0 2024-04-25T17:01:49.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.240+0000 7f29fad57640 1 -- 172.21.15.59:0/3068832219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f41f2e80 con 0x7f29f40c51a0 2024-04-25T17:01:49.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.241+0000 7f29fad57640 1 -- 172.21.15.59:0/3068832219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f4069910 con 0x7f29f40c51a0 2024-04-25T17:01:49.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.265+0000 7f29e97fa640 1 -- 172.21.15.59:0/3068832219 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f29f001a070 con 0x7f29f40c51a0 2024-04-25T17:01:49.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.265+0000 7f29e97fa640 1 --2- 172.21.15.59:0/3068832219 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f29e00744e0 0x7f29e00769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.265+0000 7f29ebfff640 1 --2- 172.21.15.59:0/3068832219 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f29e00744e0 0x7f29e00769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.266+0000 7f29ebfff640 1 --2- 172.21.15.59:0/3068832219 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f29e00744e0 0x7f29e00769f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009870 tx=0x7f29e402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:49.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.548+0000 7f29e97fa640 1 -- 172.21.15.59:0/3068832219 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f29f005ac30 con 0x7f29f40c51a0 2024-04-25T17:01:49.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.548+0000 7f29e97fa640 1 -- 172.21.15.59:0/3068832219 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f29f0021020 con 0x7f29f40c51a0 2024-04-25T17:01:49.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.740+0000 7f29fad57640 1 -- 172.21.15.59:0/3068832219 --> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f29f414eb30 con 0x7f29e00744e0 2024-04-25T17:01:49.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.740+0000 7f29e97fa640 1 -- 172.21.15.59:0/3068832219 <== mgr.4102 v2:172.21.15.59:6800/2368090706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f29f414eb30 con 0x7f29e00744e0 2024-04-25T17:01:49.738 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T17:01:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.743+0000 7f29fad57640 1 -- 172.21.15.59:0/3068832219 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f29e00744e0 msgr2=0x7f29e00769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.743+0000 7f29fad57640 1 --2- 172.21.15.59:0/3068832219 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f29e00744e0 0x7f29e00769f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009870 tx=0x7f29e402e000 comp rx=0 tx=0).stop 2024-04-25T17:01:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.743+0000 7f29fad57640 1 -- 172.21.15.59:0/3068832219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29f40c51a0 msgr2=0x7f29f415be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.743+0000 7f29fad57640 1 --2- 172.21.15.59:0/3068832219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29f40c51a0 0x7f29f415be40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f29f000c390 tx=0x7f29f000c850 comp rx=0 tx=0).stop 2024-04-25T17:01:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.743+0000 7f29fad57640 1 -- 172.21.15.59:0/3068832219 shutdown_connections 2024-04-25T17:01:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.743+0000 7f29fad57640 1 --2- 172.21.15.59:0/3068832219 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f29e00744e0 0x7f29e00769f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.743+0000 7f29fad57640 1 --2- 172.21.15.59:0/3068832219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29f415d040 0x7f29f414ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.743+0000 7f29fad57640 1 --2- 172.21.15.59:0/3068832219 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29f40ca500 0x7f29f415a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.743+0000 7f29fad57640 1 --2- 172.21.15.59:0/3068832219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29f40c51a0 0x7f29f415be40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.743+0000 7f29fad57640 1 -- 172.21.15.59:0/3068832219 >> 172.21.15.59:0/3068832219 conn(0x7f29f4068ed0 msgr2=0x7f29f4152f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:49.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.743+0000 7f29fad57640 1 -- 172.21.15.59:0/3068832219 shutdown_connections 2024-04-25T17:01:49.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.743+0000 7f29fad57640 1 -- 172.21.15.59:0/3068832219 wait complete. 2024-04-25T17:01:49.753 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T17:01:49.753 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T17:01:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.875+0000 7f55b6372640 1 Processor -- start 2024-04-25T17:01:49.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.875+0000 7f55b6372640 1 -- start start 2024-04-25T17:01:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.876+0000 7f55b6372640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f55b015cfe0 0x7f55b01564a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.876+0000 7f55b6372640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55b00cc5c0 0x7f55b00b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.876+0000 7f55b6372640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55b015d500 con 0x7f55b00b5930 2024-04-25T17:01:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.876+0000 7f55b6372640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f55b0160850 con 0x7f55b015cfe0 2024-04-25T17:01:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.876+0000 7f55b6372640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f55b015fc40 con 0x7f55b00cc5c0 2024-04-25T17:01:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.877+0000 7f55affff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f55b015cfe0 0x7f55b01564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.877+0000 7f55af7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55b00cc5c0 0x7f55b00b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.877+0000 7f55b490f640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f55b00b5930 0x7f55b008d410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.59:44676/0 (socket says 172.21.15.59:44676) 2024-04-25T17:01:49.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.877+0000 7f55b490f640 1 -- 172.21.15.59:0/405332254 learned_addr learned my addr 172.21.15.59:0/405332254 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T17:01:49.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.880+0000 7f55affff640 1 -- 172.21.15.59:0/405332254 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55b00cc5c0 msgr2=0x7f55b00b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:49.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.880+0000 7f55affff640 1 --2- 172.21.15.59:0/405332254 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55b00cc5c0 0x7f55b00b53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.880+0000 7f55affff640 1 -- 172.21.15.59:0/405332254 >> v1:172.21.15.64:6789/0 conn(0x7f55b00b5930 legacy=0x7f55b008d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.880+0000 7f55affff640 1 -- 172.21.15.59:0/405332254 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b015ff20 con 0x7f55b015cfe0 2024-04-25T17:01:49.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.882+0000 7f55affff640 1 --2- 172.21.15.59:0/405332254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b015cfe0 0x7f55b01564a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f55980097a0 tx=0x7f559802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df9bd12f5f2c77c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:49.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.884+0000 7f55aeffd640 1 -- 172.21.15.59:0/405332254 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598037070 con 0x7f55b015cfe0 2024-04-25T17:01:49.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.886+0000 7f55aeffd640 1 -- 172.21.15.59:0/405332254 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5598032440 con 0x7f55b015cfe0 2024-04-25T17:01:49.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.886+0000 7f55aeffd640 1 -- 172.21.15.59:0/405332254 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598032810 con 0x7f55b015cfe0 2024-04-25T17:01:49.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.887+0000 7f55b6372640 1 -- 172.21.15.59:0/405332254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b015cfe0 msgr2=0x7f55b01564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.887+0000 7f55b6372640 1 --2- 172.21.15.59:0/405332254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b015cfe0 0x7f55b01564a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f55980097a0 tx=0x7f559802a180 comp rx=0 tx=0).stop 2024-04-25T17:01:49.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.887+0000 7f55b6372640 1 -- 172.21.15.59:0/405332254 shutdown_connections 2024-04-25T17:01:49.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.887+0000 7f55b6372640 1 --2- 172.21.15.59:0/405332254 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55b00cc5c0 0x7f55b00b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.887+0000 7f55b6372640 1 --2- 172.21.15.59:0/405332254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b015cfe0 0x7f55b01564a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.887+0000 7f55b6372640 1 -- 172.21.15.59:0/405332254 >> 172.21.15.59:0/405332254 conn(0x7f55b00684e0 msgr2=0x7f55b00688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:49.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.887+0000 7f55b6372640 1 -- 172.21.15.59:0/405332254 shutdown_connections 2024-04-25T17:01:49.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.887+0000 7f55b6372640 1 -- 172.21.15.59:0/405332254 wait complete. 2024-04-25T17:01:49.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.889+0000 7f55b6372640 1 Processor -- start 2024-04-25T17:01:49.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.889+0000 7f55b6372640 1 -- start start 2024-04-25T17:01:49.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.890+0000 7f55b6372640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55b00b5930 0x7f55b014c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.890+0000 7f55b6372640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b00cc5c0 0x7f55b00cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.890+0000 7f55b6372640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b015cfe0 0x7f55b00cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.890+0000 7f55b6372640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f55b00b5d40 con 0x7f55b015cfe0 2024-04-25T17:01:49.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.890+0000 7f55b6372640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f55b01604e0 con 0x7f55b00cc5c0 2024-04-25T17:01:49.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.891+0000 7f55b6372640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f55b01569e0 con 0x7f55b00b5930 2024-04-25T17:01:49.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.891+0000 7f55b490f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b015cfe0 0x7f55b00cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.891+0000 7f55affff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55b00b5930 0x7f55b014c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.891+0000 7f55af7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b00cc5c0 0x7f55b00cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.891+0000 7f55b490f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b015cfe0 0x7f55b00cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51198/0 (socket says 172.21.15.59:51198) 2024-04-25T17:01:49.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.891+0000 7f55b490f640 1 -- 172.21.15.59:0/1768787423 learned_addr learned my addr 172.21.15.59:0/1768787423 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:49.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.895+0000 7f55b490f640 1 -- 172.21.15.59:0/1768787423 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55b00b5930 msgr2=0x7f55b014c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.895+0000 7f55b490f640 1 --2- 172.21.15.59:0/1768787423 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55b00b5930 0x7f55b014c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.895+0000 7f55b490f640 1 -- 172.21.15.59:0/1768787423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b00cc5c0 msgr2=0x7f55b00cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.895+0000 7f55b490f640 1 --2- 172.21.15.59:0/1768787423 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55b00cc5c0 0x7f55b00cf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.895+0000 7f55b490f640 1 -- 172.21.15.59:0/1768787423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b01f24f0 con 0x7f55b015cfe0 2024-04-25T17:01:49.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.898+0000 7f55b490f640 1 --2- 172.21.15.59:0/1768787423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b015cfe0 0x7f55b00cfe00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f55a800ca50 tx=0x7f55a800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:49.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.902+0000 7f55acff9640 1 -- 172.21.15.59:0/1768787423 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a8017070 con 0x7f55b015cfe0 2024-04-25T17:01:49.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.902+0000 7f55acff9640 1 -- 172.21.15.59:0/1768787423 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a800abb0 con 0x7f55b015cfe0 2024-04-25T17:01:49.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.902+0000 7f55acff9640 1 -- 172.21.15.59:0/1768787423 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a8012400 con 0x7f55b015cfe0 2024-04-25T17:01:49.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.902+0000 7f55b6372640 1 -- 172.21.15.59:0/1768787423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55b00caad0 con 0x7f55b015cfe0 2024-04-25T17:01:49.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.902+0000 7f55b6372640 1 -- 172.21.15.59:0/1768787423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55b01f2a90 con 0x7f55b015cfe0 2024-04-25T17:01:49.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.903+0000 7f55b6372640 1 -- 172.21.15.59:0/1768787423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f55b00c7dd0 con 0x7f55b015cfe0 2024-04-25T17:01:49.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.925+0000 7f55acff9640 1 -- 172.21.15.59:0/1768787423 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f55a801a070 con 0x7f55b015cfe0 2024-04-25T17:01:49.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.926+0000 7f55acff9640 1 --2- 172.21.15.59:0/1768787423 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5590074530 0x7f5590076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.926+0000 7f55affff640 1 --2- 172.21.15.59:0/1768787423 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5590074530 0x7f5590076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.926+0000 7f55affff640 1 --2- 172.21.15.59:0/1768787423 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5590074530 0x7f5590076a40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5598034000 tx=0x7f559802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:49.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.932+0000 7f55acff9640 1 -- 172.21.15.59:0/1768787423 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f55a805b910 con 0x7f55b015cfe0 2024-04-25T17:01:49.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.932+0000 7f55acff9640 1 --2- 172.21.15.59:0/1768787423 >> [v2:172.21.15.59:6826/3550810151,v1:172.21.15.59:6827/3550810151] conn(0x7f559007c900 0x7f559007edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:49.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.932+0000 7f55acff9640 1 -- 172.21.15.59:0/1768787423 --> [v2:172.21.15.59:6826/3550810151,v1:172.21.15.59:6827/3550810151] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f55a8006e50 con 0x7f559007c900 2024-04-25T17:01:49.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.932+0000 7f55acff9640 1 -- 172.21.15.59:0/1768787423 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f55a805bcd0 con 0x7f55b015cfe0 2024-04-25T17:01:49.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.932+0000 7f55af7fe640 1 --2- 172.21.15.59:0/1768787423 >> [v2:172.21.15.59:6826/3550810151,v1:172.21.15.59:6827/3550810151] conn(0x7f559007c900 0x7f559007edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:49.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.932+0000 7f55af7fe640 1 --2- 172.21.15.59:0/1768787423 >> [v2:172.21.15.59:6826/3550810151,v1:172.21.15.59:6827/3550810151] conn(0x7f559007c900 0x7f559007edd0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:49.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.933+0000 7f55acff9640 1 -- 172.21.15.59:0/1768787423 <== osd.1 v2:172.21.15.59:6826/3550810151 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f55a8006e50 con 0x7f559007c900 2024-04-25T17:01:49.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.946+0000 7f55b6372640 1 -- 172.21.15.59:0/1768787423 --> [v2:172.21.15.59:6826/3550810151,v1:172.21.15.59:6827/3550810151] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f55b00ca880 con 0x7f559007c900 2024-04-25T17:01:49.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.947+0000 7f55acff9640 1 -- 172.21.15.59:0/1768787423 <== osd.1 v2:172.21.15.59:6826/3550810151 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f55b00ca880 con 0x7f559007c900 2024-04-25T17:01:49.945 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T17:01:49.945 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T17:01:49.945 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T17:01:49.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.947+0000 7f55b6372640 1 -- 172.21.15.59:0/1768787423 >> [v2:172.21.15.59:6826/3550810151,v1:172.21.15.59:6827/3550810151] conn(0x7f559007c900 msgr2=0x7f559007edd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.947+0000 7f55b6372640 1 --2- 172.21.15.59:0/1768787423 >> [v2:172.21.15.59:6826/3550810151,v1:172.21.15.59:6827/3550810151] conn(0x7f559007c900 0x7f559007edd0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:49.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.947+0000 7f55b6372640 1 -- 172.21.15.59:0/1768787423 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5590074530 msgr2=0x7f5590076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.947+0000 7f55b6372640 1 --2- 172.21.15.59:0/1768787423 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5590074530 0x7f5590076a40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5598034000 tx=0x7f559802e000 comp rx=0 tx=0).stop 2024-04-25T17:01:49.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.947+0000 7f55b6372640 1 -- 172.21.15.59:0/1768787423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b015cfe0 msgr2=0x7f55b00cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:49.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.947+0000 7f55b6372640 1 --2- 172.21.15.59:0/1768787423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b015cfe0 0x7f55b00cfe00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f55a800ca50 tx=0x7f55a800cf10 comp rx=0 tx=0).stop 2024-04-25T17:01:49.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.947+0000 7f55b490f640 1 -- 172.21.15.59:0/1768787423 reap_dead start 2024-04-25T17:01:49.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.947+0000 7f55b6372640 1 -- 172.21.15.59:0/1768787423 shutdown_connections 2024-04-25T17:01:49.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.947+0000 7f55b6372640 1 -- 172.21.15.59:0/1768787423 >> 172.21.15.59:0/1768787423 conn(0x7f55b00684e0 msgr2=0x7f55b0152a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:49.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.947+0000 7f55b6372640 1 -- 172.21.15.59:0/1768787423 shutdown_connections 2024-04-25T17:01:49.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:49.947+0000 7f55b6372640 1 -- 172.21.15.59:0/1768787423 wait complete. 2024-04-25T17:01:49.957 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T17:01:50.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.071+0000 7f5da22b6640 1 Processor -- start 2024-04-25T17:01:50.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.071+0000 7f5da22b6640 1 -- start start 2024-04-25T17:01:50.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.072+0000 7f5da22b6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5d9c0b47a0 0x7f5d9c160730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:50.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.072+0000 7f5da22b6640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5d9c0cc960 0x7f5d9c0ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:50.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.072+0000 7f5da22b6640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d9c15c8c0 con 0x7f5d9c0ccd70 2024-04-25T17:01:50.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.072+0000 7f5da22b6640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f5d9c0b4bb0 con 0x7f5d9c0cc960 2024-04-25T17:01:50.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.072+0000 7f5da22b6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9c160c70 con 0x7f5d9c0b47a0 2024-04-25T17:01:50.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.073+0000 7f5d9b7fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5d9c0cc960 0x7f5d9c0ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:50.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.073+0000 7f5d9bfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5d9c0b47a0 0x7f5d9c160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:50.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.073+0000 7f5d9bfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5d9c0b47a0 0x7f5d9c160730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53180/0 (socket says 172.21.15.59:53180) 2024-04-25T17:01:50.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.073+0000 7f5d9bfff640 1 -- 172.21.15.59:0/2437339485 learned_addr learned my addr 172.21.15.59:0/2437339485 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:50.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.076+0000 7f5d9bfff640 1 -- 172.21.15.59:0/2437339485 >> v2:172.21.15.59:3300/0 conn(0x7f5d9c0cc960 msgr2=0x7f5d9c0ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:50.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.076+0000 7f5d9bfff640 1 --2- 172.21.15.59:0/2437339485 >> v2:172.21.15.59:3300/0 conn(0x7f5d9c0cc960 0x7f5d9c0ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.076+0000 7f5d9bfff640 1 -- 172.21.15.59:0/2437339485 >> v1:172.21.15.59:6789/0 conn(0x7f5d9c0ccd70 legacy=0x7f5d9c0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:50.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.076+0000 7f5d9bfff640 1 -- 172.21.15.59:0/2437339485 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9c15cba0 con 0x7f5d9c0b47a0 2024-04-25T17:01:50.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.078+0000 7f5d9bfff640 1 --2- 172.21.15.59:0/2437339485 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5d9c0b47a0 0x7f5d9c160730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009870 tx=0x7f5d8c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb4726868b4bca43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.083+0000 7f5d9affd640 1 -- 172.21.15.59:0/2437339485 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c037070 con 0x7f5d9c0b47a0 2024-04-25T17:01:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.083+0000 7f5d9affd640 1 -- 172.21.15.59:0/2437339485 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8c032440 con 0x7f5d9c0b47a0 2024-04-25T17:01:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.083+0000 7f5d9affd640 1 -- 172.21.15.59:0/2437339485 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c032810 con 0x7f5d9c0b47a0 2024-04-25T17:01:50.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.084+0000 7f5da22b6640 1 -- 172.21.15.59:0/2437339485 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5d9c0b47a0 msgr2=0x7f5d9c160730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:50.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.084+0000 7f5da22b6640 1 --2- 172.21.15.59:0/2437339485 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5d9c0b47a0 0x7f5d9c160730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009870 tx=0x7f5d8c02a1c0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.084+0000 7f5da22b6640 1 -- 172.21.15.59:0/2437339485 shutdown_connections 2024-04-25T17:01:50.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.084+0000 7f5da22b6640 1 --2- 172.21.15.59:0/2437339485 >> v2:172.21.15.59:3300/0 conn(0x7f5d9c0cc960 0x7f5d9c0ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.084+0000 7f5da22b6640 1 --2- 172.21.15.59:0/2437339485 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5d9c0b47a0 0x7f5d9c160730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.084+0000 7f5da22b6640 1 -- 172.21.15.59:0/2437339485 >> 172.21.15.59:0/2437339485 conn(0x7f5d9c0684e0 msgr2=0x7f5d9c0688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:50.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.084+0000 7f5da22b6640 1 -- 172.21.15.59:0/2437339485 shutdown_connections 2024-04-25T17:01:50.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.084+0000 7f5da22b6640 1 -- 172.21.15.59:0/2437339485 wait complete. 2024-04-25T17:01:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.086+0000 7f5da22b6640 1 Processor -- start 2024-04-25T17:01:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.086+0000 7f5da22b6640 1 -- start start 2024-04-25T17:01:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.087+0000 7f5da22b6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5d9c0b47a0 0x7f5d9c1f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.087+0000 7f5da22b6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d9c0cc960 0x7f5d9c157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.087+0000 7f5da22b6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d9c0ccd70 0x7f5d9c1e9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.087+0000 7f5da22b6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c15d440 con 0x7f5d9c0ccd70 2024-04-25T17:01:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.087+0000 7f5da22b6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c15d160 con 0x7f5d9c0cc960 2024-04-25T17:01:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.087+0000 7f5da22b6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9c0b5f90 con 0x7f5d9c0b47a0 2024-04-25T17:01:50.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.088+0000 7f5da0853640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d9c0ccd70 0x7f5d9c1e9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:50.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.088+0000 7f5d9bfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5d9c0b47a0 0x7f5d9c1f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:50.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.088+0000 7f5d9b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d9c0cc960 0x7f5d9c157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:50.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.088+0000 7f5da0853640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d9c0ccd70 0x7f5d9c1e9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51220/0 (socket says 172.21.15.59:51220) 2024-04-25T17:01:50.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.088+0000 7f5da0853640 1 -- 172.21.15.59:0/2573994624 learned_addr learned my addr 172.21.15.59:0/2573994624 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:50.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.092+0000 7f5da0853640 1 -- 172.21.15.59:0/2573994624 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5d9c0b47a0 msgr2=0x7f5d9c1f63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:50.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.092+0000 7f5da0853640 1 --2- 172.21.15.59:0/2573994624 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5d9c0b47a0 0x7f5d9c1f63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.092+0000 7f5da0853640 1 -- 172.21.15.59:0/2573994624 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d9c0cc960 msgr2=0x7f5d9c157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:50.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.092+0000 7f5da0853640 1 --2- 172.21.15.59:0/2573994624 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d9c0cc960 0x7f5d9c157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.092+0000 7f5da0853640 1 -- 172.21.15.59:0/2573994624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9c1f68e0 con 0x7f5d9c0ccd70 2024-04-25T17:01:50.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.094+0000 7f5da0853640 1 --2- 172.21.15.59:0/2573994624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d9c0ccd70 0x7f5d9c1e9400 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400c6e0 tx=0x7f5d9400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:50.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.098+0000 7f5d98ff9640 1 -- 172.21.15.59:0/2573994624 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94003b70 con 0x7f5d9c0ccd70 2024-04-25T17:01:50.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.099+0000 7f5d98ff9640 1 -- 172.21.15.59:0/2573994624 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d94003d30 con 0x7f5d9c0ccd70 2024-04-25T17:01:50.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.099+0000 7f5d98ff9640 1 -- 172.21.15.59:0/2573994624 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94005310 con 0x7f5d9c0ccd70 2024-04-25T17:01:50.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.099+0000 7f5da22b6640 1 -- 172.21.15.59:0/2573994624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d9c15e000 con 0x7f5d9c0ccd70 2024-04-25T17:01:50.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.099+0000 7f5da22b6640 1 -- 172.21.15.59:0/2573994624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d9c15e5c0 con 0x7f5d9c0ccd70 2024-04-25T17:01:50.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.099+0000 7f5da22b6640 1 -- 172.21.15.59:0/2573994624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d9c06ec30 con 0x7f5d9c0ccd70 2024-04-25T17:01:50.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.124+0000 7f5d98ff9640 1 -- 172.21.15.59:0/2573994624 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5d940054b0 con 0x7f5d9c0ccd70 2024-04-25T17:01:50.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.125+0000 7f5d98ff9640 1 --2- 172.21.15.59:0/2573994624 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5d7c074530 0x7f5d7c076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:50.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.125+0000 7f5d9bfff640 1 --2- 172.21.15.59:0/2573994624 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5d7c074530 0x7f5d7c076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:50.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.125+0000 7f5d9bfff640 1 --2- 172.21.15.59:0/2573994624 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5d7c074530 0x7f5d7c076a40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c034000 tx=0x7f5d8c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:50.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.128+0000 7f5d98ff9640 1 -- 172.21.15.59:0/2573994624 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f5d940057a0 con 0x7f5d9c0ccd70 2024-04-25T17:01:50.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.412+0000 7f5d98ff9640 1 -- 172.21.15.59:0/2573994624 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5d9c06ec30 con 0x7f5d9c0ccd70 2024-04-25T17:01:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.603+0000 7f5da22b6640 1 -- 172.21.15.59:0/2573994624 --> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f5d9c0cbdc0 con 0x7f5d7c074530 2024-04-25T17:01:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.603+0000 7f5d98ff9640 1 -- 172.21.15.59:0/2573994624 <== mgr.4102 v2:172.21.15.59:6800/2368090706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5d9c0cbdc0 con 0x7f5d7c074530 2024-04-25T17:01:50.601 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T17:01:50.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.605+0000 7f5da22b6640 1 -- 172.21.15.59:0/2573994624 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5d7c074530 msgr2=0x7f5d7c076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:50.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.605+0000 7f5da22b6640 1 --2- 172.21.15.59:0/2573994624 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5d7c074530 0x7f5d7c076a40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c034000 tx=0x7f5d8c02e000 comp rx=0 tx=0).stop 2024-04-25T17:01:50.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.605+0000 7f5da22b6640 1 -- 172.21.15.59:0/2573994624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d9c0ccd70 msgr2=0x7f5d9c1e9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:50.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.605+0000 7f5da22b6640 1 --2- 172.21.15.59:0/2573994624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d9c0ccd70 0x7f5d9c1e9400 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400c6e0 tx=0x7f5d9400cba0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.605+0000 7f5da22b6640 1 -- 172.21.15.59:0/2573994624 shutdown_connections 2024-04-25T17:01:50.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.605+0000 7f5da22b6640 1 --2- 172.21.15.59:0/2573994624 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5d7c074530 0x7f5d7c076a40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.605+0000 7f5da22b6640 1 --2- 172.21.15.59:0/2573994624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d9c0ccd70 0x7f5d9c1e9400 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.605+0000 7f5da22b6640 1 --2- 172.21.15.59:0/2573994624 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5d9c0cc960 0x7f5d9c157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.605+0000 7f5da22b6640 1 --2- 172.21.15.59:0/2573994624 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5d9c0b47a0 0x7f5d9c1f63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.605+0000 7f5da22b6640 1 -- 172.21.15.59:0/2573994624 >> 172.21.15.59:0/2573994624 conn(0x7f5d9c0684e0 msgr2=0x7f5d9c0c74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:50.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.605+0000 7f5da22b6640 1 -- 172.21.15.59:0/2573994624 shutdown_connections 2024-04-25T17:01:50.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.605+0000 7f5da22b6640 1 -- 172.21.15.59:0/2573994624 wait complete. 2024-04-25T17:01:50.615 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T17:01:50.615 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T17:01:50.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.740+0000 7f72bfb6c640 1 Processor -- start 2024-04-25T17:01:50.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.740+0000 7f72bfb6c640 1 -- start start 2024-04-25T17:01:50.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.742+0000 7f72bfb6c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f72b815d1d0 0x7f72b80cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:50.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.742+0000 7f72bfb6c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f72b80ccaf0 0x7f72b80c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:50.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.742+0000 7f72bfb6c640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72b815fd30 con 0x7f72b8156770 2024-04-25T17:01:50.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.742+0000 7f72bfb6c640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f72b815ffd0 con 0x7f72b80ccaf0 2024-04-25T17:01:50.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.742+0000 7f72bfb6c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f72b81602b0 con 0x7f72b815d1d0 2024-04-25T17:01:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.742+0000 7f72be109640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f72b80ccaf0 0x7f72b80c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.742+0000 7f72bd107640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f72b815d1d0 0x7f72b80cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.743+0000 7f72be109640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f72b80ccaf0 0x7f72b80c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51222/0 (socket says 172.21.15.59:51222) 2024-04-25T17:01:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.743+0000 7f72be109640 1 -- 172.21.15.59:0/15017028 learned_addr learned my addr 172.21.15.59:0/15017028 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:50.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.745+0000 7f72be109640 1 -- 172.21.15.59:0/15017028 >> v2:172.21.15.64:3300/0 conn(0x7f72b815d1d0 msgr2=0x7f72b80cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:50.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.745+0000 7f72be109640 1 --2- 172.21.15.59:0/15017028 >> v2:172.21.15.64:3300/0 conn(0x7f72b815d1d0 0x7f72b80cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.745+0000 7f72be109640 1 -- 172.21.15.59:0/15017028 >> v1:172.21.15.64:6789/0 conn(0x7f72b8156770 legacy=0x7f72b80cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:50.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.745+0000 7f72be109640 1 -- 172.21.15.59:0/15017028 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b8160590 con 0x7f72b80ccaf0 2024-04-25T17:01:50.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.747+0000 7f72be109640 1 --2- 172.21.15.59:0/15017028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72b80ccaf0 0x7f72b80c7430 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f72b80cf020 tx=0x7f72b002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d23d509c294212 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:50.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.751+0000 7f72bc906640 1 -- 172.21.15.59:0/15017028 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0036070 con 0x7f72b80ccaf0 2024-04-25T17:01:50.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.751+0000 7f72bc906640 1 -- 172.21.15.59:0/15017028 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b0031600 con 0x7f72b80ccaf0 2024-04-25T17:01:50.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.751+0000 7f72bc906640 1 -- 172.21.15.59:0/15017028 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b00319f0 con 0x7f72b80ccaf0 2024-04-25T17:01:50.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.752+0000 7f72bfb6c640 1 -- 172.21.15.59:0/15017028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72b80ccaf0 msgr2=0x7f72b80c7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:50.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.752+0000 7f72bfb6c640 1 --2- 172.21.15.59:0/15017028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72b80ccaf0 0x7f72b80c7430 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f72b80cf020 tx=0x7f72b002a7c0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.752+0000 7f72bfb6c640 1 -- 172.21.15.59:0/15017028 shutdown_connections 2024-04-25T17:01:50.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.752+0000 7f72bfb6c640 1 --2- 172.21.15.59:0/15017028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72b80ccaf0 0x7f72b80c7430 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.752+0000 7f72bfb6c640 1 --2- 172.21.15.59:0/15017028 >> v2:172.21.15.64:3300/0 conn(0x7f72b815d1d0 0x7f72b80cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.752+0000 7f72bfb6c640 1 -- 172.21.15.59:0/15017028 >> 172.21.15.59:0/15017028 conn(0x7f72b80684e0 msgr2=0x7f72b80688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:50.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.752+0000 7f72bfb6c640 1 -- 172.21.15.59:0/15017028 shutdown_connections 2024-04-25T17:01:50.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.752+0000 7f72bfb6c640 1 -- 172.21.15.59:0/15017028 wait complete. 2024-04-25T17:01:50.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.754+0000 7f72bfb6c640 1 Processor -- start 2024-04-25T17:01:50.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.754+0000 7f72bfb6c640 1 -- start start 2024-04-25T17:01:50.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.755+0000 7f72bfb6c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72b80ccaf0 0x7f72b8149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:50.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.755+0000 7f72bfb6c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72b8156770 0x7f72b80d0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:50.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.755+0000 7f72bfb6c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72b815d1d0 0x7f72b80d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:50.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.755+0000 7f72bfb6c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f72b80cdb80 con 0x7f72b8156770 2024-04-25T17:01:50.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.755+0000 7f72bfb6c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f72b80cda00 con 0x7f72b815d1d0 2024-04-25T17:01:50.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.755+0000 7f72bfb6c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f72b80c7970 con 0x7f72b80ccaf0 2024-04-25T17:01:50.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.756+0000 7f72bd107640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72b8156770 0x7f72b80d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:50.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.756+0000 7f72bd908640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72b80ccaf0 0x7f72b8149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:50.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.756+0000 7f72be109640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72b815d1d0 0x7f72b80d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:50.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.756+0000 7f72bd107640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72b8156770 0x7f72b80d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51238/0 (socket says 172.21.15.59:51238) 2024-04-25T17:01:50.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.756+0000 7f72bd107640 1 -- 172.21.15.59:0/1651718135 learned_addr learned my addr 172.21.15.59:0/1651718135 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:50.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.760+0000 7f72bd107640 1 -- 172.21.15.59:0/1651718135 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72b80ccaf0 msgr2=0x7f72b8149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:50.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.760+0000 7f72bd107640 1 --2- 172.21.15.59:0/1651718135 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72b80ccaf0 0x7f72b8149730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.760+0000 7f72bd107640 1 -- 172.21.15.59:0/1651718135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72b815d1d0 msgr2=0x7f72b80d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:50.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.760+0000 7f72bd107640 1 --2- 172.21.15.59:0/1651718135 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72b815d1d0 0x7f72b80d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.760+0000 7f72bd107640 1 -- 172.21.15.59:0/1651718135 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b815b8d0 con 0x7f72b8156770 2024-04-25T17:01:50.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.763+0000 7f72bd107640 1 --2- 172.21.15.59:0/1651718135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72b8156770 0x7f72b80d0270 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f72a800e870 tx=0x7f72a800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:50.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.767+0000 7f72ae7fc640 1 -- 172.21.15.59:0/1651718135 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8017070 con 0x7f72b8156770 2024-04-25T17:01:50.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.767+0000 7f72ae7fc640 1 -- 172.21.15.59:0/1651718135 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a800c940 con 0x7f72b8156770 2024-04-25T17:01:50.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.767+0000 7f72bfb6c640 1 -- 172.21.15.59:0/1651718135 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b815bb70 con 0x7f72b8156770 2024-04-25T17:01:50.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.767+0000 7f72ae7fc640 1 -- 172.21.15.59:0/1651718135 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a800cd30 con 0x7f72b8156770 2024-04-25T17:01:50.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.767+0000 7f72bfb6c640 1 -- 172.21.15.59:0/1651718135 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b815c110 con 0x7f72b8156770 2024-04-25T17:01:50.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.767+0000 7f72bfb6c640 1 -- 172.21.15.59:0/1651718135 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f72b815c350 con 0x7f72b8156770 2024-04-25T17:01:50.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.792+0000 7f72ae7fc640 1 -- 172.21.15.59:0/1651718135 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f72a801a070 con 0x7f72b8156770 2024-04-25T17:01:50.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.793+0000 7f72ae7fc640 1 --2- 172.21.15.59:0/1651718135 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f729c0744b0 0x7f729c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:50.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.793+0000 7f72bd908640 1 --2- 172.21.15.59:0/1651718135 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f729c0744b0 0x7f729c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:50.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.794+0000 7f72bd908640 1 --2- 172.21.15.59:0/1651718135 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f729c0744b0 0x7f729c0769c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f72b4000f60 tx=0x7f72b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:50.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.797+0000 7f72ae7fc640 1 -- 172.21.15.59:0/1651718135 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f72a8093e00 con 0x7f72b8156770 2024-04-25T17:01:50.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.798+0000 7f72ae7fc640 1 --2- 172.21.15.59:0/1651718135 >> [v2:172.21.15.59:6810/1651189093,v1:172.21.15.59:6811/1651189093] conn(0x7f729c07c880 0x7f729c07ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:50.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.798+0000 7f72ae7fc640 1 -- 172.21.15.59:0/1651718135 --> [v2:172.21.15.59:6810/1651189093,v1:172.21.15.59:6811/1651189093] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f729c07f420 con 0x7f729c07c880 2024-04-25T17:01:50.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.798+0000 7f72ae7fc640 1 -- 172.21.15.59:0/1651718135 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f72a805bfe0 con 0x7f72b8156770 2024-04-25T17:01:50.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.798+0000 7f72be109640 1 --2- 172.21.15.59:0/1651718135 >> [v2:172.21.15.59:6810/1651189093,v1:172.21.15.59:6811/1651189093] conn(0x7f729c07c880 0x7f729c07ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:50.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.798+0000 7f72be109640 1 --2- 172.21.15.59:0/1651718135 >> [v2:172.21.15.59:6810/1651189093,v1:172.21.15.59:6811/1651189093] conn(0x7f729c07c880 0x7f729c07ed50 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:50.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.799+0000 7f72ae7fc640 1 -- 172.21.15.59:0/1651718135 <== osd.2 v2:172.21.15.59:6810/1651189093 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f729c07f420 con 0x7f729c07c880 2024-04-25T17:01:50.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.816+0000 7f72bfb6c640 1 -- 172.21.15.59:0/1651718135 --> [v2:172.21.15.59:6810/1651189093,v1:172.21.15.59:6811/1651189093] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f72b80699b0 con 0x7f729c07c880 2024-04-25T17:01:50.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.816+0000 7f72ae7fc640 1 -- 172.21.15.59:0/1651718135 <== osd.2 v2:172.21.15.59:6810/1651189093 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f72b80699b0 con 0x7f729c07c880 2024-04-25T17:01:50.814 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T17:01:50.815 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T17:01:50.815 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T17:01:50.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.816+0000 7f72bfb6c640 1 -- 172.21.15.59:0/1651718135 >> [v2:172.21.15.59:6810/1651189093,v1:172.21.15.59:6811/1651189093] conn(0x7f729c07c880 msgr2=0x7f729c07ed50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:50.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.816+0000 7f72bfb6c640 1 --2- 172.21.15.59:0/1651718135 >> [v2:172.21.15.59:6810/1651189093,v1:172.21.15.59:6811/1651189093] conn(0x7f729c07c880 0x7f729c07ed50 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.817+0000 7f72bfb6c640 1 -- 172.21.15.59:0/1651718135 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f729c0744b0 msgr2=0x7f729c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:50.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.817+0000 7f72bfb6c640 1 --2- 172.21.15.59:0/1651718135 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f729c0744b0 0x7f729c0769c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f72b4000f60 tx=0x7f72b4009040 comp rx=0 tx=0).stop 2024-04-25T17:01:50.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.817+0000 7f72bfb6c640 1 -- 172.21.15.59:0/1651718135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72b8156770 msgr2=0x7f72b80d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:50.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.817+0000 7f72bfb6c640 1 --2- 172.21.15.59:0/1651718135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72b8156770 0x7f72b80d0270 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f72a800e870 tx=0x7f72a800ed30 comp rx=0 tx=0).stop 2024-04-25T17:01:50.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.817+0000 7f72be109640 1 -- 172.21.15.59:0/1651718135 reap_dead start 2024-04-25T17:01:50.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.817+0000 7f72bfb6c640 1 -- 172.21.15.59:0/1651718135 shutdown_connections 2024-04-25T17:01:50.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.817+0000 7f72bfb6c640 1 -- 172.21.15.59:0/1651718135 >> 172.21.15.59:0/1651718135 conn(0x7f72b80684e0 msgr2=0x7f72b80cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:50.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.817+0000 7f72bfb6c640 1 -- 172.21.15.59:0/1651718135 shutdown_connections 2024-04-25T17:01:50.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.817+0000 7f72bfb6c640 1 -- 172.21.15.59:0/1651718135 wait complete. 2024-04-25T17:01:50.827 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T17:01:50.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.941+0000 7f3bc0bd6640 1 Processor -- start 2024-04-25T17:01:50.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.941+0000 7f3bc0bd6640 1 -- start start 2024-04-25T17:01:50.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.943+0000 7f3bc0bd6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3bbc0cc560 0x7f3bbc0cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:50.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.943+0000 7f3bc0bd6640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3bbc1600c0 0x7f3bbc1604d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:50.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.943+0000 7f3bc0bd6640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bbc15fbe0 con 0x7f3bbc1566f0 2024-04-25T17:01:50.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.943+0000 7f3bc0bd6640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f3bbc0ce1f0 con 0x7f3bbc1600c0 2024-04-25T17:01:50.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.943+0000 7f3bc0bd6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f3bbc0ce4d0 con 0x7f3bbc0cc560 2024-04-25T17:01:50.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.943+0000 7f3bba59c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3bbc1566f0 0x7f3bbc0cd350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50572/0 (socket says 172.21.15.59:50572) 2024-04-25T17:01:50.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.943+0000 7f3bba59c640 1 -- 172.21.15.59:0/893703894 learned_addr learned my addr 172.21.15.59:0/893703894 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T17:01:50.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.943+0000 7f3bb9d9b640 1 --2- 172.21.15.59:0/893703894 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3bbc0cc560 0x7f3bbc0cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:50.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.944+0000 7f3bbad9d640 1 --2- 172.21.15.59:0/893703894 >> v2:172.21.15.64:3300/0 conn(0x7f3bbc1600c0 0x7f3bbc1604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.946+0000 7f3bb959a640 1 -- 172.21.15.59:0/893703894 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 375390693 0 0) 0x7f3bbc15fbe0 con 0x7f3bbc1566f0 2024-04-25T17:01:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.946+0000 7f3bb959a640 1 -- 172.21.15.59:0/893703894 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ba8003520 con 0x7f3bbc1566f0 2024-04-25T17:01:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.947+0000 7f3bb9d9b640 1 -- 172.21.15.59:0/893703894 >> v2:172.21.15.64:3300/0 conn(0x7f3bbc1600c0 msgr2=0x7f3bbc1604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:50.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.947+0000 7f3bb9d9b640 1 --2- 172.21.15.59:0/893703894 >> v2:172.21.15.64:3300/0 conn(0x7f3bbc1600c0 0x7f3bbc1604d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.947+0000 7f3bb9d9b640 1 -- 172.21.15.59:0/893703894 >> v1:172.21.15.59:6789/0 conn(0x7f3bbc1566f0 legacy=0x7f3bbc0cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:50.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.947+0000 7f3bb9d9b640 1 -- 172.21.15.59:0/893703894 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bbc0ce7b0 con 0x7f3bbc0cc560 2024-04-25T17:01:50.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.949+0000 7f3bb9d9b640 1 --2- 172.21.15.59:0/893703894 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3bbc0cc560 0x7f3bbc0cc970 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3ba40097a0 tx=0x7f3ba402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a8f4f04e2ddb986 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.954+0000 7f3bb959a640 1 -- 172.21.15.59:0/893703894 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4037070 con 0x7f3bbc0cc560 2024-04-25T17:01:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.954+0000 7f3bb959a640 1 -- 172.21.15.59:0/893703894 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba4032440 con 0x7f3bbc0cc560 2024-04-25T17:01:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.954+0000 7f3bb959a640 1 -- 172.21.15.59:0/893703894 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4032810 con 0x7f3bbc0cc560 2024-04-25T17:01:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.954+0000 7f3bc0bd6640 1 -- 172.21.15.59:0/893703894 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3bbc0cc560 msgr2=0x7f3bbc0cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.954+0000 7f3bc0bd6640 1 --2- 172.21.15.59:0/893703894 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3bbc0cc560 0x7f3bbc0cc970 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3ba40097a0 tx=0x7f3ba402a180 comp rx=0 tx=0).stop 2024-04-25T17:01:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.954+0000 7f3bc0bd6640 1 -- 172.21.15.59:0/893703894 shutdown_connections 2024-04-25T17:01:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.954+0000 7f3bc0bd6640 1 --2- 172.21.15.59:0/893703894 >> v2:172.21.15.64:3300/0 conn(0x7f3bbc1600c0 0x7f3bbc1604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.954+0000 7f3bc0bd6640 1 --2- 172.21.15.59:0/893703894 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3bbc0cc560 0x7f3bbc0cc970 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.954+0000 7f3bc0bd6640 1 -- 172.21.15.59:0/893703894 >> 172.21.15.59:0/893703894 conn(0x7f3bbc0684e0 msgr2=0x7f3bbc0688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.954+0000 7f3bc0bd6640 1 -- 172.21.15.59:0/893703894 shutdown_connections 2024-04-25T17:01:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.955+0000 7f3bc0bd6640 1 -- 172.21.15.59:0/893703894 wait complete. 2024-04-25T17:01:50.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.956+0000 7f3bc0bd6640 1 Processor -- start 2024-04-25T17:01:50.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.956+0000 7f3bc0bd6640 1 -- start start 2024-04-25T17:01:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.958+0000 7f3bc0bd6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3bbc0cc560 0x7f3bbc14f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.958+0000 7f3bc0bd6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bbc1566f0 0x7f3bbc0c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.958+0000 7f3bc0bd6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bbc1600c0 0x7f3bbc1f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.958+0000 7f3bc0bd6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc0ced70 con 0x7f3bbc1566f0 2024-04-25T17:01:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.958+0000 7f3bc0bd6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc160a10 con 0x7f3bbc1600c0 2024-04-25T17:01:50.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.958+0000 7f3bc0bd6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f3bbc0cde90 con 0x7f3bbc0cc560 2024-04-25T17:01:50.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.958+0000 7f3bb9d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bbc1566f0 0x7f3bbc0c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:50.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.958+0000 7f3bba59c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3bbc0cc560 0x7f3bbc14f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:50.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.958+0000 7f3bbad9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bbc1600c0 0x7f3bbc1f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:50.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.959+0000 7f3bba59c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3bbc0cc560 0x7f3bbc14f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53206/0 (socket says 172.21.15.59:53206) 2024-04-25T17:01:50.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.959+0000 7f3bba59c640 1 -- 172.21.15.59:0/4235649351 learned_addr learned my addr 172.21.15.59:0/4235649351 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:50.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.963+0000 7f3bb9d9b640 1 -- 172.21.15.59:0/4235649351 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3bbc0cc560 msgr2=0x7f3bbc14f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:50.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.963+0000 7f3bb9d9b640 1 --2- 172.21.15.59:0/4235649351 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3bbc0cc560 0x7f3bbc14f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.963+0000 7f3bb9d9b640 1 -- 172.21.15.59:0/4235649351 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bbc1600c0 msgr2=0x7f3bbc1f5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:50.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.963+0000 7f3bb9d9b640 1 --2- 172.21.15.59:0/4235649351 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bbc1600c0 0x7f3bbc1f5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:50.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.963+0000 7f3bb9d9b640 1 -- 172.21.15.59:0/4235649351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bbc14eb90 con 0x7f3bbc1566f0 2024-04-25T17:01:50.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.965+0000 7f3bb9d9b640 1 --2- 172.21.15.59:0/4235649351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bbc1566f0 0x7f3bbc0c7080 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4031000 tx=0x7f3ba40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:50.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.969+0000 7f3bb2ffd640 1 -- 172.21.15.59:0/4235649351 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4037050 con 0x7f3bbc1566f0 2024-04-25T17:01:50.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.969+0000 7f3bb2ffd640 1 -- 172.21.15.59:0/4235649351 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba4043070 con 0x7f3bbc1566f0 2024-04-25T17:01:50.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.969+0000 7f3bc0bd6640 1 -- 172.21.15.59:0/4235649351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bbc14ee30 con 0x7f3bbc1566f0 2024-04-25T17:01:50.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.969+0000 7f3bb2ffd640 1 -- 172.21.15.59:0/4235649351 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba403cb30 con 0x7f3bbc1566f0 2024-04-25T17:01:50.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.969+0000 7f3bc0bd6640 1 -- 172.21.15.59:0/4235649351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bbc1f66c0 con 0x7f3bbc1566f0 2024-04-25T17:01:50.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:50.970+0000 7f3bc0bd6640 1 -- 172.21.15.59:0/4235649351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bbc069910 con 0x7f3bbc1566f0 2024-04-25T17:01:51.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.265+0000 7f3bb2ffd640 1 -- 172.21.15.59:0/4235649351 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3ba403ccd0 con 0x7f3bbc1566f0 2024-04-25T17:01:51.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.265+0000 7f3bb2ffd640 1 --2- 172.21.15.59:0/4235649351 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f3b9c074500 0x7f3b9c076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:51.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.265+0000 7f3bba59c640 1 --2- 172.21.15.59:0/4235649351 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f3b9c074500 0x7f3b9c076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:51.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.266+0000 7f3bba59c640 1 --2- 172.21.15.59:0/4235649351 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f3b9c074500 0x7f3b9c076a10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4001200 tx=0x7f3bb4007d70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:51.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.299+0000 7f3bb2ffd640 1 -- 172.21.15.59:0/4235649351 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f3ba407cd70 con 0x7f3bbc1566f0 2024-04-25T17:01:51.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.299+0000 7f3bb2ffd640 1 -- 172.21.15.59:0/4235649351 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3ba4080ae0 con 0x7f3bbc1566f0 2024-04-25T17:01:51.391 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:01:51.394 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:01:51.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.489+0000 7f3bc0bd6640 1 -- 172.21.15.59:0/4235649351 --> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f3bbc0c6c80 con 0x7f3b9c074500 2024-04-25T17:01:51.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.489+0000 7f3bb2ffd640 1 -- 172.21.15.59:0/4235649351 <== mgr.4102 v2:172.21.15.59:6800/2368090706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3bbc0c6c80 con 0x7f3b9c074500 2024-04-25T17:01:51.487 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T17:01:51.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.491+0000 7f3bc0bd6640 1 -- 172.21.15.59:0/4235649351 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f3b9c074500 msgr2=0x7f3b9c076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:51.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.491+0000 7f3bc0bd6640 1 --2- 172.21.15.59:0/4235649351 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f3b9c074500 0x7f3b9c076a10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4001200 tx=0x7f3bb4007d70 comp rx=0 tx=0).stop 2024-04-25T17:01:51.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.491+0000 7f3bc0bd6640 1 -- 172.21.15.59:0/4235649351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bbc1566f0 msgr2=0x7f3bbc0c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:51.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.491+0000 7f3bc0bd6640 1 --2- 172.21.15.59:0/4235649351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bbc1566f0 0x7f3bbc0c7080 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4031000 tx=0x7f3ba40046c0 comp rx=0 tx=0).stop 2024-04-25T17:01:51.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.491+0000 7f3bc0bd6640 1 -- 172.21.15.59:0/4235649351 shutdown_connections 2024-04-25T17:01:51.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.491+0000 7f3bc0bd6640 1 --2- 172.21.15.59:0/4235649351 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f3b9c074500 0x7f3b9c076a10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:51.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.491+0000 7f3bc0bd6640 1 --2- 172.21.15.59:0/4235649351 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bbc1600c0 0x7f3bbc1f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:51.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.491+0000 7f3bc0bd6640 1 --2- 172.21.15.59:0/4235649351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bbc1566f0 0x7f3bbc0c7080 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:51.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.491+0000 7f3bc0bd6640 1 --2- 172.21.15.59:0/4235649351 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3bbc0cc560 0x7f3bbc14f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:51.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.491+0000 7f3bc0bd6640 1 -- 172.21.15.59:0/4235649351 >> 172.21.15.59:0/4235649351 conn(0x7f3bbc0684e0 msgr2=0x7f3bbc1548e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:51.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.491+0000 7f3bc0bd6640 1 -- 172.21.15.59:0/4235649351 shutdown_connections 2024-04-25T17:01:51.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.491+0000 7f3bc0bd6640 1 -- 172.21.15.59:0/4235649351 wait complete. 2024-04-25T17:01:51.501 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T17:01:51.501 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T17:01:51.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.662+0000 7fb8505b2640 1 Processor -- start 2024-04-25T17:01:51.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.662+0000 7fb8505b2640 1 -- start start 2024-04-25T17:01:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.663+0000 7fb8505b2640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8480cb220 0x7fb8480b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.663+0000 7fb8505b2640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb8480743c0 0x7fb8480cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:51.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.663+0000 7fb8505b2640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8480cecd0 con 0x7fb8480cca00 2024-04-25T17:01:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.663+0000 7fb8505b2640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb84815d3a0 con 0x7fb8480cb220 2024-04-25T17:01:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.663+0000 7fb8505b2640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fb8480b4280 con 0x7fb8480743c0 2024-04-25T17:01:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.664+0000 7fb84db4d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb8480743c0 0x7fb8480cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.664+0000 7fb84db4d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb8480743c0 0x7fb8480cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53222/0 (socket says 172.21.15.59:53222) 2024-04-25T17:01:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.664+0000 7fb84db4d640 1 -- 172.21.15.59:0/1537978270 learned_addr learned my addr 172.21.15.59:0/1537978270 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:51.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.667+0000 7fb84db4d640 1 -- 172.21.15.59:0/1537978270 >> v2:172.21.15.59:3300/0 conn(0x7fb8480cb220 msgr2=0x7fb8480b68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:51.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.667+0000 7fb84db4d640 1 --2- 172.21.15.59:0/1537978270 >> v2:172.21.15.59:3300/0 conn(0x7fb8480cb220 0x7fb8480b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:51.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.667+0000 7fb84db4d640 1 -- 172.21.15.59:0/1537978270 >> v1:172.21.15.59:6789/0 conn(0x7fb8480cca00 legacy=0x7fb8480cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:51.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.667+0000 7fb84db4d640 1 -- 172.21.15.59:0/1537978270 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8480b4560 con 0x7fb8480743c0 2024-04-25T17:01:51.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.670+0000 7fb84db4d640 1 --2- 172.21.15.59:0/1537978270 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb8480743c0 0x7fb8480cc4c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb838009870 tx=0x7fb83802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b31cf9d31a39f4e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:51.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.675+0000 7fb84d34c640 1 -- 172.21.15.59:0/1537978270 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb838037070 con 0x7fb8480743c0 2024-04-25T17:01:51.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.675+0000 7fb84d34c640 1 -- 172.21.15.59:0/1537978270 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb838032440 con 0x7fb8480743c0 2024-04-25T17:01:51.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.675+0000 7fb84d34c640 1 -- 172.21.15.59:0/1537978270 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb838032810 con 0x7fb8480743c0 2024-04-25T17:01:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.676+0000 7fb8505b2640 1 -- 172.21.15.59:0/1537978270 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb8480743c0 msgr2=0x7fb8480cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.676+0000 7fb8505b2640 1 --2- 172.21.15.59:0/1537978270 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb8480743c0 0x7fb8480cc4c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb838009870 tx=0x7fb83802a180 comp rx=0 tx=0).stop 2024-04-25T17:01:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.676+0000 7fb8505b2640 1 -- 172.21.15.59:0/1537978270 shutdown_connections 2024-04-25T17:01:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.676+0000 7fb8505b2640 1 --2- 172.21.15.59:0/1537978270 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb8480743c0 0x7fb8480cc4c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.676+0000 7fb8505b2640 1 --2- 172.21.15.59:0/1537978270 >> v2:172.21.15.59:3300/0 conn(0x7fb8480cb220 0x7fb8480b68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.676+0000 7fb8505b2640 1 -- 172.21.15.59:0/1537978270 >> 172.21.15.59:0/1537978270 conn(0x7fb848068700 msgr2=0x7fb848073cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.676+0000 7fb8505b2640 1 -- 172.21.15.59:0/1537978270 shutdown_connections 2024-04-25T17:01:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.676+0000 7fb8505b2640 1 -- 172.21.15.59:0/1537978270 wait complete. 2024-04-25T17:01:51.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.678+0000 7fb8505b2640 1 Processor -- start 2024-04-25T17:01:51.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.678+0000 7fb8505b2640 1 -- start start 2024-04-25T17:01:51.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.679+0000 7fb8505b2640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb8480743c0 0x7fb8481f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:51.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.679+0000 7fb8505b2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8480cb220 0x7fb8481f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:51.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.679+0000 7fb8505b2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8480cca00 0x7fb84814f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:51.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.679+0000 7fb8505b2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb8480b6de0 con 0x7fb8480cb220 2024-04-25T17:01:51.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.679+0000 7fb8505b2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb8480cce10 con 0x7fb8480cca00 2024-04-25T17:01:51.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.679+0000 7fb8505b2640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fb8480c52a0 con 0x7fb8480743c0 2024-04-25T17:01:51.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.680+0000 7fb84e34e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb8480743c0 0x7fb8481f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:51.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.680+0000 7fb84e34e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb8480743c0 0x7fb8481f6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:53228/0 (socket says 172.21.15.59:53228) 2024-04-25T17:01:51.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.680+0000 7fb84e34e640 1 -- 172.21.15.59:0/879267043 learned_addr learned my addr 172.21.15.59:0/879267043 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:51.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.685+0000 7fb84e34e640 1 -- 172.21.15.59:0/879267043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8480cca00 msgr2=0x7fb84814f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:51.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.685+0000 7fb84e34e640 1 --2- 172.21.15.59:0/879267043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8480cca00 0x7fb84814f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:51.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.685+0000 7fb84e34e640 1 -- 172.21.15.59:0/879267043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8480cb220 msgr2=0x7fb8481f2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:51.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.685+0000 7fb84e34e640 1 --2- 172.21.15.59:0/879267043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8480cb220 0x7fb8481f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:51.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.685+0000 7fb84e34e640 1 -- 172.21.15.59:0/879267043 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8481f3220 con 0x7fb8480743c0 2024-04-25T17:01:51.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.688+0000 7fb84e34e640 1 --2- 172.21.15.59:0/879267043 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb8480743c0 0x7fb8481f6550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb84400b410 tx=0x7fb84400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.693+0000 7fb83effd640 1 -- 172.21.15.59:0/879267043 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb844015020 con 0x7fb8480743c0 2024-04-25T17:01:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.693+0000 7fb83effd640 1 -- 172.21.15.59:0/879267043 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb844011850 con 0x7fb8480743c0 2024-04-25T17:01:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.693+0000 7fb8505b2640 1 -- 172.21.15.59:0/879267043 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb84815d080 con 0x7fb8480743c0 2024-04-25T17:01:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.693+0000 7fb83effd640 1 -- 172.21.15.59:0/879267043 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb844011c40 con 0x7fb8480743c0 2024-04-25T17:01:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.693+0000 7fb8505b2640 1 -- 172.21.15.59:0/879267043 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb848155550 con 0x7fb8480743c0 2024-04-25T17:01:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.694+0000 7fb8505b2640 1 -- 172.21.15.59:0/879267043 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb84806e9f0 con 0x7fb8480743c0 2024-04-25T17:01:51.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.717+0000 7fb83effd640 1 -- 172.21.15.59:0/879267043 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb844018020 con 0x7fb8480743c0 2024-04-25T17:01:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.718+0000 7fb83effd640 1 --2- 172.21.15.59:0/879267043 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb82c074500 0x7fb82c076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.718+0000 7fb84db4d640 1 --2- 172.21.15.59:0/879267043 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb82c074500 0x7fb82c076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:51.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.718+0000 7fb84db4d640 1 --2- 172.21.15.59:0/879267043 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb82c074500 0x7fb82c076a10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb838034000 tx=0x7fb83802c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:51.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.722+0000 7fb83effd640 1 -- 172.21.15.59:0/879267043 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fb844011de0 con 0x7fb8480743c0 2024-04-25T17:01:51.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.722+0000 7fb83effd640 1 --2- 172.21.15.59:0/879267043 >> [v2:172.21.15.59:6818/1300858236,v1:172.21.15.59:6819/1300858236] conn(0x7fb82c07c8d0 0x7fb82c07eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:51.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.722+0000 7fb83effd640 1 -- 172.21.15.59:0/879267043 --> [v2:172.21.15.59:6818/1300858236,v1:172.21.15.59:6819/1300858236] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb82c07f470 con 0x7fb82c07c8d0 2024-04-25T17:01:51.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.722+0000 7fb84eb4f640 1 --2- 172.21.15.59:0/879267043 >> [v2:172.21.15.59:6818/1300858236,v1:172.21.15.59:6819/1300858236] conn(0x7fb82c07c8d0 0x7fb82c07eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:51.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.723+0000 7fb84eb4f640 1 --2- 172.21.15.59:0/879267043 >> [v2:172.21.15.59:6818/1300858236,v1:172.21.15.59:6819/1300858236] conn(0x7fb82c07c8d0 0x7fb82c07eda0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:51.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.723+0000 7fb83effd640 1 -- 172.21.15.59:0/879267043 <== osd.3 v2:172.21.15.59:6818/1300858236 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb82c07f470 con 0x7fb82c07c8d0 2024-04-25T17:01:51.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.737+0000 7fb8505b2640 1 -- 172.21.15.59:0/879267043 --> [v2:172.21.15.59:6818/1300858236,v1:172.21.15.59:6819/1300858236] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb848069fb0 con 0x7fb82c07c8d0 2024-04-25T17:01:51.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.737+0000 7fb83effd640 1 -- 172.21.15.59:0/879267043 <== osd.3 v2:172.21.15.59:6818/1300858236 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb848069fb0 con 0x7fb82c07c8d0 2024-04-25T17:01:51.735 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T17:01:51.735 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T17:01:51.736 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T17:01:51.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.737+0000 7fb8505b2640 1 -- 172.21.15.59:0/879267043 >> [v2:172.21.15.59:6818/1300858236,v1:172.21.15.59:6819/1300858236] conn(0x7fb82c07c8d0 msgr2=0x7fb82c07eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:51.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.737+0000 7fb8505b2640 1 --2- 172.21.15.59:0/879267043 >> [v2:172.21.15.59:6818/1300858236,v1:172.21.15.59:6819/1300858236] conn(0x7fb82c07c8d0 0x7fb82c07eda0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:51.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.737+0000 7fb8505b2640 1 -- 172.21.15.59:0/879267043 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb82c074500 msgr2=0x7fb82c076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:51.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.737+0000 7fb8505b2640 1 --2- 172.21.15.59:0/879267043 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb82c074500 0x7fb82c076a10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb838034000 tx=0x7fb83802c000 comp rx=0 tx=0).stop 2024-04-25T17:01:51.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.737+0000 7fb8505b2640 1 -- 172.21.15.59:0/879267043 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb8480743c0 msgr2=0x7fb8481f6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:51.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.737+0000 7fb8505b2640 1 --2- 172.21.15.59:0/879267043 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb8480743c0 0x7fb8481f6550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb84400b410 tx=0x7fb84400b8d0 comp rx=0 tx=0).stop 2024-04-25T17:01:51.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.737+0000 7fb84eb4f640 1 -- 172.21.15.59:0/879267043 reap_dead start 2024-04-25T17:01:51.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.738+0000 7fb8505b2640 1 -- 172.21.15.59:0/879267043 shutdown_connections 2024-04-25T17:01:51.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.738+0000 7fb8505b2640 1 -- 172.21.15.59:0/879267043 >> 172.21.15.59:0/879267043 conn(0x7fb848068700 msgr2=0x7fb848073cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:51.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.738+0000 7fb8505b2640 1 -- 172.21.15.59:0/879267043 shutdown_connections 2024-04-25T17:01:51.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.738+0000 7fb8505b2640 1 -- 172.21.15.59:0/879267043 wait complete. 2024-04-25T17:01:51.747 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T17:01:51.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.864+0000 7fce3ebb2640 1 Processor -- start 2024-04-25T17:01:51.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.864+0000 7fce3ebb2640 1 -- start start 2024-04-25T17:01:51.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.865+0000 7fce3ebb2640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fce380b47a0 0x7fce38160730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:51.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.865+0000 7fce3ebb2640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fce380cc960 0x7fce380ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:51.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.865+0000 7fce3ebb2640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce3815c8c0 con 0x7fce380ccd70 2024-04-25T17:01:51.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.865+0000 7fce3ebb2640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fce380b4bb0 con 0x7fce380cc960 2024-04-25T17:01:51.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.865+0000 7fce3ebb2640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fce38160c70 con 0x7fce380b47a0 2024-04-25T17:01:51.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.903+0000 7fce3c94e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fce380b47a0 0x7fce38160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:51.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.904+0000 7fce3c94e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fce380b47a0 0x7fce38160730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:56612/0 (socket says 172.21.15.59:56612) 2024-04-25T17:01:51.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.904+0000 7fce3c94e640 1 -- 172.21.15.59:0/4287581061 learned_addr learned my addr 172.21.15.59:0/4287581061 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:51.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.908+0000 7fce2ffff640 1 --2- 172.21.15.59:0/4287581061 >> v2:172.21.15.59:3300/0 conn(0x7fce380cc960 0x7fce380ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:51.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.911+0000 7fce2ffff640 1 -- 172.21.15.59:0/4287581061 >> v2:172.21.15.64:3300/0 conn(0x7fce380b47a0 msgr2=0x7fce38160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:51.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.911+0000 7fce2ffff640 1 --2- 172.21.15.59:0/4287581061 >> v2:172.21.15.64:3300/0 conn(0x7fce380b47a0 0x7fce38160730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:51.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.911+0000 7fce2ffff640 1 -- 172.21.15.59:0/4287581061 >> v1:172.21.15.64:6789/0 conn(0x7fce380ccd70 legacy=0x7fce380b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:51.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.911+0000 7fce2ffff640 1 -- 172.21.15.59:0/4287581061 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3815cba0 con 0x7fce380cc960 2024-04-25T17:01:51.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.917+0000 7fce2ffff640 1 --2- 172.21.15.59:0/4287581061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce380cc960 0x7fce380ce3a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fce380cf530 tx=0x7fce2802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411988586227bacf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:51.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.921+0000 7fce2f7fe640 1 -- 172.21.15.59:0/4287581061 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28037070 con 0x7fce380cc960 2024-04-25T17:01:51.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.921+0000 7fce2f7fe640 1 -- 172.21.15.59:0/4287581061 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce28032440 con 0x7fce380cc960 2024-04-25T17:01:51.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.921+0000 7fce2f7fe640 1 -- 172.21.15.59:0/4287581061 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2802ae60 con 0x7fce380cc960 2024-04-25T17:01:51.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.922+0000 7fce3ebb2640 1 -- 172.21.15.59:0/4287581061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce380cc960 msgr2=0x7fce380ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:51.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.922+0000 7fce3ebb2640 1 --2- 172.21.15.59:0/4287581061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce380cc960 0x7fce380ce3a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fce380cf530 tx=0x7fce2802a110 comp rx=0 tx=0).stop 2024-04-25T17:01:51.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.922+0000 7fce3ebb2640 1 -- 172.21.15.59:0/4287581061 shutdown_connections 2024-04-25T17:01:51.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.922+0000 7fce3ebb2640 1 --2- 172.21.15.59:0/4287581061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce380cc960 0x7fce380ce3a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:51.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.922+0000 7fce3ebb2640 1 --2- 172.21.15.59:0/4287581061 >> v2:172.21.15.64:3300/0 conn(0x7fce380b47a0 0x7fce38160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:51.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.922+0000 7fce3ebb2640 1 -- 172.21.15.59:0/4287581061 >> 172.21.15.59:0/4287581061 conn(0x7fce380684e0 msgr2=0x7fce380688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:51.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.922+0000 7fce3ebb2640 1 -- 172.21.15.59:0/4287581061 shutdown_connections 2024-04-25T17:01:51.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.922+0000 7fce3ebb2640 1 -- 172.21.15.59:0/4287581061 wait complete. 2024-04-25T17:01:51.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.924+0000 7fce3ebb2640 1 Processor -- start 2024-04-25T17:01:51.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.924+0000 7fce3ebb2640 1 -- start start 2024-04-25T17:01:51.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.925+0000 7fce3ebb2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce380b47a0 0x7fce380ad440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:51.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.925+0000 7fce3ebb2640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fce380cc960 0x7fce381f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:51.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.925+0000 7fce3ebb2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce380ccd70 0x7fce380d2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:51.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.925+0000 7fce3ebb2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fce3815d440 con 0x7fce380b47a0 2024-04-25T17:01:51.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.925+0000 7fce3ebb2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fce3815d160 con 0x7fce380ccd70 2024-04-25T17:01:51.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.925+0000 7fce3ebb2640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fce380b5f90 con 0x7fce380cc960 2024-04-25T17:01:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.926+0000 7fce3c94e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce380b47a0 0x7fce380ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:51.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.926+0000 7fce3d14f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce380ccd70 0x7fce380d2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.926+0000 7fce2ffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fce380cc960 0x7fce381f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.926+0000 7fce3c94e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce380b47a0 0x7fce380ad440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51288/0 (socket says 172.21.15.59:51288) 2024-04-25T17:01:51.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.926+0000 7fce3c94e640 1 -- 172.21.15.59:0/3747337836 learned_addr learned my addr 172.21.15.59:0/3747337836 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:51.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.930+0000 7fce2ffff640 1 -- 172.21.15.59:0/3747337836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce380ccd70 msgr2=0x7fce380d2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:51.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.930+0000 7fce2ffff640 1 --2- 172.21.15.59:0/3747337836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce380ccd70 0x7fce380d2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:51.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.930+0000 7fce2ffff640 1 -- 172.21.15.59:0/3747337836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce380b47a0 msgr2=0x7fce380ad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:51.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.930+0000 7fce2ffff640 1 --2- 172.21.15.59:0/3747337836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce380b47a0 0x7fce380ad440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:51.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.930+0000 7fce2ffff640 1 -- 172.21.15.59:0/3747337836 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce381f66c0 con 0x7fce380cc960 2024-04-25T17:01:51.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.930+0000 7fce3c94e640 1 --2- 172.21.15.59:0/3747337836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce380b47a0 0x7fce380ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:01:51.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.932+0000 7fce2ffff640 1 --2- 172.21.15.59:0/3747337836 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fce380cc960 0x7fce381f6180 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fce38074710 tx=0x7fce280046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.937+0000 7fce2d7fa640 1 -- 172.21.15.59:0/3747337836 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28041030 con 0x7fce380cc960 2024-04-25T17:01:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.937+0000 7fce2d7fa640 1 -- 172.21.15.59:0/3747337836 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce28030500 con 0x7fce380cc960 2024-04-25T17:01:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.937+0000 7fce3ebb2640 1 -- 172.21.15.59:0/3747337836 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce380c89a0 con 0x7fce380cc960 2024-04-25T17:01:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.937+0000 7fce2d7fa640 1 -- 172.21.15.59:0/3747337836 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28037040 con 0x7fce380cc960 2024-04-25T17:01:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.937+0000 7fce3ebb2640 1 -- 172.21.15.59:0/3747337836 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fce380c8c40 con 0x7fce380cc960 2024-04-25T17:01:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.938+0000 7fce3ebb2640 1 -- 172.21.15.59:0/3747337836 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce380cd4b0 con 0x7fce380cc960 2024-04-25T17:01:51.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.961+0000 7fce2d7fa640 1 -- 172.21.15.59:0/3747337836 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fce28044070 con 0x7fce380cc960 2024-04-25T17:01:51.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.961+0000 7fce2d7fa640 1 --2- 172.21.15.59:0/3747337836 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fce24074530 0x7fce24076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:51.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.961+0000 7fce3c94e640 1 --2- 172.21.15.59:0/3747337836 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fce24074530 0x7fce24076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:51.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:51.962+0000 7fce3c94e640 1 --2- 172.21.15.59:0/3747337836 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fce24074530 0x7fce24076a40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fce34006f40 tx=0x7fce34009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:52.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.239+0000 7fce2d7fa640 1 -- 172.21.15.59:0/3747337836 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fce2807c180 con 0x7fce380cc960 2024-04-25T17:01:52.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.250+0000 7fce2d7fa640 1 -- 172.21.15.59:0/3747337836 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fce380cd4b0 con 0x7fce380cc960 2024-04-25T17:01:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.441+0000 7fce3ebb2640 1 -- 172.21.15.59:0/3747337836 --> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fce38069910 con 0x7fce24074530 2024-04-25T17:01:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.441+0000 7fce2d7fa640 1 -- 172.21.15.59:0/3747337836 <== mgr.4102 v2:172.21.15.59:6800/2368090706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fce38069910 con 0x7fce24074530 2024-04-25T17:01:52.440 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T17:01:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.443+0000 7fce3ebb2640 1 -- 172.21.15.59:0/3747337836 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fce24074530 msgr2=0x7fce24076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.443+0000 7fce3ebb2640 1 --2- 172.21.15.59:0/3747337836 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fce24074530 0x7fce24076a40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fce34006f40 tx=0x7fce34009240 comp rx=0 tx=0).stop 2024-04-25T17:01:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.443+0000 7fce3ebb2640 1 -- 172.21.15.59:0/3747337836 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fce380cc960 msgr2=0x7fce381f6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.443+0000 7fce3ebb2640 1 --2- 172.21.15.59:0/3747337836 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fce380cc960 0x7fce381f6180 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fce38074710 tx=0x7fce280046c0 comp rx=0 tx=0).stop 2024-04-25T17:01:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.443+0000 7fce3ebb2640 1 -- 172.21.15.59:0/3747337836 shutdown_connections 2024-04-25T17:01:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.443+0000 7fce3ebb2640 1 --2- 172.21.15.59:0/3747337836 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fce24074530 0x7fce24076a40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:52.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.443+0000 7fce3ebb2640 1 --2- 172.21.15.59:0/3747337836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce380ccd70 0x7fce380d2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:52.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.443+0000 7fce3ebb2640 1 --2- 172.21.15.59:0/3747337836 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fce380cc960 0x7fce381f6180 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:52.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.443+0000 7fce3ebb2640 1 --2- 172.21.15.59:0/3747337836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce380b47a0 0x7fce380ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:52.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.443+0000 7fce3ebb2640 1 -- 172.21.15.59:0/3747337836 >> 172.21.15.59:0/3747337836 conn(0x7fce380684e0 msgr2=0x7fce3815fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:52.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.444+0000 7fce3ebb2640 1 -- 172.21.15.59:0/3747337836 shutdown_connections 2024-04-25T17:01:52.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.444+0000 7fce3ebb2640 1 -- 172.21.15.59:0/3747337836 wait complete. 2024-04-25T17:01:52.453 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T17:01:52.453 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T17:01:52.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.572+0000 7f537ab34640 1 Processor -- start 2024-04-25T17:01:52.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.572+0000 7f537ab34640 1 -- start start 2024-04-25T17:01:52.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.573+0000 7f537ab34640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f53740c6c50 0x7f53740c7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:52.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.573+0000 7f537ab34640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53740c89e0 con 0x7f53740c8300 2024-04-25T17:01:52.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.573+0000 7f537ab34640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f537415e400 con 0x7f537406c930 2024-04-25T17:01:52.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.573+0000 7f537ab34640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f537415e9a0 con 0x7f53740c6c50 2024-04-25T17:01:52.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.574+0000 7f53790d1640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f53740c6c50 0x7f53740c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:52.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.574+0000 7f5373fff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f53740c8300 0x7f537415abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50592/0 (socket says 172.21.15.59:50592) 2024-04-25T17:01:52.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.574+0000 7f5373fff640 1 -- 172.21.15.59:0/181465342 learned_addr learned my addr 172.21.15.59:0/181465342 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T17:01:52.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.577+0000 7f53737fe640 1 -- 172.21.15.59:0/181465342 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3507820828 0 0) 0x7f53740c89e0 con 0x7f53740c8300 2024-04-25T17:01:52.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.577+0000 7f53737fe640 1 -- 172.21.15.59:0/181465342 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5364003520 con 0x7f53740c8300 2024-04-25T17:01:52.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.577+0000 7f53790d1640 1 -- 172.21.15.59:0/181465342 >> v1:172.21.15.64:6789/0 conn(0x7f537406c930 legacy=0x7f53741544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:52.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.577+0000 7f53790d1640 1 -- 172.21.15.59:0/181465342 >> v1:172.21.15.59:6789/0 conn(0x7f53740c8300 legacy=0x7f537415abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:52.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.577+0000 7f53790d1640 1 -- 172.21.15.59:0/181465342 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537415a400 con 0x7f53740c6c50 2024-04-25T17:01:52.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.580+0000 7f53790d1640 1 --2- 172.21.15.59:0/181465342 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53740c6c50 0x7f53740c7060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f536c009d90 tx=0x7f536c02a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3276134a82016a18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:52.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.584+0000 7f53737fe640 1 -- 172.21.15.59:0/181465342 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c007740 con 0x7f53740c6c50 2024-04-25T17:01:52.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.585+0000 7f53737fe640 1 -- 172.21.15.59:0/181465342 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f536c0078e0 con 0x7f53740c6c50 2024-04-25T17:01:52.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.585+0000 7f53737fe640 1 -- 172.21.15.59:0/181465342 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c007cb0 con 0x7f53740c6c50 2024-04-25T17:01:52.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.585+0000 7f537ab34640 1 -- 172.21.15.59:0/181465342 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53740c6c50 msgr2=0x7f53740c7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:52.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.585+0000 7f537ab34640 1 --2- 172.21.15.59:0/181465342 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53740c6c50 0x7f53740c7060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f536c009d90 tx=0x7f536c02a730 comp rx=0 tx=0).stop 2024-04-25T17:01:52.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.585+0000 7f537ab34640 1 -- 172.21.15.59:0/181465342 shutdown_connections 2024-04-25T17:01:52.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.585+0000 7f537ab34640 1 --2- 172.21.15.59:0/181465342 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53740c6c50 0x7f53740c7060 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:52.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.585+0000 7f537ab34640 1 -- 172.21.15.59:0/181465342 >> 172.21.15.59:0/181465342 conn(0x7f537406f1c0 msgr2=0x7f537406f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:52.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.586+0000 7f537ab34640 1 -- 172.21.15.59:0/181465342 shutdown_connections 2024-04-25T17:01:52.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.586+0000 7f537ab34640 1 -- 172.21.15.59:0/181465342 wait complete. 2024-04-25T17:01:52.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.587+0000 7f537ab34640 1 Processor -- start 2024-04-25T17:01:52.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.587+0000 7f537ab34640 1 -- start start 2024-04-25T17:01:52.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.589+0000 7f537ab34640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f537406c930 0x7f53741502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:52.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.589+0000 7f537ab34640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53740c6c50 0x7f5374142af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:52.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.589+0000 7f537ab34640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53740c8300 0x7f53740cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:52.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.589+0000 7f537ab34640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53740cad30 con 0x7f53740c8300 2024-04-25T17:01:52.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.589+0000 7f537ab34640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f53740caa50 con 0x7f53740c6c50 2024-04-25T17:01:52.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.589+0000 7f537ab34640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f537415a6c0 con 0x7f537406c930 2024-04-25T17:01:52.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.589+0000 7f53790d1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53740c8300 0x7f53740cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:52.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.589+0000 7f53788d0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f537406c930 0x7f53741502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:52.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.590+0000 7f5373fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53740c6c50 0x7f5374142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:52.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.590+0000 7f53790d1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53740c8300 0x7f53740cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51290/0 (socket says 172.21.15.59:51290) 2024-04-25T17:01:52.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.590+0000 7f53790d1640 1 -- 172.21.15.59:0/1975480177 learned_addr learned my addr 172.21.15.59:0/1975480177 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:52.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.594+0000 7f53790d1640 1 -- 172.21.15.59:0/1975480177 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f537406c930 msgr2=0x7f53741502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:52.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.594+0000 7f53790d1640 1 --2- 172.21.15.59:0/1975480177 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f537406c930 0x7f53741502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:52.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.594+0000 7f53790d1640 1 -- 172.21.15.59:0/1975480177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53740c6c50 msgr2=0x7f5374142af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:52.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.594+0000 7f53790d1640 1 --2- 172.21.15.59:0/1975480177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53740c6c50 0x7f5374142af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:52.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.594+0000 7f53790d1640 1 -- 172.21.15.59:0/1975480177 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5374150830 con 0x7f53740c8300 2024-04-25T17:01:52.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.596+0000 7f53790d1640 1 --2- 172.21.15.59:0/1975480177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53740c8300 0x7f53740cc5b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f536c009eb0 tx=0x7f536c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:52.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.600+0000 7f53717fa640 1 -- 172.21.15.59:0/1975480177 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c040070 con 0x7f53740c8300 2024-04-25T17:01:52.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.600+0000 7f53717fa640 1 -- 172.21.15.59:0/1975480177 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f536c031b40 con 0x7f53740c8300 2024-04-25T17:01:52.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.600+0000 7f537ab34640 1 -- 172.21.15.59:0/1975480177 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f537414fe10 con 0x7f53740c8300 2024-04-25T17:01:52.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.600+0000 7f53717fa640 1 -- 172.21.15.59:0/1975480177 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c03c420 con 0x7f53740c8300 2024-04-25T17:01:52.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.600+0000 7f537ab34640 1 -- 172.21.15.59:0/1975480177 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53741435e0 con 0x7f53740c8300 2024-04-25T17:01:52.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.601+0000 7f537ab34640 1 -- 172.21.15.59:0/1975480177 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f53740699b0 con 0x7f53740c8300 2024-04-25T17:01:52.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.625+0000 7f53717fa640 1 -- 172.21.15.59:0/1975480177 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f536c039040 con 0x7f53740c8300 2024-04-25T17:01:52.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.625+0000 7f53717fa640 1 --2- 172.21.15.59:0/1975480177 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5358074500 0x7f5358076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:52.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.626+0000 7f53788d0640 1 --2- 172.21.15.59:0/1975480177 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5358074500 0x7f5358076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:52.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.626+0000 7f53788d0640 1 --2- 172.21.15.59:0/1975480177 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5358074500 0x7f5358076a10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5368006fd0 tx=0x7f5368009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:52.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.629+0000 7f53717fa640 1 -- 172.21.15.59:0/1975480177 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f536c007840 con 0x7f53740c8300 2024-04-25T17:01:52.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.629+0000 7f53717fa640 1 --2- 172.21.15.59:0/1975480177 >> [v2:172.21.15.64:6816/2206186554,v1:172.21.15.64:6817/2206186554] conn(0x7f535807c8d0 0x7f535807eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:52.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.629+0000 7f53717fa640 1 -- 172.21.15.59:0/1975480177 --> [v2:172.21.15.64:6816/2206186554,v1:172.21.15.64:6817/2206186554] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f536c03ae90 con 0x7f535807c8d0 2024-04-25T17:01:52.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.630+0000 7f5373fff640 1 --2- 172.21.15.59:0/1975480177 >> [v2:172.21.15.64:6816/2206186554,v1:172.21.15.64:6817/2206186554] conn(0x7f535807c8d0 0x7f535807eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:52.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.630+0000 7f5373fff640 1 --2- 172.21.15.59:0/1975480177 >> [v2:172.21.15.64:6816/2206186554,v1:172.21.15.64:6817/2206186554] conn(0x7f535807c8d0 0x7f535807eda0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:52.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.631+0000 7f53717fa640 1 -- 172.21.15.59:0/1975480177 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f536c07d050 con 0x7f53740c8300 2024-04-25T17:01:52.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.631+0000 7f53717fa640 1 -- 172.21.15.59:0/1975480177 <== osd.4 v2:172.21.15.64:6816/2206186554 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f536c03ae90 con 0x7f535807c8d0 2024-04-25T17:01:52.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.644+0000 7f537ab34640 1 -- 172.21.15.59:0/1975480177 --> [v2:172.21.15.64:6816/2206186554,v1:172.21.15.64:6817/2206186554] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f537414b080 con 0x7f535807c8d0 2024-04-25T17:01:52.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.645+0000 7f53717fa640 1 -- 172.21.15.59:0/1975480177 <== osd.4 v2:172.21.15.64:6816/2206186554 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f537414b080 con 0x7f535807c8d0 2024-04-25T17:01:52.643 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T17:01:52.643 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T17:01:52.643 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T17:01:52.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.645+0000 7f537ab34640 1 -- 172.21.15.59:0/1975480177 >> [v2:172.21.15.64:6816/2206186554,v1:172.21.15.64:6817/2206186554] conn(0x7f535807c8d0 msgr2=0x7f535807eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:52.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.645+0000 7f537ab34640 1 --2- 172.21.15.59:0/1975480177 >> [v2:172.21.15.64:6816/2206186554,v1:172.21.15.64:6817/2206186554] conn(0x7f535807c8d0 0x7f535807eda0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:52.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.645+0000 7f537ab34640 1 -- 172.21.15.59:0/1975480177 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5358074500 msgr2=0x7f5358076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:52.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.645+0000 7f537ab34640 1 --2- 172.21.15.59:0/1975480177 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5358074500 0x7f5358076a10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5368006fd0 tx=0x7f5368009060 comp rx=0 tx=0).stop 2024-04-25T17:01:52.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.645+0000 7f537ab34640 1 -- 172.21.15.59:0/1975480177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53740c8300 msgr2=0x7f53740cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:52.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.645+0000 7f537ab34640 1 --2- 172.21.15.59:0/1975480177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53740c8300 0x7f53740cc5b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f536c009eb0 tx=0x7f536c004a40 comp rx=0 tx=0).stop 2024-04-25T17:01:52.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.645+0000 7f53790d1640 1 -- 172.21.15.59:0/1975480177 reap_dead start 2024-04-25T17:01:52.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.645+0000 7f537ab34640 1 -- 172.21.15.59:0/1975480177 shutdown_connections 2024-04-25T17:01:52.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.645+0000 7f537ab34640 1 -- 172.21.15.59:0/1975480177 >> 172.21.15.59:0/1975480177 conn(0x7f537406f1c0 msgr2=0x7f537415dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:52.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.645+0000 7f537ab34640 1 -- 172.21.15.59:0/1975480177 shutdown_connections 2024-04-25T17:01:52.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.645+0000 7f537ab34640 1 -- 172.21.15.59:0/1975480177 wait complete. 2024-04-25T17:01:52.655 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T17:01:52.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.771+0000 7fc995b1c640 1 Processor -- start 2024-04-25T17:01:52.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.771+0000 7fc995b1c640 1 -- start start 2024-04-25T17:01:52.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.772+0000 7fc995b1c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc990160730 0x7fc9900ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:52.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.772+0000 7fc995b1c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc9900ce8e0 0x7fc9900b5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:52.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.772+0000 7fc995b1c640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc99015c8c0 con 0x7fc9900b47a0 2024-04-25T17:01:52.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.772+0000 7fc995b1c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fc9900b4bb0 con 0x7fc9900ce8e0 2024-04-25T17:01:52.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.772+0000 7fc995b1c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fc9900cd070 con 0x7fc990160730 2024-04-25T17:01:52.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.773+0000 7fc98f7fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc9900b47a0 0x7fc9900cc960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50594/0 (socket says 172.21.15.59:50594) 2024-04-25T17:01:52.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.773+0000 7fc98f7fe640 1 -- 172.21.15.59:0/4135938068 learned_addr learned my addr 172.21.15.59:0/4135938068 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T17:01:52.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.773+0000 7fc98effd640 1 --2- 172.21.15.59:0/4135938068 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc990160730 0x7fc9900ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:52.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.773+0000 7fc98ffff640 1 --2- 172.21.15.59:0/4135938068 >> v2:172.21.15.64:3300/0 conn(0x7fc9900ce8e0 0x7fc9900b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:52.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.776+0000 7fc98e7fc640 1 -- 172.21.15.59:0/4135938068 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 497519535 0 0) 0x7fc99015c8c0 con 0x7fc9900b47a0 2024-04-25T17:01:52.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.776+0000 7fc98e7fc640 1 -- 172.21.15.59:0/4135938068 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc978003520 con 0x7fc9900b47a0 2024-04-25T17:01:52.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.776+0000 7fc98effd640 1 -- 172.21.15.59:0/4135938068 >> v2:172.21.15.64:3300/0 conn(0x7fc9900ce8e0 msgr2=0x7fc9900b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:52.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.776+0000 7fc98effd640 1 --2- 172.21.15.59:0/4135938068 >> v2:172.21.15.64:3300/0 conn(0x7fc9900ce8e0 0x7fc9900b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:52.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.776+0000 7fc98effd640 1 -- 172.21.15.59:0/4135938068 >> v1:172.21.15.59:6789/0 conn(0x7fc9900b47a0 legacy=0x7fc9900cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:52.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.776+0000 7fc98effd640 1 -- 172.21.15.59:0/4135938068 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99015cba0 con 0x7fc990160730 2024-04-25T17:01:52.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.778+0000 7fc98effd640 1 --2- 172.21.15.59:0/4135938068 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc990160730 0x7fc9900ce3a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc9840097a0 tx=0x7fc98402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efb080d59af64636 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:52.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.782+0000 7fc98e7fc640 1 -- 172.21.15.59:0/4135938068 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984037070 con 0x7fc990160730 2024-04-25T17:01:52.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.782+0000 7fc98e7fc640 1 -- 172.21.15.59:0/4135938068 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc98402ae50 con 0x7fc990160730 2024-04-25T17:01:52.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.782+0000 7fc98e7fc640 1 -- 172.21.15.59:0/4135938068 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984032660 con 0x7fc990160730 2024-04-25T17:01:52.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.783+0000 7fc995b1c640 1 -- 172.21.15.59:0/4135938068 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc990160730 msgr2=0x7fc9900ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:52.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.783+0000 7fc995b1c640 1 --2- 172.21.15.59:0/4135938068 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc990160730 0x7fc9900ce3a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc9840097a0 tx=0x7fc98402a100 comp rx=0 tx=0).stop 2024-04-25T17:01:52.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.783+0000 7fc995b1c640 1 -- 172.21.15.59:0/4135938068 shutdown_connections 2024-04-25T17:01:52.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.783+0000 7fc995b1c640 1 --2- 172.21.15.59:0/4135938068 >> v2:172.21.15.64:3300/0 conn(0x7fc9900ce8e0 0x7fc9900b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:52.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.783+0000 7fc995b1c640 1 --2- 172.21.15.59:0/4135938068 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc990160730 0x7fc9900ce3a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:52.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.783+0000 7fc995b1c640 1 -- 172.21.15.59:0/4135938068 >> 172.21.15.59:0/4135938068 conn(0x7fc9900684e0 msgr2=0x7fc9900688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:52.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.783+0000 7fc995b1c640 1 -- 172.21.15.59:0/4135938068 shutdown_connections 2024-04-25T17:01:52.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.783+0000 7fc995b1c640 1 -- 172.21.15.59:0/4135938068 wait complete. 2024-04-25T17:01:52.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.784+0000 7fc995b1c640 1 Processor -- start 2024-04-25T17:01:52.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.785+0000 7fc995b1c640 1 -- start start 2024-04-25T17:01:52.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.786+0000 7fc995b1c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc9900b47a0 0x7fc9901f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:52.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.786+0000 7fc995b1c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9900ce8e0 0x7fc9901f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:52.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.786+0000 7fc995b1c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc990160730 0x7fc9901e9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:52.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.786+0000 7fc995b1c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc99015d440 con 0x7fc9900ce8e0 2024-04-25T17:01:52.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.786+0000 7fc995b1c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fc99015d160 con 0x7fc990160730 2024-04-25T17:01:52.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.786+0000 7fc995b1c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fc990160b40 con 0x7fc9900b47a0 2024-04-25T17:01:52.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.786+0000 7fc98effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9900ce8e0 0x7fc9901f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:52.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.787+0000 7fc98f7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc9900b47a0 0x7fc9901f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:52.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.787+0000 7fc98ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc990160730 0x7fc9901e9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:52.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.787+0000 7fc98effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9900ce8e0 0x7fc9901f2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51294/0 (socket says 172.21.15.59:51294) 2024-04-25T17:01:52.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.787+0000 7fc98effd640 1 -- 172.21.15.59:0/869732312 learned_addr learned my addr 172.21.15.59:0/869732312 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:52.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.791+0000 7fc98ffff640 1 -- 172.21.15.59:0/869732312 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc9900b47a0 msgr2=0x7fc9901f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:52.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.791+0000 7fc98ffff640 1 --2- 172.21.15.59:0/869732312 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc9900b47a0 0x7fc9901f66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:52.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.791+0000 7fc98ffff640 1 -- 172.21.15.59:0/869732312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9900ce8e0 msgr2=0x7fc9901f2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:52.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.791+0000 7fc98ffff640 1 --2- 172.21.15.59:0/869732312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9900ce8e0 0x7fc9901f2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:52.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.791+0000 7fc98ffff640 1 -- 172.21.15.59:0/869732312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9901f34d0 con 0x7fc990160730 2024-04-25T17:01:52.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.791+0000 7fc98f7fe640 1 --2- 172.21.15.59:0/869732312 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc9900b47a0 0x7fc9901f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:01:52.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.794+0000 7fc98ffff640 1 --2- 172.21.15.59:0/869732312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc990160730 0x7fc9901e9120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc98800eba0 tx=0x7fc98800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:52.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.800+0000 7fc977fff640 1 -- 172.21.15.59:0/869732312 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc988018020 con 0x7fc990160730 2024-04-25T17:01:52.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.800+0000 7fc977fff640 1 -- 172.21.15.59:0/869732312 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc98800cd20 con 0x7fc990160730 2024-04-25T17:01:52.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.800+0000 7fc977fff640 1 -- 172.21.15.59:0/869732312 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9880146c0 con 0x7fc990160730 2024-04-25T17:01:52.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.800+0000 7fc995b1c640 1 -- 172.21.15.59:0/869732312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc99015b210 con 0x7fc990160730 2024-04-25T17:01:52.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.800+0000 7fc995b1c640 1 -- 172.21.15.59:0/869732312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9900c9650 con 0x7fc990160730 2024-04-25T17:01:52.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.801+0000 7fc995b1c640 1 -- 172.21.15.59:0/869732312 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9900c90e0 con 0x7fc990160730 2024-04-25T17:01:52.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.825+0000 7fc977fff640 1 -- 172.21.15.59:0/869732312 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc988005d10 con 0x7fc990160730 2024-04-25T17:01:53.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.826+0000 7fc977fff640 1 --2- 172.21.15.59:0/869732312 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc97c074500 0x7fc97c076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:53.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.826+0000 7fc98f7fe640 1 --2- 172.21.15.59:0/869732312 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc97c074500 0x7fc97c076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:53.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.826+0000 7fc98f7fe640 1 --2- 172.21.15.59:0/869732312 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc97c074500 0x7fc97c076a10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc980005880 tx=0x7fc980009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:53.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:52.830+0000 7fc977fff640 1 -- 172.21.15.59:0/869732312 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fc98805c7a0 con 0x7fc990160730 2024-04-25T17:01:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.115+0000 7fc977fff640 1 -- 172.21.15.59:0/869732312 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc988022030 con 0x7fc990160730 2024-04-25T17:01:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.328+0000 7fc995b1c640 1 -- 172.21.15.59:0/869732312 --> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fc9901f36a0 con 0x7fc97c074500 2024-04-25T17:01:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.328+0000 7fc977fff640 1 -- 172.21.15.59:0/869732312 <== mgr.4102 v2:172.21.15.59:6800/2368090706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc9901f36a0 con 0x7fc97c074500 2024-04-25T17:01:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T17:01:53.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.330+0000 7fc995b1c640 1 -- 172.21.15.59:0/869732312 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc97c074500 msgr2=0x7fc97c076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.330+0000 7fc995b1c640 1 --2- 172.21.15.59:0/869732312 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc97c074500 0x7fc97c076a10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc980005880 tx=0x7fc980009040 comp rx=0 tx=0).stop 2024-04-25T17:01:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.330+0000 7fc995b1c640 1 -- 172.21.15.59:0/869732312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc990160730 msgr2=0x7fc9901e9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.330+0000 7fc995b1c640 1 --2- 172.21.15.59:0/869732312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc990160730 0x7fc9901e9120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc98800eba0 tx=0x7fc98800c490 comp rx=0 tx=0).stop 2024-04-25T17:01:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.330+0000 7fc995b1c640 1 -- 172.21.15.59:0/869732312 shutdown_connections 2024-04-25T17:01:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.330+0000 7fc995b1c640 1 --2- 172.21.15.59:0/869732312 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fc97c074500 0x7fc97c076a10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.330+0000 7fc995b1c640 1 --2- 172.21.15.59:0/869732312 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc990160730 0x7fc9901e9120 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.330+0000 7fc995b1c640 1 --2- 172.21.15.59:0/869732312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9900ce8e0 0x7fc9901f2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.330+0000 7fc995b1c640 1 --2- 172.21.15.59:0/869732312 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc9900b47a0 0x7fc9901f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.330+0000 7fc995b1c640 1 -- 172.21.15.59:0/869732312 >> 172.21.15.59:0/869732312 conn(0x7fc9900684e0 msgr2=0x7fc99015bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.330+0000 7fc995b1c640 1 -- 172.21.15.59:0/869732312 shutdown_connections 2024-04-25T17:01:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.330+0000 7fc995b1c640 1 -- 172.21.15.59:0/869732312 wait complete. 2024-04-25T17:01:53.340 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T17:01:53.340 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T17:01:53.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.459+0000 7ff6e90f2640 1 Processor -- start 2024-04-25T17:01:53.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.460+0000 7ff6e90f2640 1 -- start start 2024-04-25T17:01:53.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.461+0000 7ff6e90f2640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6e4156770 0x7ff6e415d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:53.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.461+0000 7ff6e90f2640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff6e40cd2f0 0x7ff6e40cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:53.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.461+0000 7ff6e90f2640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e415fd30 con 0x7ff6e40cc5b0 2024-04-25T17:01:53.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.461+0000 7ff6e90f2640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e415ffd0 con 0x7ff6e4156770 2024-04-25T17:01:53.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.461+0000 7ff6e90f2640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e41602b0 con 0x7ff6e40cd2f0 2024-04-25T17:01:53.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.461+0000 7ff6e2d9d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6e4156770 0x7ff6e415d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:53.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.462+0000 7ff6e259c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff6e40cd2f0 0x7ff6e40cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:53.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.462+0000 7ff6e2d9d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6e4156770 0x7ff6e415d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51300/0 (socket says 172.21.15.59:51300) 2024-04-25T17:01:53.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.462+0000 7ff6e2d9d640 1 -- 172.21.15.59:0/2085586470 learned_addr learned my addr 172.21.15.59:0/2085586470 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:53.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.465+0000 7ff6e259c640 1 -- 172.21.15.59:0/2085586470 >> v2:172.21.15.59:3300/0 conn(0x7ff6e4156770 msgr2=0x7ff6e415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:53.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.465+0000 7ff6e259c640 1 --2- 172.21.15.59:0/2085586470 >> v2:172.21.15.59:3300/0 conn(0x7ff6e4156770 0x7ff6e415d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:53.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.465+0000 7ff6e259c640 1 -- 172.21.15.59:0/2085586470 >> v1:172.21.15.59:6789/0 conn(0x7ff6e40cc5b0 legacy=0x7ff6e40c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:53.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.465+0000 7ff6e259c640 1 -- 172.21.15.59:0/2085586470 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e4160590 con 0x7ff6e40cd2f0 2024-04-25T17:01:53.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.467+0000 7ff6e259c640 1 --2- 172.21.15.59:0/2085586470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6e40cd2f0 0x7ff6e40cd700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff6e408f070 tx=0x7ff6cc02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a583782d1e827af9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:53.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.471+0000 7ff6e1d9b640 1 -- 172.21.15.59:0/2085586470 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc037070 con 0x7ff6e40cd2f0 2024-04-25T17:01:53.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.471+0000 7ff6e1d9b640 1 -- 172.21.15.59:0/2085586470 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6cc032440 con 0x7ff6e40cd2f0 2024-04-25T17:01:53.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.471+0000 7ff6e1d9b640 1 -- 172.21.15.59:0/2085586470 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc032810 con 0x7ff6e40cd2f0 2024-04-25T17:01:53.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.472+0000 7ff6e90f2640 1 -- 172.21.15.59:0/2085586470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6e40cd2f0 msgr2=0x7ff6e40cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:53.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.472+0000 7ff6e90f2640 1 --2- 172.21.15.59:0/2085586470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6e40cd2f0 0x7ff6e40cd700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff6e408f070 tx=0x7ff6cc02a1e0 comp rx=0 tx=0).stop 2024-04-25T17:01:53.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.472+0000 7ff6e90f2640 1 -- 172.21.15.59:0/2085586470 shutdown_connections 2024-04-25T17:01:53.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.472+0000 7ff6e90f2640 1 --2- 172.21.15.59:0/2085586470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6e40cd2f0 0x7ff6e40cd700 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:53.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.472+0000 7ff6e90f2640 1 --2- 172.21.15.59:0/2085586470 >> v2:172.21.15.59:3300/0 conn(0x7ff6e4156770 0x7ff6e415d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:53.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.472+0000 7ff6e90f2640 1 -- 172.21.15.59:0/2085586470 >> 172.21.15.59:0/2085586470 conn(0x7ff6e40684e0 msgr2=0x7ff6e40688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:53.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.472+0000 7ff6e90f2640 1 -- 172.21.15.59:0/2085586470 shutdown_connections 2024-04-25T17:01:53.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.472+0000 7ff6e90f2640 1 -- 172.21.15.59:0/2085586470 wait complete. 2024-04-25T17:01:53.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.474+0000 7ff6e90f2640 1 Processor -- start 2024-04-25T17:01:53.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.474+0000 7ff6e90f2640 1 -- start start 2024-04-25T17:01:53.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.475+0000 7ff6e90f2640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff6e40cc5b0 0x7ff6e415b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:53.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.475+0000 7ff6e90f2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6e40cd2f0 0x7ff6e41474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:53.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.475+0000 7ff6e90f2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6e4156770 0x7ff6e41479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:53.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.475+0000 7ff6e90f2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e40c7cc0 con 0x7ff6e40cd2f0 2024-04-25T17:01:53.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.475+0000 7ff6e90f2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e40c7b40 con 0x7ff6e4156770 2024-04-25T17:01:53.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.475+0000 7ff6e90f2640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e4158500 con 0x7ff6e40cc5b0 2024-04-25T17:01:53.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.476+0000 7ff6e259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6e40cd2f0 0x7ff6e41474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:53.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.476+0000 7ff6e359e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6e4156770 0x7ff6e41479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:53.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.476+0000 7ff6e259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6e40cd2f0 0x7ff6e41474a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51316/0 (socket says 172.21.15.59:51316) 2024-04-25T17:01:53.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.476+0000 7ff6e259c640 1 -- 172.21.15.59:0/635380642 learned_addr learned my addr 172.21.15.59:0/635380642 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:53.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.476+0000 7ff6e2d9d640 1 --2- 172.21.15.59:0/635380642 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff6e40cc5b0 0x7ff6e415b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:53.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.480+0000 7ff6e259c640 1 -- 172.21.15.59:0/635380642 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff6e40cc5b0 msgr2=0x7ff6e415b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:53.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.480+0000 7ff6e259c640 1 --2- 172.21.15.59:0/635380642 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff6e40cc5b0 0x7ff6e415b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:53.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.480+0000 7ff6e259c640 1 -- 172.21.15.59:0/635380642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6e4156770 msgr2=0x7ff6e41479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:53.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.480+0000 7ff6e259c640 1 --2- 172.21.15.59:0/635380642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6e4156770 0x7ff6e41479e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:53.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.480+0000 7ff6e259c640 1 -- 172.21.15.59:0/635380642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e415d820 con 0x7ff6e40cd2f0 2024-04-25T17:01:53.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.480+0000 7ff6e359e640 1 --2- 172.21.15.59:0/635380642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6e4156770 0x7ff6e41479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:01:53.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.483+0000 7ff6e259c640 1 --2- 172.21.15.59:0/635380642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6e40cd2f0 0x7ff6e41474a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc000c00 tx=0x7ff6cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:53.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.487+0000 7ff6db7fe640 1 -- 172.21.15.59:0/635380642 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc037040 con 0x7ff6e40cd2f0 2024-04-25T17:01:53.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.487+0000 7ff6db7fe640 1 -- 172.21.15.59:0/635380642 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6cc042070 con 0x7ff6e40cd2f0 2024-04-25T17:01:53.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.487+0000 7ff6db7fe640 1 -- 172.21.15.59:0/635380642 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0308a0 con 0x7ff6e40cd2f0 2024-04-25T17:01:53.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.487+0000 7ff6e90f2640 1 -- 172.21.15.59:0/635380642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e415db00 con 0x7ff6e40cd2f0 2024-04-25T17:01:53.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.487+0000 7ff6e90f2640 1 -- 172.21.15.59:0/635380642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e415c3e0 con 0x7ff6e40cd2f0 2024-04-25T17:01:53.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.488+0000 7ff6e90f2640 1 -- 172.21.15.59:0/635380642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff6e41f40c0 con 0x7ff6e40cd2f0 2024-04-25T17:01:53.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.516+0000 7ff6db7fe640 1 -- 172.21.15.59:0/635380642 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff6cc030a40 con 0x7ff6e40cd2f0 2024-04-25T17:01:53.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.517+0000 7ff6db7fe640 1 --2- 172.21.15.59:0/635380642 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ff6c4074500 0x7ff6c4076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:53.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.517+0000 7ff6e2d9d640 1 --2- 172.21.15.59:0/635380642 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ff6c4074500 0x7ff6c4076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:53.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.517+0000 7ff6e2d9d640 1 --2- 172.21.15.59:0/635380642 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ff6c4074500 0x7ff6c4076a10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc009b30 tx=0x7ff6dc009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:53.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.521+0000 7ff6db7fe640 1 -- 172.21.15.59:0/635380642 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7ff6cc030d30 con 0x7ff6e40cd2f0 2024-04-25T17:01:53.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.521+0000 7ff6db7fe640 1 --2- 172.21.15.59:0/635380642 >> [v2:172.21.15.64:6824/639697697,v1:172.21.15.64:6825/639697697] conn(0x7ff6c407c8d0 0x7ff6c407eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:53.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.521+0000 7ff6db7fe640 1 -- 172.21.15.59:0/635380642 --> [v2:172.21.15.64:6824/639697697,v1:172.21.15.64:6825/639697697] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6cc041ec0 con 0x7ff6c407c8d0 2024-04-25T17:01:53.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.521+0000 7ff6db7fe640 1 -- 172.21.15.59:0/635380642 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff6cc07cc60 con 0x7ff6e40cd2f0 2024-04-25T17:01:53.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.522+0000 7ff6e359e640 1 --2- 172.21.15.59:0/635380642 >> [v2:172.21.15.64:6824/639697697,v1:172.21.15.64:6825/639697697] conn(0x7ff6c407c8d0 0x7ff6c407eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:53.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.522+0000 7ff6e359e640 1 --2- 172.21.15.59:0/635380642 >> [v2:172.21.15.64:6824/639697697,v1:172.21.15.64:6825/639697697] conn(0x7ff6c407c8d0 0x7ff6c407eda0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:53.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.523+0000 7ff6db7fe640 1 -- 172.21.15.59:0/635380642 <== osd.5 v2:172.21.15.64:6824/639697697 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6cc041ec0 con 0x7ff6c407c8d0 2024-04-25T17:01:53.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.540+0000 7ff6e90f2640 1 -- 172.21.15.59:0/635380642 --> [v2:172.21.15.64:6824/639697697,v1:172.21.15.64:6825/639697697] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff6e4147f20 con 0x7ff6c407c8d0 2024-04-25T17:01:53.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.541+0000 7ff6db7fe640 1 -- 172.21.15.59:0/635380642 <== osd.5 v2:172.21.15.64:6824/639697697 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff6e4147f20 con 0x7ff6c407c8d0 2024-04-25T17:01:53.539 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T17:01:53.539 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T17:01:53.539 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T17:01:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.541+0000 7ff6e90f2640 1 -- 172.21.15.59:0/635380642 >> [v2:172.21.15.64:6824/639697697,v1:172.21.15.64:6825/639697697] conn(0x7ff6c407c8d0 msgr2=0x7ff6c407eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.541+0000 7ff6e90f2640 1 --2- 172.21.15.59:0/635380642 >> [v2:172.21.15.64:6824/639697697,v1:172.21.15.64:6825/639697697] conn(0x7ff6c407c8d0 0x7ff6c407eda0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.541+0000 7ff6e90f2640 1 -- 172.21.15.59:0/635380642 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ff6c4074500 msgr2=0x7ff6c4076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.541+0000 7ff6e90f2640 1 --2- 172.21.15.59:0/635380642 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7ff6c4074500 0x7ff6c4076a10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc009b30 tx=0x7ff6dc009240 comp rx=0 tx=0).stop 2024-04-25T17:01:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.541+0000 7ff6e90f2640 1 -- 172.21.15.59:0/635380642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6e40cd2f0 msgr2=0x7ff6e41474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.541+0000 7ff6e90f2640 1 --2- 172.21.15.59:0/635380642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6e40cd2f0 0x7ff6e41474a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc000c00 tx=0x7ff6cc0046c0 comp rx=0 tx=0).stop 2024-04-25T17:01:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.541+0000 7ff6e359e640 1 -- 172.21.15.59:0/635380642 reap_dead start 2024-04-25T17:01:53.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.541+0000 7ff6e90f2640 1 -- 172.21.15.59:0/635380642 shutdown_connections 2024-04-25T17:01:53.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.541+0000 7ff6e90f2640 1 -- 172.21.15.59:0/635380642 >> 172.21.15.59:0/635380642 conn(0x7ff6e40684e0 msgr2=0x7ff6e40c7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:53.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.541+0000 7ff6e90f2640 1 -- 172.21.15.59:0/635380642 shutdown_connections 2024-04-25T17:01:53.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.541+0000 7ff6e90f2640 1 -- 172.21.15.59:0/635380642 wait complete. 2024-04-25T17:01:53.551 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T17:01:53.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.666+0000 7f45fe630640 1 Processor -- start 2024-04-25T17:01:53.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.666+0000 7f45fe630640 1 -- start start 2024-04-25T17:01:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.667+0000 7f45fe630640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f45f80c8f30 0x7f45f80cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.667+0000 7f45fe630640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f45f8153450 0x7f45f806c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.667+0000 7f45fe630640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45f8159d90 con 0x7f45f80c9400 2024-04-25T17:01:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.667+0000 7f45fe630640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f45f815a2f0 con 0x7f45f80c8f30 2024-04-25T17:01:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.667+0000 7f45fe630640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f45f815a030 con 0x7f45f8153450 2024-04-25T17:01:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.668+0000 7f45f77fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f45f80c9400 0x7f45f80c4f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50606/0 (socket says 172.21.15.59:50606) 2024-04-25T17:01:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.668+0000 7f45f77fe640 1 -- 172.21.15.59:0/4286905663 learned_addr learned my addr 172.21.15.59:0/4286905663 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T17:01:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.668+0000 7f45fcbcd640 1 --2- 172.21.15.59:0/4286905663 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f45f8153450 0x7f45f806c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.668+0000 7f45f7fff640 1 --2- 172.21.15.59:0/4286905663 >> v2:172.21.15.64:3300/0 conn(0x7f45f80c8f30 0x7f45f80cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.670+0000 7f45f6ffd640 1 -- 172.21.15.59:0/4286905663 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1225106117 0 0) 0x7f45f8159d90 con 0x7f45f80c9400 2024-04-25T17:01:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.670+0000 7f45f6ffd640 1 -- 172.21.15.59:0/4286905663 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45e0003520 con 0x7f45f80c9400 2024-04-25T17:01:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.671+0000 7f45fcbcd640 1 -- 172.21.15.59:0/4286905663 >> v2:172.21.15.64:3300/0 conn(0x7f45f80c8f30 msgr2=0x7f45f80cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.671+0000 7f45fcbcd640 1 --2- 172.21.15.59:0/4286905663 >> v2:172.21.15.64:3300/0 conn(0x7f45f80c8f30 0x7f45f80cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.671+0000 7f45fcbcd640 1 -- 172.21.15.59:0/4286905663 >> v1:172.21.15.59:6789/0 conn(0x7f45f80c9400 legacy=0x7f45f80c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.671+0000 7f45fcbcd640 1 -- 172.21.15.59:0/4286905663 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f80c8170 con 0x7f45f8153450 2024-04-25T17:01:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.673+0000 7f45fcbcd640 1 --2- 172.21.15.59:0/4286905663 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f45f8153450 0x7f45f806c580 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009d90 tx=0x7f45f002a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a358ed4bb924ef11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:53.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.677+0000 7f45f6ffd640 1 -- 172.21.15.59:0/4286905663 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0007740 con 0x7f45f8153450 2024-04-25T17:01:53.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.677+0000 7f45f6ffd640 1 -- 172.21.15.59:0/4286905663 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f00078e0 con 0x7f45f8153450 2024-04-25T17:01:53.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.677+0000 7f45f6ffd640 1 -- 172.21.15.59:0/4286905663 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0007cb0 con 0x7f45f8153450 2024-04-25T17:01:53.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.678+0000 7f45fe630640 1 -- 172.21.15.59:0/4286905663 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f45f8153450 msgr2=0x7f45f806c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:53.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.678+0000 7f45fe630640 1 --2- 172.21.15.59:0/4286905663 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f45f8153450 0x7f45f806c580 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009d90 tx=0x7f45f002a530 comp rx=0 tx=0).stop 2024-04-25T17:01:53.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.678+0000 7f45fe630640 1 -- 172.21.15.59:0/4286905663 shutdown_connections 2024-04-25T17:01:53.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.678+0000 7f45fe630640 1 --2- 172.21.15.59:0/4286905663 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f45f8153450 0x7f45f806c580 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:53.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.678+0000 7f45fe630640 1 --2- 172.21.15.59:0/4286905663 >> v2:172.21.15.64:3300/0 conn(0x7f45f80c8f30 0x7f45f80cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:53.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.678+0000 7f45fe630640 1 -- 172.21.15.59:0/4286905663 >> 172.21.15.59:0/4286905663 conn(0x7f45f8071720 msgr2=0x7f45f80ca140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:53.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.678+0000 7f45fe630640 1 -- 172.21.15.59:0/4286905663 shutdown_connections 2024-04-25T17:01:53.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.678+0000 7f45fe630640 1 -- 172.21.15.59:0/4286905663 wait complete. 2024-04-25T17:01:53.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.679+0000 7f45fe630640 1 Processor -- start 2024-04-25T17:01:53.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.680+0000 7f45fe630640 1 -- start start 2024-04-25T17:01:53.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.681+0000 7f45fe630640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f45f80c9400 0x7f45f815b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:53.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.681+0000 7f45fe630640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45f8153450 0x7f45f81ef400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:53.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.681+0000 7f45fe630640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f8153c00 0x7f45f8158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:53.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.681+0000 7f45fe630640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f45f80c8a10 con 0x7f45f8153c00 2024-04-25T17:01:53.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.681+0000 7f45fe630640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f45f80c8730 con 0x7f45f8153450 2024-04-25T17:01:53.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.681+0000 7f45fe630640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f45f80c7830 con 0x7f45f80c9400 2024-04-25T17:01:53.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.682+0000 7f45fcbcd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f8153c00 0x7f45f8158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:53.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.682+0000 7f45f7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f45f80c9400 0x7f45f815b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:53.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.682+0000 7f45f77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45f8153450 0x7f45f81ef400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:53.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.682+0000 7f45fcbcd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f8153c00 0x7f45f8158490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51328/0 (socket says 172.21.15.59:51328) 2024-04-25T17:01:53.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.682+0000 7f45fcbcd640 1 -- 172.21.15.59:0/1020835853 learned_addr learned my addr 172.21.15.59:0/1020835853 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:53.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.686+0000 7f45fcbcd640 1 -- 172.21.15.59:0/1020835853 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f45f80c9400 msgr2=0x7f45f815b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:53.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.686+0000 7f45fcbcd640 1 --2- 172.21.15.59:0/1020835853 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f45f80c9400 0x7f45f815b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:53.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.686+0000 7f45fcbcd640 1 -- 172.21.15.59:0/1020835853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45f8153450 msgr2=0x7f45f81ef400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:53.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.686+0000 7f45fcbcd640 1 --2- 172.21.15.59:0/1020835853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45f8153450 0x7f45f81ef400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:53.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.686+0000 7f45fcbcd640 1 -- 172.21.15.59:0/1020835853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f81ef940 con 0x7f45f8153c00 2024-04-25T17:01:53.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.686+0000 7f45f7fff640 1 --2- 172.21.15.59:0/1020835853 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f45f80c9400 0x7f45f815b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:01:53.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.688+0000 7f45fcbcd640 1 --2- 172.21.15.59:0/1020835853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f8153c00 0x7f45f8158490 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f45f002ab20 tx=0x7f45f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:53.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.692+0000 7f45f4ff9640 1 -- 172.21.15.59:0/1020835853 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0047070 con 0x7f45f8153c00 2024-04-25T17:01:53.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.693+0000 7f45f4ff9640 1 -- 172.21.15.59:0/1020835853 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f0039a00 con 0x7f45f8153c00 2024-04-25T17:01:53.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.693+0000 7f45fe630640 1 -- 172.21.15.59:0/1020835853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f814dfb0 con 0x7f45f8153c00 2024-04-25T17:01:53.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.693+0000 7f45f4ff9640 1 -- 172.21.15.59:0/1020835853 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0009450 con 0x7f45f8153c00 2024-04-25T17:01:53.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.693+0000 7f45fe630640 1 -- 172.21.15.59:0/1020835853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f815a6b0 con 0x7f45f8153c00 2024-04-25T17:01:53.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.694+0000 7f45fe630640 1 -- 172.21.15.59:0/1020835853 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f815c610 con 0x7f45f8153c00 2024-04-25T17:01:53.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.716+0000 7f45f4ff9640 1 -- 172.21.15.59:0/1020835853 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f45f0005d10 con 0x7f45f8153c00 2024-04-25T17:01:53.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.717+0000 7f45f4ff9640 1 --2- 172.21.15.59:0/1020835853 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f45e4074530 0x7f45e4076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:53.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.717+0000 7f45f7fff640 1 --2- 172.21.15.59:0/1020835853 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f45e4074530 0x7f45e4076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:53.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:53.717+0000 7f45f7fff640 1 --2- 172.21.15.59:0/1020835853 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f45e4074530 0x7f45e4076a40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f45e8009e80 tx=0x7f45e8009110 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:53.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.000+0000 7f45f4ff9640 1 -- 172.21.15.59:0/1020835853 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f45f0039dd0 con 0x7f45f8153c00 2024-04-25T17:01:53.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.000+0000 7f45f4ff9640 1 -- 172.21.15.59:0/1020835853 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f45f81ef940 con 0x7f45f8153c00 2024-04-25T17:01:54.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.189+0000 7f45fe630640 1 -- 172.21.15.59:0/1020835853 --> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f45f8146a30 con 0x7f45e4074530 2024-04-25T17:01:54.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.189+0000 7f45f4ff9640 1 -- 172.21.15.59:0/1020835853 <== mgr.4102 v2:172.21.15.59:6800/2368090706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f45f8146a30 con 0x7f45e4074530 2024-04-25T17:01:54.187 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T17:01:54.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.191+0000 7f45fe630640 1 -- 172.21.15.59:0/1020835853 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f45e4074530 msgr2=0x7f45e4076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:54.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.191+0000 7f45fe630640 1 --2- 172.21.15.59:0/1020835853 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f45e4074530 0x7f45e4076a40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f45e8009e80 tx=0x7f45e8009110 comp rx=0 tx=0).stop 2024-04-25T17:01:54.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.191+0000 7f45fe630640 1 -- 172.21.15.59:0/1020835853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f8153c00 msgr2=0x7f45f8158490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:54.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.191+0000 7f45fe630640 1 --2- 172.21.15.59:0/1020835853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f8153c00 0x7f45f8158490 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f45f002ab20 tx=0x7f45f0004a40 comp rx=0 tx=0).stop 2024-04-25T17:01:54.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.191+0000 7f45fe630640 1 -- 172.21.15.59:0/1020835853 shutdown_connections 2024-04-25T17:01:54.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.191+0000 7f45fe630640 1 --2- 172.21.15.59:0/1020835853 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f45e4074530 0x7f45e4076a40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:54.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.191+0000 7f45fe630640 1 --2- 172.21.15.59:0/1020835853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f8153c00 0x7f45f8158490 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:54.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.191+0000 7f45fe630640 1 --2- 172.21.15.59:0/1020835853 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45f8153450 0x7f45f81ef400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:54.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.191+0000 7f45fe630640 1 --2- 172.21.15.59:0/1020835853 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f45f80c9400 0x7f45f815b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:54.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.191+0000 7f45fe630640 1 -- 172.21.15.59:0/1020835853 >> 172.21.15.59:0/1020835853 conn(0x7f45f8071720 msgr2=0x7f45f81593a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:54.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.192+0000 7f45fe630640 1 -- 172.21.15.59:0/1020835853 shutdown_connections 2024-04-25T17:01:54.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.192+0000 7f45fe630640 1 -- 172.21.15.59:0/1020835853 wait complete. 2024-04-25T17:01:54.201 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T17:01:54.201 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T17:01:54.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.323+0000 7f2e357f8640 1 Processor -- start 2024-04-25T17:01:54.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.323+0000 7f2e357f8640 1 -- start start 2024-04-25T17:01:54.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.324+0000 7f2e357f8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2e3006e160 0x7f2e3015fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:54.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.324+0000 7f2e357f8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2e3006d690 0x7f2e300cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:54.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.324+0000 7f2e357f8640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e300c61d0 con 0x7f2e300ccc90 2024-04-25T17:01:54.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.324+0000 7f2e357f8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f2e300c64b0 con 0x7f2e3006e160 2024-04-25T17:01:54.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.324+0000 7f2e357f8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f2e300c6790 con 0x7f2e3006d690 2024-04-25T17:01:54.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.325+0000 7f2e2effd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2e3006e160 0x7f2e3015fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:54.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.326+0000 7f2e2effd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2e3006e160 0x7f2e3015fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:44076/0 (socket says 172.21.15.59:44076) 2024-04-25T17:01:54.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.326+0000 7f2e2effd640 1 -- 172.21.15.59:0/1426113950 learned_addr learned my addr 172.21.15.59:0/1426113950 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:54.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.386+0000 7f2e2e7fc640 1 --2- 172.21.15.59:0/1426113950 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2e3006d690 0x7f2e300cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:54.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.389+0000 7f2e2dffb640 1 -- 172.21.15.59:0/1426113950 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4089810598 0 0) 0x7f2e300c61d0 con 0x7f2e300ccc90 2024-04-25T17:01:54.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.389+0000 7f2e2dffb640 1 -- 172.21.15.59:0/1426113950 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e18003520 con 0x7f2e300ccc90 2024-04-25T17:01:54.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.394+0000 7f2e2dffb640 1 -- 172.21.15.59:0/1426113950 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 961657845 0 0) 0x7f2e18003520 con 0x7f2e300ccc90 2024-04-25T17:01:54.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.394+0000 7f2e2dffb640 1 -- 172.21.15.59:0/1426113950 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2e3006d690 msgr2=0x7f2e300cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:54.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.394+0000 7f2e2dffb640 1 --2- 172.21.15.59:0/1426113950 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2e3006d690 0x7f2e300cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:54.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.394+0000 7f2e2dffb640 1 -- 172.21.15.59:0/1426113950 >> v2:172.21.15.64:3300/0 conn(0x7f2e3006e160 msgr2=0x7f2e3015fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:54.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.394+0000 7f2e2dffb640 1 --2- 172.21.15.59:0/1426113950 >> v2:172.21.15.64:3300/0 conn(0x7f2e3006e160 0x7f2e3015fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:54.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.394+0000 7f2e2dffb640 1 -- 172.21.15.59:0/1426113950 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e300cc1b0 con 0x7f2e300ccc90 2024-04-25T17:01:54.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.394+0000 7f2e2dffb640 1 -- 172.21.15.59:0/1426113950 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 763030806 0 0) 0x7f2e280019f0 con 0x7f2e300ccc90 2024-04-25T17:01:54.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.394+0000 7f2e2dffb640 1 -- 172.21.15.59:0/1426113950 >> v1:172.21.15.59:6789/0 conn(0x7f2e300ccc90 legacy=0x7f2e301563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:54.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.394+0000 7f2e2dffb640 1 --2- 172.21.15.59:0/1426113950 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2e3006d690 0x7f2e180039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:54.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.394+0000 7f2e2dffb640 1 --2- 172.21.15.59:0/1426113950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e18003f80 0x7f2e18004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:54.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.394+0000 7f2e2dffb640 1 --2- 172.21.15.59:0/1426113950 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e18004d40 0x7f2e18005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:54.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.394+0000 7f2e2dffb640 1 -- 172.21.15.59:0/1426113950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2e300c64b0 con 0x7f2e18003f80 2024-04-25T17:01:54.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.394+0000 7f2e2dffb640 1 -- 172.21.15.59:0/1426113950 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2e300c6790 con 0x7f2e18004d40 2024-04-25T17:01:54.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.394+0000 7f2e2dffb640 1 -- 172.21.15.59:0/1426113950 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f2e1800baf0 con 0x7f2e3006d690 2024-04-25T17:01:54.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.401+0000 7f2e2effd640 1 --2- 172.21.15.59:0/1426113950 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2e3006d690 0x7f2e180039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:54.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.404+0000 7f2e2effd640 1 -- 172.21.15.59:0/1426113950 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e18004d40 msgr2=0x7f2e18005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.404+0000 7f2e2effd640 1 --2- 172.21.15.59:0/1426113950 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e18004d40 0x7f2e18005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.404+0000 7f2e2effd640 1 -- 172.21.15.59:0/1426113950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e18003f80 msgr2=0x7f2e18004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.404+0000 7f2e2effd640 1 --2- 172.21.15.59:0/1426113950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e18003f80 0x7f2e18004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.404+0000 7f2e2effd640 1 -- 172.21.15.59:0/1426113950 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e18003520 con 0x7f2e3006d690 2024-04-25T17:01:54.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.406+0000 7f2e2effd640 1 --2- 172.21.15.59:0/1426113950 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2e3006d690 0x7f2e180039b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009c10 tx=0x7f2e18005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ebcfb53373dd8d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:54.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.413+0000 7f2e2dffb640 1 -- 172.21.15.59:0/1426113950 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e20036070 con 0x7f2e3006d690 2024-04-25T17:01:54.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.413+0000 7f2e2dffb640 1 -- 172.21.15.59:0/1426113950 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e20031400 con 0x7f2e3006d690 2024-04-25T17:01:54.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.413+0000 7f2e2dffb640 1 -- 172.21.15.59:0/1426113950 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e200097e0 con 0x7f2e3006d690 2024-04-25T17:01:54.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.414+0000 7f2e357f8640 1 -- 172.21.15.59:0/1426113950 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2e3006d690 msgr2=0x7f2e180039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:54.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.414+0000 7f2e357f8640 1 --2- 172.21.15.59:0/1426113950 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2e3006d690 0x7f2e180039b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009c10 tx=0x7f2e18005830 comp rx=0 tx=0).stop 2024-04-25T17:01:54.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.414+0000 7f2e2f7fe640 1 -- 172.21.15.59:0/1426113950 reap_dead start 2024-04-25T17:01:54.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.414+0000 7f2e357f8640 1 -- 172.21.15.59:0/1426113950 shutdown_connections 2024-04-25T17:01:54.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.414+0000 7f2e357f8640 1 -- 172.21.15.59:0/1426113950 >> 172.21.15.59:0/1426113950 conn(0x7f2e3006c970 msgr2=0x7f2e3006cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:54.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.414+0000 7f2e357f8640 1 -- 172.21.15.59:0/1426113950 shutdown_connections 2024-04-25T17:01:54.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.414+0000 7f2e357f8640 1 -- 172.21.15.59:0/1426113950 wait complete. 2024-04-25T17:01:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.416+0000 7f2e357f8640 1 Processor -- start 2024-04-25T17:01:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.416+0000 7f2e357f8640 1 -- start start 2024-04-25T17:01:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.418+0000 7f2e357f8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e3006d690 0x7f2e3015c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.418+0000 7f2e357f8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2e301f5fd0 0x7f2e30151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.418+0000 7f2e357f8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e30156ec0 0x7f2e301572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.418+0000 7f2e357f8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2e30156ab0 con 0x7f2e30156ec0 2024-04-25T17:01:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.418+0000 7f2e357f8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2e300cc770 con 0x7f2e3006d690 2024-04-25T17:01:54.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.418+0000 7f2e357f8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f2e30156c30 con 0x7f2e301f5fd0 2024-04-25T17:01:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.418+0000 7f2e2e7fc640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2e301f5fd0 0x7f2e30151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.419+0000 7f2e2f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e30156ec0 0x7f2e301572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.419+0000 7f2e2e7fc640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2e301f5fd0 0x7f2e30151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:38960/0 (socket says 172.21.15.59:38960) 2024-04-25T17:01:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.419+0000 7f2e2e7fc640 1 -- 172.21.15.59:0/1712081837 learned_addr learned my addr 172.21.15.59:0/1712081837 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:54.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.419+0000 7f2e2effd640 1 --2- 172.21.15.59:0/1712081837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e3006d690 0x7f2e3015c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:54.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.423+0000 7f2e2e7fc640 1 -- 172.21.15.59:0/1712081837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e3006d690 msgr2=0x7f2e3015c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:54.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.423+0000 7f2e2e7fc640 1 --2- 172.21.15.59:0/1712081837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e3006d690 0x7f2e3015c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:54.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.423+0000 7f2e2e7fc640 1 -- 172.21.15.59:0/1712081837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e30156ec0 msgr2=0x7f2e301572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:54.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.423+0000 7f2e2e7fc640 1 --2- 172.21.15.59:0/1712081837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e30156ec0 0x7f2e301572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:54.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.423+0000 7f2e2e7fc640 1 -- 172.21.15.59:0/1712081837 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3015cc20 con 0x7f2e301f5fd0 2024-04-25T17:01:54.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.423+0000 7f2e2f7fe640 1 --2- 172.21.15.59:0/1712081837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e30156ec0 0x7f2e301572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:01:54.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.426+0000 7f2e2e7fc640 1 --2- 172.21.15.59:0/1712081837 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2e301f5fd0 0x7f2e30151ad0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400e780 tx=0x7f2e2400ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:54.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.431+0000 7f2e177fe640 1 -- 172.21.15.59:0/1712081837 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24017070 con 0x7f2e301f5fd0 2024-04-25T17:01:54.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.431+0000 7f2e177fe640 1 -- 172.21.15.59:0/1712081837 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e2400ee90 con 0x7f2e301f5fd0 2024-04-25T17:01:54.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.431+0000 7f2e177fe640 1 -- 172.21.15.59:0/1712081837 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2400cb80 con 0x7f2e301f5fd0 2024-04-25T17:01:54.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.431+0000 7f2e357f8640 1 -- 172.21.15.59:0/1712081837 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e30153090 con 0x7f2e301f5fd0 2024-04-25T17:01:54.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.431+0000 7f2e357f8640 1 -- 172.21.15.59:0/1712081837 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e301525b0 con 0x7f2e301f5fd0 2024-04-25T17:01:54.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.431+0000 7f2e357f8640 1 -- 172.21.15.59:0/1712081837 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2e301501f0 con 0x7f2e301f5fd0 2024-04-25T17:01:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.458+0000 7f2e177fe640 1 -- 172.21.15.59:0/1712081837 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2e2401a070 con 0x7f2e301f5fd0 2024-04-25T17:01:54.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.459+0000 7f2e177fe640 1 --2- 172.21.15.59:0/1712081837 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2e1c074530 0x7f2e1c076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.459+0000 7f2e2effd640 1 --2- 172.21.15.59:0/1712081837 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2e1c074530 0x7f2e1c076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:54.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.459+0000 7f2e2effd640 1 --2- 172.21.15.59:0/1712081837 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2e1c074530 0x7f2e1c076a40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2e20033000 tx=0x7f2e20008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.462+0000 7f2e177fe640 1 -- 172.21.15.59:0/1712081837 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f2e2400cd20 con 0x7f2e301f5fd0 2024-04-25T17:01:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.462+0000 7f2e177fe640 1 --2- 172.21.15.59:0/1712081837 >> [v2:172.21.15.64:6808/2335675289,v1:172.21.15.64:6809/2335675289] conn(0x7f2e1c07c900 0x7f2e1c07edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.462+0000 7f2e177fe640 1 -- 172.21.15.59:0/1712081837 --> [v2:172.21.15.64:6808/2335675289,v1:172.21.15.64:6809/2335675289] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e1c07f4a0 con 0x7f2e1c07c900 2024-04-25T17:01:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.462+0000 7f2e177fe640 1 -- 172.21.15.59:0/1712081837 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2e2405bb20 con 0x7f2e301f5fd0 2024-04-25T17:01:54.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.462+0000 7f2e2f7fe640 1 --2- 172.21.15.59:0/1712081837 >> [v2:172.21.15.64:6808/2335675289,v1:172.21.15.64:6809/2335675289] conn(0x7f2e1c07c900 0x7f2e1c07edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:54.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.463+0000 7f2e2f7fe640 1 --2- 172.21.15.59:0/1712081837 >> [v2:172.21.15.64:6808/2335675289,v1:172.21.15.64:6809/2335675289] conn(0x7f2e1c07c900 0x7f2e1c07edd0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:54.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.463+0000 7f2e177fe640 1 -- 172.21.15.59:0/1712081837 <== osd.6 v2:172.21.15.64:6808/2335675289 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2e1c07f4a0 con 0x7f2e1c07c900 2024-04-25T17:01:54.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.477+0000 7f2e357f8640 1 -- 172.21.15.59:0/1712081837 --> [v2:172.21.15.64:6808/2335675289,v1:172.21.15.64:6809/2335675289] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2e300cb180 con 0x7f2e1c07c900 2024-04-25T17:01:54.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.477+0000 7f2e177fe640 1 -- 172.21.15.59:0/1712081837 <== osd.6 v2:172.21.15.64:6808/2335675289 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2e300cb180 con 0x7f2e1c07c900 2024-04-25T17:01:54.475 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T17:01:54.475 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T17:01:54.476 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T17:01:54.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.477+0000 7f2e357f8640 1 -- 172.21.15.59:0/1712081837 >> [v2:172.21.15.64:6808/2335675289,v1:172.21.15.64:6809/2335675289] conn(0x7f2e1c07c900 msgr2=0x7f2e1c07edd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:54.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.477+0000 7f2e357f8640 1 --2- 172.21.15.59:0/1712081837 >> [v2:172.21.15.64:6808/2335675289,v1:172.21.15.64:6809/2335675289] conn(0x7f2e1c07c900 0x7f2e1c07edd0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:54.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.478+0000 7f2e357f8640 1 -- 172.21.15.59:0/1712081837 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2e1c074530 msgr2=0x7f2e1c076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:54.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.478+0000 7f2e357f8640 1 --2- 172.21.15.59:0/1712081837 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2e1c074530 0x7f2e1c076a40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2e20033000 tx=0x7f2e20008030 comp rx=0 tx=0).stop 2024-04-25T17:01:54.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.478+0000 7f2e357f8640 1 -- 172.21.15.59:0/1712081837 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2e301f5fd0 msgr2=0x7f2e30151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:54.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.478+0000 7f2e357f8640 1 --2- 172.21.15.59:0/1712081837 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2e301f5fd0 0x7f2e30151ad0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400e780 tx=0x7f2e2400ec40 comp rx=0 tx=0).stop 2024-04-25T17:01:54.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.478+0000 7f2e2f7fe640 1 -- 172.21.15.59:0/1712081837 reap_dead start 2024-04-25T17:01:54.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.478+0000 7f2e357f8640 1 -- 172.21.15.59:0/1712081837 shutdown_connections 2024-04-25T17:01:54.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.478+0000 7f2e357f8640 1 -- 172.21.15.59:0/1712081837 >> 172.21.15.59:0/1712081837 conn(0x7f2e3006c970 msgr2=0x7f2e30153bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:54.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.478+0000 7f2e357f8640 1 -- 172.21.15.59:0/1712081837 shutdown_connections 2024-04-25T17:01:54.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.478+0000 7f2e357f8640 1 -- 172.21.15.59:0/1712081837 wait complete. 2024-04-25T17:01:54.488 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T17:01:54.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.603+0000 7f1ac9470640 1 Processor -- start 2024-04-25T17:01:54.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.603+0000 7f1ac9470640 1 -- start start 2024-04-25T17:01:54.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.605+0000 7f1ac9470640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ac40c6980 0x7f1ac41567e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:54.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.605+0000 7f1ac9470640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ac415cfc0 0x7f1ac40d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:54.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.605+0000 7f1ac9470640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ac40cd220 con 0x7f1ac40d2350 2024-04-25T17:01:54.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.605+0000 7f1ac9470640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1ac40cd500 con 0x7f1ac415cfc0 2024-04-25T17:01:54.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.605+0000 7f1ac9470640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac40ce010 con 0x7f1ac40c6980 2024-04-25T17:01:54.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.605+0000 7f1ac2ffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ac40c6980 0x7f1ac41567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:54.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.605+0000 7f1ac27fc640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ac415cfc0 0x7f1ac40d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:54.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.606+0000 7f1ac2ffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ac40c6980 0x7f1ac41567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:38968/0 (socket says 172.21.15.59:38968) 2024-04-25T17:01:54.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.606+0000 7f1ac2ffd640 1 -- 172.21.15.59:0/2858647085 learned_addr learned my addr 172.21.15.59:0/2858647085 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:54.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.608+0000 7f1ac2ffd640 1 -- 172.21.15.59:0/2858647085 >> v2:172.21.15.59:3300/0 conn(0x7f1ac415cfc0 msgr2=0x7f1ac40d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:54.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.608+0000 7f1ac2ffd640 1 --2- 172.21.15.59:0/2858647085 >> v2:172.21.15.59:3300/0 conn(0x7f1ac415cfc0 0x7f1ac40d1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:54.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.608+0000 7f1ac2ffd640 1 -- 172.21.15.59:0/2858647085 >> v1:172.21.15.59:6789/0 conn(0x7f1ac40d2350 legacy=0x7f1ac40ceaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:54.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.608+0000 7f1ac2ffd640 1 -- 172.21.15.59:0/2858647085 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac40ce2f0 con 0x7f1ac40c6980 2024-04-25T17:01:54.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.610+0000 7f1ac2ffd640 1 --2- 172.21.15.59:0/2858647085 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ac40c6980 0x7f1ac41567e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009e50 tx=0x7f1ab402a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49cb3a02536f1cde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:54.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.614+0000 7f1ac1ffb640 1 -- 172.21.15.59:0/2858647085 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4036070 con 0x7f1ac40c6980 2024-04-25T17:01:54.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.614+0000 7f1ac1ffb640 1 -- 172.21.15.59:0/2858647085 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab4031600 con 0x7f1ac40c6980 2024-04-25T17:01:54.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.614+0000 7f1ac1ffb640 1 -- 172.21.15.59:0/2858647085 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab40319d0 con 0x7f1ac40c6980 2024-04-25T17:01:54.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.615+0000 7f1ac9470640 1 -- 172.21.15.59:0/2858647085 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ac40c6980 msgr2=0x7f1ac41567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:54.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.615+0000 7f1ac9470640 1 --2- 172.21.15.59:0/2858647085 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ac40c6980 0x7f1ac41567e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009e50 tx=0x7f1ab402a680 comp rx=0 tx=0).stop 2024-04-25T17:01:54.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.615+0000 7f1ac9470640 1 -- 172.21.15.59:0/2858647085 shutdown_connections 2024-04-25T17:01:54.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.615+0000 7f1ac9470640 1 --2- 172.21.15.59:0/2858647085 >> v2:172.21.15.59:3300/0 conn(0x7f1ac415cfc0 0x7f1ac40d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:54.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.615+0000 7f1ac9470640 1 --2- 172.21.15.59:0/2858647085 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ac40c6980 0x7f1ac41567e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:54.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.615+0000 7f1ac9470640 1 -- 172.21.15.59:0/2858647085 >> 172.21.15.59:0/2858647085 conn(0x7f1ac408db40 msgr2=0x7f1ac408df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:54.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.615+0000 7f1ac9470640 1 -- 172.21.15.59:0/2858647085 shutdown_connections 2024-04-25T17:01:54.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.615+0000 7f1ac9470640 1 -- 172.21.15.59:0/2858647085 wait complete. 2024-04-25T17:01:54.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.617+0000 7f1ac9470640 1 Processor -- start 2024-04-25T17:01:54.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.617+0000 7f1ac9470640 1 -- start start 2024-04-25T17:01:54.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.618+0000 7f1ac9470640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ac40c6980 0x7f1ac40cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:54.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.618+0000 7f1ac9470640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ac40d2350 0x7f1ac40cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:54.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.618+0000 7f1ac9470640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac415cfc0 0x7f1ac4152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:54.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.618+0000 7f1ac9470640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac415d3d0 con 0x7f1ac415cfc0 2024-04-25T17:01:54.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.618+0000 7f1ac9470640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac40cd920 con 0x7f1ac40d2350 2024-04-25T17:01:54.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.618+0000 7f1ac9470640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac40d0650 con 0x7f1ac40c6980 2024-04-25T17:01:54.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.619+0000 7f1ac37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac415cfc0 0x7f1ac4152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:54.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.619+0000 7f1ac2ffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ac40c6980 0x7f1ac40cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:54.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.619+0000 7f1ac27fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ac40d2350 0x7f1ac40cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:54.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.619+0000 7f1ac37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac415cfc0 0x7f1ac4152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46354/0 (socket says 172.21.15.59:46354) 2024-04-25T17:01:54.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.619+0000 7f1ac37fe640 1 -- 172.21.15.59:0/841081295 learned_addr learned my addr 172.21.15.59:0/841081295 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:54.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.623+0000 7f1ac37fe640 1 -- 172.21.15.59:0/841081295 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ac40c6980 msgr2=0x7f1ac40cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:54.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.623+0000 7f1ac37fe640 1 --2- 172.21.15.59:0/841081295 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ac40c6980 0x7f1ac40cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:54.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.623+0000 7f1ac37fe640 1 -- 172.21.15.59:0/841081295 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ac40d2350 msgr2=0x7f1ac40cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:54.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.623+0000 7f1ac37fe640 1 --2- 172.21.15.59:0/841081295 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ac40d2350 0x7f1ac40cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:54.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.623+0000 7f1ac37fe640 1 -- 172.21.15.59:0/841081295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac40cbc00 con 0x7f1ac415cfc0 2024-04-25T17:01:54.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.626+0000 7f1ac37fe640 1 --2- 172.21.15.59:0/841081295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac415cfc0 0x7f1ac4152590 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1abc00c390 tx=0x7f1abc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:54.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.630+0000 7f1abb7fe640 1 -- 172.21.15.59:0/841081295 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc017070 con 0x7f1ac415cfc0 2024-04-25T17:01:54.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.630+0000 7f1abb7fe640 1 -- 172.21.15.59:0/841081295 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1abc0052d0 con 0x7f1ac415cfc0 2024-04-25T17:01:54.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.630+0000 7f1abb7fe640 1 -- 172.21.15.59:0/841081295 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc003810 con 0x7f1ac415cfc0 2024-04-25T17:01:54.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.630+0000 7f1ac9470640 1 -- 172.21.15.59:0/841081295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac40d0180 con 0x7f1ac415cfc0 2024-04-25T17:01:54.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.630+0000 7f1ac9470640 1 -- 172.21.15.59:0/841081295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac415a180 con 0x7f1ac415cfc0 2024-04-25T17:01:54.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.631+0000 7f1ac9470640 1 -- 172.21.15.59:0/841081295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ac4069910 con 0x7f1ac415cfc0 2024-04-25T17:01:54.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.924+0000 7f1abb7fe640 1 -- 172.21.15.59:0/841081295 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1abc01a070 con 0x7f1ac415cfc0 2024-04-25T17:01:54.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.924+0000 7f1abb7fe640 1 --2- 172.21.15.59:0/841081295 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1aa4074530 0x7f1aa4076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:54.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.925+0000 7f1ac2ffd640 1 --2- 172.21.15.59:0/841081295 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1aa4074530 0x7f1aa4076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:54.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.925+0000 7f1ac2ffd640 1 --2- 172.21.15.59:0/841081295 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1aa4074530 0x7f1aa4076a40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4033000 tx=0x7f1ab4009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:54.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.939+0000 7f1abb7fe640 1 -- 172.21.15.59:0/841081295 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f1abc05aca0 con 0x7f1ac415cfc0 2024-04-25T17:01:54.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:54.939+0000 7f1abb7fe640 1 -- 172.21.15.59:0/841081295 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1abc021020 con 0x7f1ac415cfc0 2024-04-25T17:01:55.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.128+0000 7f1ac9470640 1 -- 172.21.15.59:0/841081295 --> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f1ac40c9c50 con 0x7f1aa4074530 2024-04-25T17:01:55.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.128+0000 7f1abb7fe640 1 -- 172.21.15.59:0/841081295 <== mgr.4102 v2:172.21.15.59:6800/2368090706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1ab403d460 con 0x7f1aa4074530 2024-04-25T17:01:55.126 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T17:01:55.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.130+0000 7f1ac9470640 1 -- 172.21.15.59:0/841081295 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1aa4074530 msgr2=0x7f1aa4076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:55.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.130+0000 7f1ac9470640 1 --2- 172.21.15.59:0/841081295 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1aa4074530 0x7f1aa4076a40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4033000 tx=0x7f1ab4009000 comp rx=0 tx=0).stop 2024-04-25T17:01:55.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.130+0000 7f1ac9470640 1 -- 172.21.15.59:0/841081295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac415cfc0 msgr2=0x7f1ac4152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:55.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.130+0000 7f1ac9470640 1 --2- 172.21.15.59:0/841081295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac415cfc0 0x7f1ac4152590 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1abc00c390 tx=0x7f1abc00c850 comp rx=0 tx=0).stop 2024-04-25T17:01:55.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.130+0000 7f1ac9470640 1 -- 172.21.15.59:0/841081295 shutdown_connections 2024-04-25T17:01:55.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.130+0000 7f1ac9470640 1 --2- 172.21.15.59:0/841081295 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1aa4074530 0x7f1aa4076a40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:55.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.130+0000 7f1ac9470640 1 --2- 172.21.15.59:0/841081295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac415cfc0 0x7f1ac4152590 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:55.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.130+0000 7f1ac9470640 1 --2- 172.21.15.59:0/841081295 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ac40d2350 0x7f1ac40cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:55.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.130+0000 7f1ac9470640 1 --2- 172.21.15.59:0/841081295 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1ac40c6980 0x7f1ac40cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:55.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.130+0000 7f1ac9470640 1 -- 172.21.15.59:0/841081295 >> 172.21.15.59:0/841081295 conn(0x7f1ac408db40 msgr2=0x7f1ac40c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:55.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.130+0000 7f1ac9470640 1 -- 172.21.15.59:0/841081295 shutdown_connections 2024-04-25T17:01:55.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.130+0000 7f1ac9470640 1 -- 172.21.15.59:0/841081295 wait complete. 2024-04-25T17:01:55.140 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T17:01:55.141 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T17:01:55.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.262+0000 7f4ac4f34640 1 Processor -- start 2024-04-25T17:01:55.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.262+0000 7f4ac4f34640 1 -- start start 2024-04-25T17:01:55.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.263+0000 7f4ac4f34640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4ac00cc5c0 0x7f4ac00b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:55.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.263+0000 7f4ac4f34640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ac00b5930 0x7f4ac00c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:55.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.263+0000 7f4ac4f34640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac015d500 con 0x7f4ac015cfe0 2024-04-25T17:01:55.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.263+0000 7f4ac4f34640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac0160850 con 0x7f4ac00cc5c0 2024-04-25T17:01:55.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.263+0000 7f4ac4f34640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac015fc40 con 0x7f4ac00b5930 2024-04-25T17:01:55.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.264+0000 7f4ab5d9b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4ac00cc5c0 0x7f4ac00b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:55.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.264+0000 7f4abed9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ac00b5930 0x7f4ac00c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:55.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.264+0000 7f4abed9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ac00b5930 0x7f4ac00c7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:38988/0 (socket says 172.21.15.59:38988) 2024-04-25T17:01:55.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.264+0000 7f4abed9d640 1 -- 172.21.15.59:0/3397797062 learned_addr learned my addr 172.21.15.59:0/3397797062 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:55.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.268+0000 7f4abed9d640 1 -- 172.21.15.59:0/3397797062 >> v2:172.21.15.64:3300/0 conn(0x7f4ac00cc5c0 msgr2=0x7f4ac00b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:55.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.268+0000 7f4abed9d640 1 --2- 172.21.15.59:0/3397797062 >> v2:172.21.15.64:3300/0 conn(0x7f4ac00cc5c0 0x7f4ac00b53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:55.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.268+0000 7f4abed9d640 1 -- 172.21.15.59:0/3397797062 >> v1:172.21.15.64:6789/0 conn(0x7f4ac015cfe0 legacy=0x7f4ac01564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:55.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.268+0000 7f4abed9d640 1 -- 172.21.15.59:0/3397797062 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac015ff20 con 0x7f4ac00b5930 2024-04-25T17:01:55.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.270+0000 7f4abed9d640 1 --2- 172.21.15.59:0/3397797062 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ac00b5930 0x7f4ac00c7280 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4ac01609d0 tx=0x7f4ab802a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1cc94f0355d34a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:55.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.274+0000 7f4abdd9b640 1 -- 172.21.15.59:0/3397797062 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8036070 con 0x7f4ac00b5930 2024-04-25T17:01:55.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.274+0000 7f4abdd9b640 1 -- 172.21.15.59:0/3397797062 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab8031600 con 0x7f4ac00b5930 2024-04-25T17:01:55.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.274+0000 7f4abdd9b640 1 -- 172.21.15.59:0/3397797062 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80319d0 con 0x7f4ac00b5930 2024-04-25T17:01:55.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.275+0000 7f4ac4f34640 1 -- 172.21.15.59:0/3397797062 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ac00b5930 msgr2=0x7f4ac00c7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:55.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.275+0000 7f4ac4f34640 1 --2- 172.21.15.59:0/3397797062 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ac00b5930 0x7f4ac00c7280 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4ac01609d0 tx=0x7f4ab802a6c0 comp rx=0 tx=0).stop 2024-04-25T17:01:55.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.275+0000 7f4ac4f34640 1 -- 172.21.15.59:0/3397797062 shutdown_connections 2024-04-25T17:01:55.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.275+0000 7f4ac4f34640 1 --2- 172.21.15.59:0/3397797062 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ac00b5930 0x7f4ac00c7280 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:55.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.275+0000 7f4ac4f34640 1 --2- 172.21.15.59:0/3397797062 >> v2:172.21.15.64:3300/0 conn(0x7f4ac00cc5c0 0x7f4ac00b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:55.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.275+0000 7f4ac4f34640 1 -- 172.21.15.59:0/3397797062 >> 172.21.15.59:0/3397797062 conn(0x7f4ac00684e0 msgr2=0x7f4ac00688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:55.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.275+0000 7f4ac4f34640 1 -- 172.21.15.59:0/3397797062 shutdown_connections 2024-04-25T17:01:55.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.275+0000 7f4ac4f34640 1 -- 172.21.15.59:0/3397797062 wait complete. 2024-04-25T17:01:55.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.277+0000 7f4ac4f34640 1 Processor -- start 2024-04-25T17:01:55.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.277+0000 7f4ac4f34640 1 -- start start 2024-04-25T17:01:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.278+0000 7f4ac4f34640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ac00b5930 0x7f4ac01f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.278+0000 7f4ac4f34640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ac00cc5c0 0x7f4ac0148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.279+0000 7f4ac4f34640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ac015cfe0 0x7f4ac00cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.279+0000 7f4ac4f34640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac00b5d40 con 0x7f4ac015cfe0 2024-04-25T17:01:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.279+0000 7f4ac4f34640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac01604e0 con 0x7f4ac00cc5c0 2024-04-25T17:01:55.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.279+0000 7f4ac4f34640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac00b4920 con 0x7f4ac00b5930 2024-04-25T17:01:55.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.279+0000 7f4abed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ac015cfe0 0x7f4ac00cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:55.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.279+0000 7f4abe59c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ac00b5930 0x7f4ac01f2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:55.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.280+0000 7f4ab5d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ac00cc5c0 0x7f4ac0148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:55.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.280+0000 7f4abed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ac015cfe0 0x7f4ac00cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46362/0 (socket says 172.21.15.59:46362) 2024-04-25T17:01:55.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.280+0000 7f4abed9d640 1 -- 172.21.15.59:0/3786928516 learned_addr learned my addr 172.21.15.59:0/3786928516 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:55.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.284+0000 7f4abed9d640 1 -- 172.21.15.59:0/3786928516 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ac00b5930 msgr2=0x7f4ac01f2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:55.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.284+0000 7f4abed9d640 1 --2- 172.21.15.59:0/3786928516 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ac00b5930 0x7f4ac01f2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:55.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.284+0000 7f4abed9d640 1 -- 172.21.15.59:0/3786928516 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ac00cc5c0 msgr2=0x7f4ac0148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:55.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.284+0000 7f4abed9d640 1 --2- 172.21.15.59:0/3786928516 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ac00cc5c0 0x7f4ac0148f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:55.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.284+0000 7f4abed9d640 1 -- 172.21.15.59:0/3786928516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac00d27b0 con 0x7f4ac015cfe0 2024-04-25T17:01:55.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.290+0000 7f4abed9d640 1 --2- 172.21.15.59:0/3786928516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ac015cfe0 0x7f4ac00cfec0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8009f10 tx=0x7f4ab8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:55.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.294+0000 7f4ab77fe640 1 -- 172.21.15.59:0/3786928516 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8041020 con 0x7f4ac015cfe0 2024-04-25T17:01:55.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.295+0000 7f4ab77fe640 1 -- 172.21.15.59:0/3786928516 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab8008760 con 0x7f4ac015cfe0 2024-04-25T17:01:55.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.295+0000 7f4ac4f34640 1 -- 172.21.15.59:0/3786928516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac014fee0 con 0x7f4ac015cfe0 2024-04-25T17:01:55.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.295+0000 7f4ab77fe640 1 -- 172.21.15.59:0/3786928516 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8036040 con 0x7f4ac015cfe0 2024-04-25T17:01:55.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.295+0000 7f4ac4f34640 1 -- 172.21.15.59:0/3786928516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac014f380 con 0x7f4ac015cfe0 2024-04-25T17:01:55.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.295+0000 7f4ac4f34640 1 -- 172.21.15.59:0/3786928516 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ac006a2c0 con 0x7f4ac015cfe0 2024-04-25T17:01:55.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.326+0000 7f4ab77fe640 1 -- 172.21.15.59:0/3786928516 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4ab8044020 con 0x7f4ac015cfe0 2024-04-25T17:01:55.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.326+0000 7f4ab77fe640 1 --2- 172.21.15.59:0/3786928516 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f4aa0074500 0x7f4aa0076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:55.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.327+0000 7f4abe59c640 1 --2- 172.21.15.59:0/3786928516 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f4aa0074500 0x7f4aa0076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:55.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.327+0000 7f4abe59c640 1 --2- 172.21.15.59:0/3786928516 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f4aa0074500 0x7f4aa0076a10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0006fd0 tx=0x7f4ab0009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:55.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.332+0000 7f4ab77fe640 1 -- 172.21.15.59:0/3786928516 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f4ab807c560 con 0x7f4ac015cfe0 2024-04-25T17:01:55.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.332+0000 7f4ab77fe640 1 --2- 172.21.15.59:0/3786928516 >> [v2:172.21.15.64:6800/970439753,v1:172.21.15.64:6801/970439753] conn(0x7f4aa007c8d0 0x7f4aa007eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:55.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.332+0000 7f4ab77fe640 1 -- 172.21.15.59:0/3786928516 --> [v2:172.21.15.64:6800/970439753,v1:172.21.15.64:6801/970439753] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4aa007f470 con 0x7f4aa007c8d0 2024-04-25T17:01:55.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.332+0000 7f4ab77fe640 1 -- 172.21.15.59:0/3786928516 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4ab807c920 con 0x7f4ac015cfe0 2024-04-25T17:01:55.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.333+0000 7f4ab5d9b640 1 --2- 172.21.15.59:0/3786928516 >> [v2:172.21.15.64:6800/970439753,v1:172.21.15.64:6801/970439753] conn(0x7f4aa007c8d0 0x7f4aa007eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:55.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.333+0000 7f4ab5d9b640 1 --2- 172.21.15.59:0/3786928516 >> [v2:172.21.15.64:6800/970439753,v1:172.21.15.64:6801/970439753] conn(0x7f4aa007c8d0 0x7f4aa007eda0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:55.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.334+0000 7f4ab77fe640 1 -- 172.21.15.59:0/3786928516 <== osd.7 v2:172.21.15.64:6800/970439753 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4aa007f470 con 0x7f4aa007c8d0 2024-04-25T17:01:55.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.353+0000 7f4ac4f34640 1 -- 172.21.15.59:0/3786928516 --> [v2:172.21.15.64:6800/970439753,v1:172.21.15.64:6801/970439753] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4ac00699b0 con 0x7f4aa007c8d0 2024-04-25T17:01:55.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.353+0000 7f4ab77fe640 1 -- 172.21.15.59:0/3786928516 <== osd.7 v2:172.21.15.64:6800/970439753 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4ac00699b0 con 0x7f4aa007c8d0 2024-04-25T17:01:55.351 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T17:01:55.351 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T17:01:55.351 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T17:01:55.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.353+0000 7f4ac4f34640 1 -- 172.21.15.59:0/3786928516 >> [v2:172.21.15.64:6800/970439753,v1:172.21.15.64:6801/970439753] conn(0x7f4aa007c8d0 msgr2=0x7f4aa007eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:55.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.353+0000 7f4ac4f34640 1 --2- 172.21.15.59:0/3786928516 >> [v2:172.21.15.64:6800/970439753,v1:172.21.15.64:6801/970439753] conn(0x7f4aa007c8d0 0x7f4aa007eda0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:55.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.354+0000 7f4ac4f34640 1 -- 172.21.15.59:0/3786928516 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f4aa0074500 msgr2=0x7f4aa0076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:55.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.354+0000 7f4ac4f34640 1 --2- 172.21.15.59:0/3786928516 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f4aa0074500 0x7f4aa0076a10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0006fd0 tx=0x7f4ab0009060 comp rx=0 tx=0).stop 2024-04-25T17:01:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.354+0000 7f4ac4f34640 1 -- 172.21.15.59:0/3786928516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ac015cfe0 msgr2=0x7f4ac00cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.354+0000 7f4ac4f34640 1 --2- 172.21.15.59:0/3786928516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ac015cfe0 0x7f4ac00cfec0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8009f10 tx=0x7f4ab8004a40 comp rx=0 tx=0).stop 2024-04-25T17:01:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.354+0000 7f4abed9d640 1 -- 172.21.15.59:0/3786928516 reap_dead start 2024-04-25T17:01:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.354+0000 7f4ac4f34640 1 -- 172.21.15.59:0/3786928516 shutdown_connections 2024-04-25T17:01:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.354+0000 7f4ac4f34640 1 -- 172.21.15.59:0/3786928516 >> 172.21.15.59:0/3786928516 conn(0x7f4ac00684e0 msgr2=0x7f4ac00c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.354+0000 7f4ac4f34640 1 -- 172.21.15.59:0/3786928516 shutdown_connections 2024-04-25T17:01:55.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.354+0000 7f4ac4f34640 1 -- 172.21.15.59:0/3786928516 wait complete. 2024-04-25T17:01:55.367 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T17:01:55.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.483+0000 7f5453eb8640 1 Processor -- start 2024-04-25T17:01:55.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.483+0000 7f5453eb8640 1 -- start start 2024-04-25T17:01:55.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.484+0000 7f5453eb8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f544c152f40 0x7f544c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:55.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.484+0000 7f5453eb8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f544c06dcd0 0x7f544c073c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:55.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.484+0000 7f5453eb8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f544c15c8b0 con 0x7f544c074140 2024-04-25T17:01:55.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.484+0000 7f5453eb8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f544c15cb50 con 0x7f544c06dcd0 2024-04-25T17:01:55.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.484+0000 7f5453eb8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f544c15ce30 con 0x7f544c152f40 2024-04-25T17:01:55.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.485+0000 7f5451c54640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f544c152f40 0x7f544c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:55.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.485+0000 7f5451453640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f544c06dcd0 0x7f544c073c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:55.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.485+0000 7f5451c54640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f544c152f40 0x7f544c06d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:38994/0 (socket says 172.21.15.59:38994) 2024-04-25T17:01:55.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.485+0000 7f5451c54640 1 -- 172.21.15.59:0/3642277814 learned_addr learned my addr 172.21.15.59:0/3642277814 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:55.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.488+0000 7f5451c54640 1 -- 172.21.15.59:0/3642277814 >> v2:172.21.15.64:3300/0 conn(0x7f544c06dcd0 msgr2=0x7f544c073c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:55.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.488+0000 7f5451c54640 1 --2- 172.21.15.59:0/3642277814 >> v2:172.21.15.64:3300/0 conn(0x7f544c06dcd0 0x7f544c073c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:55.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.488+0000 7f5451c54640 1 -- 172.21.15.59:0/3642277814 >> v1:172.21.15.64:6789/0 conn(0x7f544c074140 legacy=0x7f544c0c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:55.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.488+0000 7f5451c54640 1 -- 172.21.15.59:0/3642277814 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544c15d110 con 0x7f544c152f40 2024-04-25T17:01:55.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.491+0000 7f5451c54640 1 --2- 172.21.15.59:0/3642277814 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f544c152f40 0x7f544c06d790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5444009e50 tx=0x7f544402a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dda1203a04147297 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:55.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.494+0000 7f5450c52640 1 -- 172.21.15.59:0/3642277814 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5444036070 con 0x7f544c152f40 2024-04-25T17:01:55.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.495+0000 7f5450c52640 1 -- 172.21.15.59:0/3642277814 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5444031600 con 0x7f544c152f40 2024-04-25T17:01:55.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.495+0000 7f5450c52640 1 -- 172.21.15.59:0/3642277814 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54440319d0 con 0x7f544c152f40 2024-04-25T17:01:55.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.495+0000 7f5453eb8640 1 -- 172.21.15.59:0/3642277814 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f544c152f40 msgr2=0x7f544c06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:55.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.495+0000 7f5453eb8640 1 --2- 172.21.15.59:0/3642277814 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f544c152f40 0x7f544c06d790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5444009e50 tx=0x7f544402a7a0 comp rx=0 tx=0).stop 2024-04-25T17:01:55.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.495+0000 7f5453eb8640 1 -- 172.21.15.59:0/3642277814 shutdown_connections 2024-04-25T17:01:55.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.495+0000 7f5453eb8640 1 --2- 172.21.15.59:0/3642277814 >> v2:172.21.15.64:3300/0 conn(0x7f544c06dcd0 0x7f544c073c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:55.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.495+0000 7f5453eb8640 1 --2- 172.21.15.59:0/3642277814 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f544c152f40 0x7f544c06d790 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:55.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.495+0000 7f5453eb8640 1 -- 172.21.15.59:0/3642277814 >> 172.21.15.59:0/3642277814 conn(0x7f544c0caa70 msgr2=0x7f544c0cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:55.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.495+0000 7f5453eb8640 1 -- 172.21.15.59:0/3642277814 shutdown_connections 2024-04-25T17:01:55.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.495+0000 7f5453eb8640 1 -- 172.21.15.59:0/3642277814 wait complete. 2024-04-25T17:01:55.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.497+0000 7f5453eb8640 1 Processor -- start 2024-04-25T17:01:55.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.497+0000 7f5453eb8640 1 -- start start 2024-04-25T17:01:55.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.498+0000 7f5453eb8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f544c06dcd0 0x7f544c1e8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:55.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.498+0000 7f5453eb8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f544c074140 0x7f544c142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:55.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.498+0000 7f5453eb8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f544c152f40 0x7f544c142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:55.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.498+0000 7f5453eb8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f544c153350 con 0x7f544c152f40 2024-04-25T17:01:55.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.498+0000 7f5453eb8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f544c0c73e0 con 0x7f544c074140 2024-04-25T17:01:55.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.498+0000 7f5453eb8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f544c156ae0 con 0x7f544c06dcd0 2024-04-25T17:01:55.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.499+0000 7f5451c54640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f544c06dcd0 0x7f544c1e8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:55.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.499+0000 7f5451453640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f544c074140 0x7f544c142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:55.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.499+0000 7f5451c54640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f544c06dcd0 0x7f544c1e8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:39010/0 (socket says 172.21.15.59:39010) 2024-04-25T17:01:55.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.499+0000 7f5451c54640 1 -- 172.21.15.59:0/1942346012 learned_addr learned my addr 172.21.15.59:0/1942346012 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:55.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.500+0000 7f5452455640 1 --2- 172.21.15.59:0/1942346012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f544c152f40 0x7f544c142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:55.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.503+0000 7f5451c54640 1 -- 172.21.15.59:0/1942346012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f544c074140 msgr2=0x7f544c142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:55.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.503+0000 7f5451c54640 1 --2- 172.21.15.59:0/1942346012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f544c074140 0x7f544c142710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:55.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.503+0000 7f5451c54640 1 -- 172.21.15.59:0/1942346012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f544c152f40 msgr2=0x7f544c142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:55.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.503+0000 7f5451c54640 1 --2- 172.21.15.59:0/1942346012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f544c152f40 0x7f544c142c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:55.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.503+0000 7f5451c54640 1 -- 172.21.15.59:0/1942346012 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544c143190 con 0x7f544c06dcd0 2024-04-25T17:01:55.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.506+0000 7f5451c54640 1 --2- 172.21.15.59:0/1942346012 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f544c06dcd0 0x7f544c1e8c60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f544402ad90 tx=0x7f5444004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:55.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.510+0000 7f544a7fc640 1 -- 172.21.15.59:0/1942346012 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5444041020 con 0x7f544c06dcd0 2024-04-25T17:01:55.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.510+0000 7f544a7fc640 1 -- 172.21.15.59:0/1942346012 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54440087b0 con 0x7f544c06dcd0 2024-04-25T17:01:55.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.510+0000 7f5453eb8640 1 -- 172.21.15.59:0/1942346012 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f544c146df0 con 0x7f544c06dcd0 2024-04-25T17:01:55.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.510+0000 7f544a7fc640 1 -- 172.21.15.59:0/1942346012 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5444036040 con 0x7f544c06dcd0 2024-04-25T17:01:55.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.510+0000 7f5453eb8640 1 -- 172.21.15.59:0/1942346012 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f544c1473b0 con 0x7f544c06dcd0 2024-04-25T17:01:55.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.511+0000 7f5453eb8640 1 -- 172.21.15.59:0/1942346012 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f544c0c6e40 con 0x7f544c06dcd0 2024-04-25T17:01:55.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.534+0000 7f544a7fc640 1 -- 172.21.15.59:0/1942346012 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f5444044020 con 0x7f544c06dcd0 2024-04-25T17:01:55.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.535+0000 7f544a7fc640 1 --2- 172.21.15.59:0/1942346012 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5438074500 0x7f5438076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:55.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.535+0000 7f5451453640 1 --2- 172.21.15.59:0/1942346012 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5438074500 0x7f5438076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:55.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.535+0000 7f5451453640 1 --2- 172.21.15.59:0/1942346012 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5438074500 0x7f5438076a10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f544c06a390 tx=0x7f5440009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:55.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.538+0000 7f544a7fc640 1 -- 172.21.15.59:0/1942346012 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f544407c510 con 0x7f544c06dcd0 2024-04-25T17:01:55.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:55.830+0000 7f544a7fc640 1 -- 172.21.15.59:0/1942346012 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f544c0c6e40 con 0x7f544c06dcd0 2024-04-25T17:01:56.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.014+0000 7f5453eb8640 1 -- 172.21.15.59:0/1942346012 --> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f544c073b00 con 0x7f5438074500 2024-04-25T17:01:56.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.015+0000 7f544a7fc640 1 -- 172.21.15.59:0/1942346012 <== mgr.4102 v2:172.21.15.59:6800/2368090706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f544c073b00 con 0x7f5438074500 2024-04-25T17:01:56.013 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T17:01:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.017+0000 7f5453eb8640 1 -- 172.21.15.59:0/1942346012 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5438074500 msgr2=0x7f5438076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.017+0000 7f5453eb8640 1 --2- 172.21.15.59:0/1942346012 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5438074500 0x7f5438076a10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f544c06a390 tx=0x7f5440009190 comp rx=0 tx=0).stop 2024-04-25T17:01:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.017+0000 7f5453eb8640 1 -- 172.21.15.59:0/1942346012 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f544c06dcd0 msgr2=0x7f544c1e8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.017+0000 7f5453eb8640 1 --2- 172.21.15.59:0/1942346012 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f544c06dcd0 0x7f544c1e8c60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f544402ad90 tx=0x7f5444004a40 comp rx=0 tx=0).stop 2024-04-25T17:01:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.017+0000 7f5453eb8640 1 -- 172.21.15.59:0/1942346012 shutdown_connections 2024-04-25T17:01:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.017+0000 7f5453eb8640 1 --2- 172.21.15.59:0/1942346012 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f5438074500 0x7f5438076a10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:56.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.017+0000 7f5453eb8640 1 --2- 172.21.15.59:0/1942346012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f544c152f40 0x7f544c142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.017+0000 7f5453eb8640 1 --2- 172.21.15.59:0/1942346012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f544c074140 0x7f544c142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.017+0000 7f5453eb8640 1 --2- 172.21.15.59:0/1942346012 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f544c06dcd0 0x7f544c1e8c60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.017+0000 7f5453eb8640 1 -- 172.21.15.59:0/1942346012 >> 172.21.15.59:0/1942346012 conn(0x7f544c0caa70 msgr2=0x7f544c0cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.017+0000 7f5453eb8640 1 -- 172.21.15.59:0/1942346012 shutdown_connections 2024-04-25T17:01:56.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.017+0000 7f5453eb8640 1 -- 172.21.15.59:0/1942346012 wait complete. 2024-04-25T17:01:56.026 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T17:01:56.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.140+0000 7fecaad96640 1 Processor -- start 2024-04-25T17:01:56.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.140+0000 7fecaad96640 1 -- start start 2024-04-25T17:01:56.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.142+0000 7fecaad96640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7feca4156770 0x7feca40cae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:56.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.142+0000 7fecaad96640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feca40cfb30 0x7feca40cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:56.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.142+0000 7fecaad96640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feca408d750 con 0x7feca415fc80 2024-04-25T17:01:56.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.142+0000 7fecaad96640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7feca40d0480 con 0x7feca4156770 2024-04-25T17:01:56.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.142+0000 7fecaad96640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7feca415d3b0 con 0x7feca40cfb30 2024-04-25T17:01:56.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.143+0000 7feca8b32640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7feca4156770 0x7feca40cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:56.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.143+0000 7feca3fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feca40cfb30 0x7feca40cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:56.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.143+0000 7feca3fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feca40cfb30 0x7feca40cff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:39022/0 (socket says 172.21.15.59:39022) 2024-04-25T17:01:56.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.143+0000 7feca3fff640 1 -- 172.21.15.59:0/2778349407 learned_addr learned my addr 172.21.15.59:0/2778349407 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:56.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.146+0000 7feca3fff640 1 -- 172.21.15.59:0/2778349407 >> v2:172.21.15.64:3300/0 conn(0x7feca4156770 msgr2=0x7feca40cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:01:56.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.146+0000 7feca3fff640 1 --2- 172.21.15.59:0/2778349407 >> v2:172.21.15.64:3300/0 conn(0x7feca4156770 0x7feca40cae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:56.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.146+0000 7feca3fff640 1 -- 172.21.15.59:0/2778349407 >> v1:172.21.15.64:6789/0 conn(0x7feca415fc80 legacy=0x7feca4160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:56.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.146+0000 7feca3fff640 1 -- 172.21.15.59:0/2778349407 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca415c7a0 con 0x7feca40cfb30 2024-04-25T17:01:56.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.149+0000 7feca3fff640 1 --2- 172.21.15.59:0/2778349407 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feca40cfb30 0x7feca40cff40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fec98009870 tx=0x7fec9802a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6ac06ed9548f5d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:56.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.153+0000 7feca37fe640 1 -- 172.21.15.59:0/2778349407 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98037070 con 0x7feca40cfb30 2024-04-25T17:01:56.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.153+0000 7feca37fe640 1 -- 172.21.15.59:0/2778349407 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec9802ae50 con 0x7feca40cfb30 2024-04-25T17:01:56.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.153+0000 7feca37fe640 1 -- 172.21.15.59:0/2778349407 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98032860 con 0x7feca40cfb30 2024-04-25T17:01:56.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.154+0000 7fecaad96640 1 -- 172.21.15.59:0/2778349407 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feca40cfb30 msgr2=0x7feca40cff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:56.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.154+0000 7fecaad96640 1 --2- 172.21.15.59:0/2778349407 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feca40cfb30 0x7feca40cff40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fec98009870 tx=0x7fec9802a300 comp rx=0 tx=0).stop 2024-04-25T17:01:56.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.154+0000 7fecaad96640 1 -- 172.21.15.59:0/2778349407 shutdown_connections 2024-04-25T17:01:56.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.154+0000 7fecaad96640 1 --2- 172.21.15.59:0/2778349407 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feca40cfb30 0x7feca40cff40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:56.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.154+0000 7fecaad96640 1 --2- 172.21.15.59:0/2778349407 >> v2:172.21.15.64:3300/0 conn(0x7feca4156770 0x7feca40cae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:56.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.154+0000 7fecaad96640 1 -- 172.21.15.59:0/2778349407 >> 172.21.15.59:0/2778349407 conn(0x7feca4073200 msgr2=0x7feca4073610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:56.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.154+0000 7fecaad96640 1 -- 172.21.15.59:0/2778349407 shutdown_connections 2024-04-25T17:01:56.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.154+0000 7fecaad96640 1 -- 172.21.15.59:0/2778349407 wait complete. 2024-04-25T17:01:56.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.156+0000 7fecaad96640 1 Processor -- start 2024-04-25T17:01:56.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.156+0000 7fecaad96640 1 -- start start 2024-04-25T17:01:56.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.158+0000 7fecaad96640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feca40cfb30 0x7feca41f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:56.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.158+0000 7fecaad96640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feca4156770 0x7feca415b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:56.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.158+0000 7fecaad96640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feca415fc80 0x7feca40cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:56.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.158+0000 7fecaad96640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feca415d040 con 0x7feca4156770 2024-04-25T17:01:56.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.158+0000 7fecaad96640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7feca415cd60 con 0x7feca415fc80 2024-04-25T17:01:56.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.158+0000 7fecaad96640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7feca40c57f0 con 0x7feca40cfb30 2024-04-25T17:01:56.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.158+0000 7feca3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feca4156770 0x7feca415b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:56.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.158+0000 7feca8b32640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feca40cfb30 0x7feca41f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:56.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.159+0000 7feca9333640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feca415fc80 0x7feca40cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:56.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.159+0000 7feca8b32640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feca40cfb30 0x7feca41f4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:39038/0 (socket says 172.21.15.59:39038) 2024-04-25T17:01:56.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.159+0000 7feca8b32640 1 -- 172.21.15.59:0/3392591530 learned_addr learned my addr 172.21.15.59:0/3392591530 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:01:56.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.163+0000 7feca8b32640 1 -- 172.21.15.59:0/3392591530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feca415fc80 msgr2=0x7feca40cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:56.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.163+0000 7feca8b32640 1 --2- 172.21.15.59:0/3392591530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feca415fc80 0x7feca40cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:56.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.163+0000 7feca8b32640 1 -- 172.21.15.59:0/3392591530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feca4156770 msgr2=0x7feca415b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:56.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.163+0000 7feca8b32640 1 --2- 172.21.15.59:0/3392591530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feca4156770 0x7feca415b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:56.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.163+0000 7feca8b32640 1 -- 172.21.15.59:0/3392591530 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca41f54b0 con 0x7feca40cfb30 2024-04-25T17:01:56.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.163+0000 7feca9333640 1 --2- 172.21.15.59:0/3392591530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feca415fc80 0x7feca40cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:01:56.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.165+0000 7feca8b32640 1 --2- 172.21.15.59:0/3392591530 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feca40cfb30 0x7feca41f4f70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fec9400e8a0 tx=0x7fec9400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:56.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.170+0000 7feca17fa640 1 -- 172.21.15.59:0/3392591530 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec94017070 con 0x7feca40cfb30 2024-04-25T17:01:56.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.170+0000 7feca17fa640 1 -- 172.21.15.59:0/3392591530 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec9400c940 con 0x7feca40cfb30 2024-04-25T17:01:56.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.170+0000 7feca17fa640 1 -- 172.21.15.59:0/3392591530 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9400cd30 con 0x7feca40cfb30 2024-04-25T17:01:56.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.170+0000 7fecaad96640 1 -- 172.21.15.59:0/3392591530 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feca41f3ed0 con 0x7feca40cfb30 2024-04-25T17:01:56.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.170+0000 7fecaad96640 1 -- 172.21.15.59:0/3392591530 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feca41f4490 con 0x7feca40cfb30 2024-04-25T17:01:56.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.171+0000 7fecaad96640 1 -- 172.21.15.59:0/3392591530 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feca40c4e70 con 0x7feca40cfb30 2024-04-25T17:01:56.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.194+0000 7feca17fa640 1 -- 172.21.15.59:0/3392591530 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fec9401a070 con 0x7feca40cfb30 2024-04-25T17:01:56.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.194+0000 7feca17fa640 1 --2- 172.21.15.59:0/3392591530 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fec90074500 0x7fec90076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:01:56.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.194+0000 7feca3fff640 1 --2- 172.21.15.59:0/3392591530 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fec90074500 0x7fec90076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:01:56.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.195+0000 7feca3fff640 1 --2- 172.21.15.59:0/3392591530 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fec90074500 0x7fec90076a10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fec98034000 tx=0x7fec9802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:01:56.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.198+0000 7feca17fa640 1 -- 172.21.15.59:0/3392591530 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fec9405bc20 con 0x7feca40cfb30 2024-04-25T17:01:56.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.495+0000 7feca17fa640 1 -- 172.21.15.59:0/3392591530 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feca40c4e70 con 0x7feca40cfb30 2024-04-25T17:01:56.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.686+0000 7fecaad96640 1 -- 172.21.15.59:0/3392591530 --> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feca40698a0 con 0x7fec90074500 2024-04-25T17:01:56.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.696+0000 7feca17fa640 1 -- 172.21.15.59:0/3392591530 <== mgr.4102 v2:172.21.15.59:6800/2368090706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252608 (secure 0 0 0) 0x7feca40698a0 con 0x7fec90074500 2024-04-25T17:01:56.697 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T17:01:56.698 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T17:01:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.699+0000 7fecaad96640 1 -- 172.21.15.59:0/3392591530 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fec90074500 msgr2=0x7fec90076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.699+0000 7fecaad96640 1 --2- 172.21.15.59:0/3392591530 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fec90074500 0x7fec90076a10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fec98034000 tx=0x7fec9802e000 comp rx=0 tx=0).stop 2024-04-25T17:01:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.699+0000 7fecaad96640 1 -- 172.21.15.59:0/3392591530 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feca40cfb30 msgr2=0x7feca41f4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:01:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.699+0000 7fecaad96640 1 --2- 172.21.15.59:0/3392591530 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feca40cfb30 0x7feca41f4f70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fec9400e8a0 tx=0x7fec9400ed60 comp rx=0 tx=0).stop 2024-04-25T17:01:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.700+0000 7fecaad96640 1 -- 172.21.15.59:0/3392591530 shutdown_connections 2024-04-25T17:01:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.700+0000 7fecaad96640 1 --2- 172.21.15.59:0/3392591530 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fec90074500 0x7fec90076a10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:56.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.700+0000 7fecaad96640 1 --2- 172.21.15.59:0/3392591530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feca415fc80 0x7feca40cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:56.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.700+0000 7fecaad96640 1 --2- 172.21.15.59:0/3392591530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feca4156770 0x7feca415b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:56.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.700+0000 7fecaad96640 1 --2- 172.21.15.59:0/3392591530 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feca40cfb30 0x7feca41f4f70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:01:56.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.700+0000 7fecaad96640 1 -- 172.21.15.59:0/3392591530 >> 172.21.15.59:0/3392591530 conn(0x7feca4073200 msgr2=0x7feca40c5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:01:56.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.700+0000 7fecaad96640 1 -- 172.21.15.59:0/3392591530 shutdown_connections 2024-04-25T17:01:56.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:01:56.700+0000 7fecaad96640 1 -- 172.21.15.59:0/3392591530 wait complete. 2024-04-25T17:01:56.710 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":2288,"stamp":"2024-04-25T17:01:55.419630+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":184908490,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":5898,"num_read_kb":1451856,"num_write":56443,"num_write_kb":4563428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53255,"ondisk_log_size":53255,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":934688,"kb_used_data":363232,"kb_used_omap":12,"kb_used_meta":571379,"kb_avail":754040032,"statfs":{"total":773094113280,"available":772136992768,"internally_reserved":0,"allocated":371949568,"data_stored":370527476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":585092658},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002827"},"pg_stats":[{"pgid":"3.3f","version":"24'430","reported_seq":558,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.999750+0000","last_change":"2024-04-25T15:47:08.942552+0000","last_active":"2024-04-25T17:01:38.999750+0000","last_peered":"2024-04-25T17:01:38.999750+0000","last_clean":"2024-04-25T17:01:38.999750+0000","last_became_active":"2024-04-25T15:47:08.942222+0000","last_became_peered":"2024-04-25T15:47:08.942222+0000","last_unstale":"2024-04-25T17:01:38.999750+0000","last_undegraded":"2024-04-25T17:01:38.999750+0000","last_fullsized":"2024-04-25T17:01:38.999750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":51437,"num_write":399,"num_write_kb":108426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"24'420","reported_seq":505,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.180749+0000","last_change":"2024-04-25T15:46:33.022420+0000","last_active":"2024-04-25T17:01:39.180749+0000","last_peered":"2024-04-25T17:01:39.180749+0000","last_clean":"2024-04-25T17:01:39.180749+0000","last_became_active":"2024-04-25T15:46:33.022095+0000","last_became_peered":"2024-04-25T15:46:33.022095+0000","last_unstale":"2024-04-25T17:01:39.180749+0000","last_undegraded":"2024-04-25T17:01:39.180749+0000","last_fullsized":"2024-04-25T17:01:39.180749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15735,"num_write":392,"num_write_kb":67130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"24'384","reported_seq":465,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.999812+0000","last_change":"2024-04-25T15:46:33.063451+0000","last_active":"2024-04-25T17:01:38.999812+0000","last_peered":"2024-04-25T17:01:38.999812+0000","last_clean":"2024-04-25T17:01:38.999812+0000","last_became_active":"2024-04-25T15:46:33.063038+0000","last_became_peered":"2024-04-25T15:46:33.063038+0000","last_unstale":"2024-04-25T17:01:38.999812+0000","last_undegraded":"2024-04-25T17:01:38.999812+0000","last_fullsized":"2024-04-25T17:01:38.999812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13830,"num_write":355,"num_write_kb":38647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"24'395","reported_seq":470,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.082464+0000","last_change":"2024-04-25T15:47:09.046881+0000","last_active":"2024-04-25T17:01:39.082464+0000","last_peered":"2024-04-25T17:01:39.082464+0000","last_clean":"2024-04-25T17:01:39.082464+0000","last_became_active":"2024-04-25T15:47:09.046576+0000","last_became_peered":"2024-04-25T15:47:09.046576+0000","last_unstale":"2024-04-25T17:01:39.082464+0000","last_undegraded":"2024-04-25T17:01:39.082464+0000","last_fullsized":"2024-04-25T17:01:39.082464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":6992,"num_write":371,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"24'432","reported_seq":558,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.951575+0000","last_change":"2024-04-25T15:46:33.063350+0000","last_active":"2024-04-25T17:01:38.951575+0000","last_peered":"2024-04-25T17:01:38.951575+0000","last_clean":"2024-04-25T17:01:38.951575+0000","last_became_active":"2024-04-25T15:46:33.063110+0000","last_became_peered":"2024-04-25T15:46:33.063110+0000","last_unstale":"2024-04-25T17:01:38.951575+0000","last_undegraded":"2024-04-25T17:01:38.951575+0000","last_fullsized":"2024-04-25T17:01:38.951575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":46382,"num_write":409,"num_write_kb":84827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"24'371","reported_seq":423,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.967663+0000","last_change":"2024-04-25T15:46:33.040765+0000","last_active":"2024-04-25T17:01:38.967663+0000","last_peered":"2024-04-25T17:01:38.967663+0000","last_clean":"2024-04-25T17:01:38.967663+0000","last_became_active":"2024-04-25T15:46:33.040272+0000","last_became_peered":"2024-04-25T15:46:33.040272+0000","last_unstale":"2024-04-25T17:01:38.967663+0000","last_undegraded":"2024-04-25T17:01:38.967663+0000","last_fullsized":"2024-04-25T17:01:38.967663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:20.677976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":345,"num_write_kb":38164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"24'405","reported_seq":505,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.942762+0000","last_change":"2024-04-25T15:46:33.037395+0000","last_active":"2024-04-25T17:01:38.942762+0000","last_peered":"2024-04-25T17:01:38.942762+0000","last_clean":"2024-04-25T17:01:38.942762+0000","last_became_active":"2024-04-25T15:46:33.036613+0000","last_became_peered":"2024-04-25T15:46:33.036613+0000","last_unstale":"2024-04-25T17:01:38.942762+0000","last_undegraded":"2024-04-25T17:01:38.942762+0000","last_fullsized":"2024-04-25T17:01:38.942762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29371,"num_write":377,"num_write_kb":63589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"24'387","reported_seq":480,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.079764+0000","last_change":"2024-04-25T15:47:09.047263+0000","last_active":"2024-04-25T17:01:39.079764+0000","last_peered":"2024-04-25T17:01:39.079764+0000","last_clean":"2024-04-25T17:01:39.079764+0000","last_became_active":"2024-04-25T15:47:09.046942+0000","last_became_peered":"2024-04-25T15:47:09.046942+0000","last_unstale":"2024-04-25T17:01:39.079764+0000","last_undegraded":"2024-04-25T17:01:39.079764+0000","last_fullsized":"2024-04-25T17:01:39.079764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37992,"num_write":353,"num_write_kb":79970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"24'414","reported_seq":514,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.962775+0000","last_change":"2024-04-25T15:46:33.043405+0000","last_active":"2024-04-25T17:01:38.962775+0000","last_peered":"2024-04-25T17:01:38.962775+0000","last_clean":"2024-04-25T17:01:38.962775+0000","last_became_active":"2024-04-25T15:46:33.043094+0000","last_became_peered":"2024-04-25T15:46:33.043094+0000","last_unstale":"2024-04-25T17:01:38.962775+0000","last_undegraded":"2024-04-25T17:01:38.962775+0000","last_fullsized":"2024-04-25T17:01:38.962775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:49.811317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25428,"num_write":377,"num_write_kb":51351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"24'395","reported_seq":472,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.004887+0000","last_change":"2024-04-25T15:46:33.037180+0000","last_active":"2024-04-25T17:01:39.004887+0000","last_peered":"2024-04-25T17:01:39.004887+0000","last_clean":"2024-04-25T17:01:39.004887+0000","last_became_active":"2024-04-25T15:46:33.036822+0000","last_became_peered":"2024-04-25T15:46:33.036822+0000","last_unstale":"2024-04-25T17:01:39.004887+0000","last_undegraded":"2024-04-25T17:01:39.004887+0000","last_fullsized":"2024-04-25T17:01:39.004887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:45:45.123026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15654,"num_write":362,"num_write_kb":47082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"24'382","reported_seq":452,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.993868+0000","last_change":"2024-04-25T15:46:33.040594+0000","last_active":"2024-04-25T17:01:38.993868+0000","last_peered":"2024-04-25T17:01:38.993868+0000","last_clean":"2024-04-25T17:01:38.993868+0000","last_became_active":"2024-04-25T15:46:33.040296+0000","last_became_peered":"2024-04-25T15:46:33.040296+0000","last_unstale":"2024-04-25T17:01:38.993868+0000","last_undegraded":"2024-04-25T17:01:38.993868+0000","last_fullsized":"2024-04-25T17:01:38.993868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:06:47.844325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9049,"num_write":364,"num_write_kb":58665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"24'374","reported_seq":475,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.990927+0000","last_change":"2024-04-25T15:46:33.011129+0000","last_active":"2024-04-25T17:01:38.990927+0000","last_peered":"2024-04-25T17:01:38.990927+0000","last_clean":"2024-04-25T17:01:38.990927+0000","last_became_active":"2024-04-25T15:46:33.010754+0000","last_became_peered":"2024-04-25T15:46:33.010754+0000","last_unstale":"2024-04-25T17:01:38.990927+0000","last_undegraded":"2024-04-25T17:01:38.990927+0000","last_fullsized":"2024-04-25T17:01:38.990927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:31.093111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27496,"num_write":346,"num_write_kb":71109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"24'401","reported_seq":496,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.925242+0000","last_change":"2024-04-25T15:46:33.011388+0000","last_active":"2024-04-25T17:01:38.925242+0000","last_peered":"2024-04-25T17:01:38.925242+0000","last_clean":"2024-04-25T17:01:38.925242+0000","last_became_active":"2024-04-25T15:46:33.011083+0000","last_became_peered":"2024-04-25T15:46:33.011083+0000","last_unstale":"2024-04-25T17:01:38.925242+0000","last_undegraded":"2024-04-25T17:01:38.925242+0000","last_fullsized":"2024-04-25T17:01:38.925242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":17390,"num_write":371,"num_write_kb":87698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"24'409","reported_seq":494,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:54.804461+0000","last_change":"2024-04-25T17:01:54.804488+0000","last_active":"2024-04-25T17:01:54.804461+0000","last_peered":"2024-04-25T17:01:54.804461+0000","last_clean":"2024-04-25T17:01:54.804461+0000","last_became_active":"2024-04-25T15:46:33.022214+0000","last_became_peered":"2024-04-25T15:46:33.022214+0000","last_unstale":"2024-04-25T17:01:54.804461+0000","last_undegraded":"2024-04-25T17:01:54.804461+0000","last_fullsized":"2024-04-25T17:01:54.804461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'409","last_scrub_stamp":"2024-04-25T17:01:54.804369+0000","last_deep_scrub":"24'409","last_deep_scrub_stamp":"2024-04-25T17:01:54.804369+0000","last_clean_scrub_stamp":"2024-04-25T17:01:54.804369+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:58:11.007407+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17435,"num_write":384,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"24'435","reported_seq":564,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.162084+0000","last_change":"2024-04-25T15:46:32.929715+0000","last_active":"2024-04-25T17:01:39.162084+0000","last_peered":"2024-04-25T17:01:39.162084+0000","last_clean":"2024-04-25T17:01:39.162084+0000","last_became_active":"2024-04-25T15:46:32.929386+0000","last_became_peered":"2024-04-25T15:46:32.929386+0000","last_unstale":"2024-04-25T17:01:39.162084+0000","last_undegraded":"2024-04-25T17:01:39.162084+0000","last_fullsized":"2024-04-25T17:01:39.162084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41362,"num_write":401,"num_write_kb":92598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"24'426","reported_seq":499,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.966357+0000","last_change":"2024-04-25T15:46:33.041583+0000","last_active":"2024-04-25T17:01:38.966357+0000","last_peered":"2024-04-25T17:01:38.966357+0000","last_clean":"2024-04-25T17:01:38.966357+0000","last_became_active":"2024-04-25T15:46:33.040240+0000","last_became_peered":"2024-04-25T15:46:33.040240+0000","last_unstale":"2024-04-25T17:01:38.966357+0000","last_undegraded":"2024-04-25T17:01:38.966357+0000","last_fullsized":"2024-04-25T17:01:38.966357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16384,"num_write":396,"num_write_kb":62713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"24'404","reported_seq":490,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.972544+0000","last_change":"2024-04-25T15:46:33.044561+0000","last_active":"2024-04-25T17:01:38.972544+0000","last_peered":"2024-04-25T17:01:38.972544+0000","last_clean":"2024-04-25T17:01:38.972544+0000","last_became_active":"2024-04-25T15:46:33.044065+0000","last_became_peered":"2024-04-25T15:46:33.044065+0000","last_unstale":"2024-04-25T17:01:38.972544+0000","last_undegraded":"2024-04-25T17:01:38.972544+0000","last_fullsized":"2024-04-25T17:01:38.972544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:33.557001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":15331,"num_write":377,"num_write_kb":71706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"24'418","reported_seq":518,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.080367+0000","last_change":"2024-04-25T15:46:33.061929+0000","last_active":"2024-04-25T17:01:39.080367+0000","last_peered":"2024-04-25T17:01:39.080367+0000","last_clean":"2024-04-25T17:01:39.080367+0000","last_became_active":"2024-04-25T15:46:33.061623+0000","last_became_peered":"2024-04-25T15:46:33.061623+0000","last_unstale":"2024-04-25T17:01:39.080367+0000","last_undegraded":"2024-04-25T17:01:39.080367+0000","last_fullsized":"2024-04-25T17:01:39.080367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29942,"num_write":388,"num_write_kb":91861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"24'442","reported_seq":554,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.948818+0000","last_change":"2024-04-25T15:46:33.063451+0000","last_active":"2024-04-25T17:01:38.948818+0000","last_peered":"2024-04-25T17:01:38.948818+0000","last_clean":"2024-04-25T17:01:38.948818+0000","last_became_active":"2024-04-25T15:46:33.063126+0000","last_became_peered":"2024-04-25T15:46:33.063126+0000","last_unstale":"2024-04-25T17:01:38.948818+0000","last_undegraded":"2024-04-25T17:01:38.948818+0000","last_fullsized":"2024-04-25T17:01:38.948818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:49.144595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":28728,"num_write":405,"num_write_kb":157712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"24'446","reported_seq":529,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996562+0000","last_change":"2024-04-25T15:46:33.014377+0000","last_active":"2024-04-25T17:01:38.996562+0000","last_peered":"2024-04-25T17:01:38.996562+0000","last_clean":"2024-04-25T17:01:38.996562+0000","last_became_active":"2024-04-25T15:46:33.014056+0000","last_became_peered":"2024-04-25T15:46:33.014056+0000","last_unstale":"2024-04-25T17:01:38.996562+0000","last_undegraded":"2024-04-25T17:01:38.996562+0000","last_fullsized":"2024-04-25T17:01:38.996562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:49.025646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19430,"num_write":422,"num_write_kb":59069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"24'420","reported_seq":530,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996976+0000","last_change":"2024-04-25T15:46:33.032744+0000","last_active":"2024-04-25T17:01:38.996976+0000","last_peered":"2024-04-25T17:01:38.996976+0000","last_clean":"2024-04-25T17:01:38.996976+0000","last_became_active":"2024-04-25T15:46:33.032498+0000","last_became_peered":"2024-04-25T15:46:33.032498+0000","last_unstale":"2024-04-25T17:01:38.996976+0000","last_undegraded":"2024-04-25T17:01:38.996976+0000","last_fullsized":"2024-04-25T17:01:38.996976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38942,"num_write":394,"num_write_kb":67464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"24'418","reported_seq":501,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.974586+0000","last_change":"2024-04-25T15:46:33.043548+0000","last_active":"2024-04-25T17:01:38.974586+0000","last_peered":"2024-04-25T17:01:38.974586+0000","last_clean":"2024-04-25T17:01:38.974586+0000","last_became_active":"2024-04-25T15:46:33.043251+0000","last_became_peered":"2024-04-25T15:46:33.043251+0000","last_unstale":"2024-04-25T17:01:38.974586+0000","last_undegraded":"2024-04-25T17:01:38.974586+0000","last_fullsized":"2024-04-25T17:01:38.974586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:04.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15275,"num_write":389,"num_write_kb":50799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"24'423","reported_seq":529,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.921557+0000","last_change":"2024-04-25T15:46:32.927532+0000","last_active":"2024-04-25T17:01:38.921557+0000","last_peered":"2024-04-25T17:01:38.921557+0000","last_clean":"2024-04-25T17:01:38.921557+0000","last_became_active":"2024-04-25T15:46:32.926836+0000","last_became_peered":"2024-04-25T15:46:32.926836+0000","last_unstale":"2024-04-25T17:01:38.921557+0000","last_undegraded":"2024-04-25T17:01:38.921557+0000","last_fullsized":"2024-04-25T17:01:38.921557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":23691,"num_write":392,"num_write_kb":92779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"24'428","reported_seq":517,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.972089+0000","last_change":"2024-04-25T15:46:33.041900+0000","last_active":"2024-04-25T17:01:38.972089+0000","last_peered":"2024-04-25T17:01:38.972089+0000","last_clean":"2024-04-25T17:01:38.972089+0000","last_became_active":"2024-04-25T15:46:33.040821+0000","last_became_peered":"2024-04-25T15:46:33.040821+0000","last_unstale":"2024-04-25T17:01:38.972089+0000","last_undegraded":"2024-04-25T17:01:38.972089+0000","last_fullsized":"2024-04-25T17:01:38.972089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18443,"num_write":400,"num_write_kb":50986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"24'394","reported_seq":478,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.914675+0000","last_change":"2024-04-25T15:46:32.926772+0000","last_active":"2024-04-25T17:01:38.914675+0000","last_peered":"2024-04-25T17:01:38.914675+0000","last_clean":"2024-04-25T17:01:38.914675+0000","last_became_active":"2024-04-25T15:46:32.926468+0000","last_became_peered":"2024-04-25T15:46:32.926468+0000","last_unstale":"2024-04-25T17:01:38.914675+0000","last_undegraded":"2024-04-25T17:01:38.914675+0000","last_fullsized":"2024-04-25T17:01:38.914675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16804,"num_write":379,"num_write_kb":50499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"24'462","reported_seq":583,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.005049+0000","last_change":"2024-04-25T15:46:33.031482+0000","last_active":"2024-04-25T17:01:39.005049+0000","last_peered":"2024-04-25T17:01:39.005049+0000","last_clean":"2024-04-25T17:01:39.005049+0000","last_became_active":"2024-04-25T15:46:33.031182+0000","last_became_peered":"2024-04-25T15:46:33.031182+0000","last_unstale":"2024-04-25T17:01:39.005049+0000","last_undegraded":"2024-04-25T17:01:39.005049+0000","last_fullsized":"2024-04-25T17:01:39.005049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:54:07.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":42888,"num_write":421,"num_write_kb":44012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"24'399","reported_seq":500,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.162324+0000","last_change":"2024-04-25T15:46:32.931992+0000","last_active":"2024-04-25T17:01:39.162324+0000","last_peered":"2024-04-25T17:01:39.162324+0000","last_clean":"2024-04-25T17:01:39.162324+0000","last_became_active":"2024-04-25T15:46:32.931684+0000","last_became_peered":"2024-04-25T15:46:32.931684+0000","last_unstale":"2024-04-25T17:01:39.162324+0000","last_undegraded":"2024-04-25T17:01:39.162324+0000","last_fullsized":"2024-04-25T17:01:39.162324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25944,"num_write":373,"num_write_kb":59184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"24'397","reported_seq":466,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.924225+0000","last_change":"2024-04-25T15:46:32.926461+0000","last_active":"2024-04-25T17:01:38.924225+0000","last_peered":"2024-04-25T17:01:38.924225+0000","last_clean":"2024-04-25T17:01:38.924225+0000","last_became_active":"2024-04-25T15:46:32.926136+0000","last_became_peered":"2024-04-25T15:46:32.926136+0000","last_unstale":"2024-04-25T17:01:38.924225+0000","last_undegraded":"2024-04-25T17:01:38.924225+0000","last_fullsized":"2024-04-25T17:01:38.924225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5076,"num_write":375,"num_write_kb":141478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"24'412","reported_seq":522,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:53.816167+0000","last_change":"2024-04-25T17:01:53.816167+0000","last_active":"2024-04-25T17:01:53.816167+0000","last_peered":"2024-04-25T17:01:53.816167+0000","last_clean":"2024-04-25T17:01:53.816167+0000","last_became_active":"2024-04-25T15:46:33.022116+0000","last_became_peered":"2024-04-25T15:46:33.022116+0000","last_unstale":"2024-04-25T17:01:53.816167+0000","last_undegraded":"2024-04-25T17:01:53.816167+0000","last_fullsized":"2024-04-25T17:01:53.816167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'412","last_scrub_stamp":"2024-04-25T17:01:53.815999+0000","last_deep_scrub":"24'412","last_deep_scrub_stamp":"2024-04-25T17:01:53.815999+0000","last_clean_scrub_stamp":"2024-04-25T17:01:53.815999+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:09.710217+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":30085,"num_write":382,"num_write_kb":75269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"24'493","reported_seq":633,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.972507+0000","last_change":"2024-04-25T15:46:33.040668+0000","last_active":"2024-04-25T17:01:38.972507+0000","last_peered":"2024-04-25T17:01:38.972507+0000","last_clean":"2024-04-25T17:01:38.972507+0000","last_became_active":"2024-04-25T15:46:33.040134+0000","last_became_peered":"2024-04-25T15:46:33.040134+0000","last_unstale":"2024-04-25T17:01:38.972507+0000","last_undegraded":"2024-04-25T17:01:38.972507+0000","last_fullsized":"2024-04-25T17:01:38.972507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:16.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44575,"num_write":459,"num_write_kb":113331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"24'453","reported_seq":585,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.079472+0000","last_change":"2024-04-25T15:47:08.950730+0000","last_active":"2024-04-25T17:01:39.079472+0000","last_peered":"2024-04-25T17:01:39.079472+0000","last_clean":"2024-04-25T17:01:39.079472+0000","last_became_active":"2024-04-25T15:47:08.950453+0000","last_became_peered":"2024-04-25T15:47:08.950453+0000","last_unstale":"2024-04-25T17:01:39.079472+0000","last_undegraded":"2024-04-25T17:01:39.079472+0000","last_fullsized":"2024-04-25T17:01:39.079472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":42323,"num_write":423,"num_write_kb":72432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"24'432","reported_seq":513,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996532+0000","last_change":"2024-04-25T15:46:33.022223+0000","last_active":"2024-04-25T17:01:38.996532+0000","last_peered":"2024-04-25T17:01:38.996532+0000","last_clean":"2024-04-25T17:01:38.996532+0000","last_became_active":"2024-04-25T15:46:33.021888+0000","last_became_peered":"2024-04-25T15:46:33.021888+0000","last_unstale":"2024-04-25T17:01:38.996532+0000","last_undegraded":"2024-04-25T17:01:38.996532+0000","last_fullsized":"2024-04-25T17:01:38.996532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:23.970206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16763,"num_write":405,"num_write_kb":80030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"24'382","reported_seq":443,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.984126+0000","last_change":"2024-04-25T15:46:32.929281+0000","last_active":"2024-04-25T17:01:38.984126+0000","last_peered":"2024-04-25T17:01:38.984126+0000","last_clean":"2024-04-25T17:01:38.984126+0000","last_became_active":"2024-04-25T15:46:32.929019+0000","last_became_peered":"2024-04-25T15:46:32.929019+0000","last_unstale":"2024-04-25T17:01:38.984126+0000","last_undegraded":"2024-04-25T17:01:38.984126+0000","last_fullsized":"2024-04-25T17:01:38.984126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:55.692126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5031,"num_write":350,"num_write_kb":37997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'222","reported_seq":271,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.686189+0000","last_change":"2024-04-25T15:46:31.685950+0000","last_active":"2024-04-25T17:01:38.686189+0000","last_peered":"2024-04-25T17:01:38.686189+0000","last_clean":"2024-04-25T17:01:38.686189+0000","last_became_active":"2024-04-25T15:46:31.685602+0000","last_became_peered":"2024-04-25T15:46:31.685602+0000","last_unstale":"2024-04-25T17:01:38.686189+0000","last_undegraded":"2024-04-25T17:01:38.686189+0000","last_fullsized":"2024-04-25T17:01:38.686189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"24'361","reported_seq":425,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.001310+0000","last_change":"2024-04-25T15:46:33.023655+0000","last_active":"2024-04-25T17:01:39.001310+0000","last_peered":"2024-04-25T17:01:39.001310+0000","last_clean":"2024-04-25T17:01:39.001310+0000","last_became_active":"2024-04-25T15:46:33.023432+0000","last_became_peered":"2024-04-25T15:46:33.023432+0000","last_unstale":"2024-04-25T17:01:39.001310+0000","last_undegraded":"2024-04-25T17:01:39.001310+0000","last_fullsized":"2024-04-25T17:01:39.001310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5878,"num_write":338,"num_write_kb":30071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1233","reported_seq":1281,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:35.017131+0000","last_change":"2024-04-25T15:46:31.659079+0000","last_active":"2024-04-25T17:00:35.017131+0000","last_peered":"2024-04-25T17:00:35.017131+0000","last_clean":"2024-04-25T17:00:35.017131+0000","last_became_active":"2024-04-25T15:46:31.658681+0000","last_became_peered":"2024-04-25T15:46:31.658681+0000","last_unstale":"2024-04-25T17:00:35.017131+0000","last_undegraded":"2024-04-25T17:00:35.017131+0000","last_fullsized":"2024-04-25T17:00:35.017131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1233,"log_dups_size":0,"ondisk_log_size":1233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":12901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"24'722","reported_seq":780,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:53.373035+0000","last_change":"2024-04-25T17:01:53.373035+0000","last_active":"2024-04-25T17:01:53.373035+0000","last_peered":"2024-04-25T17:01:53.373035+0000","last_clean":"2024-04-25T17:01:53.373035+0000","last_became_active":"2024-04-25T15:46:31.682936+0000","last_became_peered":"2024-04-25T15:46:31.682936+0000","last_unstale":"2024-04-25T17:01:53.373035+0000","last_undegraded":"2024-04-25T17:01:53.373035+0000","last_fullsized":"2024-04-25T17:01:53.373035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'722","last_scrub_stamp":"2024-04-25T17:01:53.372846+0000","last_deep_scrub":"24'722","last_deep_scrub_stamp":"2024-04-25T17:01:53.372846+0000","last_clean_scrub_stamp":"2024-04-25T17:01:53.372846+0000","objects_scrubbed":2,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:53.101322+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"24'432","reported_seq":505,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.920625+0000","last_change":"2024-04-25T15:46:33.019843+0000","last_active":"2024-04-25T17:01:38.920625+0000","last_peered":"2024-04-25T17:01:38.920625+0000","last_clean":"2024-04-25T17:01:38.920625+0000","last_became_active":"2024-04-25T15:46:33.019526+0000","last_became_peered":"2024-04-25T15:46:33.019526+0000","last_unstale":"2024-04-25T17:01:38.920625+0000","last_undegraded":"2024-04-25T17:01:38.920625+0000","last_fullsized":"2024-04-25T17:01:38.920625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10652,"num_write":400,"num_write_kb":42963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"24'1278","reported_seq":1327,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:27.319190+0000","last_change":"2024-04-25T15:46:31.689444+0000","last_active":"2024-04-25T17:01:27.319190+0000","last_peered":"2024-04-25T17:01:27.319190+0000","last_clean":"2024-04-25T17:01:27.319190+0000","last_became_active":"2024-04-25T15:46:31.689130+0000","last_became_peered":"2024-04-25T15:46:31.689130+0000","last_unstale":"2024-04-25T17:01:27.319190+0000","last_undegraded":"2024-04-25T17:01:27.319190+0000","last_fullsized":"2024-04-25T17:01:27.319190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1278,"log_dups_size":0,"ondisk_log_size":1278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":12905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"24'413","reported_seq":476,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:42.354747+0000","last_change":"2024-04-25T15:46:32.931979+0000","last_active":"2024-04-25T17:01:42.354747+0000","last_peered":"2024-04-25T17:01:42.354747+0000","last_clean":"2024-04-25T17:01:42.354747+0000","last_became_active":"2024-04-25T15:46:32.931648+0000","last_became_peered":"2024-04-25T15:46:32.931648+0000","last_unstale":"2024-04-25T17:01:42.354747+0000","last_undegraded":"2024-04-25T17:01:42.354747+0000","last_fullsized":"2024-04-25T17:01:42.354747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9624,"num_write":380,"num_write_kb":46532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"24'54","reported_seq":103,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:27.332734+0000","last_change":"2024-04-25T15:46:31.685721+0000","last_active":"2024-04-25T17:01:27.332734+0000","last_peered":"2024-04-25T17:01:27.332734+0000","last_clean":"2024-04-25T17:01:27.332734+0000","last_became_active":"2024-04-25T15:46:31.685244+0000","last_became_peered":"2024-04-25T15:46:31.685244+0000","last_unstale":"2024-04-25T17:01:27.332734+0000","last_undegraded":"2024-04-25T17:01:27.332734+0000","last_fullsized":"2024-04-25T17:01:27.332734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"24'416","reported_seq":506,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.973069+0000","last_change":"2024-04-25T15:46:33.043533+0000","last_active":"2024-04-25T17:01:38.973069+0000","last_peered":"2024-04-25T17:01:38.973069+0000","last_clean":"2024-04-25T17:01:38.973069+0000","last_became_active":"2024-04-25T15:46:33.043228+0000","last_became_peered":"2024-04-25T15:46:33.043228+0000","last_unstale":"2024-04-25T17:01:38.973069+0000","last_undegraded":"2024-04-25T17:01:38.973069+0000","last_fullsized":"2024-04-25T17:01:38.973069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:07.660287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26593,"num_write":386,"num_write_kb":54872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"24'373","reported_seq":422,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:15.484935+0000","last_change":"2024-04-25T15:46:31.692399+0000","last_active":"2024-04-25T17:01:15.484935+0000","last_peered":"2024-04-25T17:01:15.484935+0000","last_clean":"2024-04-25T17:01:15.484935+0000","last_became_active":"2024-04-25T15:46:31.692063+0000","last_became_peered":"2024-04-25T15:46:31.692063+0000","last_unstale":"2024-04-25T17:01:15.484935+0000","last_undegraded":"2024-04-25T17:01:15.484935+0000","last_fullsized":"2024-04-25T17:01:15.484935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'409","reported_seq":514,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.994096+0000","last_change":"2024-04-25T15:46:33.043275+0000","last_active":"2024-04-25T17:01:38.994096+0000","last_peered":"2024-04-25T17:01:38.994096+0000","last_clean":"2024-04-25T17:01:38.994096+0000","last_became_active":"2024-04-25T15:46:33.042941+0000","last_became_peered":"2024-04-25T15:46:33.042941+0000","last_unstale":"2024-04-25T17:01:38.994096+0000","last_undegraded":"2024-04-25T17:01:38.994096+0000","last_fullsized":"2024-04-25T17:01:38.994096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53704,"num_write":377,"num_write_kb":101029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'2113","reported_seq":2163,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:36.064552+0000","last_change":"2024-04-25T15:46:31.686299+0000","last_active":"2024-04-25T17:01:36.064552+0000","last_peered":"2024-04-25T17:01:36.064552+0000","last_clean":"2024-04-25T17:01:36.064552+0000","last_became_active":"2024-04-25T15:46:31.685993+0000","last_became_peered":"2024-04-25T15:46:31.685993+0000","last_unstale":"2024-04-25T17:01:36.064552+0000","last_undegraded":"2024-04-25T17:01:36.064552+0000","last_fullsized":"2024-04-25T17:01:36.064552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":2113,"log_dups_size":0,"ondisk_log_size":2113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2065,"num_write_kb":6028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'405","reported_seq":535,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.989646+0000","last_change":"2024-04-25T15:46:33.035207+0000","last_active":"2024-04-25T17:01:38.989646+0000","last_peered":"2024-04-25T17:01:38.989646+0000","last_clean":"2024-04-25T17:01:38.989646+0000","last_became_active":"2024-04-25T15:46:33.034926+0000","last_became_peered":"2024-04-25T15:46:33.034926+0000","last_unstale":"2024-04-25T17:01:38.989646+0000","last_undegraded":"2024-04-25T17:01:38.989646+0000","last_fullsized":"2024-04-25T17:01:38.989646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:28.844626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":46433,"num_write":373,"num_write_kb":80369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'1505","reported_seq":1555,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:27.332697+0000","last_change":"2024-04-25T15:46:31.683086+0000","last_active":"2024-04-25T17:01:27.332697+0000","last_peered":"2024-04-25T17:01:27.332697+0000","last_clean":"2024-04-25T17:01:27.332697+0000","last_became_active":"2024-04-25T15:46:31.682661+0000","last_became_peered":"2024-04-25T15:46:31.682661+0000","last_unstale":"2024-04-25T17:01:27.332697+0000","last_undegraded":"2024-04-25T17:01:27.332697+0000","last_fullsized":"2024-04-25T17:01:27.332697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1505,"log_dups_size":0,"ondisk_log_size":1505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1466,"num_write_kb":13174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"24'389","reported_seq":486,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.951163+0000","last_change":"2024-04-25T15:46:33.034800+0000","last_active":"2024-04-25T17:01:38.951163+0000","last_peered":"2024-04-25T17:01:38.951163+0000","last_clean":"2024-04-25T17:01:38.951163+0000","last_became_active":"2024-04-25T15:46:33.034493+0000","last_became_peered":"2024-04-25T15:46:33.034493+0000","last_unstale":"2024-04-25T17:01:38.951163+0000","last_undegraded":"2024-04-25T17:01:38.951163+0000","last_fullsized":"2024-04-25T17:01:38.951163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:16.529649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":29846,"num_write":355,"num_write_kb":66952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"24'429","reported_seq":488,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:50.818241+0000","last_change":"2024-04-25T17:01:50.818304+0000","last_active":"2024-04-25T17:01:50.818241+0000","last_peered":"2024-04-25T17:01:50.818241+0000","last_clean":"2024-04-25T17:01:50.818241+0000","last_became_active":"2024-04-25T15:46:31.688096+0000","last_became_peered":"2024-04-25T15:46:31.688096+0000","last_unstale":"2024-04-25T17:01:50.818241+0000","last_undegraded":"2024-04-25T17:01:50.818241+0000","last_fullsized":"2024-04-25T17:01:50.818241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'429","last_scrub_stamp":"2024-04-25T17:01:50.818120+0000","last_deep_scrub":"24'429","last_deep_scrub_stamp":"2024-04-25T17:01:50.818120+0000","last_clean_scrub_stamp":"2024-04-25T17:01:50.818120+0000","objects_scrubbed":6,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:51.668308+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"24'423","reported_seq":499,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.999918+0000","last_change":"2024-04-25T15:46:33.031520+0000","last_active":"2024-04-25T17:01:38.999918+0000","last_peered":"2024-04-25T17:01:38.999918+0000","last_clean":"2024-04-25T17:01:38.999918+0000","last_became_active":"2024-04-25T15:46:33.031282+0000","last_became_peered":"2024-04-25T15:46:33.031282+0000","last_unstale":"2024-04-25T17:01:38.999918+0000","last_undegraded":"2024-04-25T17:01:38.999918+0000","last_fullsized":"2024-04-25T17:01:38.999918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11364,"num_write":392,"num_write_kb":80312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"24'62","reported_seq":112,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:12.317879+0000","last_change":"2024-04-25T15:46:31.691191+0000","last_active":"2024-04-25T17:01:12.317879+0000","last_peered":"2024-04-25T17:01:12.317879+0000","last_clean":"2024-04-25T17:01:12.317879+0000","last_became_active":"2024-04-25T15:46:31.690848+0000","last_became_peered":"2024-04-25T15:46:31.690848+0000","last_unstale":"2024-04-25T17:01:12.317879+0000","last_undegraded":"2024-04-25T17:01:12.317879+0000","last_fullsized":"2024-04-25T17:01:12.317879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'391","reported_seq":450,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.964984+0000","last_change":"2024-04-25T15:46:33.040890+0000","last_active":"2024-04-25T17:01:38.964984+0000","last_peered":"2024-04-25T17:01:38.964984+0000","last_clean":"2024-04-25T17:01:38.964984+0000","last_became_active":"2024-04-25T15:46:33.040568+0000","last_became_peered":"2024-04-25T15:46:33.040568+0000","last_unstale":"2024-04-25T17:01:38.964984+0000","last_undegraded":"2024-04-25T17:01:38.964984+0000","last_fullsized":"2024-04-25T17:01:38.964984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:04.961110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":1556,"num_write":356,"num_write_kb":55877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"24'58","reported_seq":108,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T16:59:56.238276+0000","last_change":"2024-04-25T15:46:31.659031+0000","last_active":"2024-04-25T16:59:56.238276+0000","last_peered":"2024-04-25T16:59:56.238276+0000","last_clean":"2024-04-25T16:59:56.238276+0000","last_became_active":"2024-04-25T15:46:31.658670+0000","last_became_peered":"2024-04-25T15:46:31.658670+0000","last_unstale":"2024-04-25T16:59:56.238276+0000","last_undegraded":"2024-04-25T16:59:56.238276+0000","last_fullsized":"2024-04-25T16:59:56.238276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"24'439","reported_seq":516,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.993735+0000","last_change":"2024-04-25T15:46:33.021142+0000","last_active":"2024-04-25T17:01:38.993735+0000","last_peered":"2024-04-25T17:01:38.993735+0000","last_clean":"2024-04-25T17:01:38.993735+0000","last_became_active":"2024-04-25T15:46:33.020753+0000","last_became_peered":"2024-04-25T15:46:33.020753+0000","last_unstale":"2024-04-25T17:01:38.993735+0000","last_undegraded":"2024-04-25T17:01:38.993735+0000","last_fullsized":"2024-04-25T17:01:38.993735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:38:52.666334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17823,"num_write":412,"num_write_kb":54819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'576","reported_seq":635,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:51.897551+0000","last_change":"2024-04-25T17:01:51.897633+0000","last_active":"2024-04-25T17:01:51.897551+0000","last_peered":"2024-04-25T17:01:51.897551+0000","last_clean":"2024-04-25T17:01:51.897551+0000","last_became_active":"2024-04-25T15:46:31.703167+0000","last_became_peered":"2024-04-25T15:46:31.703167+0000","last_unstale":"2024-04-25T17:01:51.897551+0000","last_undegraded":"2024-04-25T17:01:51.897551+0000","last_fullsized":"2024-04-25T17:01:51.897551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'576","last_scrub_stamp":"2024-04-25T17:01:51.897447+0000","last_deep_scrub":"24'576","last_deep_scrub_stamp":"2024-04-25T17:01:51.897447+0000","last_clean_scrub_stamp":"2024-04-25T17:01:51.897447+0000","objects_scrubbed":10,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:03.681252+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":510,"num_write_kb":8426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"24'470","reported_seq":592,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.950114+0000","last_change":"2024-04-25T15:46:33.039900+0000","last_active":"2024-04-25T17:01:38.950114+0000","last_peered":"2024-04-25T17:01:38.950114+0000","last_clean":"2024-04-25T17:01:38.950114+0000","last_became_active":"2024-04-25T15:46:33.039613+0000","last_became_peered":"2024-04-25T15:46:33.039613+0000","last_unstale":"2024-04-25T17:01:38.950114+0000","last_undegraded":"2024-04-25T17:01:38.950114+0000","last_fullsized":"2024-04-25T17:01:38.950114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":36444,"num_write":435,"num_write_kb":71594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'805","reported_seq":856,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:11.165829+0000","last_change":"2024-04-25T15:46:31.684537+0000","last_active":"2024-04-25T17:01:11.165829+0000","last_peered":"2024-04-25T17:01:11.165829+0000","last_clean":"2024-04-25T17:01:11.165829+0000","last_became_active":"2024-04-25T15:46:31.684173+0000","last_became_peered":"2024-04-25T15:46:31.684173+0000","last_unstale":"2024-04-25T17:01:11.165829+0000","last_undegraded":"2024-04-25T17:01:11.165829+0000","last_fullsized":"2024-04-25T17:01:11.165829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:41.912032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":4496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'360","reported_seq":440,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.957203+0000","last_change":"2024-04-25T15:46:33.037831+0000","last_active":"2024-04-25T17:01:38.957203+0000","last_peered":"2024-04-25T17:01:38.957203+0000","last_clean":"2024-04-25T17:01:38.957203+0000","last_became_active":"2024-04-25T15:46:33.037529+0000","last_became_peered":"2024-04-25T15:46:33.037529+0000","last_unstale":"2024-04-25T17:01:38.957203+0000","last_undegraded":"2024-04-25T17:01:38.957203+0000","last_fullsized":"2024-04-25T17:01:38.957203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:20.677976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":10575,"num_write":335,"num_write_kb":42548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'799","reported_seq":851,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:47.387978+0000","last_change":"2024-04-25T15:46:31.704159+0000","last_active":"2024-04-25T17:00:47.387978+0000","last_peered":"2024-04-25T17:00:47.387978+0000","last_clean":"2024-04-25T17:00:47.387978+0000","last_became_active":"2024-04-25T15:46:31.703896+0000","last_became_peered":"2024-04-25T15:46:31.703896+0000","last_unstale":"2024-04-25T17:00:47.387978+0000","last_undegraded":"2024-04-25T17:00:47.387978+0000","last_fullsized":"2024-04-25T17:00:47.387978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":4482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'410","reported_seq":481,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.963314+0000","last_change":"2024-04-25T15:46:33.038719+0000","last_active":"2024-04-25T17:01:38.963314+0000","last_peered":"2024-04-25T17:01:38.963314+0000","last_clean":"2024-04-25T17:01:38.963314+0000","last_became_active":"2024-04-25T15:46:33.038380+0000","last_became_peered":"2024-04-25T15:46:33.038380+0000","last_unstale":"2024-04-25T17:01:38.963314+0000","last_undegraded":"2024-04-25T17:01:38.963314+0000","last_fullsized":"2024-04-25T17:01:38.963314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:13:33.423087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18534,"num_write":381,"num_write_kb":108433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'789","reported_seq":841,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:47.527486+0000","last_change":"2024-04-25T15:46:31.690489+0000","last_active":"2024-04-25T17:00:47.527486+0000","last_peered":"2024-04-25T17:00:47.527486+0000","last_clean":"2024-04-25T17:00:47.527486+0000","last_became_active":"2024-04-25T15:46:31.690181+0000","last_became_peered":"2024-04-25T15:46:31.690181+0000","last_unstale":"2024-04-25T17:00:47.527486+0000","last_undegraded":"2024-04-25T17:00:47.527486+0000","last_fullsized":"2024-04-25T17:00:47.527486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'428","reported_seq":501,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.971899+0000","last_change":"2024-04-25T15:46:33.036460+0000","last_active":"2024-04-25T17:01:38.971899+0000","last_peered":"2024-04-25T17:01:38.971899+0000","last_clean":"2024-04-25T17:01:38.971899+0000","last_became_active":"2024-04-25T15:46:33.036033+0000","last_became_peered":"2024-04-25T15:46:33.036033+0000","last_unstale":"2024-04-25T17:01:38.971899+0000","last_undegraded":"2024-04-25T17:01:38.971899+0000","last_fullsized":"2024-04-25T17:01:38.971899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:15.023466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13038,"num_write":401,"num_write_kb":62698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"24'332","reported_seq":384,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:23.750840+0000","last_change":"2024-04-25T15:46:31.703571+0000","last_active":"2024-04-25T17:01:23.750840+0000","last_peered":"2024-04-25T17:01:23.750840+0000","last_clean":"2024-04-25T17:01:23.750840+0000","last_became_active":"2024-04-25T15:46:31.703234+0000","last_became_peered":"2024-04-25T15:46:31.703234+0000","last_unstale":"2024-04-25T17:01:23.750840+0000","last_undegraded":"2024-04-25T17:01:23.750840+0000","last_fullsized":"2024-04-25T17:01:23.750840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'422","reported_seq":513,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.957568+0000","last_change":"2024-04-25T15:46:33.043464+0000","last_active":"2024-04-25T17:01:38.957568+0000","last_peered":"2024-04-25T17:01:38.957568+0000","last_clean":"2024-04-25T17:01:38.957568+0000","last_became_active":"2024-04-25T15:46:33.043145+0000","last_became_peered":"2024-04-25T15:46:33.043145+0000","last_unstale":"2024-04-25T17:01:38.957568+0000","last_undegraded":"2024-04-25T17:01:38.957568+0000","last_fullsized":"2024-04-25T17:01:38.957568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:06.648469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":16889,"num_write":397,"num_write_kb":47575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":151,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T16:58:32.437867+0000","last_change":"2024-04-25T15:46:20.235628+0000","last_active":"2024-04-25T16:58:32.437867+0000","last_peered":"2024-04-25T16:58:32.437867+0000","last_clean":"2024-04-25T16:58:32.437867+0000","last_became_active":"2024-04-25T15:46:20.234477+0000","last_became_peered":"2024-04-25T15:46:20.234477+0000","last_unstale":"2024-04-25T16:58:32.437867+0000","last_undegraded":"2024-04-25T16:58:32.437867+0000","last_fullsized":"2024-04-25T16:58:32.437867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:17.824148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:17.824148+0000","last_clean_scrub_stamp":"2024-04-25T15:46:17.824148+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:50:25.187348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"24'370","reported_seq":424,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:26.013195+0000","last_change":"2024-04-25T15:46:31.702774+0000","last_active":"2024-04-25T17:01:26.013195+0000","last_peered":"2024-04-25T17:01:26.013195+0000","last_clean":"2024-04-25T17:01:26.013195+0000","last_became_active":"2024-04-25T15:46:31.702517+0000","last_became_peered":"2024-04-25T15:46:31.702517+0000","last_unstale":"2024-04-25T17:01:26.013195+0000","last_undegraded":"2024-04-25T17:01:26.013195+0000","last_fullsized":"2024-04-25T17:01:26.013195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:09:53.969849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"24'359","reported_seq":437,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.913349+0000","last_change":"2024-04-25T15:46:33.043034+0000","last_active":"2024-04-25T17:01:38.913349+0000","last_peered":"2024-04-25T17:01:38.913349+0000","last_clean":"2024-04-25T17:01:38.913349+0000","last_became_active":"2024-04-25T15:46:33.042522+0000","last_became_peered":"2024-04-25T15:46:33.042522+0000","last_unstale":"2024-04-25T17:01:38.913349+0000","last_undegraded":"2024-04-25T17:01:38.913349+0000","last_fullsized":"2024-04-25T17:01:38.913349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13426,"num_write":320,"num_write_kb":38038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"24'500","reported_seq":555,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:42.449985+0000","last_change":"2024-04-25T15:46:31.689200+0000","last_active":"2024-04-25T17:00:42.449985+0000","last_peered":"2024-04-25T17:00:42.449985+0000","last_clean":"2024-04-25T17:00:42.449985+0000","last_became_active":"2024-04-25T15:46:31.687761+0000","last_became_peered":"2024-04-25T15:46:31.687761+0000","last_unstale":"2024-04-25T17:00:42.449985+0000","last_undegraded":"2024-04-25T17:00:42.449985+0000","last_fullsized":"2024-04-25T17:00:42.449985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":12491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'389","reported_seq":474,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:52.826543+0000","last_change":"2024-04-25T17:01:52.826595+0000","last_active":"2024-04-25T17:01:52.826543+0000","last_peered":"2024-04-25T17:01:52.826543+0000","last_clean":"2024-04-25T17:01:52.826543+0000","last_became_active":"2024-04-25T15:46:33.020828+0000","last_became_peered":"2024-04-25T15:46:33.020828+0000","last_unstale":"2024-04-25T17:01:52.826543+0000","last_undegraded":"2024-04-25T17:01:52.826543+0000","last_fullsized":"2024-04-25T17:01:52.826543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'389","last_scrub_stamp":"2024-04-25T17:01:52.826437+0000","last_deep_scrub":"24'389","last_deep_scrub_stamp":"2024-04-25T17:01:52.826437+0000","last_clean_scrub_stamp":"2024-04-25T17:01:52.826437+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:25.402927+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12952,"num_write":356,"num_write_kb":71047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"24'3154","reported_seq":6295,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:36.056017+0000","last_change":"2024-04-25T15:46:31.704698+0000","last_active":"2024-04-25T17:01:36.056017+0000","last_peered":"2024-04-25T17:01:36.056017+0000","last_clean":"2024-04-25T17:01:36.056017+0000","last_became_active":"2024-04-25T15:46:31.704412+0000","last_became_peered":"2024-04-25T15:46:31.704412+0000","last_unstale":"2024-04-25T17:01:36.056017+0000","last_undegraded":"2024-04-25T17:01:36.056017+0000","last_fullsized":"2024-04-25T17:01:36.056017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3154,"log_dups_size":0,"ondisk_log_size":3154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458732,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3086,"num_read_kb":3630,"num_write":3090,"num_write_kb":3631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'400","reported_seq":468,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.179536+0000","last_change":"2024-04-25T15:46:33.061942+0000","last_active":"2024-04-25T17:01:39.179536+0000","last_peered":"2024-04-25T17:01:39.179536+0000","last_clean":"2024-04-25T17:01:39.179536+0000","last_became_active":"2024-04-25T15:46:33.061619+0000","last_became_peered":"2024-04-25T15:46:33.061619+0000","last_unstale":"2024-04-25T17:01:39.179536+0000","last_undegraded":"2024-04-25T17:01:39.179536+0000","last_fullsized":"2024-04-25T17:01:39.179536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9644,"num_write":362,"num_write_kb":26127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"24'999","reported_seq":1053,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T16:59:27.308098+0000","last_change":"2024-04-25T15:46:31.690694+0000","last_active":"2024-04-25T16:59:27.308098+0000","last_peered":"2024-04-25T16:59:27.308098+0000","last_clean":"2024-04-25T16:59:27.308098+0000","last_became_active":"2024-04-25T15:46:31.690339+0000","last_became_peered":"2024-04-25T15:46:31.690339+0000","last_unstale":"2024-04-25T16:59:27.308098+0000","last_undegraded":"2024-04-25T16:59:27.308098+0000","last_fullsized":"2024-04-25T16:59:27.308098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:58.317469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":939,"num_write_kb":8657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'404","reported_seq":515,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.981609+0000","last_change":"2024-04-25T15:46:33.022306+0000","last_active":"2024-04-25T17:01:38.981609+0000","last_peered":"2024-04-25T17:01:38.981609+0000","last_clean":"2024-04-25T17:01:38.981609+0000","last_became_active":"2024-04-25T15:46:33.021995+0000","last_became_peered":"2024-04-25T15:46:33.021995+0000","last_unstale":"2024-04-25T17:01:38.981609+0000","last_undegraded":"2024-04-25T17:01:38.981609+0000","last_fullsized":"2024-04-25T17:01:38.981609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:03.749619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":19099,"num_write":371,"num_write_kb":59650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"24'308","reported_seq":371,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:51.422441+0000","last_change":"2024-04-25T17:01:51.422473+0000","last_active":"2024-04-25T17:01:51.422441+0000","last_peered":"2024-04-25T17:01:51.422441+0000","last_clean":"2024-04-25T17:01:51.422441+0000","last_became_active":"2024-04-25T15:46:31.683802+0000","last_became_peered":"2024-04-25T15:46:31.683802+0000","last_unstale":"2024-04-25T17:01:51.422441+0000","last_undegraded":"2024-04-25T17:01:51.422441+0000","last_fullsized":"2024-04-25T17:01:51.422441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'308","last_scrub_stamp":"2024-04-25T17:01:51.422359+0000","last_deep_scrub":"24'308","last_deep_scrub_stamp":"2024-04-25T17:01:51.422359+0000","last_clean_scrub_stamp":"2024-04-25T17:01:51.422359+0000","objects_scrubbed":1,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:08:57.829371+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'416","reported_seq":496,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.973398+0000","last_change":"2024-04-25T15:46:33.040119+0000","last_active":"2024-04-25T17:01:38.973398+0000","last_peered":"2024-04-25T17:01:38.973398+0000","last_clean":"2024-04-25T17:01:38.973398+0000","last_became_active":"2024-04-25T15:46:33.039820+0000","last_became_peered":"2024-04-25T15:46:33.039820+0000","last_unstale":"2024-04-25T17:01:38.973398+0000","last_undegraded":"2024-04-25T17:01:38.973398+0000","last_fullsized":"2024-04-25T17:01:38.973398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:10:06.648469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13405,"num_write":380,"num_write_kb":62960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"24'638","reported_seq":692,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:18.682757+0000","last_change":"2024-04-25T15:46:31.688610+0000","last_active":"2024-04-25T17:01:18.682757+0000","last_peered":"2024-04-25T17:01:18.682757+0000","last_clean":"2024-04-25T17:01:18.682757+0000","last_became_active":"2024-04-25T15:46:31.688274+0000","last_became_peered":"2024-04-25T15:46:31.688274+0000","last_unstale":"2024-04-25T17:01:18.682757+0000","last_undegraded":"2024-04-25T17:01:18.682757+0000","last_fullsized":"2024-04-25T17:01:18.682757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:02.574106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":579,"num_write_kb":8483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'387","reported_seq":511,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.179010+0000","last_change":"2024-04-25T15:46:33.062042+0000","last_active":"2024-04-25T17:01:39.179010+0000","last_peered":"2024-04-25T17:01:39.179010+0000","last_clean":"2024-04-25T17:01:39.179010+0000","last_became_active":"2024-04-25T15:46:33.061680+0000","last_became_peered":"2024-04-25T15:46:33.061680+0000","last_unstale":"2024-04-25T17:01:39.179010+0000","last_undegraded":"2024-04-25T17:01:39.179010+0000","last_fullsized":"2024-04-25T17:01:39.179010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":42014,"num_write":351,"num_write_kb":75036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"24'3879","reported_seq":3932,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:35.678279+0000","last_change":"2024-04-25T15:46:31.687114+0000","last_active":"2024-04-25T17:01:35.678279+0000","last_peered":"2024-04-25T17:01:35.678279+0000","last_clean":"2024-04-25T17:01:35.678279+0000","last_became_active":"2024-04-25T15:46:31.686758+0000","last_became_peered":"2024-04-25T15:46:31.686758+0000","last_unstale":"2024-04-25T17:01:35.678279+0000","last_undegraded":"2024-04-25T17:01:35.678279+0000","last_fullsized":"2024-04-25T17:01:35.678279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":3879,"log_dups_size":0,"ondisk_log_size":3879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10737,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'337","reported_seq":411,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.922936+0000","last_change":"2024-04-25T15:46:33.031231+0000","last_active":"2024-04-25T17:01:38.922936+0000","last_peered":"2024-04-25T17:01:38.922936+0000","last_clean":"2024-04-25T17:01:38.922936+0000","last_became_active":"2024-04-25T15:46:33.030894+0000","last_became_peered":"2024-04-25T15:46:33.030894+0000","last_unstale":"2024-04-25T17:01:38.922936+0000","last_undegraded":"2024-04-25T17:01:38.922936+0000","last_fullsized":"2024-04-25T17:01:38.922936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11416,"num_write":310,"num_write_kb":17828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'235","reported_seq":287,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:53.830348+0000","last_change":"2024-04-25T15:46:31.688577+0000","last_active":"2024-04-25T17:00:53.830348+0000","last_peered":"2024-04-25T17:00:53.830348+0000","last_clean":"2024-04-25T17:00:53.830348+0000","last_became_active":"2024-04-25T15:46:31.687691+0000","last_became_peered":"2024-04-25T15:46:31.687691+0000","last_unstale":"2024-04-25T17:00:53.830348+0000","last_undegraded":"2024-04-25T17:00:53.830348+0000","last_fullsized":"2024-04-25T17:00:53.830348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:20.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'474","reported_seq":614,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:51.784349+0000","last_change":"2024-04-25T17:01:51.784376+0000","last_active":"2024-04-25T17:01:51.784349+0000","last_peered":"2024-04-25T17:01:51.784349+0000","last_clean":"2024-04-25T17:01:51.784349+0000","last_became_active":"2024-04-25T15:46:33.020779+0000","last_became_peered":"2024-04-25T15:46:33.020779+0000","last_unstale":"2024-04-25T17:01:51.784349+0000","last_undegraded":"2024-04-25T17:01:51.784349+0000","last_fullsized":"2024-04-25T17:01:51.784349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'474","last_scrub_stamp":"2024-04-25T17:01:51.784259+0000","last_deep_scrub":"24'474","last_deep_scrub_stamp":"2024-04-25T17:01:51.784259+0000","last_clean_scrub_stamp":"2024-04-25T17:01:51.784259+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:39.841053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":41834,"num_write":442,"num_write_kb":97214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"24'714","reported_seq":766,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:36.706046+0000","last_change":"2024-04-25T15:46:31.689494+0000","last_active":"2024-04-25T17:00:36.706046+0000","last_peered":"2024-04-25T17:00:36.706046+0000","last_clean":"2024-04-25T17:00:36.706046+0000","last_became_active":"2024-04-25T15:46:31.688192+0000","last_became_peered":"2024-04-25T15:46:31.688192+0000","last_unstale":"2024-04-25T17:00:36.706046+0000","last_undegraded":"2024-04-25T17:00:36.706046+0000","last_fullsized":"2024-04-25T17:00:36.706046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:16:47.085711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":4437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"24'485","reported_seq":603,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.977098+0000","last_change":"2024-04-25T15:46:33.062043+0000","last_active":"2024-04-25T17:01:38.977098+0000","last_peered":"2024-04-25T17:01:38.977098+0000","last_clean":"2024-04-25T17:01:38.977098+0000","last_became_active":"2024-04-25T15:46:33.061651+0000","last_became_peered":"2024-04-25T15:46:33.061651+0000","last_unstale":"2024-04-25T17:01:38.977098+0000","last_undegraded":"2024-04-25T17:01:38.977098+0000","last_fullsized":"2024-04-25T17:01:38.977098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:21.340361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31150,"num_write":464,"num_write_kb":116869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'289","reported_seq":342,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:27.830409+0000","last_change":"2024-04-25T15:46:31.685055+0000","last_active":"2024-04-25T17:00:27.830409+0000","last_peered":"2024-04-25T17:00:27.830409+0000","last_clean":"2024-04-25T17:00:27.830409+0000","last_became_active":"2024-04-25T15:46:31.684706+0000","last_became_peered":"2024-04-25T15:46:31.684706+0000","last_unstale":"2024-04-25T17:00:27.830409+0000","last_undegraded":"2024-04-25T17:00:27.830409+0000","last_fullsized":"2024-04-25T17:00:27.830409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"24'407","reported_seq":501,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.922754+0000","last_change":"2024-04-25T15:46:32.929240+0000","last_active":"2024-04-25T17:01:38.922754+0000","last_peered":"2024-04-25T17:01:38.922754+0000","last_clean":"2024-04-25T17:01:38.922754+0000","last_became_active":"2024-04-25T15:46:32.928971+0000","last_became_peered":"2024-04-25T15:46:32.928971+0000","last_unstale":"2024-04-25T17:01:38.922754+0000","last_undegraded":"2024-04-25T17:01:38.922754+0000","last_fullsized":"2024-04-25T17:01:38.922754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21551,"num_write":373,"num_write_kb":54456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'743","reported_seq":796,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:00:25.633897+0000","last_change":"2024-04-25T15:46:31.687651+0000","last_active":"2024-04-25T17:00:25.633897+0000","last_peered":"2024-04-25T17:00:25.633897+0000","last_clean":"2024-04-25T17:00:25.633897+0000","last_became_active":"2024-04-25T15:46:31.687335+0000","last_became_peered":"2024-04-25T15:46:31.687335+0000","last_unstale":"2024-04-25T17:00:25.633897+0000","last_undegraded":"2024-04-25T17:00:25.633897+0000","last_fullsized":"2024-04-25T17:00:25.633897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"24'417","reported_seq":479,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.925120+0000","last_change":"2024-04-25T15:46:33.021215+0000","last_active":"2024-04-25T17:01:38.925120+0000","last_peered":"2024-04-25T17:01:38.925120+0000","last_clean":"2024-04-25T17:01:38.925120+0000","last_became_active":"2024-04-25T15:46:33.020855+0000","last_became_peered":"2024-04-25T15:46:33.020855+0000","last_unstale":"2024-04-25T17:01:38.925120+0000","last_undegraded":"2024-04-25T17:01:38.925120+0000","last_fullsized":"2024-04-25T17:01:38.925120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6898,"num_write":384,"num_write_kb":50772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'1028","reported_seq":1079,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.689923+0000","last_change":"2024-04-25T15:46:31.693099+0000","last_active":"2024-04-25T17:01:38.689923+0000","last_peered":"2024-04-25T17:01:38.689923+0000","last_clean":"2024-04-25T17:01:38.689923+0000","last_became_active":"2024-04-25T15:46:31.692762+0000","last_became_peered":"2024-04-25T15:46:31.692762+0000","last_unstale":"2024-04-25T17:01:38.689923+0000","last_undegraded":"2024-04-25T17:01:38.689923+0000","last_fullsized":"2024-04-25T17:01:38.689923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:29.917598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10888152,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":975,"num_write_kb":11131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"24'426","reported_seq":522,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.996220+0000","last_change":"2024-04-25T15:46:33.014467+0000","last_active":"2024-04-25T17:01:38.996220+0000","last_peered":"2024-04-25T17:01:38.996220+0000","last_clean":"2024-04-25T17:01:38.996220+0000","last_became_active":"2024-04-25T15:46:33.014116+0000","last_became_peered":"2024-04-25T15:46:33.014116+0000","last_unstale":"2024-04-25T17:01:38.996220+0000","last_undegraded":"2024-04-25T17:01:38.996220+0000","last_fullsized":"2024-04-25T17:01:38.996220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:44.912712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25236,"num_write":391,"num_write_kb":71743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"24'397","reported_seq":515,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.977707+0000","last_change":"2024-04-25T15:46:33.040027+0000","last_active":"2024-04-25T17:01:38.977707+0000","last_peered":"2024-04-25T17:01:38.977707+0000","last_clean":"2024-04-25T17:01:38.977707+0000","last_became_active":"2024-04-25T15:46:33.039713+0000","last_became_peered":"2024-04-25T15:46:33.039713+0000","last_unstale":"2024-04-25T17:01:38.977707+0000","last_undegraded":"2024-04-25T17:01:38.977707+0000","last_fullsized":"2024-04-25T17:01:38.977707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:49.811317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":31357,"num_write":351,"num_write_kb":60889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"24'784","reported_seq":832,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:26.015449+0000","last_change":"2024-04-25T15:46:31.686712+0000","last_active":"2024-04-25T17:01:26.015449+0000","last_peered":"2024-04-25T17:01:26.015449+0000","last_clean":"2024-04-25T17:01:26.015449+0000","last_became_active":"2024-04-25T15:46:31.686390+0000","last_became_peered":"2024-04-25T15:46:31.686390+0000","last_unstale":"2024-04-25T17:01:26.015449+0000","last_undegraded":"2024-04-25T17:01:26.015449+0000","last_fullsized":"2024-04-25T17:01:26.015449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:54.516613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":4471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'374","reported_seq":433,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.968333+0000","last_change":"2024-04-25T15:46:33.041233+0000","last_active":"2024-04-25T17:01:38.968333+0000","last_peered":"2024-04-25T17:01:38.968333+0000","last_clean":"2024-04-25T17:01:38.968333+0000","last_became_active":"2024-04-25T15:46:33.040941+0000","last_became_peered":"2024-04-25T15:46:33.040941+0000","last_unstale":"2024-04-25T17:01:38.968333+0000","last_undegraded":"2024-04-25T17:01:38.968333+0000","last_fullsized":"2024-04-25T17:01:38.968333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8232,"num_write":346,"num_write_kb":71494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'1200","reported_seq":1248,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:19.564433+0000","last_change":"2024-04-25T15:46:31.688658+0000","last_active":"2024-04-25T17:01:19.564433+0000","last_peered":"2024-04-25T17:01:19.564433+0000","last_clean":"2024-04-25T17:01:19.564433+0000","last_became_active":"2024-04-25T15:46:31.688342+0000","last_became_peered":"2024-04-25T15:46:31.688342+0000","last_unstale":"2024-04-25T17:01:19.564433+0000","last_undegraded":"2024-04-25T17:01:19.564433+0000","last_fullsized":"2024-04-25T17:01:19.564433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:30.343493+0000","last_clean_scrub_stamp":"2024-04-25T15:46:30.343493+0000","objects_scrubbed":0,"log_size":1200,"log_dups_size":0,"ondisk_log_size":1200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:27.669113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":12844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"24'387","reported_seq":483,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:39.000393+0000","last_change":"2024-04-25T15:46:33.043423+0000","last_active":"2024-04-25T17:01:39.000393+0000","last_peered":"2024-04-25T17:01:39.000393+0000","last_clean":"2024-04-25T17:01:39.000393+0000","last_became_active":"2024-04-25T15:46:33.043134+0000","last_became_peered":"2024-04-25T15:46:33.043134+0000","last_unstale":"2024-04-25T17:01:39.000393+0000","last_undegraded":"2024-04-25T17:01:39.000393+0000","last_fullsized":"2024-04-25T17:01:39.000393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22111,"num_write":359,"num_write_kb":59931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"24'240","reported_seq":304,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:54.342253+0000","last_change":"2024-04-25T17:01:54.342308+0000","last_active":"2024-04-25T17:01:54.342253+0000","last_peered":"2024-04-25T17:01:54.342253+0000","last_clean":"2024-04-25T17:01:54.342253+0000","last_became_active":"2024-04-25T15:46:31.684729+0000","last_became_peered":"2024-04-25T15:46:31.684729+0000","last_unstale":"2024-04-25T17:01:54.342253+0000","last_undegraded":"2024-04-25T17:01:54.342253+0000","last_fullsized":"2024-04-25T17:01:54.342253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'240","last_scrub_stamp":"2024-04-25T17:01:54.342153+0000","last_deep_scrub":"24'240","last_deep_scrub_stamp":"2024-04-25T17:01:54.342153+0000","last_clean_scrub_stamp":"2024-04-25T17:01:54.342153+0000","objects_scrubbed":1,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:10.236370+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":4173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"24'427","reported_seq":552,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:38.921716+0000","last_change":"2024-04-25T15:46:33.012259+0000","last_active":"2024-04-25T17:01:38.921716+0000","last_peered":"2024-04-25T17:01:38.921716+0000","last_clean":"2024-04-25T17:01:38.921716+0000","last_became_active":"2024-04-25T15:46:33.011979+0000","last_became_peered":"2024-04-25T15:46:33.011979+0000","last_unstale":"2024-04-25T17:01:38.921716+0000","last_undegraded":"2024-04-25T17:01:38.921716+0000","last_fullsized":"2024-04-25T17:01:38.921716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:46:31.519006+0000","last_clean_scrub_stamp":"2024-04-25T15:46:31.519006+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":33589,"num_write":403,"num_write_kb":89000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"24'415","reported_seq":478,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:49.799506+0000","last_change":"2024-04-25T17:01:49.799574+0000","last_active":"2024-04-25T17:01:49.799506+0000","last_peered":"2024-04-25T17:01:49.799506+0000","last_clean":"2024-04-25T17:01:49.799506+0000","last_became_active":"2024-04-25T15:46:31.687705+0000","last_became_peered":"2024-04-25T15:46:31.687705+0000","last_unstale":"2024-04-25T17:01:49.799506+0000","last_undegraded":"2024-04-25T17:01:49.799506+0000","last_fullsized":"2024-04-25T17:01:49.799506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'415","last_scrub_stamp":"2024-04-25T17:01:49.799376+0000","last_deep_scrub":"24'415","last_deep_scrub_stamp":"2024-04-25T17:01:49.799376+0000","last_clean_scrub_stamp":"2024-04-25T17:01:49.799376+0000","objects_scrubbed":6,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:22.012948+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2746,"num_read_kb":1448171,"num_write":24417,"num_write_kb":4365214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26337,"ondisk_log_size":26337,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":184318122,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":3086,"num_read_kb":3630,"num_write":31925,"num_write_kb":196586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368795648,"data_stored":368636244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26846,"ondisk_log_size":26846,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510351,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140188,"kb_used_data":72916,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94231652,"statfs":{"total":96636764160,"available":96493211648,"internally_reserved":0,"allocated":74665984,"data_stored":74483790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510351,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120840,"kb_used_data":49408,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94251000,"statfs":{"total":96636764160,"available":96513024000,"internally_reserved":0,"allocated":50593792,"data_stored":50421810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510353,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108492,"kb_used_data":41220,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94263348,"statfs":{"total":96636764160,"available":96525668352,"internally_reserved":0,"allocated":42209280,"data_stored":42033230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510351,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119124,"kb_used_data":51852,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94252716,"statfs":{"total":96636764160,"available":96514781184,"internally_reserved":0,"allocated":53096448,"data_stored":52920718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510352,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93600,"kb_used_data":22168,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94278240,"statfs":{"total":96636764160,"available":96540917760,"internally_reserved":0,"allocated":22700032,"data_stored":22519792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510353,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125008,"kb_used_data":49416,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94246832,"statfs":{"total":96636764160,"available":96508755968,"internally_reserved":0,"allocated":50601984,"data_stored":50421404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543056,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128096,"kb_used_data":34456,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94243744,"statfs":{"total":96636764160,"available":96505593856,"internally_reserved":0,"allocated":35282944,"data_stored":35103852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":95877576},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543057,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99340,"kb_used_data":41796,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94272500,"statfs":{"total":96636764160,"available":96535040000,"internally_reserved":0,"allocated":42799104,"data_stored":42622880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41959424,"data_stored":41943700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50356224,"data_stored":50332592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22454272,"data_stored":22430980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35037184,"data_stored":35015040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":52850688,"data_stored":52831906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41963520,"data_stored":41944418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":50348032,"data_stored":50332998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73826304,"data_stored":73804610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T17:01:56.717 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.722 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.722 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.722 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.722 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.722 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.722 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.723 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.723 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.723 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.723 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.723 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.723 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.723 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.724 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.724 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.724 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.724 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.724 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.724 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.724 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.725 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.725 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.725 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.725 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.725 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.725 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.725 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.725 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.725 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.725 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.726 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.726 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.726 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.726 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.726 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.726 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.726 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.726 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.726 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.727 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.727 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.727 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.727 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.727 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.727 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.727 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.727 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.727 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.728 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.728 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.728 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.728 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.728 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.728 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.728 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.729 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.729 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.729 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.729 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T15:46:17.824148+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=17, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.729 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.729 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.729 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.730 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.730 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.730 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.730 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.730 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.730 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.730 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.730 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.730 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.731 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.731 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.731 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.731 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.731 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.731 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.731 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.731 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.731 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.732 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.732 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.732 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.732 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-25T15:46:30.343493+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.732 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.732 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T15:46:31.519006+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=46, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=17, tm_min=1, tm_sec=47, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T17:01:56.732 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T17:02:16.733 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T17:02:16.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.855+0000 7f964c297640 1 Processor -- start 2024-04-25T17:02:16.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.855+0000 7f964c297640 1 -- start start 2024-04-25T17:02:16.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.856+0000 7f964c297640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f964415d3b0 0x7f9644159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:16.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.856+0000 7f964c297640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f96440c4be0 0x7f9644163ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:16.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.856+0000 7f964c297640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96440cdc20 con 0x7f96440c7420 2024-04-25T17:02:16.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.856+0000 7f964c297640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f96440cdec0 con 0x7f964415d3b0 2024-04-25T17:02:16.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.856+0000 7f964c297640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f96440ce1a0 con 0x7f96440c4be0 2024-04-25T17:02:16.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.857+0000 7f964a033640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f96440c7420 0x7f96440c8fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36180/0 (socket says 172.21.15.59:36180) 2024-04-25T17:02:16.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.857+0000 7f964a033640 1 -- 172.21.15.59:0/4001729409 learned_addr learned my addr 172.21.15.59:0/4001729409 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T17:02:16.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.857+0000 7f964a834640 1 --2- 172.21.15.59:0/4001729409 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f96440c4be0 0x7f9644163ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:16.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.857+0000 7f9649832640 1 --2- 172.21.15.59:0/4001729409 >> v2:172.21.15.64:3300/0 conn(0x7f964415d3b0 0x7f9644159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:16.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.860+0000 7f9649031640 1 -- 172.21.15.59:0/4001729409 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2459366715 0 0) 0x7f96440cdc20 con 0x7f96440c7420 2024-04-25T17:02:16.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.860+0000 7f9649031640 1 -- 172.21.15.59:0/4001729409 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9630003520 con 0x7f96440c7420 2024-04-25T17:02:16.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.860+0000 7f964a834640 1 -- 172.21.15.59:0/4001729409 >> v2:172.21.15.64:3300/0 conn(0x7f964415d3b0 msgr2=0x7f9644159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:02:16.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.860+0000 7f964a834640 1 --2- 172.21.15.59:0/4001729409 >> v2:172.21.15.64:3300/0 conn(0x7f964415d3b0 0x7f9644159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:16.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.860+0000 7f964a834640 1 -- 172.21.15.59:0/4001729409 >> v1:172.21.15.59:6789/0 conn(0x7f96440c7420 legacy=0x7f96440c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:16.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.860+0000 7f964a834640 1 -- 172.21.15.59:0/4001729409 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964415c8d0 con 0x7f96440c4be0 2024-04-25T17:02:16.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.863+0000 7f964a834640 1 --2- 172.21.15.59:0/4001729409 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f96440c4be0 0x7f9644163ac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f963c009d90 tx=0x7f963c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e711bc06de9e1a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:16.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.867+0000 7f9649031640 1 -- 172.21.15.59:0/4001729409 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c007740 con 0x7f96440c4be0 2024-04-25T17:02:16.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.867+0000 7f9649031640 1 -- 172.21.15.59:0/4001729409 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f963c0078e0 con 0x7f96440c4be0 2024-04-25T17:02:16.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.867+0000 7f9649031640 1 -- 172.21.15.59:0/4001729409 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c007cb0 con 0x7f96440c4be0 2024-04-25T17:02:16.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.868+0000 7f964c297640 1 -- 172.21.15.59:0/4001729409 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f96440c4be0 msgr2=0x7f9644163ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:16.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.868+0000 7f964c297640 1 --2- 172.21.15.59:0/4001729409 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f96440c4be0 0x7f9644163ac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f963c009d90 tx=0x7f963c02a660 comp rx=0 tx=0).stop 2024-04-25T17:02:16.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.868+0000 7f964c297640 1 -- 172.21.15.59:0/4001729409 shutdown_connections 2024-04-25T17:02:16.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.868+0000 7f964c297640 1 --2- 172.21.15.59:0/4001729409 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f96440c4be0 0x7f9644163ac0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:16.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.868+0000 7f964c297640 1 --2- 172.21.15.59:0/4001729409 >> v2:172.21.15.64:3300/0 conn(0x7f964415d3b0 0x7f9644159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:16.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.868+0000 7f964c297640 1 -- 172.21.15.59:0/4001729409 >> 172.21.15.59:0/4001729409 conn(0x7f9644068900 msgr2=0x7f964406f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:02:16.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.868+0000 7f964c297640 1 -- 172.21.15.59:0/4001729409 shutdown_connections 2024-04-25T17:02:16.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.868+0000 7f964c297640 1 -- 172.21.15.59:0/4001729409 wait complete. 2024-04-25T17:02:16.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.870+0000 7f964c297640 1 Processor -- start 2024-04-25T17:02:16.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.870+0000 7f964c297640 1 -- start start 2024-04-25T17:02:16.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.871+0000 7f964c297640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96440c4be0 0x7f964414dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:16.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.871+0000 7f964c297640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96440c7420 0x7f964414f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:16.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.871+0000 7f964c297640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f964415d3b0 0x7f9644142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:16.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.871+0000 7f964c297640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f96440ca3a0 con 0x7f96440c4be0 2024-04-25T17:02:16.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.871+0000 7f964c297640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f964415ce90 con 0x7f96440c7420 2024-04-25T17:02:16.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.871+0000 7f964c297640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f96440c9ee0 con 0x7f964415d3b0 2024-04-25T17:02:16.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.872+0000 7f964a033640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96440c4be0 0x7f964414dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:16.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.872+0000 7f964a834640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f964415d3b0 0x7f9644142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:16.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.872+0000 7f9649832640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96440c7420 0x7f964414f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:16.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.872+0000 7f964a033640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96440c4be0 0x7f964414dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38308/0 (socket says 172.21.15.59:38308) 2024-04-25T17:02:16.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.872+0000 7f964a033640 1 -- 172.21.15.59:0/2915254229 learned_addr learned my addr 172.21.15.59:0/2915254229 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:02:16.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.876+0000 7f964a033640 1 -- 172.21.15.59:0/2915254229 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f964415d3b0 msgr2=0x7f9644142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:16.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.876+0000 7f964a033640 1 --2- 172.21.15.59:0/2915254229 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f964415d3b0 0x7f9644142cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:16.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.876+0000 7f964a033640 1 -- 172.21.15.59:0/2915254229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96440c7420 msgr2=0x7f964414f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:16.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.876+0000 7f964a033640 1 --2- 172.21.15.59:0/2915254229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96440c7420 0x7f964414f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:16.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.876+0000 7f964a033640 1 -- 172.21.15.59:0/2915254229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964414fc70 con 0x7f96440c4be0 2024-04-25T17:02:16.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.878+0000 7f964a033640 1 --2- 172.21.15.59:0/2915254229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96440c4be0 0x7f964414dd60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f964000c390 tx=0x7f964000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:16.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.882+0000 7f963affd640 1 -- 172.21.15.59:0/2915254229 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9640017070 con 0x7f96440c4be0 2024-04-25T17:02:16.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.883+0000 7f963affd640 1 -- 172.21.15.59:0/2915254229 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9640005ce0 con 0x7f96440c4be0 2024-04-25T17:02:16.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.883+0000 7f964c297640 1 -- 172.21.15.59:0/2915254229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9644146540 con 0x7f96440c4be0 2024-04-25T17:02:16.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.883+0000 7f963affd640 1 -- 172.21.15.59:0/2915254229 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96400072f0 con 0x7f96440c4be0 2024-04-25T17:02:16.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.883+0000 7f964c297640 1 -- 172.21.15.59:0/2915254229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f964414ec50 con 0x7f96440c4be0 2024-04-25T17:02:16.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:16.884+0000 7f964c297640 1 -- 172.21.15.59:0/2915254229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96440698a0 con 0x7f96440c4be0 2024-04-25T17:02:17.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.177+0000 7f963affd640 1 -- 172.21.15.59:0/2915254229 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f964001a070 con 0x7f96440c4be0 2024-04-25T17:02:17.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.177+0000 7f963affd640 1 --2- 172.21.15.59:0/2915254229 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f9628074500 0x7f9628076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:17.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.178+0000 7f9649832640 1 --2- 172.21.15.59:0/2915254229 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f9628074500 0x7f9628076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:17.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.178+0000 7f9649832640 1 --2- 172.21.15.59:0/2915254229 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f9628074500 0x7f9628076a10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f96440cce20 tx=0x7f9634009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:17.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.193+0000 7f963affd640 1 -- 172.21.15.59:0/2915254229 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f964005ae00 con 0x7f96440c4be0 2024-04-25T17:02:17.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.193+0000 7f963affd640 1 -- 172.21.15.59:0/2915254229 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9640021020 con 0x7f96440c4be0 2024-04-25T17:02:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.380+0000 7f964c297640 1 -- 172.21.15.59:0/2915254229 --> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9644146800 con 0x7f9628074500 2024-04-25T17:02:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.387+0000 7f963affd640 1 -- 172.21.15.59:0/2915254229 <== mgr.4102 v2:172.21.15.59:6800/2368090706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254503 (secure 0 0 0) 0x7f9644146800 con 0x7f9628074500 2024-04-25T17:02:17.388 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T17:02:17.389 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T17:02:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.390+0000 7f964c297640 1 -- 172.21.15.59:0/2915254229 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f9628074500 msgr2=0x7f9628076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.390+0000 7f964c297640 1 --2- 172.21.15.59:0/2915254229 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f9628074500 0x7f9628076a10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f96440cce20 tx=0x7f9634009190 comp rx=0 tx=0).stop 2024-04-25T17:02:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.390+0000 7f964c297640 1 -- 172.21.15.59:0/2915254229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96440c4be0 msgr2=0x7f964414dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.390+0000 7f964c297640 1 --2- 172.21.15.59:0/2915254229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96440c4be0 0x7f964414dd60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f964000c390 tx=0x7f964000c850 comp rx=0 tx=0).stop 2024-04-25T17:02:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.390+0000 7f964c297640 1 -- 172.21.15.59:0/2915254229 shutdown_connections 2024-04-25T17:02:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.390+0000 7f964c297640 1 --2- 172.21.15.59:0/2915254229 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f9628074500 0x7f9628076a10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.390+0000 7f964c297640 1 --2- 172.21.15.59:0/2915254229 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f964415d3b0 0x7f9644142cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.390+0000 7f964c297640 1 --2- 172.21.15.59:0/2915254229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f96440c7420 0x7f964414f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.390+0000 7f964c297640 1 --2- 172.21.15.59:0/2915254229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96440c4be0 0x7f964414dd60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.390+0000 7f964c297640 1 -- 172.21.15.59:0/2915254229 >> 172.21.15.59:0/2915254229 conn(0x7f9644068900 msgr2=0x7f96440c8730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:02:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.390+0000 7f964c297640 1 -- 172.21.15.59:0/2915254229 shutdown_connections 2024-04-25T17:02:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.390+0000 7f964c297640 1 -- 172.21.15.59:0/2915254229 wait complete. 2024-04-25T17:02:17.400 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":2298,"stamp":"2024-04-25T17:02:15.424973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":184908490,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":5898,"num_read_kb":1451856,"num_write":56443,"num_write_kb":4563428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53328,"ondisk_log_size":53328,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":934688,"kb_used_data":363232,"kb_used_omap":12,"kb_used_meta":571379,"kb_avail":754040032,"statfs":{"total":773094113280,"available":772136992768,"internally_reserved":0,"allocated":371949568,"data_stored":370527476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":585092658},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003356"},"pg_stats":[{"pgid":"3.3f","version":"24'430","reported_seq":567,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:56.755655+0000","last_change":"2024-04-25T17:01:56.755655+0000","last_active":"2024-04-25T17:01:56.755655+0000","last_peered":"2024-04-25T17:01:56.755655+0000","last_clean":"2024-04-25T17:01:56.755655+0000","last_became_active":"2024-04-25T15:47:08.942222+0000","last_became_peered":"2024-04-25T15:47:08.942222+0000","last_unstale":"2024-04-25T17:01:56.755655+0000","last_undegraded":"2024-04-25T17:01:56.755655+0000","last_fullsized":"2024-04-25T17:01:56.755655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'430","last_scrub_stamp":"2024-04-25T17:01:56.755485+0000","last_deep_scrub":"24'430","last_deep_scrub_stamp":"2024-04-25T17:01:56.755485+0000","last_clean_scrub_stamp":"2024-04-25T17:01:56.755485+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:34.470644+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":51437,"num_write":399,"num_write_kb":108426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"24'420","reported_seq":513,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:00.236273+0000","last_change":"2024-04-25T17:02:00.236301+0000","last_active":"2024-04-25T17:02:00.236273+0000","last_peered":"2024-04-25T17:02:00.236273+0000","last_clean":"2024-04-25T17:02:00.236273+0000","last_became_active":"2024-04-25T15:46:33.022095+0000","last_became_peered":"2024-04-25T15:46:33.022095+0000","last_unstale":"2024-04-25T17:02:00.236273+0000","last_undegraded":"2024-04-25T17:02:00.236273+0000","last_fullsized":"2024-04-25T17:02:00.236273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'420","last_scrub_stamp":"2024-04-25T17:02:00.236175+0000","last_deep_scrub":"24'420","last_deep_scrub_stamp":"2024-04-25T17:02:00.236175+0000","last_clean_scrub_stamp":"2024-04-25T17:02:00.236175+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:55:56.594745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15735,"num_write":392,"num_write_kb":67130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"24'384","reported_seq":473,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:00.745519+0000","last_change":"2024-04-25T17:02:00.745554+0000","last_active":"2024-04-25T17:02:00.745519+0000","last_peered":"2024-04-25T17:02:00.745519+0000","last_clean":"2024-04-25T17:02:00.745519+0000","last_became_active":"2024-04-25T15:46:33.063038+0000","last_became_peered":"2024-04-25T15:46:33.063038+0000","last_unstale":"2024-04-25T17:02:00.745519+0000","last_undegraded":"2024-04-25T17:02:00.745519+0000","last_fullsized":"2024-04-25T17:02:00.745519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'384","last_scrub_stamp":"2024-04-25T17:02:00.745422+0000","last_deep_scrub":"24'384","last_deep_scrub_stamp":"2024-04-25T17:02:00.745422+0000","last_clean_scrub_stamp":"2024-04-25T17:02:00.745422+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:10:28.696279+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13830,"num_write":355,"num_write_kb":38647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"24'395","reported_seq":478,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:58.792738+0000","last_change":"2024-04-25T17:01:58.792762+0000","last_active":"2024-04-25T17:01:58.792738+0000","last_peered":"2024-04-25T17:01:58.792738+0000","last_clean":"2024-04-25T17:01:58.792738+0000","last_became_active":"2024-04-25T15:47:09.046576+0000","last_became_peered":"2024-04-25T15:47:09.046576+0000","last_unstale":"2024-04-25T17:01:58.792738+0000","last_undegraded":"2024-04-25T17:01:58.792738+0000","last_fullsized":"2024-04-25T17:01:58.792738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'395","last_scrub_stamp":"2024-04-25T17:01:58.792653+0000","last_deep_scrub":"24'395","last_deep_scrub_stamp":"2024-04-25T17:01:58.792653+0000","last_clean_scrub_stamp":"2024-04-25T17:01:58.792653+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:58.498718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":6992,"num_write":371,"num_write_kb":83931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"24'432","reported_seq":567,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:10.801821+0000","last_change":"2024-04-25T17:02:10.801862+0000","last_active":"2024-04-25T17:02:10.801821+0000","last_peered":"2024-04-25T17:02:10.801821+0000","last_clean":"2024-04-25T17:02:10.801821+0000","last_became_active":"2024-04-25T15:46:33.063110+0000","last_became_peered":"2024-04-25T15:46:33.063110+0000","last_unstale":"2024-04-25T17:02:10.801821+0000","last_undegraded":"2024-04-25T17:02:10.801821+0000","last_fullsized":"2024-04-25T17:02:10.801821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'432","last_scrub_stamp":"2024-04-25T17:02:10.801719+0000","last_deep_scrub":"24'432","last_deep_scrub_stamp":"2024-04-25T17:02:10.801719+0000","last_clean_scrub_stamp":"2024-04-25T17:02:10.801719+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:40:08.869918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":46382,"num_write":409,"num_write_kb":84827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"24'371","reported_seq":432,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:05.755567+0000","last_change":"2024-04-25T17:02:05.755596+0000","last_active":"2024-04-25T17:02:05.755567+0000","last_peered":"2024-04-25T17:02:05.755567+0000","last_clean":"2024-04-25T17:02:05.755567+0000","last_became_active":"2024-04-25T15:46:33.040272+0000","last_became_peered":"2024-04-25T15:46:33.040272+0000","last_unstale":"2024-04-25T17:02:05.755567+0000","last_undegraded":"2024-04-25T17:02:05.755567+0000","last_fullsized":"2024-04-25T17:02:05.755567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'371","last_scrub_stamp":"2024-04-25T17:02:05.755479+0000","last_deep_scrub":"24'371","last_deep_scrub_stamp":"2024-04-25T17:02:05.755479+0000","last_clean_scrub_stamp":"2024-04-25T17:02:05.755479+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:42.401126+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":345,"num_write_kb":38164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"24'405","reported_seq":514,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:56.053060+0000","last_change":"2024-04-25T17:01:56.053113+0000","last_active":"2024-04-25T17:01:56.053060+0000","last_peered":"2024-04-25T17:01:56.053060+0000","last_clean":"2024-04-25T17:01:56.053060+0000","last_became_active":"2024-04-25T15:46:33.036613+0000","last_became_peered":"2024-04-25T15:46:33.036613+0000","last_unstale":"2024-04-25T17:01:56.053060+0000","last_undegraded":"2024-04-25T17:01:56.053060+0000","last_fullsized":"2024-04-25T17:01:56.053060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'405","last_scrub_stamp":"2024-04-25T17:01:56.052923+0000","last_deep_scrub":"24'405","last_deep_scrub_stamp":"2024-04-25T17:01:56.052923+0000","last_clean_scrub_stamp":"2024-04-25T17:01:56.052923+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:19:06.073912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":29371,"num_write":377,"num_write_kb":63589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"24'387","reported_seq":489,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:59.792033+0000","last_change":"2024-04-25T17:01:59.792033+0000","last_active":"2024-04-25T17:01:59.792033+0000","last_peered":"2024-04-25T17:01:59.792033+0000","last_clean":"2024-04-25T17:01:59.792033+0000","last_became_active":"2024-04-25T15:47:09.046942+0000","last_became_peered":"2024-04-25T15:47:09.046942+0000","last_unstale":"2024-04-25T17:01:59.792033+0000","last_undegraded":"2024-04-25T17:01:59.792033+0000","last_fullsized":"2024-04-25T17:01:59.792033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'387","last_scrub_stamp":"2024-04-25T17:01:59.791920+0000","last_deep_scrub":"24'387","last_deep_scrub_stamp":"2024-04-25T17:01:59.791920+0000","last_clean_scrub_stamp":"2024-04-25T17:01:59.791920+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:19:09.812909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37992,"num_write":353,"num_write_kb":79970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"24'414","reported_seq":523,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:08.836563+0000","last_change":"2024-04-25T17:02:08.836619+0000","last_active":"2024-04-25T17:02:08.836563+0000","last_peered":"2024-04-25T17:02:08.836563+0000","last_clean":"2024-04-25T17:02:08.836563+0000","last_became_active":"2024-04-25T15:46:33.043094+0000","last_became_peered":"2024-04-25T15:46:33.043094+0000","last_unstale":"2024-04-25T17:02:08.836563+0000","last_undegraded":"2024-04-25T17:02:08.836563+0000","last_fullsized":"2024-04-25T17:02:08.836563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'414","last_scrub_stamp":"2024-04-25T17:02:08.836411+0000","last_deep_scrub":"24'414","last_deep_scrub_stamp":"2024-04-25T17:02:08.836411+0000","last_clean_scrub_stamp":"2024-04-25T17:02:08.836411+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:42.820807+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":25428,"num_write":377,"num_write_kb":51351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"24'395","reported_seq":481,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:05.341711+0000","last_change":"2024-04-25T17:02:05.341771+0000","last_active":"2024-04-25T17:02:05.341711+0000","last_peered":"2024-04-25T17:02:05.341711+0000","last_clean":"2024-04-25T17:02:05.341711+0000","last_became_active":"2024-04-25T15:46:33.036822+0000","last_became_peered":"2024-04-25T15:46:33.036822+0000","last_unstale":"2024-04-25T17:02:05.341711+0000","last_undegraded":"2024-04-25T17:02:05.341711+0000","last_fullsized":"2024-04-25T17:02:05.341711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'395","last_scrub_stamp":"2024-04-25T17:02:05.341599+0000","last_deep_scrub":"24'395","last_deep_scrub_stamp":"2024-04-25T17:02:05.341599+0000","last_clean_scrub_stamp":"2024-04-25T17:02:05.341599+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:17.905407+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15654,"num_write":362,"num_write_kb":47082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"24'382","reported_seq":461,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:06.364881+0000","last_change":"2024-04-25T17:02:06.364910+0000","last_active":"2024-04-25T17:02:06.364881+0000","last_peered":"2024-04-25T17:02:06.364881+0000","last_clean":"2024-04-25T17:02:06.364881+0000","last_became_active":"2024-04-25T15:46:33.040296+0000","last_became_peered":"2024-04-25T15:46:33.040296+0000","last_unstale":"2024-04-25T17:02:06.364881+0000","last_undegraded":"2024-04-25T17:02:06.364881+0000","last_fullsized":"2024-04-25T17:02:06.364881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'382","last_scrub_stamp":"2024-04-25T17:02:06.364780+0000","last_deep_scrub":"24'382","last_deep_scrub_stamp":"2024-04-25T17:02:06.364780+0000","last_clean_scrub_stamp":"2024-04-25T17:02:06.364780+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:15.347209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":9049,"num_write":364,"num_write_kb":58665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"24'374","reported_seq":484,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:55.590283+0000","last_change":"2024-04-25T17:01:55.590307+0000","last_active":"2024-04-25T17:01:55.590283+0000","last_peered":"2024-04-25T17:01:55.590283+0000","last_clean":"2024-04-25T17:01:55.590283+0000","last_became_active":"2024-04-25T15:46:33.010754+0000","last_became_peered":"2024-04-25T15:46:33.010754+0000","last_unstale":"2024-04-25T17:01:55.590283+0000","last_undegraded":"2024-04-25T17:01:55.590283+0000","last_fullsized":"2024-04-25T17:01:55.590283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'374","last_scrub_stamp":"2024-04-25T17:01:55.590191+0000","last_deep_scrub":"24'374","last_deep_scrub_stamp":"2024-04-25T17:01:55.590191+0000","last_clean_scrub_stamp":"2024-04-25T17:01:55.590191+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:53:49.033887+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27496,"num_write":346,"num_write_kb":71109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"24'401","reported_seq":504,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:00.325958+0000","last_change":"2024-04-25T17:02:00.326029+0000","last_active":"2024-04-25T17:02:00.325958+0000","last_peered":"2024-04-25T17:02:00.325958+0000","last_clean":"2024-04-25T17:02:00.325958+0000","last_became_active":"2024-04-25T15:46:33.011083+0000","last_became_peered":"2024-04-25T15:46:33.011083+0000","last_unstale":"2024-04-25T17:02:00.325958+0000","last_undegraded":"2024-04-25T17:02:00.325958+0000","last_fullsized":"2024-04-25T17:02:00.325958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'401","last_scrub_stamp":"2024-04-25T17:02:00.325844+0000","last_deep_scrub":"24'401","last_deep_scrub_stamp":"2024-04-25T17:02:00.325844+0000","last_clean_scrub_stamp":"2024-04-25T17:02:00.325844+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:35:12.403213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":17390,"num_write":371,"num_write_kb":87698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"24'409","reported_seq":494,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:54.804461+0000","last_change":"2024-04-25T17:01:54.804488+0000","last_active":"2024-04-25T17:01:54.804461+0000","last_peered":"2024-04-25T17:01:54.804461+0000","last_clean":"2024-04-25T17:01:54.804461+0000","last_became_active":"2024-04-25T15:46:33.022214+0000","last_became_peered":"2024-04-25T15:46:33.022214+0000","last_unstale":"2024-04-25T17:01:54.804461+0000","last_undegraded":"2024-04-25T17:01:54.804461+0000","last_fullsized":"2024-04-25T17:01:54.804461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'409","last_scrub_stamp":"2024-04-25T17:01:54.804369+0000","last_deep_scrub":"24'409","last_deep_scrub_stamp":"2024-04-25T17:01:54.804369+0000","last_clean_scrub_stamp":"2024-04-25T17:01:54.804369+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:58:11.007407+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17435,"num_write":384,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"24'435","reported_seq":572,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:57.316098+0000","last_change":"2024-04-25T17:01:57.316125+0000","last_active":"2024-04-25T17:01:57.316098+0000","last_peered":"2024-04-25T17:01:57.316098+0000","last_clean":"2024-04-25T17:01:57.316098+0000","last_became_active":"2024-04-25T15:46:32.929386+0000","last_became_peered":"2024-04-25T15:46:32.929386+0000","last_unstale":"2024-04-25T17:01:57.316098+0000","last_undegraded":"2024-04-25T17:01:57.316098+0000","last_fullsized":"2024-04-25T17:01:57.316098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'435","last_scrub_stamp":"2024-04-25T17:01:57.316009+0000","last_deep_scrub":"24'435","last_deep_scrub_stamp":"2024-04-25T17:01:57.316009+0000","last_clean_scrub_stamp":"2024-04-25T17:01:57.316009+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:42.018821+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":41362,"num_write":401,"num_write_kb":92598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"24'426","reported_seq":508,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:04.745540+0000","last_change":"2024-04-25T17:02:04.745564+0000","last_active":"2024-04-25T17:02:04.745540+0000","last_peered":"2024-04-25T17:02:04.745540+0000","last_clean":"2024-04-25T17:02:04.745540+0000","last_became_active":"2024-04-25T15:46:33.040240+0000","last_became_peered":"2024-04-25T15:46:33.040240+0000","last_unstale":"2024-04-25T17:02:04.745540+0000","last_undegraded":"2024-04-25T17:02:04.745540+0000","last_fullsized":"2024-04-25T17:02:04.745540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'426","last_scrub_stamp":"2024-04-25T17:02:04.745449+0000","last_deep_scrub":"24'426","last_deep_scrub_stamp":"2024-04-25T17:02:04.745449+0000","last_clean_scrub_stamp":"2024-04-25T17:02:04.745449+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:32.316470+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16384,"num_write":396,"num_write_kb":62713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"24'404","reported_seq":499,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:09.801001+0000","last_change":"2024-04-25T17:02:09.801030+0000","last_active":"2024-04-25T17:02:09.801001+0000","last_peered":"2024-04-25T17:02:09.801001+0000","last_clean":"2024-04-25T17:02:09.801001+0000","last_became_active":"2024-04-25T15:46:33.044065+0000","last_became_peered":"2024-04-25T15:46:33.044065+0000","last_unstale":"2024-04-25T17:02:09.801001+0000","last_undegraded":"2024-04-25T17:02:09.801001+0000","last_fullsized":"2024-04-25T17:02:09.801001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'404","last_scrub_stamp":"2024-04-25T17:02:09.800884+0000","last_deep_scrub":"24'404","last_deep_scrub_stamp":"2024-04-25T17:02:09.800884+0000","last_clean_scrub_stamp":"2024-04-25T17:02:09.800884+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:31.660552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":15331,"num_write":377,"num_write_kb":71706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"24'418","reported_seq":526,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:55.783504+0000","last_change":"2024-04-25T17:01:55.783556+0000","last_active":"2024-04-25T17:01:55.783504+0000","last_peered":"2024-04-25T17:01:55.783504+0000","last_clean":"2024-04-25T17:01:55.783504+0000","last_became_active":"2024-04-25T15:46:33.061623+0000","last_became_peered":"2024-04-25T15:46:33.061623+0000","last_unstale":"2024-04-25T17:01:55.783504+0000","last_undegraded":"2024-04-25T17:01:55.783504+0000","last_fullsized":"2024-04-25T17:01:55.783504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'418","last_scrub_stamp":"2024-04-25T17:01:55.783408+0000","last_deep_scrub":"24'418","last_deep_scrub_stamp":"2024-04-25T17:01:55.783408+0000","last_clean_scrub_stamp":"2024-04-25T17:01:55.783408+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:02.190419+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29942,"num_write":388,"num_write_kb":91861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"24'442","reported_seq":563,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:11.754508+0000","last_change":"2024-04-25T17:02:11.754565+0000","last_active":"2024-04-25T17:02:11.754508+0000","last_peered":"2024-04-25T17:02:11.754508+0000","last_clean":"2024-04-25T17:02:11.754508+0000","last_became_active":"2024-04-25T15:46:33.063126+0000","last_became_peered":"2024-04-25T15:46:33.063126+0000","last_unstale":"2024-04-25T17:02:11.754508+0000","last_undegraded":"2024-04-25T17:02:11.754508+0000","last_fullsized":"2024-04-25T17:02:11.754508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'442","last_scrub_stamp":"2024-04-25T17:02:11.754349+0000","last_deep_scrub":"24'442","last_deep_scrub_stamp":"2024-04-25T17:02:11.754349+0000","last_clean_scrub_stamp":"2024-04-25T17:02:11.754349+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:39.502480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":28728,"num_write":405,"num_write_kb":157712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"24'446","reported_seq":538,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:00.352896+0000","last_change":"2024-04-25T17:02:00.352928+0000","last_active":"2024-04-25T17:02:00.352896+0000","last_peered":"2024-04-25T17:02:00.352896+0000","last_clean":"2024-04-25T17:02:00.352896+0000","last_became_active":"2024-04-25T15:46:33.014056+0000","last_became_peered":"2024-04-25T15:46:33.014056+0000","last_unstale":"2024-04-25T17:02:00.352896+0000","last_undegraded":"2024-04-25T17:02:00.352896+0000","last_fullsized":"2024-04-25T17:02:00.352896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'446","last_scrub_stamp":"2024-04-25T17:02:00.352793+0000","last_deep_scrub":"24'446","last_deep_scrub_stamp":"2024-04-25T17:02:00.352793+0000","last_clean_scrub_stamp":"2024-04-25T17:02:00.352793+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:32.863526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19430,"num_write":422,"num_write_kb":59069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"24'420","reported_seq":538,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:57.790876+0000","last_change":"2024-04-25T17:01:57.790911+0000","last_active":"2024-04-25T17:01:57.790876+0000","last_peered":"2024-04-25T17:01:57.790876+0000","last_clean":"2024-04-25T17:01:57.790876+0000","last_became_active":"2024-04-25T15:46:33.032498+0000","last_became_peered":"2024-04-25T15:46:33.032498+0000","last_unstale":"2024-04-25T17:01:57.790876+0000","last_undegraded":"2024-04-25T17:01:57.790876+0000","last_fullsized":"2024-04-25T17:01:57.790876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'420","last_scrub_stamp":"2024-04-25T17:01:57.790785+0000","last_deep_scrub":"24'420","last_deep_scrub_stamp":"2024-04-25T17:01:57.790785+0000","last_clean_scrub_stamp":"2024-04-25T17:01:57.790785+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:55:38.821921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":38942,"num_write":394,"num_write_kb":67464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"24'418","reported_seq":510,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:08.808380+0000","last_change":"2024-04-25T17:02:08.808409+0000","last_active":"2024-04-25T17:02:08.808380+0000","last_peered":"2024-04-25T17:02:08.808380+0000","last_clean":"2024-04-25T17:02:08.808380+0000","last_became_active":"2024-04-25T15:46:33.043251+0000","last_became_peered":"2024-04-25T15:46:33.043251+0000","last_unstale":"2024-04-25T17:02:08.808380+0000","last_undegraded":"2024-04-25T17:02:08.808380+0000","last_fullsized":"2024-04-25T17:02:08.808380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'418","last_scrub_stamp":"2024-04-25T17:02:08.808268+0000","last_deep_scrub":"24'418","last_deep_scrub_stamp":"2024-04-25T17:02:08.808268+0000","last_clean_scrub_stamp":"2024-04-25T17:02:08.808268+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:42.792664+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15275,"num_write":389,"num_write_kb":50799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"24'423","reported_seq":537,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:58.325905+0000","last_change":"2024-04-25T17:01:58.325956+0000","last_active":"2024-04-25T17:01:58.325905+0000","last_peered":"2024-04-25T17:01:58.325905+0000","last_clean":"2024-04-25T17:01:58.325905+0000","last_became_active":"2024-04-25T15:46:32.926836+0000","last_became_peered":"2024-04-25T15:46:32.926836+0000","last_unstale":"2024-04-25T17:01:58.325905+0000","last_undegraded":"2024-04-25T17:01:58.325905+0000","last_fullsized":"2024-04-25T17:01:58.325905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'423","last_scrub_stamp":"2024-04-25T17:01:58.325791+0000","last_deep_scrub":"24'423","last_deep_scrub_stamp":"2024-04-25T17:01:58.325791+0000","last_clean_scrub_stamp":"2024-04-25T17:01:58.325791+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:44.041298+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":23691,"num_write":392,"num_write_kb":92779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"24'428","reported_seq":526,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:06.781370+0000","last_change":"2024-04-25T17:02:06.781397+0000","last_active":"2024-04-25T17:02:06.781370+0000","last_peered":"2024-04-25T17:02:06.781370+0000","last_clean":"2024-04-25T17:02:06.781370+0000","last_became_active":"2024-04-25T15:46:33.040821+0000","last_became_peered":"2024-04-25T15:46:33.040821+0000","last_unstale":"2024-04-25T17:02:06.781370+0000","last_undegraded":"2024-04-25T17:02:06.781370+0000","last_fullsized":"2024-04-25T17:02:06.781370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'428","last_scrub_stamp":"2024-04-25T17:02:06.781275+0000","last_deep_scrub":"24'428","last_deep_scrub_stamp":"2024-04-25T17:02:06.781275+0000","last_clean_scrub_stamp":"2024-04-25T17:02:06.781275+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:50:07.648654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":18443,"num_write":400,"num_write_kb":50986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"24'394","reported_seq":486,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:57.362141+0000","last_change":"2024-04-25T17:01:57.362167+0000","last_active":"2024-04-25T17:01:57.362141+0000","last_peered":"2024-04-25T17:01:57.362141+0000","last_clean":"2024-04-25T17:01:57.362141+0000","last_became_active":"2024-04-25T15:46:32.926468+0000","last_became_peered":"2024-04-25T15:46:32.926468+0000","last_unstale":"2024-04-25T17:01:57.362141+0000","last_undegraded":"2024-04-25T17:01:57.362141+0000","last_fullsized":"2024-04-25T17:01:57.362141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'394","last_scrub_stamp":"2024-04-25T17:01:57.362058+0000","last_deep_scrub":"24'394","last_deep_scrub_stamp":"2024-04-25T17:01:57.362058+0000","last_clean_scrub_stamp":"2024-04-25T17:01:57.362058+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:58.292887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16804,"num_write":379,"num_write_kb":50499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"24'462","reported_seq":592,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:04.370777+0000","last_change":"2024-04-25T17:02:04.370805+0000","last_active":"2024-04-25T17:02:04.370777+0000","last_peered":"2024-04-25T17:02:04.370777+0000","last_clean":"2024-04-25T17:02:04.370777+0000","last_became_active":"2024-04-25T15:46:33.031182+0000","last_became_peered":"2024-04-25T15:46:33.031182+0000","last_unstale":"2024-04-25T17:02:04.370777+0000","last_undegraded":"2024-04-25T17:02:04.370777+0000","last_fullsized":"2024-04-25T17:02:04.370777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'462","last_scrub_stamp":"2024-04-25T17:02:04.370673+0000","last_deep_scrub":"24'462","last_deep_scrub_stamp":"2024-04-25T17:02:04.370673+0000","last_clean_scrub_stamp":"2024-04-25T17:02:04.370673+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:56:00.729244+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":42888,"num_write":421,"num_write_kb":44012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"24'399","reported_seq":508,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:59.269792+0000","last_change":"2024-04-25T17:01:59.269820+0000","last_active":"2024-04-25T17:01:59.269792+0000","last_peered":"2024-04-25T17:01:59.269792+0000","last_clean":"2024-04-25T17:01:59.269792+0000","last_became_active":"2024-04-25T15:46:32.931684+0000","last_became_peered":"2024-04-25T15:46:32.931684+0000","last_unstale":"2024-04-25T17:01:59.269792+0000","last_undegraded":"2024-04-25T17:01:59.269792+0000","last_fullsized":"2024-04-25T17:01:59.269792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'399","last_scrub_stamp":"2024-04-25T17:01:59.269692+0000","last_deep_scrub":"24'399","last_deep_scrub_stamp":"2024-04-25T17:01:59.269692+0000","last_clean_scrub_stamp":"2024-04-25T17:01:59.269692+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:17.858396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25944,"num_write":373,"num_write_kb":59184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"24'397","reported_seq":474,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:56.390540+0000","last_change":"2024-04-25T17:01:56.390564+0000","last_active":"2024-04-25T17:01:56.390540+0000","last_peered":"2024-04-25T17:01:56.390540+0000","last_clean":"2024-04-25T17:01:56.390540+0000","last_became_active":"2024-04-25T15:46:32.926136+0000","last_became_peered":"2024-04-25T15:46:32.926136+0000","last_unstale":"2024-04-25T17:01:56.390540+0000","last_undegraded":"2024-04-25T17:01:56.390540+0000","last_fullsized":"2024-04-25T17:01:56.390540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'397","last_scrub_stamp":"2024-04-25T17:01:56.390426+0000","last_deep_scrub":"24'397","last_deep_scrub_stamp":"2024-04-25T17:01:56.390426+0000","last_clean_scrub_stamp":"2024-04-25T17:01:56.390426+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:48:14.327305+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5076,"num_write":375,"num_write_kb":141478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"24'412","reported_seq":522,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:53.816167+0000","last_change":"2024-04-25T17:01:53.816167+0000","last_active":"2024-04-25T17:01:53.816167+0000","last_peered":"2024-04-25T17:01:53.816167+0000","last_clean":"2024-04-25T17:01:53.816167+0000","last_became_active":"2024-04-25T15:46:33.022116+0000","last_became_peered":"2024-04-25T15:46:33.022116+0000","last_unstale":"2024-04-25T17:01:53.816167+0000","last_undegraded":"2024-04-25T17:01:53.816167+0000","last_fullsized":"2024-04-25T17:01:53.816167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'412","last_scrub_stamp":"2024-04-25T17:01:53.815999+0000","last_deep_scrub":"24'412","last_deep_scrub_stamp":"2024-04-25T17:01:53.815999+0000","last_clean_scrub_stamp":"2024-04-25T17:01:53.815999+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:09.710217+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":30085,"num_write":382,"num_write_kb":75269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"24'493","reported_seq":642,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:03.747245+0000","last_change":"2024-04-25T17:02:03.747273+0000","last_active":"2024-04-25T17:02:03.747245+0000","last_peered":"2024-04-25T17:02:03.747245+0000","last_clean":"2024-04-25T17:02:03.747245+0000","last_became_active":"2024-04-25T15:46:33.040134+0000","last_became_peered":"2024-04-25T15:46:33.040134+0000","last_unstale":"2024-04-25T17:02:03.747245+0000","last_undegraded":"2024-04-25T17:02:03.747245+0000","last_fullsized":"2024-04-25T17:02:03.747245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'493","last_scrub_stamp":"2024-04-25T17:02:03.747150+0000","last_deep_scrub":"24'493","last_deep_scrub_stamp":"2024-04-25T17:02:03.747150+0000","last_clean_scrub_stamp":"2024-04-25T17:02:03.747150+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:39.824552+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":44575,"num_write":459,"num_write_kb":113331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"24'453","reported_seq":593,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:57.761720+0000","last_change":"2024-04-25T17:01:57.761747+0000","last_active":"2024-04-25T17:01:57.761720+0000","last_peered":"2024-04-25T17:01:57.761720+0000","last_clean":"2024-04-25T17:01:57.761720+0000","last_became_active":"2024-04-25T15:47:08.950453+0000","last_became_peered":"2024-04-25T15:47:08.950453+0000","last_unstale":"2024-04-25T17:01:57.761720+0000","last_undegraded":"2024-04-25T17:01:57.761720+0000","last_fullsized":"2024-04-25T17:01:57.761720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'453","last_scrub_stamp":"2024-04-25T17:01:57.761618+0000","last_deep_scrub":"24'453","last_deep_scrub_stamp":"2024-04-25T17:01:57.761618+0000","last_clean_scrub_stamp":"2024-04-25T17:01:57.761618+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:14:17.870833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":42323,"num_write":423,"num_write_kb":72432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"24'432","reported_seq":522,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:03.386345+0000","last_change":"2024-04-25T17:02:03.386370+0000","last_active":"2024-04-25T17:02:03.386345+0000","last_peered":"2024-04-25T17:02:03.386345+0000","last_clean":"2024-04-25T17:02:03.386345+0000","last_became_active":"2024-04-25T15:46:33.021888+0000","last_became_peered":"2024-04-25T15:46:33.021888+0000","last_unstale":"2024-04-25T17:02:03.386345+0000","last_undegraded":"2024-04-25T17:02:03.386345+0000","last_fullsized":"2024-04-25T17:02:03.386345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'432","last_scrub_stamp":"2024-04-25T17:02:03.386230+0000","last_deep_scrub":"24'432","last_deep_scrub_stamp":"2024-04-25T17:02:03.386230+0000","last_clean_scrub_stamp":"2024-04-25T17:02:03.386230+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:54.354578+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":16763,"num_write":405,"num_write_kb":80030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"24'382","reported_seq":452,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:54.555809+0000","last_change":"2024-04-25T17:01:54.555834+0000","last_active":"2024-04-25T17:01:54.555809+0000","last_peered":"2024-04-25T17:01:54.555809+0000","last_clean":"2024-04-25T17:01:54.555809+0000","last_became_active":"2024-04-25T15:46:32.929019+0000","last_became_peered":"2024-04-25T15:46:32.929019+0000","last_unstale":"2024-04-25T17:01:54.555809+0000","last_undegraded":"2024-04-25T17:01:54.555809+0000","last_fullsized":"2024-04-25T17:01:54.555809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'382","last_scrub_stamp":"2024-04-25T17:01:54.555720+0000","last_deep_scrub":"24'382","last_deep_scrub_stamp":"2024-04-25T17:01:54.555720+0000","last_clean_scrub_stamp":"2024-04-25T17:01:54.555720+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:30.282696+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":5031,"num_write":350,"num_write_kb":37997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'224","reported_seq":281,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:55.358516+0000","last_change":"2024-04-25T17:01:55.358572+0000","last_active":"2024-04-25T17:01:55.358516+0000","last_peered":"2024-04-25T17:01:55.358516+0000","last_clean":"2024-04-25T17:01:55.358516+0000","last_became_active":"2024-04-25T15:46:31.685602+0000","last_became_peered":"2024-04-25T15:46:31.685602+0000","last_unstale":"2024-04-25T17:01:55.358516+0000","last_undegraded":"2024-04-25T17:01:55.358516+0000","last_fullsized":"2024-04-25T17:01:55.358516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'224","last_scrub_stamp":"2024-04-25T17:01:55.358379+0000","last_deep_scrub":"24'224","last_deep_scrub_stamp":"2024-04-25T17:01:55.358379+0000","last_clean_scrub_stamp":"2024-04-25T17:01:55.358379+0000","objects_scrubbed":3,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:58:11.561416+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":4169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"24'361","reported_seq":433,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:55.780620+0000","last_change":"2024-04-25T17:01:55.780645+0000","last_active":"2024-04-25T17:01:55.780620+0000","last_peered":"2024-04-25T17:01:55.780620+0000","last_clean":"2024-04-25T17:01:55.780620+0000","last_became_active":"2024-04-25T15:46:33.023432+0000","last_became_peered":"2024-04-25T15:46:33.023432+0000","last_unstale":"2024-04-25T17:01:55.780620+0000","last_undegraded":"2024-04-25T17:01:55.780620+0000","last_fullsized":"2024-04-25T17:01:55.780620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'361","last_scrub_stamp":"2024-04-25T17:01:55.780536+0000","last_deep_scrub":"24'361","last_deep_scrub_stamp":"2024-04-25T17:01:55.780536+0000","last_clean_scrub_stamp":"2024-04-25T17:01:55.780536+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:20.704922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5878,"num_write":338,"num_write_kb":30071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1237","reported_seq":1294,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:56.408747+0000","last_change":"2024-04-25T17:01:56.408816+0000","last_active":"2024-04-25T17:01:56.408747+0000","last_peered":"2024-04-25T17:01:56.408747+0000","last_clean":"2024-04-25T17:01:56.408747+0000","last_became_active":"2024-04-25T15:46:31.658681+0000","last_became_peered":"2024-04-25T15:46:31.658681+0000","last_unstale":"2024-04-25T17:01:56.408747+0000","last_undegraded":"2024-04-25T17:01:56.408747+0000","last_fullsized":"2024-04-25T17:01:56.408747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1237","last_scrub_stamp":"2024-04-25T17:01:56.408642+0000","last_deep_scrub":"24'1237","last_deep_scrub_stamp":"2024-04-25T17:01:56.408642+0000","last_clean_scrub_stamp":"2024-04-25T17:01:56.408642+0000","objects_scrubbed":4,"log_size":1237,"log_dups_size":0,"ondisk_log_size":1237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:34.123801+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1176,"num_write_kb":12901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"24'722","reported_seq":780,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:53.373035+0000","last_change":"2024-04-25T17:01:53.373035+0000","last_active":"2024-04-25T17:01:53.373035+0000","last_peered":"2024-04-25T17:01:53.373035+0000","last_clean":"2024-04-25T17:01:53.373035+0000","last_became_active":"2024-04-25T15:46:31.682936+0000","last_became_peered":"2024-04-25T15:46:31.682936+0000","last_unstale":"2024-04-25T17:01:53.373035+0000","last_undegraded":"2024-04-25T17:01:53.373035+0000","last_fullsized":"2024-04-25T17:01:53.373035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'722","last_scrub_stamp":"2024-04-25T17:01:53.372846+0000","last_deep_scrub":"24'722","last_deep_scrub_stamp":"2024-04-25T17:01:53.372846+0000","last_clean_scrub_stamp":"2024-04-25T17:01:53.372846+0000","objects_scrubbed":2,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:47:53.101322+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"24'432","reported_seq":513,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:02.291849+0000","last_change":"2024-04-25T17:02:02.291876+0000","last_active":"2024-04-25T17:02:02.291849+0000","last_peered":"2024-04-25T17:02:02.291849+0000","last_clean":"2024-04-25T17:02:02.291849+0000","last_became_active":"2024-04-25T15:46:33.019526+0000","last_became_peered":"2024-04-25T15:46:33.019526+0000","last_unstale":"2024-04-25T17:02:02.291849+0000","last_undegraded":"2024-04-25T17:02:02.291849+0000","last_fullsized":"2024-04-25T17:02:02.291849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'432","last_scrub_stamp":"2024-04-25T17:02:02.291751+0000","last_deep_scrub":"24'432","last_deep_scrub_stamp":"2024-04-25T17:02:02.291751+0000","last_clean_scrub_stamp":"2024-04-25T17:02:02.291751+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:08.431160+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10652,"num_write":400,"num_write_kb":42963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"24'1281","reported_seq":1339,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:54.810642+0000","last_change":"2024-04-25T17:01:54.810700+0000","last_active":"2024-04-25T17:01:54.810642+0000","last_peered":"2024-04-25T17:01:54.810642+0000","last_clean":"2024-04-25T17:01:54.810642+0000","last_became_active":"2024-04-25T15:46:31.689130+0000","last_became_peered":"2024-04-25T15:46:31.689130+0000","last_unstale":"2024-04-25T17:01:54.810642+0000","last_undegraded":"2024-04-25T17:01:54.810642+0000","last_fullsized":"2024-04-25T17:01:54.810642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1281","last_scrub_stamp":"2024-04-25T17:01:54.810515+0000","last_deep_scrub":"24'1281","last_deep_scrub_stamp":"2024-04-25T17:01:54.810515+0000","last_clean_scrub_stamp":"2024-04-25T17:01:54.810515+0000","objects_scrubbed":3,"log_size":1281,"log_dups_size":0,"ondisk_log_size":1281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:19:04.831504+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":12905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"24'413","reported_seq":484,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:58.269614+0000","last_change":"2024-04-25T17:01:58.269668+0000","last_active":"2024-04-25T17:01:58.269614+0000","last_peered":"2024-04-25T17:01:58.269614+0000","last_clean":"2024-04-25T17:01:58.269614+0000","last_became_active":"2024-04-25T15:46:32.931648+0000","last_became_peered":"2024-04-25T15:46:32.931648+0000","last_unstale":"2024-04-25T17:01:58.269614+0000","last_undegraded":"2024-04-25T17:01:58.269614+0000","last_fullsized":"2024-04-25T17:01:58.269614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'413","last_scrub_stamp":"2024-04-25T17:01:58.269508+0000","last_deep_scrub":"24'413","last_deep_scrub_stamp":"2024-04-25T17:01:58.269508+0000","last_clean_scrub_stamp":"2024-04-25T17:01:58.269508+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:33.301125+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9624,"num_write":380,"num_write_kb":46532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"24'55","reported_seq":113,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:58.357071+0000","last_change":"2024-04-25T17:01:58.357142+0000","last_active":"2024-04-25T17:01:58.357071+0000","last_peered":"2024-04-25T17:01:58.357071+0000","last_clean":"2024-04-25T17:01:58.357071+0000","last_became_active":"2024-04-25T15:46:31.685244+0000","last_became_peered":"2024-04-25T15:46:31.685244+0000","last_unstale":"2024-04-25T17:01:58.357071+0000","last_undegraded":"2024-04-25T17:01:58.357071+0000","last_fullsized":"2024-04-25T17:01:58.357071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'55","last_scrub_stamp":"2024-04-25T17:01:58.356971+0000","last_deep_scrub":"24'55","last_deep_scrub_stamp":"2024-04-25T17:01:58.356971+0000","last_clean_scrub_stamp":"2024-04-25T17:01:58.356971+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:08:59.753896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"24'416","reported_seq":515,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:07.764832+0000","last_change":"2024-04-25T17:02:07.764882+0000","last_active":"2024-04-25T17:02:07.764832+0000","last_peered":"2024-04-25T17:02:07.764832+0000","last_clean":"2024-04-25T17:02:07.764832+0000","last_became_active":"2024-04-25T15:46:33.043228+0000","last_became_peered":"2024-04-25T15:46:33.043228+0000","last_unstale":"2024-04-25T17:02:07.764832+0000","last_undegraded":"2024-04-25T17:02:07.764832+0000","last_fullsized":"2024-04-25T17:02:07.764832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'416","last_scrub_stamp":"2024-04-25T17:02:07.764715+0000","last_deep_scrub":"24'416","last_deep_scrub_stamp":"2024-04-25T17:02:07.764715+0000","last_clean_scrub_stamp":"2024-04-25T17:02:07.764715+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:08.338139+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26593,"num_write":386,"num_write_kb":54872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"24'375","reported_seq":433,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:57.755399+0000","last_change":"2024-04-25T17:01:57.755438+0000","last_active":"2024-04-25T17:01:57.755399+0000","last_peered":"2024-04-25T17:01:57.755399+0000","last_clean":"2024-04-25T17:01:57.755399+0000","last_became_active":"2024-04-25T15:46:31.692063+0000","last_became_peered":"2024-04-25T15:46:31.692063+0000","last_unstale":"2024-04-25T17:01:57.755399+0000","last_undegraded":"2024-04-25T17:01:57.755399+0000","last_fullsized":"2024-04-25T17:01:57.755399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'375","last_scrub_stamp":"2024-04-25T17:01:57.755299+0000","last_deep_scrub":"24'375","last_deep_scrub_stamp":"2024-04-25T17:01:57.755299+0000","last_clean_scrub_stamp":"2024-04-25T17:01:57.755299+0000","objects_scrubbed":2,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:19.008300+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'409","reported_seq":522,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:58.780150+0000","last_change":"2024-04-25T17:01:58.780200+0000","last_active":"2024-04-25T17:01:58.780150+0000","last_peered":"2024-04-25T17:01:58.780150+0000","last_clean":"2024-04-25T17:01:58.780150+0000","last_became_active":"2024-04-25T15:46:33.042941+0000","last_became_peered":"2024-04-25T15:46:33.042941+0000","last_unstale":"2024-04-25T17:01:58.780150+0000","last_undegraded":"2024-04-25T17:01:58.780150+0000","last_fullsized":"2024-04-25T17:01:58.780150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'409","last_scrub_stamp":"2024-04-25T17:01:58.780019+0000","last_deep_scrub":"24'409","last_deep_scrub_stamp":"2024-04-25T17:01:58.780019+0000","last_clean_scrub_stamp":"2024-04-25T17:01:58.780019+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:54.758399+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53704,"num_write":377,"num_write_kb":101029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'2116","reported_seq":2174,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:53.327583+0000","last_change":"2024-04-25T17:01:53.327615+0000","last_active":"2024-04-25T17:01:53.327583+0000","last_peered":"2024-04-25T17:01:53.327583+0000","last_clean":"2024-04-25T17:01:53.327583+0000","last_became_active":"2024-04-25T15:46:31.685993+0000","last_became_peered":"2024-04-25T15:46:31.685993+0000","last_unstale":"2024-04-25T17:01:53.327583+0000","last_undegraded":"2024-04-25T17:01:53.327583+0000","last_fullsized":"2024-04-25T17:01:53.327583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2116","last_scrub_stamp":"2024-04-25T17:01:53.327496+0000","last_deep_scrub":"24'2116","last_deep_scrub_stamp":"2024-04-25T17:01:53.327496+0000","last_clean_scrub_stamp":"2024-04-25T17:01:53.327496+0000","objects_scrubbed":4,"log_size":2116,"log_dups_size":0,"ondisk_log_size":2116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:14:13.436710+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2065,"num_write_kb":6028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'405","reported_seq":544,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:57.539685+0000","last_change":"2024-04-25T17:01:57.539714+0000","last_active":"2024-04-25T17:01:57.539685+0000","last_peered":"2024-04-25T17:01:57.539685+0000","last_clean":"2024-04-25T17:01:57.539685+0000","last_became_active":"2024-04-25T15:46:33.034926+0000","last_became_peered":"2024-04-25T15:46:33.034926+0000","last_unstale":"2024-04-25T17:01:57.539685+0000","last_undegraded":"2024-04-25T17:01:57.539685+0000","last_fullsized":"2024-04-25T17:01:57.539685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'405","last_scrub_stamp":"2024-04-25T17:01:57.539577+0000","last_deep_scrub":"24'405","last_deep_scrub_stamp":"2024-04-25T17:01:57.539577+0000","last_clean_scrub_stamp":"2024-04-25T17:01:57.539577+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:24.634570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":46433,"num_write":373,"num_write_kb":80369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'1511","reported_seq":1571,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:57.356370+0000","last_change":"2024-04-25T17:01:57.356404+0000","last_active":"2024-04-25T17:01:57.356370+0000","last_peered":"2024-04-25T17:01:57.356370+0000","last_clean":"2024-04-25T17:01:57.356370+0000","last_became_active":"2024-04-25T15:46:31.682661+0000","last_became_peered":"2024-04-25T15:46:31.682661+0000","last_unstale":"2024-04-25T17:01:57.356370+0000","last_undegraded":"2024-04-25T17:01:57.356370+0000","last_fullsized":"2024-04-25T17:01:57.356370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1511","last_scrub_stamp":"2024-04-25T17:01:57.356280+0000","last_deep_scrub":"24'1511","last_deep_scrub_stamp":"2024-04-25T17:01:57.356280+0000","last_clean_scrub_stamp":"2024-04-25T17:01:57.356280+0000","objects_scrubbed":7,"log_size":1511,"log_dups_size":0,"ondisk_log_size":1511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:44.860009+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1466,"num_write_kb":13174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"24'389","reported_seq":495,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:03.909598+0000","last_change":"2024-04-25T17:02:03.909627+0000","last_active":"2024-04-25T17:02:03.909598+0000","last_peered":"2024-04-25T17:02:03.909598+0000","last_clean":"2024-04-25T17:02:03.909598+0000","last_became_active":"2024-04-25T15:46:33.034493+0000","last_became_peered":"2024-04-25T15:46:33.034493+0000","last_unstale":"2024-04-25T17:02:03.909598+0000","last_undegraded":"2024-04-25T17:02:03.909598+0000","last_fullsized":"2024-04-25T17:02:03.909598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'389","last_scrub_stamp":"2024-04-25T17:02:03.909503+0000","last_deep_scrub":"24'389","last_deep_scrub_stamp":"2024-04-25T17:02:03.909503+0000","last_clean_scrub_stamp":"2024-04-25T17:02:03.909503+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:59:39.986904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":29846,"num_write":355,"num_write_kb":66952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"24'429","reported_seq":488,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:50.818241+0000","last_change":"2024-04-25T17:01:50.818304+0000","last_active":"2024-04-25T17:01:50.818241+0000","last_peered":"2024-04-25T17:01:50.818241+0000","last_clean":"2024-04-25T17:01:50.818241+0000","last_became_active":"2024-04-25T15:46:31.688096+0000","last_became_peered":"2024-04-25T15:46:31.688096+0000","last_unstale":"2024-04-25T17:01:50.818241+0000","last_undegraded":"2024-04-25T17:01:50.818241+0000","last_fullsized":"2024-04-25T17:01:50.818241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'429","last_scrub_stamp":"2024-04-25T17:01:50.818120+0000","last_deep_scrub":"24'429","last_deep_scrub_stamp":"2024-04-25T17:01:50.818120+0000","last_clean_scrub_stamp":"2024-04-25T17:01:50.818120+0000","objects_scrubbed":6,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:51.668308+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":8362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"24'423","reported_seq":507,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:56.793072+0000","last_change":"2024-04-25T17:01:56.793098+0000","last_active":"2024-04-25T17:01:56.793072+0000","last_peered":"2024-04-25T17:01:56.793072+0000","last_clean":"2024-04-25T17:01:56.793072+0000","last_became_active":"2024-04-25T15:46:33.031282+0000","last_became_peered":"2024-04-25T15:46:33.031282+0000","last_unstale":"2024-04-25T17:01:56.793072+0000","last_undegraded":"2024-04-25T17:01:56.793072+0000","last_fullsized":"2024-04-25T17:01:56.793072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'423","last_scrub_stamp":"2024-04-25T17:01:56.792983+0000","last_deep_scrub":"24'423","last_deep_scrub_stamp":"2024-04-25T17:01:56.792983+0000","last_clean_scrub_stamp":"2024-04-25T17:01:56.792983+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:57.723812+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":11364,"num_write":392,"num_write_kb":80312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"24'63","reported_seq":122,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:56.761221+0000","last_change":"2024-04-25T17:01:56.761248+0000","last_active":"2024-04-25T17:01:56.761221+0000","last_peered":"2024-04-25T17:01:56.761221+0000","last_clean":"2024-04-25T17:01:56.761221+0000","last_became_active":"2024-04-25T15:46:31.690848+0000","last_became_peered":"2024-04-25T15:46:31.690848+0000","last_unstale":"2024-04-25T17:01:56.761221+0000","last_undegraded":"2024-04-25T17:01:56.761221+0000","last_fullsized":"2024-04-25T17:01:56.761221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'63","last_scrub_stamp":"2024-04-25T17:01:56.761147+0000","last_deep_scrub":"24'63","last_deep_scrub_stamp":"2024-04-25T17:01:56.761147+0000","last_clean_scrub_stamp":"2024-04-25T17:01:56.761147+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:49:06.863222+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'391","reported_seq":459,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:07.848992+0000","last_change":"2024-04-25T17:02:07.849016+0000","last_active":"2024-04-25T17:02:07.848992+0000","last_peered":"2024-04-25T17:02:07.848992+0000","last_clean":"2024-04-25T17:02:07.848992+0000","last_became_active":"2024-04-25T15:46:33.040568+0000","last_became_peered":"2024-04-25T15:46:33.040568+0000","last_unstale":"2024-04-25T17:02:07.848992+0000","last_undegraded":"2024-04-25T17:02:07.848992+0000","last_fullsized":"2024-04-25T17:02:07.848992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'391","last_scrub_stamp":"2024-04-25T17:02:07.848907+0000","last_deep_scrub":"24'391","last_deep_scrub_stamp":"2024-04-25T17:02:07.848907+0000","last_clean_scrub_stamp":"2024-04-25T17:02:07.848907+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:31.812314+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":1556,"num_write":356,"num_write_kb":55877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"24'60","reported_seq":119,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:55.423835+0000","last_change":"2024-04-25T17:01:55.423921+0000","last_active":"2024-04-25T17:01:55.423835+0000","last_peered":"2024-04-25T17:01:55.423835+0000","last_clean":"2024-04-25T17:01:55.423835+0000","last_became_active":"2024-04-25T15:46:31.658670+0000","last_became_peered":"2024-04-25T15:46:31.658670+0000","last_unstale":"2024-04-25T17:01:55.423835+0000","last_undegraded":"2024-04-25T17:01:55.423835+0000","last_fullsized":"2024-04-25T17:01:55.423835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'60","last_scrub_stamp":"2024-04-25T17:01:55.423701+0000","last_deep_scrub":"24'60","last_deep_scrub_stamp":"2024-04-25T17:01:55.423701+0000","last_clean_scrub_stamp":"2024-04-25T17:01:55.423701+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:44:18.090818+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"24'439","reported_seq":525,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:02.383357+0000","last_change":"2024-04-25T17:02:02.383418+0000","last_active":"2024-04-25T17:02:02.383357+0000","last_peered":"2024-04-25T17:02:02.383357+0000","last_clean":"2024-04-25T17:02:02.383357+0000","last_became_active":"2024-04-25T15:46:33.020753+0000","last_became_peered":"2024-04-25T15:46:33.020753+0000","last_unstale":"2024-04-25T17:02:02.383357+0000","last_undegraded":"2024-04-25T17:02:02.383357+0000","last_fullsized":"2024-04-25T17:02:02.383357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'439","last_scrub_stamp":"2024-04-25T17:02:02.383238+0000","last_deep_scrub":"24'439","last_deep_scrub_stamp":"2024-04-25T17:02:02.383238+0000","last_clean_scrub_stamp":"2024-04-25T17:02:02.383238+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:37.414856+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":17823,"num_write":412,"num_write_kb":54819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'576","reported_seq":635,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:51.897551+0000","last_change":"2024-04-25T17:01:51.897633+0000","last_active":"2024-04-25T17:01:51.897551+0000","last_peered":"2024-04-25T17:01:51.897551+0000","last_clean":"2024-04-25T17:01:51.897551+0000","last_became_active":"2024-04-25T15:46:31.703167+0000","last_became_peered":"2024-04-25T15:46:31.703167+0000","last_unstale":"2024-04-25T17:01:51.897551+0000","last_undegraded":"2024-04-25T17:01:51.897551+0000","last_fullsized":"2024-04-25T17:01:51.897551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'576","last_scrub_stamp":"2024-04-25T17:01:51.897447+0000","last_deep_scrub":"24'576","last_deep_scrub_stamp":"2024-04-25T17:01:51.897447+0000","last_clean_scrub_stamp":"2024-04-25T17:01:51.897447+0000","objects_scrubbed":10,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:03.681252+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":510,"num_write_kb":8426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"24'470","reported_seq":601,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:06.834865+0000","last_change":"2024-04-25T17:02:06.834892+0000","last_active":"2024-04-25T17:02:06.834865+0000","last_peered":"2024-04-25T17:02:06.834865+0000","last_clean":"2024-04-25T17:02:06.834865+0000","last_became_active":"2024-04-25T15:46:33.039613+0000","last_became_peered":"2024-04-25T15:46:33.039613+0000","last_unstale":"2024-04-25T17:02:06.834865+0000","last_undegraded":"2024-04-25T17:02:06.834865+0000","last_fullsized":"2024-04-25T17:02:06.834865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'470","last_scrub_stamp":"2024-04-25T17:02:06.834764+0000","last_deep_scrub":"24'470","last_deep_scrub_stamp":"2024-04-25T17:02:06.834764+0000","last_clean_scrub_stamp":"2024-04-25T17:02:06.834764+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:50:07.702142+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":36444,"num_write":435,"num_write_kb":71594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'808","reported_seq":868,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:53.543689+0000","last_change":"2024-04-25T17:01:53.543722+0000","last_active":"2024-04-25T17:01:53.543689+0000","last_peered":"2024-04-25T17:01:53.543689+0000","last_clean":"2024-04-25T17:01:53.543689+0000","last_became_active":"2024-04-25T15:46:31.684173+0000","last_became_peered":"2024-04-25T15:46:31.684173+0000","last_unstale":"2024-04-25T17:01:53.543689+0000","last_undegraded":"2024-04-25T17:01:53.543689+0000","last_fullsized":"2024-04-25T17:01:53.543689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'808","last_scrub_stamp":"2024-04-25T17:01:53.543600+0000","last_deep_scrub":"24'808","last_deep_scrub_stamp":"2024-04-25T17:01:53.543600+0000","last_clean_scrub_stamp":"2024-04-25T17:01:53.543600+0000","objects_scrubbed":3,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:09.480330+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":4496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'360","reported_seq":449,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:04.863588+0000","last_change":"2024-04-25T17:02:04.863616+0000","last_active":"2024-04-25T17:02:04.863588+0000","last_peered":"2024-04-25T17:02:04.863588+0000","last_clean":"2024-04-25T17:02:04.863588+0000","last_became_active":"2024-04-25T15:46:33.037529+0000","last_became_peered":"2024-04-25T15:46:33.037529+0000","last_unstale":"2024-04-25T17:02:04.863588+0000","last_undegraded":"2024-04-25T17:02:04.863588+0000","last_fullsized":"2024-04-25T17:02:04.863588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'360","last_scrub_stamp":"2024-04-25T17:02:04.863494+0000","last_deep_scrub":"24'360","last_deep_scrub_stamp":"2024-04-25T17:02:04.863494+0000","last_clean_scrub_stamp":"2024-04-25T17:02:04.863494+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:32.434516+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":10575,"num_write":335,"num_write_kb":42548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'801","reported_seq":861,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:53.882613+0000","last_change":"2024-04-25T17:01:53.882646+0000","last_active":"2024-04-25T17:01:53.882613+0000","last_peered":"2024-04-25T17:01:53.882613+0000","last_clean":"2024-04-25T17:01:53.882613+0000","last_became_active":"2024-04-25T15:46:31.703896+0000","last_became_peered":"2024-04-25T15:46:31.703896+0000","last_unstale":"2024-04-25T17:01:53.882613+0000","last_undegraded":"2024-04-25T17:01:53.882613+0000","last_fullsized":"2024-04-25T17:01:53.882613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'801","last_scrub_stamp":"2024-04-25T17:01:53.882526+0000","last_deep_scrub":"24'801","last_deep_scrub_stamp":"2024-04-25T17:01:53.882526+0000","last_clean_scrub_stamp":"2024-04-25T17:01:53.882526+0000","objects_scrubbed":2,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:03.746627+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":4482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'410","reported_seq":490,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:05.866996+0000","last_change":"2024-04-25T17:02:05.867021+0000","last_active":"2024-04-25T17:02:05.866996+0000","last_peered":"2024-04-25T17:02:05.866996+0000","last_clean":"2024-04-25T17:02:05.866996+0000","last_became_active":"2024-04-25T15:46:33.038380+0000","last_became_peered":"2024-04-25T15:46:33.038380+0000","last_unstale":"2024-04-25T17:02:05.866996+0000","last_undegraded":"2024-04-25T17:02:05.866996+0000","last_fullsized":"2024-04-25T17:02:05.866996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'410","last_scrub_stamp":"2024-04-25T17:02:05.866907+0000","last_deep_scrub":"24'410","last_deep_scrub_stamp":"2024-04-25T17:02:05.866907+0000","last_clean_scrub_stamp":"2024-04-25T17:02:05.866907+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:42.512553+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":18534,"num_write":381,"num_write_kb":108433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'791","reported_seq":851,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:56.310065+0000","last_change":"2024-04-25T17:01:56.310095+0000","last_active":"2024-04-25T17:01:56.310065+0000","last_peered":"2024-04-25T17:01:56.310065+0000","last_clean":"2024-04-25T17:01:56.310065+0000","last_became_active":"2024-04-25T15:46:31.690181+0000","last_became_peered":"2024-04-25T15:46:31.690181+0000","last_unstale":"2024-04-25T17:01:56.310065+0000","last_undegraded":"2024-04-25T17:01:56.310065+0000","last_fullsized":"2024-04-25T17:01:56.310065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'791","last_scrub_stamp":"2024-04-25T17:01:56.309978+0000","last_deep_scrub":"24'791","last_deep_scrub_stamp":"2024-04-25T17:01:56.309978+0000","last_clean_scrub_stamp":"2024-04-25T17:01:56.309978+0000","objects_scrubbed":2,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:28.820711+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'428","reported_seq":510,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:59.689156+0000","last_change":"2024-04-25T17:01:59.689182+0000","last_active":"2024-04-25T17:01:59.689156+0000","last_peered":"2024-04-25T17:01:59.689156+0000","last_clean":"2024-04-25T17:01:59.689156+0000","last_became_active":"2024-04-25T15:46:33.036033+0000","last_became_peered":"2024-04-25T15:46:33.036033+0000","last_unstale":"2024-04-25T17:01:59.689156+0000","last_undegraded":"2024-04-25T17:01:59.689156+0000","last_fullsized":"2024-04-25T17:01:59.689156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'428","last_scrub_stamp":"2024-04-25T17:01:59.689049+0000","last_deep_scrub":"24'428","last_deep_scrub_stamp":"2024-04-25T17:01:59.689049+0000","last_clean_scrub_stamp":"2024-04-25T17:01:59.689049+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:50.657397+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":13038,"num_write":401,"num_write_kb":62698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"24'335","reported_seq":395,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:52.878467+0000","last_change":"2024-04-25T17:01:52.878502+0000","last_active":"2024-04-25T17:01:52.878467+0000","last_peered":"2024-04-25T17:01:52.878467+0000","last_clean":"2024-04-25T17:01:52.878467+0000","last_became_active":"2024-04-25T15:46:31.703234+0000","last_became_peered":"2024-04-25T15:46:31.703234+0000","last_unstale":"2024-04-25T17:01:52.878467+0000","last_undegraded":"2024-04-25T17:01:52.878467+0000","last_fullsized":"2024-04-25T17:01:52.878467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'335","last_scrub_stamp":"2024-04-25T17:01:52.878382+0000","last_deep_scrub":"24'335","last_deep_scrub_stamp":"2024-04-25T17:01:52.878382+0000","last_clean_scrub_stamp":"2024-04-25T17:01:52.878382+0000","objects_scrubbed":3,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:55:35.165507+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'422","reported_seq":522,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:09.833073+0000","last_change":"2024-04-25T17:02:09.833102+0000","last_active":"2024-04-25T17:02:09.833073+0000","last_peered":"2024-04-25T17:02:09.833073+0000","last_clean":"2024-04-25T17:02:09.833073+0000","last_became_active":"2024-04-25T15:46:33.043145+0000","last_became_peered":"2024-04-25T15:46:33.043145+0000","last_unstale":"2024-04-25T17:02:09.833073+0000","last_undegraded":"2024-04-25T17:02:09.833073+0000","last_fullsized":"2024-04-25T17:02:09.833073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'422","last_scrub_stamp":"2024-04-25T17:02:09.832965+0000","last_deep_scrub":"24'422","last_deep_scrub_stamp":"2024-04-25T17:02:09.832965+0000","last_clean_scrub_stamp":"2024-04-25T17:02:09.832965+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:45:31.692633+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":16889,"num_write":397,"num_write_kb":47575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"24'74","reported_seq":162,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:57.028260+0000","last_change":"2024-04-25T17:01:57.028293+0000","last_active":"2024-04-25T17:01:57.028260+0000","last_peered":"2024-04-25T17:01:57.028260+0000","last_clean":"2024-04-25T17:01:57.028260+0000","last_became_active":"2024-04-25T15:46:20.234477+0000","last_became_peered":"2024-04-25T15:46:20.234477+0000","last_unstale":"2024-04-25T17:01:57.028260+0000","last_undegraded":"2024-04-25T17:01:57.028260+0000","last_fullsized":"2024-04-25T17:01:57.028260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'74","last_scrub_stamp":"2024-04-25T17:01:57.028167+0000","last_deep_scrub":"24'74","last_deep_scrub_stamp":"2024-04-25T17:01:57.028167+0000","last_clean_scrub_stamp":"2024-04-25T17:01:57.028167+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:22:20.736089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"24'374","reported_seq":437,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:58.705706+0000","last_change":"2024-04-25T17:01:58.705739+0000","last_active":"2024-04-25T17:01:58.705706+0000","last_peered":"2024-04-25T17:01:58.705706+0000","last_clean":"2024-04-25T17:01:58.705706+0000","last_became_active":"2024-04-25T15:46:31.702517+0000","last_became_peered":"2024-04-25T15:46:31.702517+0000","last_unstale":"2024-04-25T17:01:58.705706+0000","last_undegraded":"2024-04-25T17:01:58.705706+0000","last_fullsized":"2024-04-25T17:01:58.705706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'374","last_scrub_stamp":"2024-04-25T17:01:58.705617+0000","last_deep_scrub":"24'374","last_deep_scrub_stamp":"2024-04-25T17:01:58.705617+0000","last_clean_scrub_stamp":"2024-04-25T17:01:58.705617+0000","objects_scrubbed":4,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:40.262273+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":4261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"24'359","reported_seq":445,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:05.290087+0000","last_change":"2024-04-25T17:02:05.290113+0000","last_active":"2024-04-25T17:02:05.290087+0000","last_peered":"2024-04-25T17:02:05.290087+0000","last_clean":"2024-04-25T17:02:05.290087+0000","last_became_active":"2024-04-25T15:46:33.042522+0000","last_became_peered":"2024-04-25T15:46:33.042522+0000","last_unstale":"2024-04-25T17:02:05.290087+0000","last_undegraded":"2024-04-25T17:02:05.290087+0000","last_fullsized":"2024-04-25T17:02:05.290087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'359","last_scrub_stamp":"2024-04-25T17:02:05.289980+0000","last_deep_scrub":"24'359","last_deep_scrub_stamp":"2024-04-25T17:02:05.289980+0000","last_clean_scrub_stamp":"2024-04-25T17:02:05.289980+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:10.864059+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":13426,"num_write":320,"num_write_kb":38038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"24'504","reported_seq":568,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:00.969292+0000","last_change":"2024-04-25T17:02:00.969325+0000","last_active":"2024-04-25T17:02:00.969292+0000","last_peered":"2024-04-25T17:02:00.969292+0000","last_clean":"2024-04-25T17:02:00.969292+0000","last_became_active":"2024-04-25T15:46:31.687761+0000","last_became_peered":"2024-04-25T15:46:31.687761+0000","last_unstale":"2024-04-25T17:02:00.969292+0000","last_undegraded":"2024-04-25T17:02:00.969292+0000","last_fullsized":"2024-04-25T17:02:00.969292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'504","last_scrub_stamp":"2024-04-25T17:02:00.969191+0000","last_deep_scrub":"24'504","last_deep_scrub_stamp":"2024-04-25T17:02:00.969191+0000","last_clean_scrub_stamp":"2024-04-25T17:02:00.969191+0000","objects_scrubbed":4,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:55:57.327762+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":12491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'389","reported_seq":474,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:52.826543+0000","last_change":"2024-04-25T17:01:52.826595+0000","last_active":"2024-04-25T17:01:52.826543+0000","last_peered":"2024-04-25T17:01:52.826543+0000","last_clean":"2024-04-25T17:01:52.826543+0000","last_became_active":"2024-04-25T15:46:33.020828+0000","last_became_peered":"2024-04-25T15:46:33.020828+0000","last_unstale":"2024-04-25T17:01:52.826543+0000","last_undegraded":"2024-04-25T17:01:52.826543+0000","last_fullsized":"2024-04-25T17:01:52.826543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'389","last_scrub_stamp":"2024-04-25T17:01:52.826437+0000","last_deep_scrub":"24'389","last_deep_scrub_stamp":"2024-04-25T17:01:52.826437+0000","last_clean_scrub_stamp":"2024-04-25T17:01:52.826437+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:25.402927+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12952,"num_write":356,"num_write_kb":71047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"24'3156","reported_seq":6305,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:54.830159+0000","last_change":"2024-04-25T17:01:54.830197+0000","last_active":"2024-04-25T17:01:54.830159+0000","last_peered":"2024-04-25T17:01:54.830159+0000","last_clean":"2024-04-25T17:01:54.830159+0000","last_became_active":"2024-04-25T15:46:31.704412+0000","last_became_peered":"2024-04-25T15:46:31.704412+0000","last_unstale":"2024-04-25T17:01:54.830159+0000","last_undegraded":"2024-04-25T17:01:54.830159+0000","last_fullsized":"2024-04-25T17:01:54.830159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3156","last_scrub_stamp":"2024-04-25T17:01:54.830068+0000","last_deep_scrub":"24'3156","last_deep_scrub_stamp":"2024-04-25T17:01:54.830068+0000","last_clean_scrub_stamp":"2024-04-25T17:01:54.830068+0000","objects_scrubbed":3,"log_size":3156,"log_dups_size":0,"ondisk_log_size":3156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:27:16.900080+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458732,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3086,"num_read_kb":3630,"num_write":3090,"num_write_kb":3631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'400","reported_seq":476,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:01.231312+0000","last_change":"2024-04-25T17:02:01.231367+0000","last_active":"2024-04-25T17:02:01.231312+0000","last_peered":"2024-04-25T17:02:01.231312+0000","last_clean":"2024-04-25T17:02:01.231312+0000","last_became_active":"2024-04-25T15:46:33.061619+0000","last_became_peered":"2024-04-25T15:46:33.061619+0000","last_unstale":"2024-04-25T17:02:01.231312+0000","last_undegraded":"2024-04-25T17:02:01.231312+0000","last_fullsized":"2024-04-25T17:02:01.231312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'400","last_scrub_stamp":"2024-04-25T17:02:01.231203+0000","last_deep_scrub":"24'400","last_deep_scrub_stamp":"2024-04-25T17:02:01.231203+0000","last_clean_scrub_stamp":"2024-04-25T17:02:01.231203+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:13.795012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9644,"num_write":362,"num_write_kb":26127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"24'1001","reported_seq":1064,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:55.789082+0000","last_change":"2024-04-25T17:01:55.789147+0000","last_active":"2024-04-25T17:01:55.789082+0000","last_peered":"2024-04-25T17:01:55.789082+0000","last_clean":"2024-04-25T17:01:55.789082+0000","last_became_active":"2024-04-25T15:46:31.690339+0000","last_became_peered":"2024-04-25T15:46:31.690339+0000","last_unstale":"2024-04-25T17:01:55.789082+0000","last_undegraded":"2024-04-25T17:01:55.789082+0000","last_fullsized":"2024-04-25T17:01:55.789082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1001","last_scrub_stamp":"2024-04-25T17:01:55.788989+0000","last_deep_scrub":"24'1001","last_deep_scrub_stamp":"2024-04-25T17:01:55.788989+0000","last_clean_scrub_stamp":"2024-04-25T17:01:55.788989+0000","objects_scrubbed":2,"log_size":1001,"log_dups_size":0,"ondisk_log_size":1001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:22:19.496912+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":939,"num_write_kb":8657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'404","reported_seq":524,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:56.542758+0000","last_change":"2024-04-25T17:01:56.542782+0000","last_active":"2024-04-25T17:01:56.542758+0000","last_peered":"2024-04-25T17:01:56.542758+0000","last_clean":"2024-04-25T17:01:56.542758+0000","last_became_active":"2024-04-25T15:46:33.021995+0000","last_became_peered":"2024-04-25T15:46:33.021995+0000","last_unstale":"2024-04-25T17:01:56.542758+0000","last_undegraded":"2024-04-25T17:01:56.542758+0000","last_fullsized":"2024-04-25T17:01:56.542758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'404","last_scrub_stamp":"2024-04-25T17:01:56.542668+0000","last_deep_scrub":"24'404","last_deep_scrub_stamp":"2024-04-25T17:01:56.542668+0000","last_clean_scrub_stamp":"2024-04-25T17:01:56.542668+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:12.907552+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":19099,"num_write":371,"num_write_kb":59650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"24'308","reported_seq":371,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:51.422441+0000","last_change":"2024-04-25T17:01:51.422473+0000","last_active":"2024-04-25T17:01:51.422441+0000","last_peered":"2024-04-25T17:01:51.422441+0000","last_clean":"2024-04-25T17:01:51.422441+0000","last_became_active":"2024-04-25T15:46:31.683802+0000","last_became_peered":"2024-04-25T15:46:31.683802+0000","last_unstale":"2024-04-25T17:01:51.422441+0000","last_undegraded":"2024-04-25T17:01:51.422441+0000","last_fullsized":"2024-04-25T17:01:51.422441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'308","last_scrub_stamp":"2024-04-25T17:01:51.422359+0000","last_deep_scrub":"24'308","last_deep_scrub_stamp":"2024-04-25T17:01:51.422359+0000","last_clean_scrub_stamp":"2024-04-25T17:01:51.422359+0000","objects_scrubbed":1,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:08:57.829371+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":243,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'416","reported_seq":505,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:01.729696+0000","last_change":"2024-04-25T17:02:01.729724+0000","last_active":"2024-04-25T17:02:01.729696+0000","last_peered":"2024-04-25T17:02:01.729696+0000","last_clean":"2024-04-25T17:02:01.729696+0000","last_became_active":"2024-04-25T15:46:33.039820+0000","last_became_peered":"2024-04-25T15:46:33.039820+0000","last_unstale":"2024-04-25T17:02:01.729696+0000","last_undegraded":"2024-04-25T17:02:01.729696+0000","last_fullsized":"2024-04-25T17:02:01.729696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'416","last_scrub_stamp":"2024-04-25T17:02:01.729602+0000","last_deep_scrub":"24'416","last_deep_scrub_stamp":"2024-04-25T17:02:01.729602+0000","last_clean_scrub_stamp":"2024-04-25T17:02:01.729602+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:51.531848+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":13405,"num_write":380,"num_write_kb":62960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"24'641","reported_seq":704,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:59.008384+0000","last_change":"2024-04-25T17:01:59.008438+0000","last_active":"2024-04-25T17:01:59.008384+0000","last_peered":"2024-04-25T17:01:59.008384+0000","last_clean":"2024-04-25T17:01:59.008384+0000","last_became_active":"2024-04-25T15:46:31.688274+0000","last_became_peered":"2024-04-25T15:46:31.688274+0000","last_unstale":"2024-04-25T17:01:59.008384+0000","last_undegraded":"2024-04-25T17:01:59.008384+0000","last_fullsized":"2024-04-25T17:01:59.008384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'641","last_scrub_stamp":"2024-04-25T17:01:59.008283+0000","last_deep_scrub":"24'641","last_deep_scrub_stamp":"2024-04-25T17:01:59.008283+0000","last_clean_scrub_stamp":"2024-04-25T17:01:59.008283+0000","objects_scrubbed":3,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:40.564939+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":579,"num_write_kb":8483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'387","reported_seq":519,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:02.275430+0000","last_change":"2024-04-25T17:02:02.275458+0000","last_active":"2024-04-25T17:02:02.275430+0000","last_peered":"2024-04-25T17:02:02.275430+0000","last_clean":"2024-04-25T17:02:02.275430+0000","last_became_active":"2024-04-25T15:46:33.061680+0000","last_became_peered":"2024-04-25T15:46:33.061680+0000","last_unstale":"2024-04-25T17:02:02.275430+0000","last_undegraded":"2024-04-25T17:02:02.275430+0000","last_fullsized":"2024-04-25T17:02:02.275430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'387","last_scrub_stamp":"2024-04-25T17:02:02.275340+0000","last_deep_scrub":"24'387","last_deep_scrub_stamp":"2024-04-25T17:02:02.275340+0000","last_clean_scrub_stamp":"2024-04-25T17:02:02.275340+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:11.257769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":42014,"num_write":351,"num_write_kb":75036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"24'3880","reported_seq":3941,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:54.313077+0000","last_change":"2024-04-25T17:01:54.313120+0000","last_active":"2024-04-25T17:01:54.313077+0000","last_peered":"2024-04-25T17:01:54.313077+0000","last_clean":"2024-04-25T17:01:54.313077+0000","last_became_active":"2024-04-25T15:46:31.686758+0000","last_became_peered":"2024-04-25T15:46:31.686758+0000","last_unstale":"2024-04-25T17:01:54.313077+0000","last_undegraded":"2024-04-25T17:01:54.313077+0000","last_fullsized":"2024-04-25T17:01:54.313077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3880","last_scrub_stamp":"2024-04-25T17:01:54.312976+0000","last_deep_scrub":"24'3880","last_deep_scrub_stamp":"2024-04-25T17:01:54.312976+0000","last_clean_scrub_stamp":"2024-04-25T17:01:54.312976+0000","objects_scrubbed":2,"log_size":3880,"log_dups_size":0,"ondisk_log_size":3880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:54.019042+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10737,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'337","reported_seq":419,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:04.299426+0000","last_change":"2024-04-25T17:02:04.299456+0000","last_active":"2024-04-25T17:02:04.299426+0000","last_peered":"2024-04-25T17:02:04.299426+0000","last_clean":"2024-04-25T17:02:04.299426+0000","last_became_active":"2024-04-25T15:46:33.030894+0000","last_became_peered":"2024-04-25T15:46:33.030894+0000","last_unstale":"2024-04-25T17:02:04.299426+0000","last_undegraded":"2024-04-25T17:02:04.299426+0000","last_fullsized":"2024-04-25T17:02:04.299426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'337","last_scrub_stamp":"2024-04-25T17:02:04.299323+0000","last_deep_scrub":"24'337","last_deep_scrub_stamp":"2024-04-25T17:02:04.299323+0000","last_clean_scrub_stamp":"2024-04-25T17:02:04.299323+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:21.816609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":11416,"num_write":310,"num_write_kb":17828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"24'238","reported_seq":299,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:59.390575+0000","last_change":"2024-04-25T17:01:59.390619+0000","last_active":"2024-04-25T17:01:59.390575+0000","last_peered":"2024-04-25T17:01:59.390575+0000","last_clean":"2024-04-25T17:01:59.390575+0000","last_became_active":"2024-04-25T15:46:31.687691+0000","last_became_peered":"2024-04-25T15:46:31.687691+0000","last_unstale":"2024-04-25T17:01:59.390575+0000","last_undegraded":"2024-04-25T17:01:59.390575+0000","last_fullsized":"2024-04-25T17:01:59.390575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'238","last_scrub_stamp":"2024-04-25T17:01:59.390483+0000","last_deep_scrub":"24'238","last_deep_scrub_stamp":"2024-04-25T17:01:59.390483+0000","last_clean_scrub_stamp":"2024-04-25T17:01:59.390483+0000","objects_scrubbed":3,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:24:46.783183+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'474","reported_seq":614,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:51.784349+0000","last_change":"2024-04-25T17:01:51.784376+0000","last_active":"2024-04-25T17:01:51.784349+0000","last_peered":"2024-04-25T17:01:51.784349+0000","last_clean":"2024-04-25T17:01:51.784349+0000","last_became_active":"2024-04-25T15:46:33.020779+0000","last_became_peered":"2024-04-25T15:46:33.020779+0000","last_unstale":"2024-04-25T17:01:51.784349+0000","last_undegraded":"2024-04-25T17:01:51.784349+0000","last_fullsized":"2024-04-25T17:01:51.784349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'474","last_scrub_stamp":"2024-04-25T17:01:51.784259+0000","last_deep_scrub":"24'474","last_deep_scrub_stamp":"2024-04-25T17:01:51.784259+0000","last_clean_scrub_stamp":"2024-04-25T17:01:51.784259+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:39.841053+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":41834,"num_write":442,"num_write_kb":97214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"24'716","reported_seq":777,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:01.964723+0000","last_change":"2024-04-25T17:02:01.964755+0000","last_active":"2024-04-25T17:02:01.964723+0000","last_peered":"2024-04-25T17:02:01.964723+0000","last_clean":"2024-04-25T17:02:01.964723+0000","last_became_active":"2024-04-25T15:46:31.688192+0000","last_became_peered":"2024-04-25T15:46:31.688192+0000","last_unstale":"2024-04-25T17:02:01.964723+0000","last_undegraded":"2024-04-25T17:02:01.964723+0000","last_fullsized":"2024-04-25T17:02:01.964723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'716","last_scrub_stamp":"2024-04-25T17:02:01.964618+0000","last_deep_scrub":"24'716","last_deep_scrub_stamp":"2024-04-25T17:02:01.964618+0000","last_clean_scrub_stamp":"2024-04-25T17:02:01.964618+0000","objects_scrubbed":2,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:51.766863+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":4437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"24'485","reported_seq":612,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:58.578632+0000","last_change":"2024-04-25T17:01:58.578681+0000","last_active":"2024-04-25T17:01:58.578632+0000","last_peered":"2024-04-25T17:01:58.578632+0000","last_clean":"2024-04-25T17:01:58.578632+0000","last_became_active":"2024-04-25T15:46:33.061651+0000","last_became_peered":"2024-04-25T15:46:33.061651+0000","last_unstale":"2024-04-25T17:01:58.578632+0000","last_undegraded":"2024-04-25T17:01:58.578632+0000","last_fullsized":"2024-04-25T17:01:58.578632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'485","last_scrub_stamp":"2024-04-25T17:01:58.578497+0000","last_deep_scrub":"24'485","last_deep_scrub_stamp":"2024-04-25T17:01:58.578497+0000","last_clean_scrub_stamp":"2024-04-25T17:01:58.578497+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:44:21.245614+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31150,"num_write":464,"num_write_kb":116869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"24'292","reported_seq":353,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:52.372515+0000","last_change":"2024-04-25T17:01:52.372548+0000","last_active":"2024-04-25T17:01:52.372515+0000","last_peered":"2024-04-25T17:01:52.372515+0000","last_clean":"2024-04-25T17:01:52.372515+0000","last_became_active":"2024-04-25T15:46:31.684706+0000","last_became_peered":"2024-04-25T15:46:31.684706+0000","last_unstale":"2024-04-25T17:01:52.372515+0000","last_undegraded":"2024-04-25T17:01:52.372515+0000","last_fullsized":"2024-04-25T17:01:52.372515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'292","last_scrub_stamp":"2024-04-25T17:01:52.372433+0000","last_deep_scrub":"24'292","last_deep_scrub_stamp":"2024-04-25T17:01:52.372433+0000","last_clean_scrub_stamp":"2024-04-25T17:01:52.372433+0000","objects_scrubbed":3,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:30.087592+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"24'407","reported_seq":509,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:59.299737+0000","last_change":"2024-04-25T17:01:59.299761+0000","last_active":"2024-04-25T17:01:59.299737+0000","last_peered":"2024-04-25T17:01:59.299737+0000","last_clean":"2024-04-25T17:01:59.299737+0000","last_became_active":"2024-04-25T15:46:32.928971+0000","last_became_peered":"2024-04-25T15:46:32.928971+0000","last_unstale":"2024-04-25T17:01:59.299737+0000","last_undegraded":"2024-04-25T17:01:59.299737+0000","last_fullsized":"2024-04-25T17:01:59.299737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'407","last_scrub_stamp":"2024-04-25T17:01:59.299658+0000","last_deep_scrub":"24'407","last_deep_scrub_stamp":"2024-04-25T17:01:59.299658+0000","last_clean_scrub_stamp":"2024-04-25T17:01:59.299658+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:50.286267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":21551,"num_write":373,"num_write_kb":54456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"24'745","reported_seq":806,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:55.354346+0000","last_change":"2024-04-25T17:01:55.354393+0000","last_active":"2024-04-25T17:01:55.354346+0000","last_peered":"2024-04-25T17:01:55.354346+0000","last_clean":"2024-04-25T17:01:55.354346+0000","last_became_active":"2024-04-25T15:46:31.687335+0000","last_became_peered":"2024-04-25T15:46:31.687335+0000","last_unstale":"2024-04-25T17:01:55.354346+0000","last_undegraded":"2024-04-25T17:01:55.354346+0000","last_fullsized":"2024-04-25T17:01:55.354346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'745","last_scrub_stamp":"2024-04-25T17:01:55.354259+0000","last_deep_scrub":"24'745","last_deep_scrub_stamp":"2024-04-25T17:01:55.354259+0000","last_clean_scrub_stamp":"2024-04-25T17:01:55.354259+0000","objects_scrubbed":2,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:19:05.375248+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":4454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"24'417","reported_seq":487,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:03.332469+0000","last_change":"2024-04-25T17:02:03.332495+0000","last_active":"2024-04-25T17:02:03.332469+0000","last_peered":"2024-04-25T17:02:03.332469+0000","last_clean":"2024-04-25T17:02:03.332469+0000","last_became_active":"2024-04-25T15:46:33.020855+0000","last_became_peered":"2024-04-25T15:46:33.020855+0000","last_unstale":"2024-04-25T17:02:03.332469+0000","last_undegraded":"2024-04-25T17:02:03.332469+0000","last_fullsized":"2024-04-25T17:02:03.332469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'417","last_scrub_stamp":"2024-04-25T17:02:03.332378+0000","last_deep_scrub":"24'417","last_deep_scrub_stamp":"2024-04-25T17:02:03.332378+0000","last_clean_scrub_stamp":"2024-04-25T17:02:03.332378+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:53:19.999496+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6898,"num_write":384,"num_write_kb":50772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'1032","reported_seq":1092,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:02.966844+0000","last_change":"2024-04-25T17:02:02.966896+0000","last_active":"2024-04-25T17:02:02.966844+0000","last_peered":"2024-04-25T17:02:02.966844+0000","last_clean":"2024-04-25T17:02:02.966844+0000","last_became_active":"2024-04-25T15:46:31.692762+0000","last_became_peered":"2024-04-25T15:46:31.692762+0000","last_unstale":"2024-04-25T17:02:02.966844+0000","last_undegraded":"2024-04-25T17:02:02.966844+0000","last_fullsized":"2024-04-25T17:02:02.966844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1032","last_scrub_stamp":"2024-04-25T17:02:02.966740+0000","last_deep_scrub":"24'1032","last_deep_scrub_stamp":"2024-04-25T17:02:02.966740+0000","last_clean_scrub_stamp":"2024-04-25T17:02:02.966740+0000","objects_scrubbed":5,"log_size":1032,"log_dups_size":0,"ondisk_log_size":1032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:31.895432+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10888152,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":975,"num_write_kb":11131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"24'426","reported_seq":531,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:01.361543+0000","last_change":"2024-04-25T17:02:01.361567+0000","last_active":"2024-04-25T17:02:01.361543+0000","last_peered":"2024-04-25T17:02:01.361543+0000","last_clean":"2024-04-25T17:02:01.361543+0000","last_became_active":"2024-04-25T15:46:33.014116+0000","last_became_peered":"2024-04-25T15:46:33.014116+0000","last_unstale":"2024-04-25T17:02:01.361543+0000","last_undegraded":"2024-04-25T17:02:01.361543+0000","last_fullsized":"2024-04-25T17:02:01.361543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'426","last_scrub_stamp":"2024-04-25T17:02:01.361455+0000","last_deep_scrub":"24'426","last_deep_scrub_stamp":"2024-04-25T17:02:01.361455+0000","last_clean_scrub_stamp":"2024-04-25T17:02:01.361455+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:46.064267+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25236,"num_write":391,"num_write_kb":71743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"24'397","reported_seq":524,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:00.688823+0000","last_change":"2024-04-25T17:02:00.688891+0000","last_active":"2024-04-25T17:02:00.688823+0000","last_peered":"2024-04-25T17:02:00.688823+0000","last_clean":"2024-04-25T17:02:00.688823+0000","last_became_active":"2024-04-25T15:46:33.039713+0000","last_became_peered":"2024-04-25T15:46:33.039713+0000","last_unstale":"2024-04-25T17:02:00.688823+0000","last_undegraded":"2024-04-25T17:02:00.688823+0000","last_fullsized":"2024-04-25T17:02:00.688823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'397","last_scrub_stamp":"2024-04-25T17:02:00.688680+0000","last_deep_scrub":"24'397","last_deep_scrub_stamp":"2024-04-25T17:02:00.688680+0000","last_clean_scrub_stamp":"2024-04-25T17:02:00.688680+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:10:27.384004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":31357,"num_write":351,"num_write_kb":60889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"24'786","reported_seq":843,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:57.996255+0000","last_change":"2024-04-25T17:01:57.996288+0000","last_active":"2024-04-25T17:01:57.996255+0000","last_peered":"2024-04-25T17:01:57.996255+0000","last_clean":"2024-04-25T17:01:57.996255+0000","last_became_active":"2024-04-25T15:46:31.686390+0000","last_became_peered":"2024-04-25T15:46:31.686390+0000","last_unstale":"2024-04-25T17:01:57.996255+0000","last_undegraded":"2024-04-25T17:01:57.996255+0000","last_fullsized":"2024-04-25T17:01:57.996255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'786","last_scrub_stamp":"2024-04-25T17:01:57.996169+0000","last_deep_scrub":"24'786","last_deep_scrub_stamp":"2024-04-25T17:01:57.996169+0000","last_clean_scrub_stamp":"2024-04-25T17:01:57.996169+0000","objects_scrubbed":2,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:49:08.098244+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":4471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'374","reported_seq":442,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:02.703674+0000","last_change":"2024-04-25T17:02:02.703699+0000","last_active":"2024-04-25T17:02:02.703674+0000","last_peered":"2024-04-25T17:02:02.703674+0000","last_clean":"2024-04-25T17:02:02.703674+0000","last_became_active":"2024-04-25T15:46:33.040941+0000","last_became_peered":"2024-04-25T15:46:33.040941+0000","last_unstale":"2024-04-25T17:02:02.703674+0000","last_undegraded":"2024-04-25T17:02:02.703674+0000","last_fullsized":"2024-04-25T17:02:02.703674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'374","last_scrub_stamp":"2024-04-25T17:02:02.703583+0000","last_deep_scrub":"24'374","last_deep_scrub_stamp":"2024-04-25T17:02:02.703583+0000","last_clean_scrub_stamp":"2024-04-25T17:02:02.703583+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:31.632276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8232,"num_write":346,"num_write_kb":71494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'1205","reported_seq":1262,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:00.026318+0000","last_change":"2024-04-25T17:02:00.026359+0000","last_active":"2024-04-25T17:02:00.026318+0000","last_peered":"2024-04-25T17:02:00.026318+0000","last_clean":"2024-04-25T17:02:00.026318+0000","last_became_active":"2024-04-25T15:46:31.688342+0000","last_became_peered":"2024-04-25T15:46:31.688342+0000","last_unstale":"2024-04-25T17:02:00.026318+0000","last_undegraded":"2024-04-25T17:02:00.026318+0000","last_fullsized":"2024-04-25T17:02:00.026318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1205","last_scrub_stamp":"2024-04-25T17:02:00.026220+0000","last_deep_scrub":"24'1205","last_deep_scrub_stamp":"2024-04-25T17:02:00.026220+0000","last_clean_scrub_stamp":"2024-04-25T17:02:00.026220+0000","objects_scrubbed":5,"log_size":1205,"log_dups_size":0,"ondisk_log_size":1205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:50.994568+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":12844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"24'387","reported_seq":491,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:59.780864+0000","last_change":"2024-04-25T17:01:59.780906+0000","last_active":"2024-04-25T17:01:59.780864+0000","last_peered":"2024-04-25T17:01:59.780864+0000","last_clean":"2024-04-25T17:01:59.780864+0000","last_became_active":"2024-04-25T15:46:33.043134+0000","last_became_peered":"2024-04-25T15:46:33.043134+0000","last_unstale":"2024-04-25T17:01:59.780864+0000","last_undegraded":"2024-04-25T17:01:59.780864+0000","last_fullsized":"2024-04-25T17:01:59.780864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'387","last_scrub_stamp":"2024-04-25T17:01:59.780763+0000","last_deep_scrub":"24'387","last_deep_scrub_stamp":"2024-04-25T17:01:59.780763+0000","last_clean_scrub_stamp":"2024-04-25T17:01:59.780763+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:35:11.858132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22111,"num_write":359,"num_write_kb":59931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"24'240","reported_seq":304,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:54.342253+0000","last_change":"2024-04-25T17:01:54.342308+0000","last_active":"2024-04-25T17:01:54.342253+0000","last_peered":"2024-04-25T17:01:54.342253+0000","last_clean":"2024-04-25T17:01:54.342253+0000","last_became_active":"2024-04-25T15:46:31.684729+0000","last_became_peered":"2024-04-25T15:46:31.684729+0000","last_unstale":"2024-04-25T17:01:54.342253+0000","last_undegraded":"2024-04-25T17:01:54.342253+0000","last_fullsized":"2024-04-25T17:01:54.342253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'240","last_scrub_stamp":"2024-04-25T17:01:54.342153+0000","last_deep_scrub":"24'240","last_deep_scrub_stamp":"2024-04-25T17:01:54.342153+0000","last_clean_scrub_stamp":"2024-04-25T17:01:54.342153+0000","objects_scrubbed":1,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:10.236370+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":4173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"24'427","reported_seq":560,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:02:01.311588+0000","last_change":"2024-04-25T17:02:01.311612+0000","last_active":"2024-04-25T17:02:01.311588+0000","last_peered":"2024-04-25T17:02:01.311588+0000","last_clean":"2024-04-25T17:02:01.311588+0000","last_became_active":"2024-04-25T15:46:33.011979+0000","last_became_peered":"2024-04-25T15:46:33.011979+0000","last_unstale":"2024-04-25T17:02:01.311588+0000","last_undegraded":"2024-04-25T17:02:01.311588+0000","last_fullsized":"2024-04-25T17:02:01.311588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'427","last_scrub_stamp":"2024-04-25T17:02:01.311507+0000","last_deep_scrub":"24'427","last_deep_scrub_stamp":"2024-04-25T17:02:01.311507+0000","last_clean_scrub_stamp":"2024-04-25T17:02:01.311507+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:10:29.262365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":33589,"num_write":403,"num_write_kb":89000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"24'415","reported_seq":478,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T17:01:49.799506+0000","last_change":"2024-04-25T17:01:49.799574+0000","last_active":"2024-04-25T17:01:49.799506+0000","last_peered":"2024-04-25T17:01:49.799506+0000","last_clean":"2024-04-25T17:01:49.799506+0000","last_became_active":"2024-04-25T15:46:31.687705+0000","last_became_peered":"2024-04-25T15:46:31.687705+0000","last_unstale":"2024-04-25T17:01:49.799506+0000","last_undegraded":"2024-04-25T17:01:49.799506+0000","last_fullsized":"2024-04-25T17:01:49.799506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'415","last_scrub_stamp":"2024-04-25T17:01:49.799376+0000","last_deep_scrub":"24'415","last_deep_scrub_stamp":"2024-04-25T17:01:49.799376+0000","last_clean_scrub_stamp":"2024-04-25T17:01:49.799376+0000","objects_scrubbed":6,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:35:22.012948+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":8367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2746,"num_read_kb":1448171,"num_write":24417,"num_write_kb":4365214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26337,"ondisk_log_size":26337,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":184318122,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":3086,"num_read_kb":3630,"num_write":31925,"num_write_kb":196586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368795648,"data_stored":368636244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26917,"ondisk_log_size":26917,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510355,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140188,"kb_used_data":72916,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94231652,"statfs":{"total":96636764160,"available":96493211648,"internally_reserved":0,"allocated":74665984,"data_stored":74483790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510355,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120840,"kb_used_data":49408,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94251000,"statfs":{"total":96636764160,"available":96513024000,"internally_reserved":0,"allocated":50593792,"data_stored":50421810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510357,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108492,"kb_used_data":41220,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94263348,"statfs":{"total":96636764160,"available":96525668352,"internally_reserved":0,"allocated":42209280,"data_stored":42033230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510355,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119124,"kb_used_data":51852,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94252716,"statfs":{"total":96636764160,"available":96514781184,"internally_reserved":0,"allocated":53096448,"data_stored":52920718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510356,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93600,"kb_used_data":22168,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94278240,"statfs":{"total":96636764160,"available":96540917760,"internally_reserved":0,"allocated":22700032,"data_stored":22519792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510357,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125008,"kb_used_data":49416,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94246832,"statfs":{"total":96636764160,"available":96508755968,"internally_reserved":0,"allocated":50601984,"data_stored":50421404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77396422},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543060,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128096,"kb_used_data":34456,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94243744,"statfs":{"total":96636764160,"available":96505593856,"internally_reserved":0,"allocated":35282944,"data_stored":35103852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":95877576},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543061,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99340,"kb_used_data":41796,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94272500,"statfs":{"total":96636764160,"available":96535040000,"internally_reserved":0,"allocated":42799104,"data_stored":42622880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41959424,"data_stored":41943700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50356224,"data_stored":50332592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22454272,"data_stored":22430980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35037184,"data_stored":35015040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":52850688,"data_stored":52831906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41963520,"data_stored":41944418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":50348032,"data_stored":50332998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73826304,"data_stored":73804610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T17:02:17.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T17:02:17.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.554+0000 7f1b42fe3640 1 Processor -- start 2024-04-25T17:02:17.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.554+0000 7f1b42fe3640 1 -- start start 2024-04-25T17:02:17.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.555+0000 7f1b42fe3640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1b3c1545f0 0x7f1b3c0c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:17.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.555+0000 7f1b42fe3640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b3c06f350 0x7f1b3c0c7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:17.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.555+0000 7f1b42fe3640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b3c15af90 con 0x7f1b3c06ff60 2024-04-25T17:02:17.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.555+0000 7f1b42fe3640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f1b3c0c8b60 con 0x7f1b3c06f350 2024-04-25T17:02:17.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.555+0000 7f1b42fe3640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1b3c15b270 con 0x7f1b3c1545f0 2024-04-25T17:02:17.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.556+0000 7f1b33fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1b3c1545f0 0x7f1b3c0c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:17.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.556+0000 7f1b40d7f640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f1b3c06ff60 0x7f1b3c0c8450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.59:41154/0 (socket says 172.21.15.59:41154) 2024-04-25T17:02:17.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.556+0000 7f1b40d7f640 1 -- 172.21.15.59:0/1379979673 learned_addr learned my addr 172.21.15.59:0/1379979673 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T17:02:17.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.560+0000 7f1b33fff640 1 -- 172.21.15.59:0/1379979673 >> v2:172.21.15.59:3300/0 conn(0x7f1b3c06f350 msgr2=0x7f1b3c0c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:02:17.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.560+0000 7f1b33fff640 1 --2- 172.21.15.59:0/1379979673 >> v2:172.21.15.59:3300/0 conn(0x7f1b3c06f350 0x7f1b3c0c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:17.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.560+0000 7f1b33fff640 1 -- 172.21.15.59:0/1379979673 >> v1:172.21.15.64:6789/0 conn(0x7f1b3c06ff60 legacy=0x7f1b3c0c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:17.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.560+0000 7f1b33fff640 1 -- 172.21.15.59:0/1379979673 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3c15d9f0 con 0x7f1b3c1545f0 2024-04-25T17:02:17.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.563+0000 7f1b33fff640 1 --2- 172.21.15.59:0/1379979673 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1b3c1545f0 0x7f1b3c0c6d50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0097a0 tx=0x7f1b2c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f808309c6341f34b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:17.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.567+0000 7f1b337fe640 1 -- 172.21.15.59:0/1379979673 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c037070 con 0x7f1b3c1545f0 2024-04-25T17:02:17.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.567+0000 7f1b337fe640 1 -- 172.21.15.59:0/1379979673 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b2c032440 con 0x7f1b3c1545f0 2024-04-25T17:02:17.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.567+0000 7f1b337fe640 1 -- 172.21.15.59:0/1379979673 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c032810 con 0x7f1b3c1545f0 2024-04-25T17:02:17.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.568+0000 7f1b42fe3640 1 -- 172.21.15.59:0/1379979673 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1b3c1545f0 msgr2=0x7f1b3c0c6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:17.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.568+0000 7f1b42fe3640 1 --2- 172.21.15.59:0/1379979673 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1b3c1545f0 0x7f1b3c0c6d50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0097a0 tx=0x7f1b2c02a1a0 comp rx=0 tx=0).stop 2024-04-25T17:02:17.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.568+0000 7f1b42fe3640 1 -- 172.21.15.59:0/1379979673 shutdown_connections 2024-04-25T17:02:17.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.568+0000 7f1b42fe3640 1 --2- 172.21.15.59:0/1379979673 >> v2:172.21.15.59:3300/0 conn(0x7f1b3c06f350 0x7f1b3c0c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:17.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.568+0000 7f1b42fe3640 1 --2- 172.21.15.59:0/1379979673 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1b3c1545f0 0x7f1b3c0c6d50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:17.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.568+0000 7f1b42fe3640 1 -- 172.21.15.59:0/1379979673 >> 172.21.15.59:0/1379979673 conn(0x7f1b3c071720 msgr2=0x7f1b3c0ca140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:02:17.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.568+0000 7f1b42fe3640 1 -- 172.21.15.59:0/1379979673 shutdown_connections 2024-04-25T17:02:17.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.568+0000 7f1b42fe3640 1 -- 172.21.15.59:0/1379979673 wait complete. 2024-04-25T17:02:17.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.570+0000 7f1b42fe3640 1 Processor -- start 2024-04-25T17:02:17.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.570+0000 7f1b42fe3640 1 -- start start 2024-04-25T17:02:17.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.571+0000 7f1b42fe3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1b3c06f350 0x7f1b3c0c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:17.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.571+0000 7f1b42fe3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b3c06ff60 0x7f1b3c15b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:17.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.571+0000 7f1b42fe3640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1b3c1545f0 0x7f1b3c15bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:17.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.571+0000 7f1b42fe3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c15e290 con 0x7f1b3c06ff60 2024-04-25T17:02:17.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.571+0000 7f1b42fe3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c15dfb0 con 0x7f1b3c06f350 2024-04-25T17:02:17.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.571+0000 7f1b42fe3640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f1b3c06fa30 con 0x7f1b3c1545f0 2024-04-25T17:02:17.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.572+0000 7f1b41580640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1b3c1545f0 0x7f1b3c15bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:17.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.572+0000 7f1b40d7f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1b3c06f350 0x7f1b3c0c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:17.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.572+0000 7f1b41580640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1b3c1545f0 0x7f1b3c15bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:52774/0 (socket says 172.21.15.59:52774) 2024-04-25T17:02:17.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.572+0000 7f1b41580640 1 -- 172.21.15.59:0/2470732212 learned_addr learned my addr 172.21.15.59:0/2470732212 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:02:17.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.577+0000 7f1b41580640 1 -- 172.21.15.59:0/2470732212 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1b3c06f350 msgr2=0x7f1b3c0c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:17.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.577+0000 7f1b41580640 1 --2- 172.21.15.59:0/2470732212 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1b3c06f350 0x7f1b3c0c5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:17.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.577+0000 7f1b41580640 1 -- 172.21.15.59:0/2470732212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b3c06ff60 msgr2=0x7f1b3c15b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:17.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.577+0000 7f1b41580640 1 --2- 172.21.15.59:0/2470732212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b3c06ff60 0x7f1b3c15b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:17.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.577+0000 7f1b41580640 1 -- 172.21.15.59:0/2470732212 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3c0c6240 con 0x7f1b3c1545f0 2024-04-25T17:02:17.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.580+0000 7f1b41580640 1 --2- 172.21.15.59:0/2470732212 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1b3c1545f0 0x7f1b3c15bb00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400b3e0 tx=0x7f1b3400b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.584+0000 7f1b317fa640 1 -- 172.21.15.59:0/2470732212 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b34015020 con 0x7f1b3c1545f0 2024-04-25T17:02:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.584+0000 7f1b317fa640 1 -- 172.21.15.59:0/2470732212 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b34011830 con 0x7f1b3c1545f0 2024-04-25T17:02:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.584+0000 7f1b317fa640 1 -- 172.21.15.59:0/2470732212 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b34011c00 con 0x7f1b3c1545f0 2024-04-25T17:02:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.584+0000 7f1b42fe3640 1 -- 172.21.15.59:0/2470732212 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b3c15ccf0 con 0x7f1b3c1545f0 2024-04-25T17:02:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.585+0000 7f1b42fe3640 1 -- 172.21.15.59:0/2470732212 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b3c15d260 con 0x7f1b3c1545f0 2024-04-25T17:02:17.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.586+0000 7f1b42fe3640 1 -- 172.21.15.59:0/2470732212 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b3c069910 con 0x7f1b3c1545f0 2024-04-25T17:02:17.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.611+0000 7f1b317fa640 1 -- 172.21.15.59:0/2470732212 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1b34018020 con 0x7f1b3c1545f0 2024-04-25T17:02:17.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.612+0000 7f1b317fa640 1 --2- 172.21.15.59:0/2470732212 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1b280744b0 0x7f1b280769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:17.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.612+0000 7f1b40d7f640 1 --2- 172.21.15.59:0/2470732212 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1b280744b0 0x7f1b280769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:17.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.613+0000 7f1b40d7f640 1 --2- 172.21.15.59:0/2470732212 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1b280744b0 0x7f1b280769c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1b38001330 tx=0x7f1b38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:17.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.901+0000 7f1b317fa640 1 -- 172.21.15.59:0/2470732212 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f1b34011da0 con 0x7f1b3c1545f0 2024-04-25T17:02:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:17.913+0000 7f1b317fa640 1 -- 172.21.15.59:0/2470732212 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1b3401f020 con 0x7f1b3c1545f0 2024-04-25T17:02:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.101+0000 7f1b42fe3640 1 -- 172.21.15.59:0/2470732212 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f1b3c06fd40 con 0x7f1b3c1545f0 2024-04-25T17:02:18.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.356+0000 7f1b317fa640 1 -- 172.21.15.59:0/2470732212 <== mon.2 v2:172.21.15.64:3301/0 7 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1b3405f210 con 0x7f1b3c1545f0 2024-04-25T17:02:18.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.356+0000 7f1b317fa640 1 -- 172.21.15.59:0/2470732212 <== mon.2 v2:172.21.15.64:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f1b3405fe00 con 0x7f1b3c1545f0 2024-04-25T17:02:18.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.358+0000 7f1b42fe3640 1 -- 172.21.15.59:0/2470732212 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1b280744b0 msgr2=0x7f1b280769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:18.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.358+0000 7f1b42fe3640 1 --2- 172.21.15.59:0/2470732212 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1b280744b0 0x7f1b280769c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1b38001330 tx=0x7f1b38009040 comp rx=0 tx=0).stop 2024-04-25T17:02:18.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.358+0000 7f1b42fe3640 1 -- 172.21.15.59:0/2470732212 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1b3c1545f0 msgr2=0x7f1b3c15bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:18.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.358+0000 7f1b42fe3640 1 --2- 172.21.15.59:0/2470732212 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1b3c1545f0 0x7f1b3c15bb00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400b3e0 tx=0x7f1b3400b8a0 comp rx=0 tx=0).stop 2024-04-25T17:02:18.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.359+0000 7f1b42fe3640 1 -- 172.21.15.59:0/2470732212 shutdown_connections 2024-04-25T17:02:18.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.359+0000 7f1b42fe3640 1 --2- 172.21.15.59:0/2470732212 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f1b280744b0 0x7f1b280769c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:18.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.359+0000 7f1b42fe3640 1 --2- 172.21.15.59:0/2470732212 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1b3c1545f0 0x7f1b3c15bb00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:18.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.359+0000 7f1b42fe3640 1 --2- 172.21.15.59:0/2470732212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b3c06ff60 0x7f1b3c15b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:18.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.359+0000 7f1b42fe3640 1 --2- 172.21.15.59:0/2470732212 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1b3c06f350 0x7f1b3c0c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:18.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.359+0000 7f1b42fe3640 1 -- 172.21.15.59:0/2470732212 >> 172.21.15.59:0/2470732212 conn(0x7f1b3c071720 msgr2=0x7f1b3c152e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:02:18.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.359+0000 7f1b42fe3640 1 -- 172.21.15.59:0/2470732212 shutdown_connections 2024-04-25T17:02:18.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.359+0000 7f1b42fe3640 1 -- 172.21.15.59:0/2470732212 wait complete. 2024-04-25T17:02:18.371 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T17:02:18.371 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T17:02:18.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.485+0000 7f2bfc668640 1 Processor -- start 2024-04-25T17:02:18.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.486+0000 7f2bfc668640 1 -- start start 2024-04-25T17:02:18.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.487+0000 7f2bfc668640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2bf40b41c0 0x7f2bf40cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:18.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.487+0000 7f2bfc668640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2bf40cd680 0x7f2bf415c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:18.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.487+0000 7f2bfc668640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf415cd60 con 0x7f2bf415c6f0 2024-04-25T17:02:18.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.487+0000 7f2bfc668640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7f2bf415cb00 con 0x7f2bf40b41c0 2024-04-25T17:02:18.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.487+0000 7f2bfc668640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf415d040 con 0x7f2bf40cd680 2024-04-25T17:02:18.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.488+0000 7f2bfa404640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2bf40b41c0 0x7f2bf40cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:18.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.488+0000 7f2bfac05640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f2bf415c6f0 0x7f2bf40ce540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.59:41160/0 (socket says 172.21.15.59:41160) 2024-04-25T17:02:18.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.488+0000 7f2bfac05640 1 -- 172.21.15.59:0/2787783225 learned_addr learned my addr 172.21.15.59:0/2787783225 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T17:02:18.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.488+0000 7f2bf9c03640 1 --2- 172.21.15.59:0/2787783225 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2bf40cd680 0x7f2bf415c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:18.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.491+0000 7f2bf9402640 1 -- 172.21.15.59:0/2787783225 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3888779886 0 0) 0x7f2bf415cd60 con 0x7f2bf415c6f0 2024-04-25T17:02:18.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.491+0000 7f2bf9402640 1 -- 172.21.15.59:0/2787783225 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2be0003520 con 0x7f2bf415c6f0 2024-04-25T17:02:18.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.491+0000 7f2bfa404640 1 -- 172.21.15.59:0/2787783225 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2bf40cd680 msgr2=0x7f2bf415c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:02:18.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.491+0000 7f2bfa404640 1 --2- 172.21.15.59:0/2787783225 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2bf40cd680 0x7f2bf415c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:18.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.491+0000 7f2bfa404640 1 -- 172.21.15.59:0/2787783225 >> v1:172.21.15.64:6789/0 conn(0x7f2bf415c6f0 legacy=0x7f2bf40ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:18.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.491+0000 7f2bfa404640 1 -- 172.21.15.59:0/2787783225 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf415d320 con 0x7f2bf40b41c0 2024-04-25T17:02:18.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.493+0000 7f2bfa404640 1 --2- 172.21.15.59:0/2787783225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bf40b41c0 0x7f2bf40cd140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00097a0 tx=0x7f2bf002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea63a8c8c06990b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:18.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.497+0000 7f2bf9402640 1 -- 172.21.15.59:0/2787783225 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0037070 con 0x7f2bf40b41c0 2024-04-25T17:02:18.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.497+0000 7f2bf9402640 1 -- 172.21.15.59:0/2787783225 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2bf0032440 con 0x7f2bf40b41c0 2024-04-25T17:02:18.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.497+0000 7f2bf9402640 1 -- 172.21.15.59:0/2787783225 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0032830 con 0x7f2bf40b41c0 2024-04-25T17:02:18.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.498+0000 7f2bfc668640 1 -- 172.21.15.59:0/2787783225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bf40b41c0 msgr2=0x7f2bf40cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:18.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.498+0000 7f2bfc668640 1 --2- 172.21.15.59:0/2787783225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bf40b41c0 0x7f2bf40cd140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00097a0 tx=0x7f2bf002a180 comp rx=0 tx=0).stop 2024-04-25T17:02:18.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.498+0000 7f2bfc668640 1 -- 172.21.15.59:0/2787783225 shutdown_connections 2024-04-25T17:02:18.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.498+0000 7f2bfc668640 1 --2- 172.21.15.59:0/2787783225 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2bf40cd680 0x7f2bf415c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:18.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.498+0000 7f2bfc668640 1 --2- 172.21.15.59:0/2787783225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bf40b41c0 0x7f2bf40cd140 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:18.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.498+0000 7f2bfc668640 1 -- 172.21.15.59:0/2787783225 >> 172.21.15.59:0/2787783225 conn(0x7f2bf406ed70 msgr2=0x7f2bf406f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:02:18.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.498+0000 7f2bfc668640 1 -- 172.21.15.59:0/2787783225 shutdown_connections 2024-04-25T17:02:18.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.498+0000 7f2bfc668640 1 -- 172.21.15.59:0/2787783225 wait complete. 2024-04-25T17:02:18.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.500+0000 7f2bfc668640 1 Processor -- start 2024-04-25T17:02:18.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.500+0000 7f2bfc668640 1 -- start start 2024-04-25T17:02:18.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.501+0000 7f2bfc668640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2bf40b41c0 0x7f2bf4155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:18.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.501+0000 7f2bfc668640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bf40cd680 0x7f2bf40ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:18.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.501+0000 7f2bfc668640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2bf415c6f0 0x7f2bf40d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:18.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.501+0000 7f2bfc668640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf40b78a0 con 0x7f2bf40cd680 2024-04-25T17:02:18.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.501+0000 7f2bfc668640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf40ce020 con 0x7f2bf40b41c0 2024-04-25T17:02:18.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.501+0000 7f2bfc668640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf40c51e0 con 0x7f2bf415c6f0 2024-04-25T17:02:18.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.502+0000 7f2bf9c03640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bf40cd680 0x7f2bf40ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:18.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.502+0000 7f2bfac05640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2bf415c6f0 0x7f2bf40d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:18.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.502+0000 7f2bfa404640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2bf40b41c0 0x7f2bf4155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:18.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.502+0000 7f2bfac05640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2bf415c6f0 0x7f2bf40d0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:52800/0 (socket says 172.21.15.59:52800) 2024-04-25T17:02:18.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.502+0000 7f2bfac05640 1 -- 172.21.15.59:0/864151451 learned_addr learned my addr 172.21.15.59:0/864151451 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:02:18.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.506+0000 7f2bfac05640 1 -- 172.21.15.59:0/864151451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2bf40b41c0 msgr2=0x7f2bf4155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:18.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.506+0000 7f2bfac05640 1 --2- 172.21.15.59:0/864151451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2bf40b41c0 0x7f2bf4155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:18.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.506+0000 7f2bfac05640 1 -- 172.21.15.59:0/864151451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bf40cd680 msgr2=0x7f2bf40ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:18.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.506+0000 7f2bfac05640 1 --2- 172.21.15.59:0/864151451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bf40cd680 0x7f2bf40ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:18.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.506+0000 7f2bfac05640 1 -- 172.21.15.59:0/864151451 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf4153780 con 0x7f2bf415c6f0 2024-04-25T17:02:18.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.509+0000 7f2bfac05640 1 --2- 172.21.15.59:0/864151451 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2bf415c6f0 0x7f2bf40d0e50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00ca70 tx=0x7f2bec00cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:18.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.513+0000 7f2beaffd640 1 -- 172.21.15.59:0/864151451 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec017070 con 0x7f2bf415c6f0 2024-04-25T17:02:18.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.513+0000 7f2beaffd640 1 -- 172.21.15.59:0/864151451 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2bec00ab70 con 0x7f2bf415c6f0 2024-04-25T17:02:18.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.513+0000 7f2bfc668640 1 -- 172.21.15.59:0/864151451 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf4153a60 con 0x7f2bf415c6f0 2024-04-25T17:02:18.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.513+0000 7f2beaffd640 1 -- 172.21.15.59:0/864151451 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec012400 con 0x7f2bf415c6f0 2024-04-25T17:02:18.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.513+0000 7f2bfc668640 1 -- 172.21.15.59:0/864151451 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf4154020 con 0x7f2bf415c6f0 2024-04-25T17:02:18.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.514+0000 7f2bfc668640 1 -- 172.21.15.59:0/864151451 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf40698a0 con 0x7f2bf415c6f0 2024-04-25T17:02:18.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.821+0000 7f2beaffd640 1 -- 172.21.15.59:0/864151451 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2bec01a070 con 0x7f2bf415c6f0 2024-04-25T17:02:18.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.822+0000 7f2beaffd640 1 --2- 172.21.15.59:0/864151451 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2bd8074500 0x7f2bd8076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:18.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.822+0000 7f2bfa404640 1 --2- 172.21.15.59:0/864151451 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2bd8074500 0x7f2bd8076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:18.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.822+0000 7f2bfa404640 1 --2- 172.21.15.59:0/864151451 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2bd8074500 0x7f2bd8076a10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0034000 tx=0x7f2bf002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:18.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.826+0000 7f2beaffd640 1 -- 172.21.15.59:0/864151451 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f2bec05b720 con 0x7f2bf415c6f0 2024-04-25T17:02:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:18.837+0000 7f2beaffd640 1 -- 172.21.15.59:0/864151451 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2bec05f490 con 0x7f2bf415c6f0 2024-04-25T17:02:19.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.065+0000 7f2bfc668640 1 -- 172.21.15.59:0/864151451 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2bf40cbab0 con 0x7f2bf415c6f0 2024-04-25T17:02:19.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.080+0000 7f2beaffd640 1 -- 172.21.15.59:0/864151451 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6862 (secure 0 0 0) 0x7f2bec063790 con 0x7f2bf415c6f0 2024-04-25T17:02:19.078 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T17:02:19.078 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/783440137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":783440137},{"type":"v1","addr":"172.21.15.64:6835","nonce":783440137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2150121481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2150121481},{"type":"v1","addr":"172.21.15.59:6835","nonce":2150121481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4208,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2853549826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2853549826},{"type":"v1","addr":"172.21.15.64:6833","nonce":2853549826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:32.561262+0000","modified":"2024-04-25T15:46:42.826371+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4284,"mds_1":4281,"mds_2":4217},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4217":{"gid":4217,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.59:6837/2036351360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2036351360},{"type":"v1","addr":"172.21.15.59:6837","nonce":2036351360}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/4162601241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4162601241},{"type":"v1","addr":"172.21.15.59:6839","nonce":4162601241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6837/2368752795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2368752795},{"type":"v1","addr":"172.21.15.64:6837","nonce":2368752795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4217,4281,4284]},"id":1}]} 2024-04-25T17:02:19.079 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 13 2024-04-25T17:02:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.082+0000 7f2bfc668640 1 -- 172.21.15.59:0/864151451 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2bd8074500 msgr2=0x7f2bd8076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.082+0000 7f2bfc668640 1 --2- 172.21.15.59:0/864151451 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2bd8074500 0x7f2bd8076a10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0034000 tx=0x7f2bf002e000 comp rx=0 tx=0).stop 2024-04-25T17:02:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.082+0000 7f2bfc668640 1 -- 172.21.15.59:0/864151451 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2bf415c6f0 msgr2=0x7f2bf40d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.082+0000 7f2bfc668640 1 --2- 172.21.15.59:0/864151451 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2bf415c6f0 0x7f2bf40d0e50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00ca70 tx=0x7f2bec00cf30 comp rx=0 tx=0).stop 2024-04-25T17:02:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.082+0000 7f2bfc668640 1 -- 172.21.15.59:0/864151451 shutdown_connections 2024-04-25T17:02:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.082+0000 7f2bfc668640 1 --2- 172.21.15.59:0/864151451 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f2bd8074500 0x7f2bd8076a10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.082+0000 7f2bfc668640 1 --2- 172.21.15.59:0/864151451 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2bf415c6f0 0x7f2bf40d0e50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.082+0000 7f2bfc668640 1 --2- 172.21.15.59:0/864151451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bf40cd680 0x7f2bf40ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.082+0000 7f2bfc668640 1 --2- 172.21.15.59:0/864151451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2bf40b41c0 0x7f2bf4155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.082+0000 7f2bfc668640 1 -- 172.21.15.59:0/864151451 >> 172.21.15.59:0/864151451 conn(0x7f2bf406ed70 msgr2=0x7f2bf4157c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:02:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.082+0000 7f2bfc668640 1 -- 172.21.15.59:0/864151451 shutdown_connections 2024-04-25T17:02:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.082+0000 7f2bfc668640 1 -- 172.21.15.59:0/864151451 wait complete. 2024-04-25T17:02:19.093 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T17:02:19.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.208+0000 7fec0d434640 1 Processor -- start 2024-04-25T17:02:19.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.208+0000 7fec0d434640 1 -- start start 2024-04-25T17:02:19.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.209+0000 7fec0d434640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fec080c7d70 0x7fec081564a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:19.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.209+0000 7fec0d434640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec081608f0 con 0x7fec080cc4e0 2024-04-25T17:02:19.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.209+0000 7fec0d434640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec08160610 con 0x7fec0815c550 2024-04-25T17:02:19.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.209+0000 7fec0d434640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fec080c78e0 con 0x7fec080c7d70 2024-04-25T17:02:19.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.210+0000 7fec06ffd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fec080c7d70 0x7fec081564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:19.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.210+0000 7febfe7fc640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fec0815c550 0x7fec080b52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.59:41170/0 (socket says 172.21.15.59:41170) 2024-04-25T17:02:19.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.210+0000 7febfe7fc640 1 -- 172.21.15.59:0/853390402 learned_addr learned my addr 172.21.15.59:0/853390402 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T17:02:19.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.214+0000 7fec067fc640 1 -- 172.21.15.59:0/853390402 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2666511229 0 0) 0x7fec081608f0 con 0x7fec080cc4e0 2024-04-25T17:02:19.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.214+0000 7fec067fc640 1 -- 172.21.15.59:0/853390402 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febf4003520 con 0x7fec080cc4e0 2024-04-25T17:02:19.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.214+0000 7fec06ffd640 1 -- 172.21.15.59:0/853390402 >> v1:172.21.15.64:6789/0 conn(0x7fec0815c550 legacy=0x7fec080b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:19.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.214+0000 7fec06ffd640 1 -- 172.21.15.59:0/853390402 >> v1:172.21.15.59:6789/0 conn(0x7fec080cc4e0 legacy=0x7fec0815f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:19.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.214+0000 7fec06ffd640 1 -- 172.21.15.59:0/853390402 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec080c6fb0 con 0x7fec080c7d70 2024-04-25T17:02:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.217+0000 7fec06ffd640 1 --2- 172.21.15.59:0/853390402 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec080c7d70 0x7fec081564a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7febf80097a0 tx=0x7febf802a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c9440b4bff8c94b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:19.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.221+0000 7fec067fc640 1 -- 172.21.15.59:0/853390402 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8037070 con 0x7fec080c7d70 2024-04-25T17:02:19.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.221+0000 7fec067fc640 1 -- 172.21.15.59:0/853390402 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7febf8032640 con 0x7fec080c7d70 2024-04-25T17:02:19.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.221+0000 7fec067fc640 1 -- 172.21.15.59:0/853390402 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8032a30 con 0x7fec080c7d70 2024-04-25T17:02:19.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.222+0000 7fec0d434640 1 -- 172.21.15.59:0/853390402 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec080c7d70 msgr2=0x7fec081564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:19.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.222+0000 7fec0d434640 1 --2- 172.21.15.59:0/853390402 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec080c7d70 0x7fec081564a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7febf80097a0 tx=0x7febf802a2c0 comp rx=0 tx=0).stop 2024-04-25T17:02:19.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.222+0000 7fec0d434640 1 -- 172.21.15.59:0/853390402 shutdown_connections 2024-04-25T17:02:19.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.222+0000 7fec0d434640 1 --2- 172.21.15.59:0/853390402 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec080c7d70 0x7fec081564a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:19.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.222+0000 7fec0d434640 1 -- 172.21.15.59:0/853390402 >> 172.21.15.59:0/853390402 conn(0x7fec0806f2c0 msgr2=0x7fec080684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:02:19.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.222+0000 7fec0d434640 1 -- 172.21.15.59:0/853390402 shutdown_connections 2024-04-25T17:02:19.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.222+0000 7fec0d434640 1 -- 172.21.15.59:0/853390402 wait complete. 2024-04-25T17:02:19.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.224+0000 7fec0d434640 1 Processor -- start 2024-04-25T17:02:19.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.224+0000 7fec0d434640 1 -- start start 2024-04-25T17:02:19.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.225+0000 7fec0d434640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec080cc4e0 0x7fec08150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:19.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.225+0000 7fec0d434640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec0815c550 0x7fec081f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:19.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.225+0000 7fec0d434640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fec081f5d70 0x7fec08152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:19.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.225+0000 7fec0d434640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fec08160100 con 0x7fec0815c550 2024-04-25T17:02:19.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.225+0000 7fec0d434640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fec080c7570 con 0x7fec080cc4e0 2024-04-25T17:02:19.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.225+0000 7fec0d434640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fec08160280 con 0x7fec081f5d70 2024-04-25T17:02:19.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.226+0000 7febfe7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec0815c550 0x7fec081f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:19.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.226+0000 7fec06ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec080cc4e0 0x7fec08150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:19.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.226+0000 7fec077fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fec081f5d70 0x7fec08152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:19.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.226+0000 7febfe7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec0815c550 0x7fec081f5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38352/0 (socket says 172.21.15.59:38352) 2024-04-25T17:02:19.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.226+0000 7febfe7fc640 1 -- 172.21.15.59:0/2325476580 learned_addr learned my addr 172.21.15.59:0/2325476580 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:02:19.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.231+0000 7febfe7fc640 1 -- 172.21.15.59:0/2325476580 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fec081f5d70 msgr2=0x7fec08152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:19.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.231+0000 7febfe7fc640 1 --2- 172.21.15.59:0/2325476580 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fec081f5d70 0x7fec08152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:19.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.231+0000 7febfe7fc640 1 -- 172.21.15.59:0/2325476580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec080cc4e0 msgr2=0x7fec08150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:19.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.231+0000 7febfe7fc640 1 --2- 172.21.15.59:0/2325476580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec080cc4e0 0x7fec08150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:19.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.231+0000 7febfe7fc640 1 -- 172.21.15.59:0/2325476580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec08150540 con 0x7fec0815c550 2024-04-25T17:02:19.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.231+0000 7fec06ffd640 1 --2- 172.21.15.59:0/2325476580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec080cc4e0 0x7fec08150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:02:19.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.233+0000 7febfe7fc640 1 --2- 172.21.15.59:0/2325476580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec0815c550 0x7fec081f5830 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7febf000c4b0 tx=0x7febf000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:19.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.238+0000 7febfffff640 1 -- 172.21.15.59:0/2325476580 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0017070 con 0x7fec0815c550 2024-04-25T17:02:19.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.238+0000 7febfffff640 1 -- 172.21.15.59:0/2325476580 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7febf0005ce0 con 0x7fec0815c550 2024-04-25T17:02:19.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.238+0000 7febfffff640 1 -- 172.21.15.59:0/2325476580 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0007290 con 0x7fec0815c550 2024-04-25T17:02:19.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.238+0000 7fec0d434640 1 -- 172.21.15.59:0/2325476580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec081f6540 con 0x7fec0815c550 2024-04-25T17:02:19.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.238+0000 7fec0d434640 1 -- 172.21.15.59:0/2325476580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec0815e070 con 0x7fec0815c550 2024-04-25T17:02:19.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.239+0000 7fec0d434640 1 -- 172.21.15.59:0/2325476580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec080698a0 con 0x7fec0815c550 2024-04-25T17:02:19.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.534+0000 7febfffff640 1 -- 172.21.15.59:0/2325476580 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7febf001a070 con 0x7fec0815c550 2024-04-25T17:02:19.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.534+0000 7febfffff640 1 --2- 172.21.15.59:0/2325476580 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7febe8074500 0x7febe8076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:19.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.535+0000 7fec06ffd640 1 --2- 172.21.15.59:0/2325476580 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7febe8074500 0x7febe8076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:19.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.535+0000 7fec06ffd640 1 --2- 172.21.15.59:0/2325476580 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7febe8074500 0x7febe8076a10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7febf8034000 tx=0x7febf802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:19.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.551+0000 7febfffff640 1 -- 172.21.15.59:0/2325476580 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7febf005ad60 con 0x7fec0815c550 2024-04-25T17:02:19.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.551+0000 7febfffff640 1 -- 172.21.15.59:0/2325476580 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7febf0021020 con 0x7fec0815c550 2024-04-25T17:02:19.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.775+0000 7fec0d434640 1 -- 172.21.15.59:0/2325476580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec080cbc70 con 0x7fec0815c550 2024-04-25T17:02:19.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.791+0000 7febfffff640 1 -- 172.21.15.59:0/2325476580 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6862 (secure 0 0 0) 0x7febf005ead0 con 0x7fec0815c550 2024-04-25T17:02:19.789 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T17:02:19.789 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4204,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/783440137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":783440137},{"type":"v1","addr":"172.21.15.64:6835","nonce":783440137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2150121481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2150121481},{"type":"v1","addr":"172.21.15.59:6835","nonce":2150121481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4208,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/2853549826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2853549826},{"type":"v1","addr":"172.21.15.64:6833","nonce":2853549826}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:46:32.561262+0000","modified":"2024-04-25T15:46:42.826371+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4284,"mds_1":4281,"mds_2":4217},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4217":{"gid":4217,"name":"e","rank":2,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.59:6837/2036351360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":2036351360},{"type":"v1","addr":"172.21.15.59:6837","nonce":2036351360}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"c","rank":1,"incarnation":9,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/4162601241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4162601241},{"type":"v1","addr":"172.21.15.59:6839","nonce":4162601241}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6837/2368752795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6836","nonce":2368752795},{"type":"v1","addr":"172.21.15.64:6837","nonce":2368752795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4217,4281,4284]},"id":1}]} 2024-04-25T17:02:19.790 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 13 2024-04-25T17:02:19.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.793+0000 7fec0d434640 1 -- 172.21.15.59:0/2325476580 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7febe8074500 msgr2=0x7febe8076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:19.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.793+0000 7fec0d434640 1 --2- 172.21.15.59:0/2325476580 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7febe8074500 0x7febe8076a10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7febf8034000 tx=0x7febf802e000 comp rx=0 tx=0).stop 2024-04-25T17:02:19.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.793+0000 7fec0d434640 1 -- 172.21.15.59:0/2325476580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec0815c550 msgr2=0x7fec081f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:19.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.793+0000 7fec0d434640 1 --2- 172.21.15.59:0/2325476580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec0815c550 0x7fec081f5830 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7febf000c4b0 tx=0x7febf000c970 comp rx=0 tx=0).stop 2024-04-25T17:02:19.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.793+0000 7fec0d434640 1 -- 172.21.15.59:0/2325476580 shutdown_connections 2024-04-25T17:02:19.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.793+0000 7fec0d434640 1 --2- 172.21.15.59:0/2325476580 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7febe8074500 0x7febe8076a10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:19.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.793+0000 7fec0d434640 1 --2- 172.21.15.59:0/2325476580 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fec081f5d70 0x7fec08152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:19.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.793+0000 7fec0d434640 1 --2- 172.21.15.59:0/2325476580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec0815c550 0x7fec081f5830 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:19.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.793+0000 7fec0d434640 1 --2- 172.21.15.59:0/2325476580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec080cc4e0 0x7fec08150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:19.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.793+0000 7fec0d434640 1 -- 172.21.15.59:0/2325476580 >> 172.21.15.59:0/2325476580 conn(0x7fec0806f2c0 msgr2=0x7fec08153eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:02:19.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.793+0000 7fec0d434640 1 -- 172.21.15.59:0/2325476580 shutdown_connections 2024-04-25T17:02:19.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.793+0000 7fec0d434640 1 -- 172.21.15.59:0/2325476580 wait complete. 2024-04-25T17:02:19.803 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T17:02:19.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.918+0000 7f456fdf3640 1 Processor -- start 2024-04-25T17:02:19.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.918+0000 7f456fdf3640 1 -- start start 2024-04-25T17:02:19.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.919+0000 7f456fdf3640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f45680cec50 0x7f456815c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:19.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.919+0000 7f456fdf3640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f456815cd60 con 0x7f45680b41c0 2024-04-25T17:02:19.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.919+0000 7f456fdf3640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f456815d040 con 0x7f456815c1b0 2024-04-25T17:02:19.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.919+0000 7f456fdf3640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f456815cb00 con 0x7f45680cec50 2024-04-25T17:02:19.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.920+0000 7f456e390640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f45680cec50 0x7f456815c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:19.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.921+0000 7f456e390640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f45680cec50 0x7f456815c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:50360/0 (socket says 172.21.15.59:50360) 2024-04-25T17:02:19.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.921+0000 7f456e390640 1 -- 172.21.15.59:0/1343009854 learned_addr learned my addr 172.21.15.59:0/1343009854 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:02:19.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.925+0000 7f456e390640 1 -- 172.21.15.59:0/1343009854 >> v1:172.21.15.64:6789/0 conn(0x7f456815c1b0 legacy=0x7f45680ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:19.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.925+0000 7f456e390640 1 -- 172.21.15.59:0/1343009854 >> v1:172.21.15.59:6789/0 conn(0x7f45680b41c0 legacy=0x7f45680cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:02:19.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.925+0000 7f456e390640 1 -- 172.21.15.59:0/1343009854 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456815d320 con 0x7f45680cec50 2024-04-25T17:02:19.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.929+0000 7f456e390640 1 --2- 172.21.15.59:0/1343009854 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45680cec50 0x7f456815c5c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4560009e50 tx=0x7f456002a760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89cf3930602cb26c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:19.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.934+0000 7f456cb8d640 1 -- 172.21.15.59:0/1343009854 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4560036070 con 0x7f45680cec50 2024-04-25T17:02:19.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.934+0000 7f456cb8d640 1 -- 172.21.15.59:0/1343009854 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4560031600 con 0x7f45680cec50 2024-04-25T17:02:19.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.934+0000 7f456cb8d640 1 -- 172.21.15.59:0/1343009854 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45600319f0 con 0x7f45680cec50 2024-04-25T17:02:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.935+0000 7f456fdf3640 1 -- 172.21.15.59:0/1343009854 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45680cec50 msgr2=0x7f456815c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.935+0000 7f456fdf3640 1 --2- 172.21.15.59:0/1343009854 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45680cec50 0x7f456815c5c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4560009e50 tx=0x7f456002a760 comp rx=0 tx=0).stop 2024-04-25T17:02:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.935+0000 7f456fdf3640 1 -- 172.21.15.59:0/1343009854 shutdown_connections 2024-04-25T17:02:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.935+0000 7f456fdf3640 1 --2- 172.21.15.59:0/1343009854 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45680cec50 0x7f456815c5c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.935+0000 7f456fdf3640 1 -- 172.21.15.59:0/1343009854 >> 172.21.15.59:0/1343009854 conn(0x7f456806ed70 msgr2=0x7f456806f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:02:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.935+0000 7f456fdf3640 1 -- 172.21.15.59:0/1343009854 shutdown_connections 2024-04-25T17:02:19.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.935+0000 7f456fdf3640 1 -- 172.21.15.59:0/1343009854 wait complete. 2024-04-25T17:02:19.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.937+0000 7f456fdf3640 1 Processor -- start 2024-04-25T17:02:19.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.937+0000 7f456fdf3640 1 -- start start 2024-04-25T17:02:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.939+0000 7f456fdf3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45680b41c0 0x7f45681f36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.939+0000 7f456fdf3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45680cec50 0x7f4568151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.939+0000 7f456fdf3640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f456815c1b0 0x7f45681577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.939+0000 7f456fdf3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f45680b78a0 con 0x7f45680cec50 2024-04-25T17:02:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.939+0000 7f456fdf3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f45680ce020 con 0x7f45680b41c0 2024-04-25T17:02:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.939+0000 7f456fdf3640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f45680c51e0 con 0x7f456815c1b0 2024-04-25T17:02:19.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.941+0000 7f456d38e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45680cec50 0x7f4568151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:19.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.942+0000 7f456d38e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45680cec50 0x7f4568151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38362/0 (socket says 172.21.15.59:38362) 2024-04-25T17:02:19.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.942+0000 7f456d38e640 1 -- 172.21.15.59:0/4051703172 learned_addr learned my addr 172.21.15.59:0/4051703172 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:02:19.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.946+0000 7f456d38e640 1 -- 172.21.15.59:0/4051703172 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f456815c1b0 msgr2=0x7f45681577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:19.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.946+0000 7f456d38e640 1 --2- 172.21.15.59:0/4051703172 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f456815c1b0 0x7f45681577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:19.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.946+0000 7f456d38e640 1 -- 172.21.15.59:0/4051703172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45680b41c0 msgr2=0x7f45681f36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:19.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.946+0000 7f456d38e640 1 --2- 172.21.15.59:0/4051703172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45680b41c0 0x7f45681f36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:19.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.946+0000 7f456d38e640 1 -- 172.21.15.59:0/4051703172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45681f2c60 con 0x7f45680cec50 2024-04-25T17:02:19.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.948+0000 7f456d38e640 1 --2- 172.21.15.59:0/4051703172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45680cec50 0x7f4568151ff0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f455800c340 tx=0x7f455800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:19.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.952+0000 7f455e7fc640 1 -- 172.21.15.59:0/4051703172 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45580052d0 con 0x7f45680cec50 2024-04-25T17:02:19.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.953+0000 7f455e7fc640 1 -- 172.21.15.59:0/4051703172 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4558005490 con 0x7f45680cec50 2024-04-25T17:02:19.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.953+0000 7f456fdf3640 1 -- 172.21.15.59:0/4051703172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45681530f0 con 0x7f45680cec50 2024-04-25T17:02:19.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.953+0000 7f455e7fc640 1 -- 172.21.15.59:0/4051703172 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4558007280 con 0x7f45680cec50 2024-04-25T17:02:19.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.953+0000 7f456fdf3640 1 -- 172.21.15.59:0/4051703172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4568152530 con 0x7f45680cec50 2024-04-25T17:02:19.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.954+0000 7f456fdf3640 1 -- 172.21.15.59:0/4051703172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45680698a0 con 0x7f45680cec50 2024-04-25T17:02:19.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.976+0000 7f455e7fc640 1 -- 172.21.15.59:0/4051703172 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4558007420 con 0x7f45680cec50 2024-04-25T17:02:19.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.977+0000 7f455e7fc640 1 --2- 172.21.15.59:0/4051703172 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f454c074500 0x7f454c076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:19.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.977+0000 7f456db8f640 1 --2- 172.21.15.59:0/4051703172 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f454c074500 0x7f454c076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:19.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.977+0000 7f456db8f640 1 --2- 172.21.15.59:0/4051703172 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f454c074500 0x7f454c076a10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4564009650 tx=0x7f4564006ba0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:19.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:19.982+0000 7f455e7fc640 1 -- 172.21.15.59:0/4051703172 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f455805ae00 con 0x7f45680cec50 2024-04-25T17:02:20.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.271+0000 7f455e7fc640 1 -- 172.21.15.59:0/4051703172 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f45580c1b80 con 0x7f45680cec50 2024-04-25T17:02:20.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.477+0000 7f456fdf3640 1 -- 172.21.15.59:0/4051703172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45680c8840 con 0x7f45680cec50 2024-04-25T17:02:20.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.525+0000 7f455e7fc640 1 -- 172.21.15.59:0/4051703172 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16795 (secure 0 0 0) 0x7f455805f300 con 0x7f45680cec50 2024-04-25T17:02:20.524 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T17:02:20.524 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"9bb5d7ca-5217-467b-882c-0a18cd57f08f","created":"2024-04-25T15:46:00.198001+0000","modified":"2024-04-25T15:47:08.715345+0000","last_up_change":"2024-04-25T15:46:15.850827+0000","last_in_change":"2024-04-25T15:46:06.311980+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:46:16.936340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:46:30.174141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:46:31.372481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"34cee654-11dd-4f4b-99fe-093462f8abad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6803","nonce":1314235095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6805","nonce":1314235095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6809","nonce":1314235095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1314235095},{"type":"v1","addr":"172.21.15.59:6807","nonce":1314235095}]},"public_addr":"172.21.15.59:6803/1314235095","cluster_addr":"172.21.15.59:6805/1314235095","heartbeat_back_addr":"172.21.15.59:6809/1314235095","heartbeat_front_addr":"172.21.15.59:6807/1314235095","state":["exists","up"]},{"osd":1,"uuid":"3c15505b-4abd-4a24-b30c-edc2732f8ac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6827","nonce":3550810151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6829","nonce":3550810151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6833","nonce":3550810151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3550810151},{"type":"v1","addr":"172.21.15.59:6831","nonce":3550810151}]},"public_addr":"172.21.15.59:6827/3550810151","cluster_addr":"172.21.15.59:6829/3550810151","heartbeat_back_addr":"172.21.15.59:6833/3550810151","heartbeat_front_addr":"172.21.15.59:6831/3550810151","state":["exists","up"]},{"osd":2,"uuid":"5884bf21-e6b4-4813-b8bc-6baa92443c87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6811","nonce":1651189093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6813","nonce":1651189093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6817","nonce":1651189093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1651189093},{"type":"v1","addr":"172.21.15.59:6815","nonce":1651189093}]},"public_addr":"172.21.15.59:6811/1651189093","cluster_addr":"172.21.15.59:6813/1651189093","heartbeat_back_addr":"172.21.15.59:6817/1651189093","heartbeat_front_addr":"172.21.15.59:6815/1651189093","state":["exists","up"]},{"osd":3,"uuid":"6ff71700-3b00-4350-b3c9-f6c41ec46b00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6819","nonce":1300858236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6821","nonce":1300858236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6825","nonce":1300858236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1300858236},{"type":"v1","addr":"172.21.15.59:6823","nonce":1300858236}]},"public_addr":"172.21.15.59:6819/1300858236","cluster_addr":"172.21.15.59:6821/1300858236","heartbeat_back_addr":"172.21.15.59:6825/1300858236","heartbeat_front_addr":"172.21.15.59:6823/1300858236","state":["exists","up"]},{"osd":4,"uuid":"d0a72143-93fd-4712-aadb-f3fade303426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6817","nonce":2206186554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6819","nonce":2206186554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6823","nonce":2206186554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":2206186554},{"type":"v1","addr":"172.21.15.64:6821","nonce":2206186554}]},"public_addr":"172.21.15.64:6817/2206186554","cluster_addr":"172.21.15.64:6819/2206186554","heartbeat_back_addr":"172.21.15.64:6823/2206186554","heartbeat_front_addr":"172.21.15.64:6821/2206186554","state":["exists","up"]},{"osd":5,"uuid":"9dcd93f0-b323-4a4e-b8af-3d5f6a5e5aaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6825","nonce":639697697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6827","nonce":639697697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6831","nonce":639697697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":639697697},{"type":"v1","addr":"172.21.15.64:6829","nonce":639697697}]},"public_addr":"172.21.15.64:6825/639697697","cluster_addr":"172.21.15.64:6827/639697697","heartbeat_back_addr":"172.21.15.64:6831/639697697","heartbeat_front_addr":"172.21.15.64:6829/639697697","state":["exists","up"]},{"osd":6,"uuid":"311d9a6b-8fbc-4809-8d33-b9248a3562f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6809","nonce":2335675289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6811","nonce":2335675289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6815","nonce":2335675289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2335675289},{"type":"v1","addr":"172.21.15.64:6813","nonce":2335675289}]},"public_addr":"172.21.15.64:6809/2335675289","cluster_addr":"172.21.15.64:6811/2335675289","heartbeat_back_addr":"172.21.15.64:6815/2335675289","heartbeat_front_addr":"172.21.15.64:6813/2335675289","state":["exists","up"]},{"osd":7,"uuid":"d0f7436e-882f-4aa7-b2ae-684b9894b1f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6801","nonce":970439753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6803","nonce":970439753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6807","nonce":970439753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":970439753},{"type":"v1","addr":"172.21.15.64:6805","nonce":970439753}]},"public_addr":"172.21.15.64:6801/970439753","cluster_addr":"172.21.15.64:6803/970439753","heartbeat_back_addr":"172.21.15.64:6807/970439753","heartbeat_front_addr":"172.21.15.64:6805/970439753","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.807777+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.945589+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.926832+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.943537+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.925062+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.957550+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.913559+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:46:11.839159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T17:02:20.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.528+0000 7f456fdf3640 1 -- 172.21.15.59:0/4051703172 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f454c074500 msgr2=0x7f454c076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:20.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.528+0000 7f456fdf3640 1 --2- 172.21.15.59:0/4051703172 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f454c074500 0x7f454c076a10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4564009650 tx=0x7f4564006ba0 comp rx=0 tx=0).stop 2024-04-25T17:02:20.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.528+0000 7f456fdf3640 1 -- 172.21.15.59:0/4051703172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45680cec50 msgr2=0x7f4568151ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:20.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.528+0000 7f456fdf3640 1 --2- 172.21.15.59:0/4051703172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45680cec50 0x7f4568151ff0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f455800c340 tx=0x7f455800c740 comp rx=0 tx=0).stop 2024-04-25T17:02:20.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.528+0000 7f456fdf3640 1 -- 172.21.15.59:0/4051703172 shutdown_connections 2024-04-25T17:02:20.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.528+0000 7f456fdf3640 1 --2- 172.21.15.59:0/4051703172 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f454c074500 0x7f454c076a10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:20.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.528+0000 7f456fdf3640 1 --2- 172.21.15.59:0/4051703172 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f456815c1b0 0x7f45681577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:20.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.528+0000 7f456fdf3640 1 --2- 172.21.15.59:0/4051703172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45680cec50 0x7f4568151ff0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:20.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.528+0000 7f456fdf3640 1 --2- 172.21.15.59:0/4051703172 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f45680b41c0 0x7f45681f36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:20.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.528+0000 7f456fdf3640 1 -- 172.21.15.59:0/4051703172 >> 172.21.15.59:0/4051703172 conn(0x7f456806ed70 msgr2=0x7f456815ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:02:20.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.528+0000 7f456fdf3640 1 -- 172.21.15.59:0/4051703172 shutdown_connections 2024-04-25T17:02:20.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.528+0000 7f456fdf3640 1 -- 172.21.15.59:0/4051703172 wait complete. 2024-04-25T17:02:20.538 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T17:02:20.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.653+0000 7fba01a61640 1 Processor -- start 2024-04-25T17:02:20.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.653+0000 7fba01a61640 1 -- start start 2024-04-25T17:02:20.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.654+0000 7fba01a61640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9fc15e380 0x7fb9fc154580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:20.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.654+0000 7fba01a61640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb9fc0c8470 0x7fb9fc15ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:20.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.654+0000 7fba01a61640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9fc15e8c0 con 0x7fb9fc15b060 2024-04-25T17:02:20.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.654+0000 7fba01a61640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fb9fc0c8b50 con 0x7fb9fc15e380 2024-04-25T17:02:20.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.654+0000 7fba01a61640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fb9fc0cb080 con 0x7fb9fc0c8470 2024-04-25T17:02:20.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.655+0000 7fb9faffd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9fc15e380 0x7fb9fc154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:20.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.655+0000 7fb9f3fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb9fc0c8470 0x7fb9fc15ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:20.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.655+0000 7fb9faffd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9fc15e380 0x7fb9fc154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38376/0 (socket says 172.21.15.59:38376) 2024-04-25T17:02:20.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.655+0000 7fb9faffd640 1 -- 172.21.15.59:0/59418670 learned_addr learned my addr 172.21.15.59:0/59418670 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:02:20.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.658+0000 7fb9faffd640 1 -- 172.21.15.59:0/59418670 >> v2:172.21.15.64:3300/0 conn(0x7fb9fc0c8470 msgr2=0x7fb9fc15ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:02:20.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.658+0000 7fb9faffd640 1 --2- 172.21.15.59:0/59418670 >> v2:172.21.15.64:3300/0 conn(0x7fb9fc0c8470 0x7fb9fc15ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:20.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.658+0000 7fb9faffd640 1 -- 172.21.15.59:0/59418670 >> v1:172.21.15.64:6789/0 conn(0x7fb9fc15b060 legacy=0x7fb9fc0c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:02:20.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.658+0000 7fb9faffd640 1 -- 172.21.15.59:0/59418670 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc15a350 con 0x7fb9fc15e380 2024-04-25T17:02:20.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.660+0000 7fb9faffd640 1 --2- 172.21.15.59:0/59418670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc15e380 0x7fb9fc154580 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc06f2e0 tx=0x7fb9ec02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97cda38a1c234b25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:20.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.664+0000 7fb9fa7fc640 1 -- 172.21.15.59:0/59418670 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec004030 con 0x7fb9fc15e380 2024-04-25T17:02:20.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.664+0000 7fb9fa7fc640 1 -- 172.21.15.59:0/59418670 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb9ec0041d0 con 0x7fb9fc15e380 2024-04-25T17:02:20.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.664+0000 7fb9fa7fc640 1 -- 172.21.15.59:0/59418670 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec003610 con 0x7fb9fc15e380 2024-04-25T17:02:20.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.665+0000 7fba01a61640 1 -- 172.21.15.59:0/59418670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc15e380 msgr2=0x7fb9fc154580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:20.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.665+0000 7fba01a61640 1 --2- 172.21.15.59:0/59418670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc15e380 0x7fb9fc154580 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc06f2e0 tx=0x7fb9ec02a200 comp rx=0 tx=0).stop 2024-04-25T17:02:20.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.665+0000 7fba01a61640 1 -- 172.21.15.59:0/59418670 shutdown_connections 2024-04-25T17:02:20.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.665+0000 7fba01a61640 1 --2- 172.21.15.59:0/59418670 >> v2:172.21.15.64:3300/0 conn(0x7fb9fc0c8470 0x7fb9fc15ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:20.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.665+0000 7fba01a61640 1 --2- 172.21.15.59:0/59418670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc15e380 0x7fb9fc154580 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:20.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.665+0000 7fba01a61640 1 -- 172.21.15.59:0/59418670 >> 172.21.15.59:0/59418670 conn(0x7fb9fc071720 msgr2=0x7fb9fc0ca140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:02:20.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.665+0000 7fba01a61640 1 -- 172.21.15.59:0/59418670 shutdown_connections 2024-04-25T17:02:20.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.665+0000 7fba01a61640 1 -- 172.21.15.59:0/59418670 wait complete. 2024-04-25T17:02:20.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.667+0000 7fba01a61640 1 Processor -- start 2024-04-25T17:02:20.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.667+0000 7fba01a61640 1 -- start start 2024-04-25T17:02:20.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.668+0000 7fba01a61640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9fc0c8470 0x7fb9fc0c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:20.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.668+0000 7fba01a61640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb9fc15b060 0x7fb9fc14fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:20.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.668+0000 7fba01a61640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc15e380 0x7fb9fc1ecb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:20.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.668+0000 7fba01a61640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc06f6d0 con 0x7fb9fc15e380 2024-04-25T17:02:20.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.668+0000 7fba01a61640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc154ac0 con 0x7fb9fc0c8470 2024-04-25T17:02:20.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.668+0000 7fba01a61640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fb9fc06f9b0 con 0x7fb9fc15b060 2024-04-25T17:02:20.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.669+0000 7fb9fb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc15e380 0x7fb9fc1ecb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:20.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.669+0000 7fb9f3fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb9fc15b060 0x7fb9fc14fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:20.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.669+0000 7fb9faffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9fc0c8470 0x7fb9fc0c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:20.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.669+0000 7fb9fb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc15e380 0x7fb9fc1ecb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38380/0 (socket says 172.21.15.59:38380) 2024-04-25T17:02:20.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.669+0000 7fb9fb7fe640 1 -- 172.21.15.59:0/1527453255 learned_addr learned my addr 172.21.15.59:0/1527453255 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:02:20.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.673+0000 7fb9fb7fe640 1 -- 172.21.15.59:0/1527453255 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb9fc15b060 msgr2=0x7fb9fc14fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:20.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.673+0000 7fb9fb7fe640 1 --2- 172.21.15.59:0/1527453255 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb9fc15b060 0x7fb9fc14fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.673+0000 7fb9fb7fe640 1 -- 172.21.15.59:0/1527453255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9fc0c8470 msgr2=0x7fb9fc0c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.673+0000 7fb9fb7fe640 1 --2- 172.21.15.59:0/1527453255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9fc0c8470 0x7fb9fc0c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.673+0000 7fb9fb7fe640 1 -- 172.21.15.59:0/1527453255 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc0c5a20 con 0x7fb9fc15e380 2024-04-25T17:02:20.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.676+0000 7fb9fb7fe640 1 --2- 172.21.15.59:0/1527453255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc15e380 0x7fb9fc1ecb60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400ba10 tx=0x7fb9f400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.680+0000 7fb9f8ff9640 1 -- 172.21.15.59:0/1527453255 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4019070 con 0x7fb9fc15e380 2024-04-25T17:02:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.680+0000 7fb9f8ff9640 1 -- 172.21.15.59:0/1527453255 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb9f400cb40 con 0x7fb9fc15e380 2024-04-25T17:02:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.680+0000 7fba01a61640 1 -- 172.21.15.59:0/1527453255 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9fc159be0 con 0x7fb9fc15e380 2024-04-25T17:02:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.680+0000 7fb9f8ff9640 1 -- 172.21.15.59:0/1527453255 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4014440 con 0x7fb9fc15e380 2024-04-25T17:02:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.680+0000 7fba01a61640 1 -- 172.21.15.59:0/1527453255 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9fc151140 con 0x7fb9fc15e380 2024-04-25T17:02:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.681+0000 7fba01a61640 1 -- 172.21.15.59:0/1527453255 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9fc069910 con 0x7fb9fc15e380 2024-04-25T17:02:20.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.704+0000 7fb9f8ff9640 1 -- 172.21.15.59:0/1527453255 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb9f401c070 con 0x7fb9fc15e380 2024-04-25T17:02:20.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.705+0000 7fb9f8ff9640 1 --2- 172.21.15.59:0/1527453255 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb9dc074500 0x7fb9dc076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:20.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.705+0000 7fb9faffd640 1 --2- 172.21.15.59:0/1527453255 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb9dc074500 0x7fb9dc076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:20.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.705+0000 7fb9faffd640 1 --2- 172.21.15.59:0/1527453255 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb9dc074500 0x7fb9dc076a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec033000 tx=0x7fb9ec02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:20.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.709+0000 7fb9f8ff9640 1 -- 172.21.15.59:0/1527453255 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fb9f4015d10 con 0x7fb9fc15e380 2024-04-25T17:02:20.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:20.990+0000 7fb9f8ff9640 1 -- 172.21.15.59:0/1527453255 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb9f405f180 con 0x7fb9fc15e380 2024-04-25T17:02:21.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.236+0000 7fba01a61640 1 -- 172.21.15.59:0/1527453255 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb9fc0b9d90 con 0x7fb9fc15e380 2024-04-25T17:02:21.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.391+0000 7fb9f8ff9640 1 -- 172.21.15.59:0/1527453255 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) ==== 161+0+0 (secure 0 0 0) 0x7fb9f4063480 con 0x7fb9fc15e380 2024-04-25T17:02:21.389 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T17:02:21.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.393+0000 7fba01a61640 1 -- 172.21.15.59:0/1527453255 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb9dc074500 msgr2=0x7fb9dc076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:21.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.393+0000 7fba01a61640 1 --2- 172.21.15.59:0/1527453255 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb9dc074500 0x7fb9dc076a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec033000 tx=0x7fb9ec02e000 comp rx=0 tx=0).stop 2024-04-25T17:02:21.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.393+0000 7fba01a61640 1 -- 172.21.15.59:0/1527453255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc15e380 msgr2=0x7fb9fc1ecb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:21.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.393+0000 7fba01a61640 1 --2- 172.21.15.59:0/1527453255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc15e380 0x7fb9fc1ecb60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400ba10 tx=0x7fb9f400bed0 comp rx=0 tx=0).stop 2024-04-25T17:02:21.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.393+0000 7fba01a61640 1 -- 172.21.15.59:0/1527453255 shutdown_connections 2024-04-25T17:02:21.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.393+0000 7fba01a61640 1 --2- 172.21.15.59:0/1527453255 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb9dc074500 0x7fb9dc076a10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:21.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.393+0000 7fba01a61640 1 --2- 172.21.15.59:0/1527453255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9fc15e380 0x7fb9fc1ecb60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:21.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.393+0000 7fba01a61640 1 --2- 172.21.15.59:0/1527453255 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb9fc15b060 0x7fb9fc14fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:21.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.393+0000 7fba01a61640 1 --2- 172.21.15.59:0/1527453255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9fc0c8470 0x7fb9fc0c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:21.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.393+0000 7fba01a61640 1 -- 172.21.15.59:0/1527453255 >> 172.21.15.59:0/1527453255 conn(0x7fb9fc071720 msgr2=0x7fb9fc1581f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:02:21.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.393+0000 7fba01a61640 1 -- 172.21.15.59:0/1527453255 shutdown_connections 2024-04-25T17:02:21.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.393+0000 7fba01a61640 1 -- 172.21.15.59:0/1527453255 wait complete. 2024-04-25T17:02:21.403 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T17:02:21.454 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:02:21.456 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:02:21.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.525+0000 7fa1446f9640 1 Processor -- start 2024-04-25T17:02:21.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.525+0000 7fa1446f9640 1 -- start start 2024-04-25T17:02:21.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.528+0000 7fa1446f9640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa13c15d6a0 0x7fa13c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:21.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.528+0000 7fa1446f9640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa13c0c94b0 0x7fa13c0ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:21.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.528+0000 7fa1446f9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa13c072140 0x7fa13c152e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:21.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.528+0000 7fa1446f9640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 -- 0x7fa13c15c970 con 0x7fa13c15d6a0 2024-04-25T17:02:21.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.528+0000 7fa1446f9640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7fa13c0ca160 con 0x7fa13c0c94b0 2024-04-25T17:02:21.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.528+0000 7fa1446f9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fa13c159f10 con 0x7fa13c072140 2024-04-25T17:02:21.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.529+0000 7fa142495640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa13c15d6a0 0x7fa13c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.532+0000 7fa141c94640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa13c0c94b0 0x7fa13c0ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:21.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.532+0000 7fa141c94640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa13c0c94b0 0x7fa13c0ca5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.59:50380/0 (socket says 172.21.15.59:50380) 2024-04-25T17:02:21.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.532+0000 7fa141c94640 1 -- 172.21.15.59:0/3595574000 learned_addr learned my addr 172.21.15.59:0/3595574000 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:02:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.535+0000 7fa141c94640 1 -- 172.21.15.59:0/3595574000 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa13c072140 msgr2=0x7fa13c152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:02:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.535+0000 7fa141c94640 1 --2- 172.21.15.59:0/3595574000 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa13c072140 0x7fa13c152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.535+0000 7fa141c94640 1 -- 172.21.15.59:0/3595574000 >> v2:172.21.15.59:3300/0 conn(0x7fa13c15d6a0 msgr2=0x7fa13c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:02:21.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.535+0000 7fa141c94640 1 --2- 172.21.15.59:0/3595574000 >> v2:172.21.15.59:3300/0 conn(0x7fa13c15d6a0 0x7fa13c0cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.535+0000 7fa141c94640 1 -- 172.21.15.59:0/3595574000 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13c15a1b0 con 0x7fa13c0c94b0 2024-04-25T17:02:21.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.608+0000 7fa141c94640 1 --2- 172.21.15.59:0/3595574000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa13c0c94b0 0x7fa13c0ca5d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa13c0cef00 tx=0x7fa12c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffcf36c0faef345 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:21.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.625+0000 7fa141493640 1 -- 172.21.15.59:0/3595574000 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c037070 con 0x7fa13c0c94b0 2024-04-25T17:02:21.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.625+0000 7fa141493640 1 -- 172.21.15.59:0/3595574000 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa12c032440 con 0x7fa13c0c94b0 2024-04-25T17:02:21.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.625+0000 7fa141493640 1 -- 172.21.15.59:0/3595574000 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c032830 con 0x7fa13c0c94b0 2024-04-25T17:02:21.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.626+0000 7fa1446f9640 1 -- 172.21.15.59:0/3595574000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa13c0c94b0 msgr2=0x7fa13c0ca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:21.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.626+0000 7fa1446f9640 1 --2- 172.21.15.59:0/3595574000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa13c0c94b0 0x7fa13c0ca5d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa13c0cef00 tx=0x7fa12c02a180 comp rx=0 tx=0).stop 2024-04-25T17:02:21.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.626+0000 7fa1446f9640 1 -- 172.21.15.59:0/3595574000 shutdown_connections 2024-04-25T17:02:21.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.626+0000 7fa1446f9640 1 --2- 172.21.15.59:0/3595574000 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa13c072140 0x7fa13c152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:21.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.626+0000 7fa1446f9640 1 --2- 172.21.15.59:0/3595574000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa13c0c94b0 0x7fa13c0ca5d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:21.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.626+0000 7fa1446f9640 1 --2- 172.21.15.59:0/3595574000 >> v2:172.21.15.59:3300/0 conn(0x7fa13c15d6a0 0x7fa13c0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:21.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.626+0000 7fa1446f9640 1 -- 172.21.15.59:0/3595574000 >> 172.21.15.59:0/3595574000 conn(0x7fa13c068d80 msgr2=0x7fa13c070340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:02:21.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.626+0000 7fa1446f9640 1 -- 172.21.15.59:0/3595574000 shutdown_connections 2024-04-25T17:02:21.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.626+0000 7fa1446f9640 1 -- 172.21.15.59:0/3595574000 wait complete. 2024-04-25T17:02:21.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.629+0000 7fa1446f9640 1 Processor -- start 2024-04-25T17:02:21.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.629+0000 7fa1446f9640 1 -- start start 2024-04-25T17:02:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.631+0000 7fa1446f9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa13c072140 0x7fa13c1413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.631+0000 7fa1446f9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa13c0c94b0 0x7fa13c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.631+0000 7fa1446f9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa13c140e80 0x7fa13c144a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.632+0000 7fa1446f9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c0cab10 con 0x7fa13c140e80 2024-04-25T17:02:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.632+0000 7fa1446f9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c15cea0 con 0x7fa13c0c94b0 2024-04-25T17:02:21.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.632+0000 7fa1446f9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fa13c0c9100 con 0x7fa13c072140 2024-04-25T17:02:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.632+0000 7fa142495640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa13c072140 0x7fa13c1413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.632+0000 7fa141c94640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa13c0c94b0 0x7fa13c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.632+0000 7fa142495640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa13c072140 0x7fa13c1413d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:52864/0 (socket says 172.21.15.59:52864) 2024-04-25T17:02:21.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.632+0000 7fa142495640 1 -- 172.21.15.59:0/1029221128 learned_addr learned my addr 172.21.15.59:0/1029221128 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:02:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.638+0000 7fa142495640 1 -- 172.21.15.59:0/1029221128 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa13c0c94b0 msgr2=0x7fa13c15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.638+0000 7fa142495640 1 --2- 172.21.15.59:0/1029221128 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa13c0c94b0 0x7fa13c15bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.638+0000 7fa142495640 1 -- 172.21.15.59:0/1029221128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa13c140e80 msgr2=0x7fa13c144a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.638+0000 7fa142495640 1 --2- 172.21.15.59:0/1029221128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa13c140e80 0x7fa13c144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:21.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.638+0000 7fa142495640 1 -- 172.21.15.59:0/1029221128 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13c15c2c0 con 0x7fa13c072140 2024-04-25T17:02:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.640+0000 7fa142495640 1 --2- 172.21.15.59:0/1029221128 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa13c072140 0x7fa13c1413d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa13800c850 tx=0x7fa13800cd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.644+0000 7fa132ffd640 1 -- 172.21.15.59:0/1029221128 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa138015070 con 0x7fa13c072140 2024-04-25T17:02:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.644+0000 7fa1446f9640 1 -- 172.21.15.59:0/1029221128 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa13c15a790 con 0x7fa13c072140 2024-04-25T17:02:21.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.644+0000 7fa1446f9640 1 -- 172.21.15.59:0/1029221128 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa13c15ad50 con 0x7fa13c072140 2024-04-25T17:02:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.644+0000 7fa132ffd640 1 -- 172.21.15.59:0/1029221128 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa138004020 con 0x7fa13c072140 2024-04-25T17:02:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.644+0000 7fa132ffd640 1 -- 172.21.15.59:0/1029221128 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13801e060 con 0x7fa13c072140 2024-04-25T17:02:21.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.645+0000 7fa1446f9640 1 -- 172.21.15.59:0/1029221128 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa124005290 con 0x7fa13c072140 2024-04-25T17:02:21.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.950+0000 7fa132ffd640 1 -- 172.21.15.59:0/1029221128 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa138007830 con 0x7fa13c072140 2024-04-25T17:02:21.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.950+0000 7fa132ffd640 1 --2- 172.21.15.59:0/1029221128 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fa1200744e0 0x7fa1200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:21.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.950+0000 7fa141c94640 1 --2- 172.21.15.59:0/1029221128 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fa1200744e0 0x7fa1200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:21.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.951+0000 7fa141c94640 1 --2- 172.21.15.59:0/1029221128 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fa1200744e0 0x7fa1200769f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa12c034000 tx=0x7fa12c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:21.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.954+0000 7fa132ffd640 1 -- 172.21.15.59:0/1029221128 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6083+0+0 (secure 0 0 0) 0x7fa138004410 con 0x7fa13c072140 2024-04-25T17:02:21.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:21.966+0000 7fa132ffd640 1 -- 172.21.15.59:0/1029221128 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa13805f770 con 0x7fa13c072140 2024-04-25T17:02:22.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.196+0000 7fa1446f9640 1 -- 172.21.15.59:0/1029221128 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa124005850 con 0x7fa13c072140 2024-04-25T17:02:22.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.807+0000 7fa132ffd640 1 -- 172.21.15.59:0/1029221128 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7fa138063a70 con 0x7fa13c072140 2024-04-25T17:02:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.810+0000 7fa1446f9640 1 -- 172.21.15.59:0/1029221128 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fa1200744e0 msgr2=0x7fa1200769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.810+0000 7fa1446f9640 1 --2- 172.21.15.59:0/1029221128 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fa1200744e0 0x7fa1200769f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa12c034000 tx=0x7fa12c02e000 comp rx=0 tx=0).stop 2024-04-25T17:02:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.810+0000 7fa1446f9640 1 -- 172.21.15.59:0/1029221128 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa13c072140 msgr2=0x7fa13c1413d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.810+0000 7fa1446f9640 1 --2- 172.21.15.59:0/1029221128 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa13c072140 0x7fa13c1413d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa13800c850 tx=0x7fa13800cd10 comp rx=0 tx=0).stop 2024-04-25T17:02:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.810+0000 7fa1446f9640 1 -- 172.21.15.59:0/1029221128 shutdown_connections 2024-04-25T17:02:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.810+0000 7fa1446f9640 1 --2- 172.21.15.59:0/1029221128 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fa1200744e0 0x7fa1200769f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.810+0000 7fa1446f9640 1 --2- 172.21.15.59:0/1029221128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa13c140e80 0x7fa13c144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.810+0000 7fa1446f9640 1 --2- 172.21.15.59:0/1029221128 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa13c0c94b0 0x7fa13c15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.810+0000 7fa1446f9640 1 --2- 172.21.15.59:0/1029221128 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa13c072140 0x7fa13c1413d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:22.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.810+0000 7fa1446f9640 1 -- 172.21.15.59:0/1029221128 >> 172.21.15.59:0/1029221128 conn(0x7fa13c068d80 msgr2=0x7fa13c075ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:02:22.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.810+0000 7fa1446f9640 1 -- 172.21.15.59:0/1029221128 shutdown_connections 2024-04-25T17:02:22.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.810+0000 7fa1446f9640 1 -- 172.21.15.59:0/1029221128 wait complete. 2024-04-25T17:02:22.821 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T17:02:22.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.980+0000 7f0eff2d8640 1 Processor -- start 2024-04-25T17:02:22.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.981+0000 7f0eff2d8640 1 -- start start 2024-04-25T17:02:22.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.982+0000 7f0eff2d8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0ef815d1d0 0x7f0ef80cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:22.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.982+0000 7f0eff2d8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0ef80ccaf0 0x7f0ef80c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:22.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.982+0000 7f0eff2d8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ef815fd30 con 0x7f0ef8156770 2024-04-25T17:02:22.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.982+0000 7f0eff2d8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 -- 0x7f0ef815ffd0 con 0x7f0ef80ccaf0 2024-04-25T17:02:22.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.982+0000 7f0eff2d8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f0ef81602b0 con 0x7f0ef815d1d0 2024-04-25T17:02:22.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.983+0000 7f0efd875640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0ef80ccaf0 0x7f0ef80c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:22.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.983+0000 7f0efc873640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0ef815d1d0 0x7f0ef80cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:22.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.984+0000 7f0efc873640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0ef815d1d0 0x7f0ef80cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:52880/0 (socket says 172.21.15.59:52880) 2024-04-25T17:02:22.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.984+0000 7f0efc873640 1 -- 172.21.15.59:0/2466441669 learned_addr learned my addr 172.21.15.59:0/2466441669 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:02:22.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.987+0000 7f0efd875640 1 -- 172.21.15.59:0/2466441669 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0ef815d1d0 msgr2=0x7f0ef80cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T17:02:22.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.987+0000 7f0efd875640 1 --2- 172.21.15.59:0/2466441669 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0ef815d1d0 0x7f0ef80cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:22.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.987+0000 7f0efd875640 1 -- 172.21.15.59:0/2466441669 >> v1:172.21.15.64:6789/0 conn(0x7f0ef8156770 legacy=0x7f0ef80cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:22.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.987+0000 7f0efd875640 1 -- 172.21.15.59:0/2466441669 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef8160590 con 0x7f0ef80ccaf0 2024-04-25T17:02:22.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.990+0000 7f0efd875640 1 --2- 172.21.15.59:0/2466441669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef80ccaf0 0x7f0ef80c7430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009d90 tx=0x7f0ef002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63f2240ccc727fe0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:22.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.996+0000 7f0eeffff640 1 -- 172.21.15.59:0/2466441669 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0007740 con 0x7f0ef80ccaf0 2024-04-25T17:02:22.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.996+0000 7f0eeffff640 1 -- 172.21.15.59:0/2466441669 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0ef00078e0 con 0x7f0ef80ccaf0 2024-04-25T17:02:22.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.996+0000 7f0eeffff640 1 -- 172.21.15.59:0/2466441669 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0007cd0 con 0x7f0ef80ccaf0 2024-04-25T17:02:22.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.996+0000 7f0eff2d8640 1 -- 172.21.15.59:0/2466441669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef80ccaf0 msgr2=0x7f0ef80c7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:22.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.996+0000 7f0eff2d8640 1 --2- 172.21.15.59:0/2466441669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef80ccaf0 0x7f0ef80c7430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009d90 tx=0x7f0ef002a6f0 comp rx=0 tx=0).stop 2024-04-25T17:02:22.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.997+0000 7f0eff2d8640 1 -- 172.21.15.59:0/2466441669 shutdown_connections 2024-04-25T17:02:22.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.997+0000 7f0eff2d8640 1 --2- 172.21.15.59:0/2466441669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef80ccaf0 0x7f0ef80c7430 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:22.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.997+0000 7f0eff2d8640 1 --2- 172.21.15.59:0/2466441669 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0ef815d1d0 0x7f0ef80cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:22.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.997+0000 7f0eff2d8640 1 -- 172.21.15.59:0/2466441669 >> 172.21.15.59:0/2466441669 conn(0x7f0ef80684e0 msgr2=0x7f0ef80688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:02:22.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.997+0000 7f0eff2d8640 1 -- 172.21.15.59:0/2466441669 shutdown_connections 2024-04-25T17:02:22.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.997+0000 7f0eff2d8640 1 -- 172.21.15.59:0/2466441669 wait complete. 2024-04-25T17:02:22.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.998+0000 7f0eff2d8640 1 Processor -- start 2024-04-25T17:02:22.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:22.998+0000 7f0eff2d8640 1 -- start start 2024-04-25T17:02:22.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.000+0000 7f0eff2d8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0ef80ccaf0 0x7f0ef815e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:22.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.000+0000 7f0eff2d8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef8156770 0x7f0ef8151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:22.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.000+0000 7f0eff2d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ef815d1d0 0x7f0ef815f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:22.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.000+0000 7f0eff2d8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef80cdb80 con 0x7f0ef815d1d0 2024-04-25T17:02:22.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.000+0000 7f0eff2d8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef80cda00 con 0x7f0ef8156770 2024-04-25T17:02:22.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.000+0000 7f0eff2d8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7f0ef80c7970 con 0x7f0ef80ccaf0 2024-04-25T17:02:22.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.000+0000 7f0efd074640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0ef80ccaf0 0x7f0ef815e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:22.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.000+0000 7f0efc873640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef8156770 0x7f0ef8151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:22.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.001+0000 7f0efd074640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0ef80ccaf0 0x7f0ef815e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.59:52894/0 (socket says 172.21.15.59:52894) 2024-04-25T17:02:22.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.001+0000 7f0efd074640 1 -- 172.21.15.59:0/4155719997 learned_addr learned my addr 172.21.15.59:0/4155719997 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:02:23.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.005+0000 7f0efc873640 1 -- 172.21.15.59:0/4155719997 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0ef80ccaf0 msgr2=0x7f0ef815e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:23.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.005+0000 7f0efc873640 1 --2- 172.21.15.59:0/4155719997 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0ef80ccaf0 0x7f0ef815e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:23.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.005+0000 7f0efc873640 1 -- 172.21.15.59:0/4155719997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ef815d1d0 msgr2=0x7f0ef815f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:23.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.005+0000 7f0efc873640 1 --2- 172.21.15.59:0/4155719997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ef815d1d0 0x7f0ef815f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:23.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.005+0000 7f0efc873640 1 -- 172.21.15.59:0/4155719997 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef81f6120 con 0x7f0ef8156770 2024-04-25T17:02:23.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.007+0000 7f0efc873640 1 --2- 172.21.15.59:0/4155719997 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef8156770 0x7f0ef8151880 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0ee800e870 tx=0x7f0ee800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:23.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.012+0000 7f0eedffb640 1 -- 172.21.15.59:0/4155719997 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8017070 con 0x7f0ef8156770 2024-04-25T17:02:23.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.012+0000 7f0eedffb640 1 -- 172.21.15.59:0/4155719997 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0ee800ee60 con 0x7f0ef8156770 2024-04-25T17:02:23.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.012+0000 7f0eff2d8640 1 -- 172.21.15.59:0/4155719997 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef815dc10 con 0x7f0ef8156770 2024-04-25T17:02:23.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.012+0000 7f0eedffb640 1 -- 172.21.15.59:0/4155719997 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee800cb20 con 0x7f0ef8156770 2024-04-25T17:02:23.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.012+0000 7f0eff2d8640 1 -- 172.21.15.59:0/4155719997 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef815e1b0 con 0x7f0ef8156770 2024-04-25T17:02:23.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.013+0000 7f0eff2d8640 1 -- 172.21.15.59:0/4155719997 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ef80699b0 con 0x7f0ef8156770 2024-04-25T17:02:23.030 INFO:tasks.ceph.mds.c.smithi059.stderr:==00:01:16:06.235 39841== 2024-04-25T17:02:23.030 INFO:tasks.ceph.mds.c.smithi059.stderr:==00:01:16:06.235 39841== Exit program on first error (--exit-on-first-error=yes) 2024-04-25T17:02:23.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.036+0000 7f0eedffb640 1 -- 172.21.15.59:0/4155719997 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0ee801a070 con 0x7f0ef8156770 2024-04-25T17:02:23.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.037+0000 7f0eedffb640 1 --2- 172.21.15.59:0/4155719997 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f0edc0744b0 0x7f0edc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:23.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.037+0000 7f0efd074640 1 --2- 172.21.15.59:0/4155719997 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f0edc0744b0 0x7f0edc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:23.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.038+0000 7f0efd074640 1 --2- 172.21.15.59:0/4155719997 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f0edc0744b0 0x7f0edc0769c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4001780 tx=0x7f0ef4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:23.079 INFO:tasks.ceph.mds.e.smithi059.stderr:==00:01:16:06.267 39842== 2024-04-25T17:02:23.079 INFO:tasks.ceph.mds.e.smithi059.stderr:==00:01:16:06.267 39842== Exit program on first error (--exit-on-first-error=yes) 2024-04-25T17:02:23.156 INFO:tasks.ceph.mds.c.smithi059.stderr:daemon-helper: command failed with exit status 42 2024-04-25T17:02:23.156 INFO:tasks.ceph.mds.e.smithi059.stderr:daemon-helper: command failed with exit status 42 2024-04-25T17:02:23.200 INFO:tasks.ceph.mds.d.smithi064.stderr:==00:01:16:06.405 41105== 2024-04-25T17:02:23.200 INFO:tasks.ceph.mds.d.smithi064.stderr:==00:01:16:06.405 41105== Exit program on first error (--exit-on-first-error=yes) 2024-04-25T17:02:23.221 INFO:tasks.ceph.mds.d.smithi064.stderr:daemon-helper: command failed with exit status 42 2024-04-25T17:02:23.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.352+0000 7f0eedffb640 1 -- 172.21.15.59:0/4155719997 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6083+0+0 (secure 0 0 0) 0x7f0ee805bba0 con 0x7f0ef8156770 2024-04-25T17:02:23.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.363+0000 7f0eedffb640 1 -- 172.21.15.59:0/4155719997 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0ee805f910 con 0x7f0ef8156770 2024-04-25T17:02:23.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:23.572+0000 7f0eff2d8640 1 -- 172.21.15.59:0/4155719997 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0ef80c6c20 con 0x7f0ef8156770 2024-04-25T17:02:24.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.268+0000 7f0eedffb640 1 -- 172.21.15.59:0/4155719997 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) ==== 181+0+0 (secure 0 0 0) 0x7f0ee8063c10 con 0x7f0ef8156770 2024-04-25T17:02:24.266 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-04-25T17:02:24.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.270+0000 7f0eff2d8640 1 -- 172.21.15.59:0/4155719997 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f0edc0744b0 msgr2=0x7f0edc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:24.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.270+0000 7f0eff2d8640 1 --2- 172.21.15.59:0/4155719997 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f0edc0744b0 0x7f0edc0769c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4001780 tx=0x7f0ef4009040 comp rx=0 tx=0).stop 2024-04-25T17:02:24.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.270+0000 7f0eff2d8640 1 -- 172.21.15.59:0/4155719997 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef8156770 msgr2=0x7f0ef8151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:24.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.270+0000 7f0eff2d8640 1 --2- 172.21.15.59:0/4155719997 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef8156770 0x7f0ef8151880 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0ee800e870 tx=0x7f0ee800ed30 comp rx=0 tx=0).stop 2024-04-25T17:02:24.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.270+0000 7f0eff2d8640 1 -- 172.21.15.59:0/4155719997 shutdown_connections 2024-04-25T17:02:24.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.270+0000 7f0eff2d8640 1 --2- 172.21.15.59:0/4155719997 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7f0edc0744b0 0x7f0edc0769c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:24.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.270+0000 7f0eff2d8640 1 --2- 172.21.15.59:0/4155719997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ef815d1d0 0x7f0ef815f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:24.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.270+0000 7f0eff2d8640 1 --2- 172.21.15.59:0/4155719997 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ef8156770 0x7f0ef8151880 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:24.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.270+0000 7f0eff2d8640 1 --2- 172.21.15.59:0/4155719997 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0ef80ccaf0 0x7f0ef815e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:24.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.270+0000 7f0eff2d8640 1 -- 172.21.15.59:0/4155719997 >> 172.21.15.59:0/4155719997 conn(0x7f0ef80684e0 msgr2=0x7f0ef80cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:02:24.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.270+0000 7f0eff2d8640 1 -- 172.21.15.59:0/4155719997 shutdown_connections 2024-04-25T17:02:24.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.270+0000 7f0eff2d8640 1 -- 172.21.15.59:0/4155719997 wait complete. 2024-04-25T17:02:24.281 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T17:02:24.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.398+0000 7fb151f08640 1 Processor -- start 2024-04-25T17:02:24.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.398+0000 7fb151f08640 1 -- start start 2024-04-25T17:02:24.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.399+0000 7fb151f08640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb14c0c8780 0x7fb14c1547d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:24.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.399+0000 7fb151f08640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb14c0737f0 con 0x7fb14c071e70 2024-04-25T17:02:24.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.399+0000 7fb151f08640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb14c073ad0 con 0x7fb14c0c8e60 2024-04-25T17:02:24.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.399+0000 7fb151f08640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fb14c15eac0 con 0x7fb14c0c8780 2024-04-25T17:02:24.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.400+0000 7fb14b7fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb14c071e70 0x7fb14c15af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33376/0 (socket says 172.21.15.59:33376) 2024-04-25T17:02:24.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.400+0000 7fb14b7fe640 1 -- 172.21.15.59:0/1028257627 learned_addr learned my addr 172.21.15.59:0/1028257627 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T17:02:24.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.400+0000 7fb14bfff640 1 --2- 172.21.15.59:0/1028257627 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb14c0c8780 0x7fb14c1547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:24.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.403+0000 7fb14a7fc640 1 -- 172.21.15.59:0/1028257627 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3467726435 0 0) 0x7fb14c0737f0 con 0x7fb14c071e70 2024-04-25T17:02:24.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.403+0000 7fb14a7fc640 1 -- 172.21.15.59:0/1028257627 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb134003520 con 0x7fb14c071e70 2024-04-25T17:02:24.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.403+0000 7fb14a7fc640 1 -- 172.21.15.59:0/1028257627 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3220101016 0 0) 0x7fb14c073ad0 con 0x7fb14c0c8e60 2024-04-25T17:02:24.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.403+0000 7fb14a7fc640 1 -- 172.21.15.59:0/1028257627 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb14c0737f0 con 0x7fb14c0c8e60 2024-04-25T17:02:24.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.403+0000 7fb14bfff640 1 -- 172.21.15.59:0/1028257627 >> v1:172.21.15.64:6789/0 conn(0x7fb14c0c8e60 legacy=0x7fb14c0c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:24.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.403+0000 7fb14bfff640 1 -- 172.21.15.59:0/1028257627 >> v1:172.21.15.59:6789/0 conn(0x7fb14c071e70 legacy=0x7fb14c15af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:24.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.403+0000 7fb14bfff640 1 -- 172.21.15.59:0/1028257627 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c15a770 con 0x7fb14c0c8780 2024-04-25T17:02:24.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.406+0000 7fb14bfff640 1 --2- 172.21.15.59:0/1028257627 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb14c0c8780 0x7fb14c1547d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb144009dc0 tx=0x7fb14402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fc76b28db7cafc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.410+0000 7fb14a7fc640 1 -- 172.21.15.59:0/1028257627 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144007740 con 0x7fb14c0c8780 2024-04-25T17:02:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.410+0000 7fb14a7fc640 1 -- 172.21.15.59:0/1028257627 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb1440078e0 con 0x7fb14c0c8780 2024-04-25T17:02:24.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.410+0000 7fb14a7fc640 1 -- 172.21.15.59:0/1028257627 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144007cd0 con 0x7fb14c0c8780 2024-04-25T17:02:24.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.411+0000 7fb151f08640 1 -- 172.21.15.59:0/1028257627 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb14c0c8780 msgr2=0x7fb14c1547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:24.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.411+0000 7fb151f08640 1 --2- 172.21.15.59:0/1028257627 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb14c0c8780 0x7fb14c1547d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb144009dc0 tx=0x7fb14402a6d0 comp rx=0 tx=0).stop 2024-04-25T17:02:24.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.411+0000 7fb151f08640 1 -- 172.21.15.59:0/1028257627 shutdown_connections 2024-04-25T17:02:24.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.411+0000 7fb151f08640 1 --2- 172.21.15.59:0/1028257627 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb14c0c8780 0x7fb14c1547d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:24.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.411+0000 7fb151f08640 1 -- 172.21.15.59:0/1028257627 >> 172.21.15.59:0/1028257627 conn(0x7fb14c06cbb0 msgr2=0x7fb14c071240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:02:24.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.411+0000 7fb151f08640 1 -- 172.21.15.59:0/1028257627 shutdown_connections 2024-04-25T17:02:24.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.411+0000 7fb151f08640 1 -- 172.21.15.59:0/1028257627 wait complete. 2024-04-25T17:02:24.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.412+0000 7fb151f08640 1 Processor -- start 2024-04-25T17:02:24.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.413+0000 7fb151f08640 1 -- start start 2024-04-25T17:02:24.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.414+0000 7fb151f08640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb14c071e70 0x7fb14c151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:24.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.414+0000 7fb151f08640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb14c0c8780 0x7fb14c159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:24.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.414+0000 7fb151f08640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb14c0c8e60 0x7fb14c14a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:24.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.414+0000 7fb151f08640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c0c7670 con 0x7fb14c0c8e60 2024-04-25T17:02:24.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.414+0000 7fb151f08640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c15aae0 con 0x7fb14c071e70 2024-04-25T17:02:24.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.414+0000 7fb151f08640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 -- 0x7fb14c0c77f0 con 0x7fb14c0c8780 2024-04-25T17:02:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.414+0000 7fb14bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb14c0c8e60 0x7fb14c14a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.415+0000 7fb14b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb14c071e70 0x7fb14c151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.415+0000 7fb14affd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb14c0c8780 0x7fb14c159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.415+0000 7fb14bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb14c0c8e60 0x7fb14c14a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57192/0 (socket says 172.21.15.59:57192) 2024-04-25T17:02:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.415+0000 7fb14bfff640 1 -- 172.21.15.59:0/3754633352 learned_addr learned my addr 172.21.15.59:0/3754633352 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T17:02:24.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.419+0000 7fb14bfff640 1 -- 172.21.15.59:0/3754633352 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb14c0c8780 msgr2=0x7fb14c159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:24.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.419+0000 7fb14bfff640 1 --2- 172.21.15.59:0/3754633352 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb14c0c8780 0x7fb14c159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:24.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.419+0000 7fb14bfff640 1 -- 172.21.15.59:0/3754633352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb14c071e70 msgr2=0x7fb14c151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:24.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.419+0000 7fb14bfff640 1 --2- 172.21.15.59:0/3754633352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb14c071e70 0x7fb14c151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:24.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.419+0000 7fb14bfff640 1 -- 172.21.15.59:0/3754633352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c0c4d50 con 0x7fb14c0c8e60 2024-04-25T17:02:24.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.421+0000 7fb14bfff640 1 --2- 172.21.15.59:0/3754633352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb14c0c8e60 0x7fb14c14a070 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb144009ee0 tx=0x7fb144004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:24.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.425+0000 7fb133fff640 1 -- 172.21.15.59:0/3754633352 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14403f070 con 0x7fb14c0c8e60 2024-04-25T17:02:24.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.425+0000 7fb133fff640 1 -- 172.21.15.59:0/3754633352 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb144031bc0 con 0x7fb14c0c8e60 2024-04-25T17:02:24.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.425+0000 7fb133fff640 1 -- 172.21.15.59:0/3754633352 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144009450 con 0x7fb14c0c8e60 2024-04-25T17:02:24.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.425+0000 7fb151f08640 1 -- 172.21.15.59:0/3754633352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14c1503e0 con 0x7fb14c0c8e60 2024-04-25T17:02:24.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.425+0000 7fb151f08640 1 -- 172.21.15.59:0/3754633352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb14c1509a0 con 0x7fb14c0c8e60 2024-04-25T17:02:24.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.426+0000 7fb151f08640 1 -- 172.21.15.59:0/3754633352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb14c069910 con 0x7fb14c0c8e60 2024-04-25T17:02:24.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.450+0000 7fb133fff640 1 -- 172.21.15.59:0/3754633352 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb144044460 con 0x7fb14c0c8e60 2024-04-25T17:02:24.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.451+0000 7fb133fff640 1 --2- 172.21.15.59:0/3754633352 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb138074500 0x7fb138076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:02:24.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.451+0000 7fb14b7fe640 1 --2- 172.21.15.59:0/3754633352 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb138074500 0x7fb138076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:02:24.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.451+0000 7fb14b7fe640 1 --2- 172.21.15.59:0/3754633352 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb138074500 0x7fb138076a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb13c000f60 tx=0x7fb13c007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:02:24.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.751+0000 7fb133fff640 1 -- 172.21.15.59:0/3754633352 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5645+0+0 (secure 0 0 0) 0x7fb144007840 con 0x7fb14c0c8e60 2024-04-25T17:02:24.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.751+0000 7fb133fff640 1 -- 172.21.15.59:0/3754633352 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb144053080 con 0x7fb14c0c8e60 2024-04-25T17:02:24.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:24.940+0000 7fb151f08640 1 -- 172.21.15.59:0/3754633352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb14c073ee0 con 0x7fb14c0c8e60 2024-04-25T17:02:25.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:25.222+0000 7fb133fff640 1 -- 172.21.15.59:0/3754633352 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) ==== 169+0+0 (secure 0 0 0) 0x7fb144080f60 con 0x7fb14c0c8e60 2024-04-25T17:02:25.221 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-04-25T17:02:25.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:25.224+0000 7fb151f08640 1 -- 172.21.15.59:0/3754633352 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb138074500 msgr2=0x7fb138076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:25.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:25.224+0000 7fb151f08640 1 --2- 172.21.15.59:0/3754633352 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb138074500 0x7fb138076a10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb13c000f60 tx=0x7fb13c007d50 comp rx=0 tx=0).stop 2024-04-25T17:02:25.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:25.224+0000 7fb151f08640 1 -- 172.21.15.59:0/3754633352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb14c0c8e60 msgr2=0x7fb14c14a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:02:25.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:25.224+0000 7fb151f08640 1 --2- 172.21.15.59:0/3754633352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb14c0c8e60 0x7fb14c14a070 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb144009ee0 tx=0x7fb144004a40 comp rx=0 tx=0).stop 2024-04-25T17:02:25.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:25.225+0000 7fb151f08640 1 -- 172.21.15.59:0/3754633352 shutdown_connections 2024-04-25T17:02:25.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:25.225+0000 7fb151f08640 1 --2- 172.21.15.59:0/3754633352 >> [v2:172.21.15.59:6800/2368090706,v1:172.21.15.59:6801/2368090706] conn(0x7fb138074500 0x7fb138076a10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:25.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:25.225+0000 7fb151f08640 1 --2- 172.21.15.59:0/3754633352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb14c0c8e60 0x7fb14c14a070 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:25.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:25.225+0000 7fb151f08640 1 --2- 172.21.15.59:0/3754633352 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb14c0c8780 0x7fb14c159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:25.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:25.225+0000 7fb151f08640 1 --2- 172.21.15.59:0/3754633352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb14c071e70 0x7fb14c151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:02:25.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:25.225+0000 7fb151f08640 1 -- 172.21.15.59:0/3754633352 >> 172.21.15.59:0/3754633352 conn(0x7fb14c06cbb0 msgr2=0x7fb14c071220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:02:25.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:25.225+0000 7fb151f08640 1 -- 172.21.15.59:0/3754633352 shutdown_connections 2024-04-25T17:02:25.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T17:02:25.225+0000 7fb151f08640 1 -- 172.21.15.59:0/3754633352 wait complete. 2024-04-25T17:02:25.235 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T17:02:25.235 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T17:02:25.236 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:02:25.250 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T17:02:25.242+0000 f85b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 39828) UID: 0 2024-04-25T17:02:25.250 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T17:02:25.243+0000 f85b640 -1 mds.a *** got signal Terminated *** 2024-04-25T17:02:27.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-04-25T17:02:27.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2024-04-25T17:02:27.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-04-25T17:02:31.338 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T17:02:31.338 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T17:02:31.338 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:02:31.338 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-25T17:02:31.339 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c" 2024-04-25T17:02:31.339 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T17:02:31.339 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-25T17:02:31.340 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:02:31.340 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-25T17:02:31.340 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e" 2024-04-25T17:02:31.340 INFO:tasks.ceph.mds.e:Stopped 2024-04-25T17:02:31.340 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T17:02:31.340 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:02:31.358 INFO:tasks.ceph.mds.b.smithi064.stderr:2024-04-25T17:02:31.347+0000 f85b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 41098) UID: 0 2024-04-25T17:02:31.358 INFO:tasks.ceph.mds.b.smithi064.stderr:2024-04-25T17:02:31.349+0000 f85b640 -1 mds.b *** got signal Terminated *** 2024-04-25T17:02:34.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-04-25T17:02:34.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2024-04-25T17:02:34.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-04-25T17:02:34.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2024-04-25T17:02:37.442 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T17:02:37.442 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T17:02:37.442 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:02:37.442 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-25T17:02:37.442 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi064 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d" 2024-04-25T17:02:37.443 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T17:02:37.443 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-25T17:02:37.443 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:02:37.461 INFO:tasks.ceph.mds.f.smithi064.stderr:2024-04-25T17:02:37.450+0000 f85b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f (PID: 41103) UID: 0 2024-04-25T17:02:37.462 INFO:tasks.ceph.mds.f.smithi064.stderr:2024-04-25T17:02:37.452+0000 f85b640 -1 mds.f *** got signal Terminated *** 2024-04-25T17:02:40.439 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-04-25T17:02:40.439 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-04-25T17:02:43.545 INFO:tasks.ceph.mds.f:Stopped 2024-04-25T17:02:43.545 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T17:02:43.546 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T17:02:43.546 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:02:43.547 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-25T17:02:43.549+0000 7f82a13e3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 34939) UID: 0 2024-04-25T17:02:43.547 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-25T17:02:43.549+0000 7f82a13e3640 -1 osd.0 30 *** Got signal Terminated *** 2024-04-25T17:02:46.649 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-25T17:02:49.647 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T17:02:49.647 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T17:02:49.647 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:02:49.648 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-04-25T17:02:49.651+0000 7f18bcd2f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 34949) UID: 0 2024-04-25T17:02:49.649 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-04-25T17:02:49.651+0000 7f18bcd2f640 -1 osd.1 32 *** Got signal Terminated *** 2024-04-25T17:02:51.515 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:02:51.517 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:02:52.759 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-25T17:02:52.759 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-25T17:02:55.749 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T17:02:55.750 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T17:02:55.750 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:02:55.751 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-04-25T17:02:55.753+0000 7f3c3624d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 34954) UID: 0 2024-04-25T17:02:55.751 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-04-25T17:02:55.753+0000 7f3c3624d640 -1 osd.2 33 *** Got signal Terminated *** 2024-04-25T17:02:58.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-25T17:02:58.768 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-25T17:03:01.851 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T17:03:01.852 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T17:03:01.852 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:03:01.852 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-04-25T17:03:01.855+0000 7fc9d0b39640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 34960) UID: 0 2024-04-25T17:03:01.853 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-04-25T17:03:01.855+0000 7fc9d0b39640 -1 osd.3 34 *** Got signal Terminated *** 2024-04-25T17:03:04.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-25T17:03:04.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-25T17:03:06.328 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:17:18.935 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T17:03:06.332 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:17:18.939 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T17:03:06.344 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:17:18.910 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T17:03:06.345 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:17:18.911 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T17:03:06.346 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:17:18.912 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T17:03:06.348 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:17:18.914 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T17:03:06.405 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:17:19.011 34581== Warning: unimplemented fcntl command: 1036 2024-04-25T17:03:06.417 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:17:18.983 34325== Warning: unimplemented fcntl command: 1036 2024-04-25T17:03:06.421 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:17:18.987 34326== Warning: unimplemented fcntl command: 1036 2024-04-25T17:03:07.954 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T17:03:07.954 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T17:03:07.954 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:03:07.955 INFO:tasks.ceph.osd.4.smithi064.stderr:2024-04-25T17:03:07.957+0000 7fb08ad8d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 34912) UID: 0 2024-04-25T17:03:07.955 INFO:tasks.ceph.osd.4.smithi064.stderr:2024-04-25T17:03:07.957+0000 7fb08ad8d640 -1 osd.4 35 *** Got signal Terminated *** 2024-04-25T17:03:10.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-25T17:03:14.055 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T17:03:14.056 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T17:03:14.056 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:03:14.057 INFO:tasks.ceph.osd.5.smithi064.stderr:2024-04-25T17:03:14.059+0000 7f93ced19640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 34913) UID: 0 2024-04-25T17:03:14.057 INFO:tasks.ceph.osd.5.smithi064.stderr:2024-04-25T17:03:14.059+0000 7f93ced19640 -1 osd.5 36 *** Got signal Terminated *** 2024-04-25T17:03:16.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-25T17:03:20.159 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T17:03:20.160 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T17:03:20.160 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:03:20.161 INFO:tasks.ceph.osd.6.smithi064.stderr:2024-04-25T17:03:20.163+0000 7f9e12567640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 34916) UID: 0 2024-04-25T17:03:20.161 INFO:tasks.ceph.osd.6.smithi064.stderr:2024-04-25T17:03:20.163+0000 7f9e12567640 -1 osd.6 37 *** Got signal Terminated *** 2024-04-25T17:03:21.577 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:03:21.580 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:03:21.893 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-25T17:03:21.893 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-25T17:03:26.262 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T17:03:26.263 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T17:03:26.263 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:03:26.264 INFO:tasks.ceph.osd.7.smithi064.stderr:2024-04-25T17:03:26.266+0000 7ff16d595640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 34919) UID: 0 2024-04-25T17:03:26.264 INFO:tasks.ceph.osd.7.smithi064.stderr:2024-04-25T17:03:26.266+0000 7ff16d595640 -1 osd.7 37 *** Got signal Terminated *** 2024-04-25T17:03:27.454 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-25T17:03:27.454 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-25T17:03:32.364 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T17:03:32.364 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T17:03:32.365 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T17:03:32.365 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:03:32.366 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T17:03:32.367+0000 7fa6f74a8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 34614) UID: 0 2024-04-25T17:03:32.394 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T17:03:32.394 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T17:03:32.394 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:03:32.421 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T17:03:32.421 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T17:03:32.421 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T17:03:32.421 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:03:32.453 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T17:03:32.440+0000 e229640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 34578) UID: 0 2024-04-25T17:03:32.453 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T17:03:32.442+0000 e229640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-25T17:03:32.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-25T17:03:33.062 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:17:45.669 34581== 2024-04-25T17:03:33.062 INFO:tasks.ceph.mon.a.smithi059.stderr:==00:01:17:45.669 34581== Exit program on first error (--exit-on-first-error=yes) 2024-04-25T17:03:33.078 INFO:tasks.ceph.mon.a.smithi059.stderr:daemon-helper: command failed with exit status 42 2024-04-25T17:03:37.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-25T17:03:38.523 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-25T17:03:38.523 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2024-04-25T17:03:38.523 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T17:03:38.523 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T17:03:38.524 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:03:38.543 INFO:tasks.ceph.mon.b.smithi064.stderr:2024-04-25T17:03:38.529+0000 e229640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 34305) UID: 0 2024-04-25T17:03:38.544 INFO:tasks.ceph.mon.b.smithi064.stderr:2024-04-25T17:03:38.531+0000 e229640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-04-25T17:03:39.337 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:17:51.903 34325== 2024-04-25T17:03:39.337 INFO:tasks.ceph.mon.b.smithi064.stderr:==00:01:17:51.903 34325== Exit program on first error (--exit-on-first-error=yes) 2024-04-25T17:03:39.350 INFO:tasks.ceph.mon.b.smithi064.stderr:daemon-helper: command failed with exit status 42 2024-04-25T17:03:43.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-25T17:03:43.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-25T17:03:44.625 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-25T17:03:44.625 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi064 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2024-04-25T17:03:44.626 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T17:03:44.626 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T17:03:44.626 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:03:44.645 INFO:tasks.ceph.mon.c.smithi064.stderr:2024-04-25T17:03:44.633+0000 e229640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 34320) UID: 0 2024-04-25T17:03:44.646 INFO:tasks.ceph.mon.c.smithi064.stderr:2024-04-25T17:03:44.634+0000 e229640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2024-04-25T17:03:45.447 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:17:58.013 34326== 2024-04-25T17:03:45.449 INFO:tasks.ceph.mon.c.smithi064.stderr:==00:01:17:58.013 34326== Exit program on first error (--exit-on-first-error=yes) 2024-04-25T17:03:45.460 INFO:tasks.ceph.mon.c.smithi064.stderr:daemon-helper: command failed with exit status 42 2024-04-25T17:03:48.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-25T17:03:48.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-25T17:03:50.727 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-25T17:03:50.728 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi064 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2024-04-25T17:03:50.728 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T17:03:50.728 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T17:03:50.729 DEBUG:teuthology.orchestra.run.smithi059:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-04-25T17:03:50.780 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T17:03:50.780 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T17:03:50.871 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T17:03:50.872 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T17:03:50.931 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T17:03:50.931 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T17:03:50.988 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T17:03:50.988 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T17:03:51.048 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi064.front.sepia.ceph.com 2024-04-25T17:03:51.048 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T17:03:51.179 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi064.front.sepia.ceph.com 2024-04-25T17:03:51.179 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T17:03:51.269 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi064.front.sepia.ceph.com 2024-04-25T17:03:51.269 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T17:03:51.335 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi064.front.sepia.ceph.com 2024-04-25T17:03:51.335 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T17:03:51.511 INFO:tasks.ceph:Archiving mon data... 2024-04-25T17:03:51.512 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673226/data/mon.a.tgz 2024-04-25T17:03:51.513 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2024-04-25T17:03:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.1U8bNpqtAf 2024-04-25T17:03:51.531 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.1U8bNpqtAf 2024-04-25T17:03:51.641 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:03:51.644 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:03:51.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.1U8bNpqtAf 2024-04-25T17:03:51.816 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.1U8bNpqtAf is 317KB 2024-04-25T17:03:51.913 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.1U8bNpqtAf 2024-04-25T17:03:51.929 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673226/data/mon.b.tgz 2024-04-25T17:03:51.929 DEBUG:teuthology.orchestra.run.smithi064:> mktemp 2024-04-25T17:03:51.947 INFO:teuthology.orchestra.run.smithi064.stdout:/tmp/tmp.LZ6y6TgsVP 2024-04-25T17:03:51.948 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.LZ6y6TgsVP 2024-04-25T17:03:52.100 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0666 /tmp/tmp.LZ6y6TgsVP 2024-04-25T17:03:52.186 DEBUG:teuthology.orchestra.remote:smithi064:/tmp/tmp.LZ6y6TgsVP is 319KB 2024-04-25T17:03:52.256 DEBUG:teuthology.orchestra.run.smithi064:> rm -fr /tmp/tmp.LZ6y6TgsVP 2024-04-25T17:03:52.272 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673226/data/mon.c.tgz 2024-04-25T17:03:52.272 DEBUG:teuthology.orchestra.run.smithi064:> mktemp 2024-04-25T17:03:52.327 INFO:teuthology.orchestra.run.smithi064.stdout:/tmp/tmp.zfJ5zsV6Lx 2024-04-25T17:03:52.327 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.zfJ5zsV6Lx 2024-04-25T17:03:52.447 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0666 /tmp/tmp.zfJ5zsV6Lx 2024-04-25T17:03:52.529 DEBUG:teuthology.orchestra.remote:smithi064:/tmp/tmp.zfJ5zsV6Lx is 319KB 2024-04-25T17:03:52.623 DEBUG:teuthology.orchestra.run.smithi064:> rm -fr /tmp/tmp.zfJ5zsV6Lx 2024-04-25T17:03:52.638 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T17:03:52.638 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T17:03:52.640 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T17:03:52.923 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc strdup 2024-04-25T17:03:53.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-25T17:03:53.163 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T17:03:53.165 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673226/remote/smithi059/crash 2024-04-25T17:03:53.166 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T17:03:53.195 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673226/remote/smithi064/crash 2024-04-25T17:03:53.196 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T17:03:53.220 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T17:03:53.221 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:03:53.240 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T17:03:53.311 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T17:03:53.338 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T17:03:53.362 INFO:tasks.ceph:Compressing logs... 2024-04-25T17:03:53.362 DEBUG:teuthology.orchestra.run.smithi059:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T17:03:53.381 DEBUG:teuthology.orchestra.run.smithi064:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T17:03:53.403 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34617.log 2024-04-25T17:03:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40450.log 2024-04-25T17:03:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48627.log 2024-04-25T17:03:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41134.log 2024-04-25T17:03:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48627.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40450.log.gz 2024-04-25T17:03:53.410 INFO:teuthology.orchestra.run.smithi059.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.34617.log.gz 2024-04-25T17:03:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48357.log 2024-04-25T17:03:53.410 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48627.log.gz 2024-04-25T17:03:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:gzip/var/log/ceph/ceph-client.admin.41134.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47937.log 2024-04-25T17:03:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41688.log 2024-04-25T17:03:53.410 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41134.log.gz 2024-04-25T17:03:53.410 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48357.log.gz/var/log/ceph/ceph-client.admin.47937.log: 2024-04-25T17:03:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40534.log 2024-04-25T17:03:53.410 INFO:teuthology.orchestra.run.smithi059.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47937.log.gz 2024-04-25T17:03:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39884.log 2024-04-25T17:03:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40534.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41688.log.gz 2024-04-25T17:03:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48105.log 2024-04-25T17:03:53.410 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40534.log.gz/var/log/ceph/ceph-client.admin.39884.log: 2024-04-25T17:03:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47177.log 2024-04-25T17:03:53.411 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39884.log.gz 2024-04-25T17:03:53.411 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47793.log 2024-04-25T17:03:53.411 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47177.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 88.9% 2024-04-25T17:03:53.411 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48105.log.gz 2024-04-25T17:03:53.411 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47177.log.gz 2024-04-25T17:03:53.411 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42550.log 2024-04-25T17:03:53.411 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40783.log 2024-04-25T17:03:53.411 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47793.log.gz 2024-04-25T17:03:53.411 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40282.log 2024-04-25T17:03:53.411 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40783.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42550.log.gz 2024-04-25T17:03:53.411 INFO:teuthology.orchestra.run.smithi059.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40198.log 2024-04-25T17:03:53.411 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40282.log: gzip -5 --verbose -- 88.1% /var/log/ceph/ceph-osd.2.log 2024-04-25T17:03:53.411 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40783.log.gz 2024-04-25T17:03:53.411 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40198.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40282.log.gz 2024-04-25T17:03:53.411 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41364.log 2024-04-25T17:03:53.412 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40198.log.gz 2024-04-25T17:03:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42844.log 2024-04-25T17:03:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40408.log 2024-04-25T17:03:53.439 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T17:03:53.439 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-25T17:03:53.439 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T17:03:53.439 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T17:03:53.440 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T17:03:53.440 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34742.log 2024-04-25T17:03:53.440 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T17:03:53.440 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34742.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T17:03:53.440 INFO:teuthology.orchestra.run.smithi064.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T17:03:53.440 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34782.log 2024-04-25T17:03:53.440 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34742.log.gz 2024-04-25T17:03:53.440 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5/var/log/ceph/ceph-osd.4.log: --verbose -- /var/log/ceph/ceph-client.admin.34621.log 2024-04-25T17:03:53.440 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34782.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T17:03:53.440 INFO:teuthology.orchestra.run.smithi064.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34782.log.gz 2024-04-25T17:03:53.440 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34822.log 2024-04-25T17:03:53.440 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mgr.x.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34621.log.gz 2024-04-25T17:03:53.440 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T17:03:53.440 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34822.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34822.log.gz 2024-04-25T17:03:53.441 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-04-25T17:03:53.441 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mon.c.log: 93.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T17:03:53.444 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2024-04-25T17:03:53.444 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/valgrind/mon.b.log: 69.8% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-04-25T17:03:53.445 INFO:teuthology.orchestra.run.smithi064.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T17:03:53.445 INFO:teuthology.orchestra.run.smithi064.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-25T17:03:53.448 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41364.log.gz 2024-04-25T17:03:53.448 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41786.log 2024-04-25T17:03:53.448 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40741.log 2024-04-25T17:03:53.448 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40408.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42844.log.gz 2024-04-25T17:03:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41786.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40408.log.gz 2024-04-25T17:03:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47403.log 2024-04-25T17:03:53.449 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41786.log.gz 2024-04-25T17:03:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42088.log 2024-04-25T17:03:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40741.log: /var/log/ceph/ceph-client.admin.47403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47895.log 2024-04-25T17:03:53.449 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40741.log.gz 2024-04-25T17:03:53.449 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47403.log.gz 2024-04-25T17:03:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41132.log 2024-04-25T17:03:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48567.log 2024-04-25T17:03:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47895.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42088.log.gz 2024-04-25T17:03:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41132.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47895.log.gz 2024-04-25T17:03:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T17:03:53.449 INFO:teuthology.orchestra.run.smithi059.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.41132.log.gz 2024-04-25T17:03:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42592.log 2024-04-25T17:03:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48567.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39724.log 2024-04-25T17:03:53.450 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48567.log.gz 2024-04-25T17:03:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40240.log 2024-04-25T17:03:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40670.log 2024-04-25T17:03:53.450 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T17:03:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41352.log 2024-04-25T17:03:53.450 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% 90.5% -- replaced with /var/log/ceph/ceph-client.admin.39724.log.gz -- replaced with /var/log/ceph/ceph-client.admin.42592.log.gz 2024-04-25T17:03:53.450 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-04-25T17:03:53.450 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40240.log.gz 2024-04-25T17:03:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46867.log 2024-04-25T17:03:53.450 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T17:03:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40954.log 2024-04-25T17:03:53.450 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40670.log.gz 2024-04-25T17:03:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46867.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41352.log.gz 2024-04-25T17:03:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T17:03:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40954.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46867.log.gz 2024-04-25T17:03:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39839.log 2024-04-25T17:03:53.451 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40954.log.gz 2024-04-25T17:03:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40627.log 2024-04-25T17:03:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47135.log 2024-04-25T17:03:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40627.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39839.log.gz 2024-04-25T17:03:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41130.log 2024-04-25T17:03:53.451 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40627.log.gz 2024-04-25T17:03:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T17:03:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47135.log: /var/log/ceph/ceph-client.admin.41130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47540.log 2024-04-25T17:03:53.451 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47135.log.gz 2024-04-25T17:03:53.451 INFO:teuthology.orchestra.run.smithi059.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41130.log.gz 2024-04-25T17:03:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47709.log 2024-04-25T17:03:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T17:03:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47540.log: /var/log/ceph/ceph-client.admin.47709.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T17:03:53.452 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47540.log.gz 2024-04-25T17:03:53.452 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47709.log.gz 2024-04-25T17:03:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47035.log 2024-04-25T17:03:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47751.log 2024-04-25T17:03:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47583.log 2024-04-25T17:03:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47751.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47035.log.gz 2024-04-25T17:03:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41962.log 2024-04-25T17:03:53.452 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47751.log.gz 2024-04-25T17:03:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:gzip/var/log/ceph/ceph-client.admin.47583.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48483.log 2024-04-25T17:03:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41962.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47583.log.gz 2024-04-25T17:03:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40492.log 2024-04-25T17:03:53.452 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41962.log.gz 2024-04-25T17:03:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48483.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T17:03:53.452 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6%/var/log/ceph/ceph-client.admin.40492.log: -- replaced with /var/log/ceph/ceph-client.admin.48483.log.gz 2024-04-25T17:03:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41129.log 2024-04-25T17:03:53.453 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40492.log.gz 2024-04-25T17:03:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46993.log 2024-04-25T17:03:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.41129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42046.log 2024-04-25T17:03:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46993.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41129.log.gz 2024-04-25T17:03:53.453 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46993.log.gz 2024-04-25T17:03:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47979.log 2024-04-25T17:03:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42046.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42046.log.gz 2024-04-25T17:03:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2024-04-25T17:03:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47979.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-04-25T17:03:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/valgrind/mds.e.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47979.log.gz 2024-04-25T17:03:53.453 INFO:teuthology.orchestra.run.smithi059.stderr: 67.6% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2024-04-25T17:03:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2024-04-25T17:03:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2024-04-25T17:03:53.454 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/valgrind/mds.c.log: 69.9% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-04-25T17:03:53.454 INFO:teuthology.orchestra.run.smithi059.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.c.log.gzgzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2024-04-25T17:03:53.454 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-04-25T17:03:53.454 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/valgrind/client.0.log: 76.6% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2024-04-25T17:03:53.454 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40825.log 2024-04-25T17:03:53.454 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/valgrind/mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39949.log 2024-04-25T17:03:53.454 INFO:teuthology.orchestra.run.smithi059.stderr: 57.1% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2024-04-25T17:03:53.454 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40324.log 2024-04-25T17:03:53.454 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40825.log.gz 2024-04-25T17:03:53.454 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39949.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39949.log.gz 2024-04-25T17:03:53.454 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T17:03:53.454 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47667.log 2024-04-25T17:03:53.454 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mon.a.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40324.log.gz 2024-04-25T17:03:53.454 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40870.log 2024-04-25T17:03:53.455 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47667.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47667.log.gz 2024-04-25T17:03:53.455 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41136.log 2024-04-25T17:03:53.455 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40870.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40870.log.gz 2024-04-25T17:03:53.455 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42382.log 2024-04-25T17:03:53.455 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41136.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41136.log.gz 2024-04-25T17:03:53.455 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48669.log 2024-04-25T17:03:53.455 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42382.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42382.log.gz 2024-04-25T17:03:53.455 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42340.log 2024-04-25T17:03:53.455 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48669.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48669.log.gz 2024-04-25T17:03:53.455 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46951.log 2024-04-25T17:03:53.455 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42340.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42340.log.gz 2024-04-25T17:03:53.455 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43254.log 2024-04-25T17:03:53.455 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46951.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46951.log.gz 2024-04-25T17:03:53.455 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48021.log 2024-04-25T17:03:53.456 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.43254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41868.log 2024-04-25T17:03:53.461 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2024-04-25T17:03:53.461 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/valgrind/mds.d.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-04-25T17:03:53.461 INFO:teuthology.orchestra.run.smithi064.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz/var/log/ceph/valgrind/mds.f.log: 2024-04-25T17:03:53.461 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2024-04-25T17:03:53.461 INFO:teuthology.orchestra.run.smithi064.stderr: 57.3% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2024-04-25T17:03:53.461 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose --/var/log/ceph/valgrind/mon.c.log: /var/log/ceph/ceph-client.admin.34662.log 2024-04-25T17:03:53.461 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/valgrind/mds.b.log: 69.9%gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T17:03:53.461 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-04-25T17:03:53.461 INFO:teuthology.orchestra.run.smithi064.stderr: 57.2% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2024-04-25T17:03:53.461 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34702.log 2024-04-25T17:03:53.461 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34529.log 2024-04-25T17:03:53.461 INFO:teuthology.orchestra.run.smithi064.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34662.log.gz 2024-04-25T17:03:53.461 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34702.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T17:03:53.462 INFO:teuthology.orchestra.run.smithi064.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34702.log.gz 2024-04-25T17:03:53.462 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.34529.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T17:03:53.462 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mds.d.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.34529.log.gz 2024-04-25T17:03:53.462 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34579.log 2024-04-25T17:03:53.463 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48021.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41710.log 2024-04-25T17:03:53.463 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41868.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41868.log.gz 2024-04-25T17:03:53.466 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48021.log.gz 2024-04-25T17:03:53.470 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41463.log 2024-04-25T17:03:53.471 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41710.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41710.log.gz 2024-04-25T17:03:53.471 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.34579.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.34579.log.gz 2024-04-25T17:03:53.483 INFO:teuthology.orchestra.run.smithi064.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T17:03:53.489 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48399.log 2024-04-25T17:03:53.490 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41463.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41463.log.gz 2024-04-25T17:03:53.498 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40912.log 2024-04-25T17:03:53.499 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48399.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48399.log.gz 2024-04-25T17:03:53.510 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41126.log 2024-04-25T17:03:53.510 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40912.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40912.log.gz 2024-04-25T17:03:53.520 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34971.log 2024-04-25T17:03:53.521 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41126.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41126.log.gz 2024-04-25T17:03:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40114.log 2024-04-25T17:03:53.539 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46909.log 2024-04-25T17:03:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40114.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34971.log.gz 2024-04-25T17:03:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47093.log 2024-04-25T17:03:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46909.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40114.log.gz 2024-04-25T17:03:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41395.log 2024-04-25T17:03:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47093.log: 87.3% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46909.log.gz 2024-04-25T17:03:53.568 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-25T17:03:53.569 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41395.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41395.log.gz 2024-04-25T17:03:53.570 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47093.log.gz 2024-04-25T17:03:53.579 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40039.log 2024-04-25T17:03:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42466.log 2024-04-25T17:03:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40039.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40039.log.gz 2024-04-25T17:03:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42214.log 2024-04-25T17:03:53.617 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42466.log: gzip -5 --verbose 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42466.log.gz 2024-04-25T17:03:53.617 INFO:teuthology.orchestra.run.smithi059.stderr: -- /var/log/ceph/ceph-client.admin.41420.log 2024-04-25T17:03:53.617 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42214.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42214.log.gz 2024-04-25T17:03:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42424.log 2024-04-25T17:03:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41420.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41420.log.gz 2024-04-25T17:03:53.638 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48274.log 2024-04-25T17:03:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42424.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42424.log.gz 2024-04-25T17:03:53.657 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41668.log 2024-04-25T17:03:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48274.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48274.log.gz 2024-04-25T17:03:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48317.log 2024-04-25T17:03:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41668.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41668.log.gz 2024-04-25T17:03:53.675 INFO:teuthology.orchestra.run.smithi059.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T17:03:53.689 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48232.log 2024-04-25T17:03:53.701 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48317.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42298.log 2024-04-25T17:03:53.701 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48232.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48232.log.gz 2024-04-25T17:03:53.703 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48317.log.gz 2024-04-25T17:03:53.717 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48190.log 2024-04-25T17:03:53.719 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42298.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42298.log.gz 2024-04-25T17:03:53.726 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40366.log 2024-04-25T17:03:53.740 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48190.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48190.log.gz 2024-04-25T17:03:53.747 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41817.log 2024-04-25T17:03:53.748 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40366.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40366.log.gz 2024-04-25T17:03:53.756 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47625.log 2024-04-25T17:03:53.766 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48063.log 2024-04-25T17:03:53.770 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47625.log: 88.1% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41817.log.gz 2024-04-25T17:03:53.778 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47625.log.gz 2024-04-25T17:03:53.778 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35086.log 2024-04-25T17:03:53.778 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48063.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48063.log.gz 2024-04-25T17:03:53.789 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47445.log 2024-04-25T17:03:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35086.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35086.log.gz 2024-04-25T17:03:53.798 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47261.log 2024-04-25T17:03:53.808 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42658.log 2024-04-25T17:03:53.811 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47261.log: 88.2% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47445.log.gz 2024-04-25T17:03:53.816 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28589.log 2024-04-25T17:03:53.821 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42658.log: -- replaced with /var/log/ceph/ceph-client.admin.47261.log.gz 2024-04-25T17:03:53.825 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48525.log 2024-04-25T17:03:53.830 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.tmp-client.admin.28589.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.42658.log.gz 2024-04-25T17:03:53.838 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28589.log.gz 2024-04-25T17:03:53.846 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47488.log 2024-04-25T17:03:53.846 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48525.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48525.log.gz 2024-04-25T17:03:53.850 INFO:teuthology.orchestra.run.smithi059.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-25T17:03:53.851 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41890.log 2024-04-25T17:03:53.853 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47488.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47488.log.gz 2024-04-25T17:03:53.853 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T17:03:53.853 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41890.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41890.log.gz 2024-04-25T17:03:53.853 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48147.log 2024-04-25T17:03:53.866 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41512.log 2024-04-25T17:03:53.866 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48147.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48147.log.gz 2024-04-25T17:03:53.873 INFO:teuthology.orchestra.run.smithi059.stderr: 92.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42172.log 2024-04-25T17:03:53.875 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41512.log: 88.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T17:03:53.875 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41512.log.gz 2024-04-25T17:03:53.875 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42508.log 2024-04-25T17:03:53.876 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42172.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42172.log.gz 2024-04-25T17:03:53.876 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41332.log 2024-04-25T17:03:53.878 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42508.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42508.log.gz 2024-04-25T17:03:53.878 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42256.log 2024-04-25T17:03:53.879 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41332.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41332.log.gz 2024-04-25T17:03:53.879 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41462.log 2024-04-25T17:03:53.880 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42256.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42256.log.gz 2024-04-25T17:03:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48441.log 2024-04-25T17:03:53.882 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41462.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41462.log.gz 2024-04-25T17:03:53.882 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47219.log 2024-04-25T17:03:53.883 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48441.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48441.log.gz 2024-04-25T17:03:53.883 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41131.log 2024-04-25T17:03:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47219.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47219.log.gz 2024-04-25T17:03:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41128.log 2024-04-25T17:03:53.886 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41131.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41131.log.gz 2024-04-25T17:03:53.886 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40576.log 2024-04-25T17:03:53.887 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41128.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41128.log.gz 2024-04-25T17:03:53.889 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42004.log 2024-04-25T17:03:53.889 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40576.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40576.log.gz 2024-04-25T17:03:53.889 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42724.log 2024-04-25T17:03:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42004.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42004.log.gz 2024-04-25T17:03:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42130.log 2024-04-25T17:03:53.892 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42724.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.42724.log.gz 2024-04-25T17:03:53.892 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47853.log 2024-04-25T17:03:53.892 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42130.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42130.log.gz 2024-04-25T17:03:53.893 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40156.log 2024-04-25T17:03:53.894 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47853.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47853.log.gz 2024-04-25T17:03:53.895 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40156.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40156.log.gz 2024-04-25T17:03:54.071 INFO:teuthology.orchestra.run.smithi059.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T17:03:54.601 INFO:teuthology.orchestra.run.smithi064.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T17:03:55.060 INFO:teuthology.orchestra.run.smithi064.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T17:03:55.752 INFO:teuthology.orchestra.run.smithi064.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T17:03:56.307 INFO:teuthology.orchestra.run.smithi059.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T17:03:56.562 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T17:03:56.908 INFO:teuthology.orchestra.run.smithi064.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T17:03:57.230 INFO:teuthology.orchestra.run.smithi064.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T17:03:57.364 INFO:teuthology.orchestra.run.smithi059.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T17:03:57.457 INFO:teuthology.orchestra.run.smithi059.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T17:03:57.524 INFO:teuthology.orchestra.run.smithi064.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T17:03:58.122 INFO:teuthology.orchestra.run.smithi059.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T17:04:09.659 INFO:teuthology.orchestra.run.smithi059.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.43254.log.gz 2024-04-25T17:04:09.660 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-04-25T17:04:09.660 INFO:teuthology.orchestra.run.smithi059.stderr:real 0m16.266s 2024-04-25T17:04:09.661 INFO:teuthology.orchestra.run.smithi059.stderr:user 0m35.012s 2024-04-25T17:04:09.661 INFO:teuthology.orchestra.run.smithi059.stderr:sys 0m1.064s 2024-04-25T17:04:54.887 INFO:teuthology.orchestra.run.smithi064.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T17:04:54.888 INFO:teuthology.orchestra.run.smithi064.stderr: 2024-04-25T17:04:54.888 INFO:teuthology.orchestra.run.smithi064.stderr:real 1m1.472s 2024-04-25T17:04:54.889 INFO:teuthology.orchestra.run.smithi064.stderr:user 1m15.617s 2024-04-25T17:04:54.889 INFO:teuthology.orchestra.run.smithi064.stderr:sys 0m2.188s 2024-04-25T17:04:54.889 INFO:tasks.ceph:Archiving logs... 2024-04-25T17:04:54.889 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673226/remote/smithi059/log 2024-04-25T17:04:54.890 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T17:05:00.008 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673226/remote/smithi064/log 2024-04-25T17:05:00.009 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T17:05:11.181 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-04-25T17:05:11.183 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T17:05:11.192 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-04-25T17:05:11.192 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T17:05:11.193 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T17:05:11.195 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T17:05:11.272 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T17:05:11.282 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T17:05:11.282 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T17:05:11.285 DEBUG:teuthology.orchestra.run.smithi064:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T17:05:11.299 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2024-04-25T17:05:11.302 INFO:teuthology.orchestra.run.smithi064.stderr:bash: line 1: ntpq: command not found 2024-04-25T17:05:11.304 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T17:05:11.304 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2024-04-25T17:05:11.304 INFO:teuthology.orchestra.run.smithi059.stdout:^* hv01.front.sepia.ceph.com 3 6 377 41 +792us[ +801us] +/- 48ms 2024-04-25T17:05:11.304 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 -1308us[-1308us] +/- 55ms 2024-04-25T17:05:11.304 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +382us[ +382us] +/- 71ms 2024-04-25T17:05:11.304 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T17:05:11.308 INFO:teuthology.orchestra.run.smithi064.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T17:05:11.308 INFO:teuthology.orchestra.run.smithi064.stdout:=============================================================================== 2024-04-25T17:05:11.308 INFO:teuthology.orchestra.run.smithi064.stdout:^* hv01.front.sepia.ceph.com 3 7 377 102 +838us[ +870us] +/- 47ms 2024-04-25T17:05:11.308 INFO:teuthology.orchestra.run.smithi064.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 34 -1241us[-1241us] +/- 55ms 2024-04-25T17:05:11.308 INFO:teuthology.orchestra.run.smithi064.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 +413us[ +413us] +/- 71ms 2024-04-25T17:05:11.308 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T17:05:11.309 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T17:05:11.319 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T17:05:11.320 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T17:05:11.329 DEBUG:teuthology.orchestra.run.smithi059:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T17:05:11.419 DEBUG:teuthology.orchestra.run.smithi064:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T17:05:11.491 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T17:05:11.520 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T17:05:11.521 DEBUG:teuthology.orchestra.run.smithi064:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T17:05:11.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T17:05:11.551 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T17:05:11.561 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T17:05:11.571 INFO:teuthology.task.internal:Duration was 5570.511908 seconds 2024-04-25T17:05:11.572 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T17:05:11.582 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T17:05:11.582 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T17:05:11.585 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T17:05:11.623 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T17:05:11.632 INFO:teuthology.orchestra.run.smithi064.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T17:05:11.912 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T17:05:11.912 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T17:05:11.912 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T17:05:11.973 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi064.front.sepia.ceph.com 2024-04-25T17:05:11.974 DEBUG:teuthology.orchestra.run.smithi064:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T17:05:12.002 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T17:05:12.002 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T17:05:12.016 DEBUG:teuthology.orchestra.run.smithi064:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T17:05:12.071 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T17:05:12.071 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T17:05:12.084 DEBUG:teuthology.orchestra.run.smithi064:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T17:05:12.248 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T17:05:12.263 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T17:05:12.263 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T17:05:12.288 DEBUG:teuthology.orchestra.run.smithi064:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T17:05:12.312 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T17:05:12.323 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T17:05:12.331 DEBUG:teuthology.orchestra.run.smithi064:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T17:05:12.351 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2024-04-25T17:05:12.375 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = core 2024-04-25T17:05:12.393 DEBUG:teuthology.orchestra.run.smithi059:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T17:05:12.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T17:05:12.419 DEBUG:teuthology.orchestra.run.smithi064:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T17:05:12.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T17:05:12.448 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T17:05:12.458 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T17:05:12.460 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673226/remote/smithi059 2024-04-25T17:05:12.460 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T17:05:12.494 DEBUG:teuthology.misc:Transferring archived files from smithi064:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673226/remote/smithi064 2024-04-25T17:05:12.494 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T17:05:12.528 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T17:05:12.528 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T17:05:12.531 DEBUG:teuthology.orchestra.run.smithi064:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T17:05:12.578 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T17:05:12.590 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T17:05:12.591 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T17:05:12.601 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T17:05:12.601 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T17:05:12.603 DEBUG:teuthology.orchestra.run.smithi064:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T17:05:12.616 INFO:teuthology.orchestra.run.smithi059.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 17:05 /home/ubuntu/cephtest 2024-04-25T17:05:12.632 INFO:teuthology.orchestra.run.smithi064.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 17:05 /home/ubuntu/cephtest 2024-04-25T17:05:12.634 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T17:05:12.644 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T17:05:12.655 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-04-25T17:05:12.656 INFO:teuthology.nuke:Checking targets against current locks 2024-04-25T17:05:12.683 DEBUG:teuthology.nuke:shortname: smithi059 2024-04-25T17:05:12.683 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T17:05:12.703 DEBUG:teuthology.nuke:shortname: smithi064 2024-04-25T17:05:12.703 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T17:05:12.708 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673226', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 15:26:53.491578', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGdemGxTK68nqF3V6Lmt9r8tcb216MI1zS4QEgjsP1aRZvGLT6LWUifVNcR6SteFO1LcYelejf8Ym2jkv/FDopE='} 2024-04-25T17:05:12.721 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673226', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 15:26:53.493385', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKFArLSnqQ2fJgOOsnL3/wiLX/siemldj7xq0Cy0DgHMJCkM55ry4RBTTgQP6sGYbMSmS4OIRwDvD0dIRh+E/V4='} 2024-04-25T17:05:12.751 INFO:teuthology.orchestra.console.smithi059:Power off 2024-04-25T17:05:12.751 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T17:05:12.768 INFO:teuthology.orchestra.console.smithi064:Power off 2024-04-25T17:05:12.769 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T17:05:12.778 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2024-04-25T17:05:12.779 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T17:05:12.792 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2024-04-25T17:05:12.792 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T17:05:12.803 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-04-25T17:05:12.820 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2024-04-25T17:05:16.804 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T17:05:16.821 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T17:05:16.915 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-04-25T17:05:16.932 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2024-04-25T17:05:20.919 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T17:05:20.933 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T17:05:21.029 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-04-25T17:05:21.043 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2024-04-25T17:05:21.143 INFO:teuthology.orchestra.console.smithi064:Power off completed 2024-04-25T17:05:25.031 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T17:05:25.221 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-04-25T17:05:25.322 INFO:teuthology.orchestra.console.smithi059:Power off completed 2024-04-25T17:05:25.479 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/fsstress validater/valgrind} duration: 5570.511908054352 failure_reason: 'valgrind error: Leak_StillReachable malloc malloc strdup' flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2024-04-25T17:05:25.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T17:05:25.584 INFO:teuthology.run:FAIL